tMysqlConfiguration
Stores connection information and credentials to be reused by other MySQL
components.
You configure the connection to a MySQL database in tMysqlConfiguration and configure the other
MySQL components to reuse this configuration. At runtime, the Spark
executors read this configuration in order to connect to MySQL.
Depending on the Talend
product you are using, this component can be used in one, some or all of the following
Job frameworks:
-
Spark Batch: see tMysqlConfiguration properties for Apache Spark Batch.
The component in this framework is available in all subscription-based Talend products with Big Data
and Talend Data Fabric. -
Spark Streaming: see tMysqlConfiguration properties for Apache Spark Streaming.
This component is available in Talend Real Time Big Data Platform and Talend Data Fabric.
tMysqlConfiguration properties for Apache Spark Batch
These properties are used to configure tMysqlConfiguration running in the Spark Batch Job framework.
The Spark Batch
tMysqlConfiguration component belongs to the Storage and the Databases families.
The component in this framework is available in all subscription-based Talend products with Big Data
and Talend Data Fabric.
Basic settings
Property type |
Either Built-In or Repository. Built-In: No property data stored centrally.
Repository: Select the repository file where the |
DB version |
Select the version of the database to be used. When the database to be used is RDS Aurora, you need to select Mysql 5. |
Host |
Enter the IP address of the database server. |
Port |
Enter the listening port number of the database server. |
Database |
Enter the name of the database to be used. |
Additional JDBC parameters |
Specify additional connection properties for the database |
Username and |
Enter the database user authentication data. To enter the password, click the […] button next to the |
Advanced settings
Connection pool |
In this area, you configure, for each Spark executor, the connection pool used to control
|
Evict connections |
Select this check box to define criteria to destroy connections in the connection pool. The
|
Usage
Usage rule |
This component is used with no need to be connected to other The configuration in a tMysqlConfiguration component This component, along with the Spark Batch component Palette it belongs to, Note that in this documentation, unless otherwise explicitly stated, a |
Spark Connection |
In the Spark
Configuration tab in the Run view, define the connection to a given Spark cluster for the whole Job. In addition, since the Job expects its dependent jar files for execution, you must specify the directory in the file system to which these jar files are transferred so that Spark can access these files:
This connection is effective on a per-Job basis. |
Related scenarios
No scenario is available for the Spark Batch version of this component
yet.
tMysqlConfiguration properties for Apache Spark Streaming
These properties are used to configure tMysqlConfiguration running in the Spark Streaming Job framework.
The Spark Streaming
tMysqlConfiguration component belongs to the Storage and the Databases families.
This component is available in Talend Real Time Big Data Platform and Talend Data Fabric.
Basic settings
Property type |
Either Built-In or Repository. Built-In: No property data stored centrally.
Repository: Select the repository file where the |
DB version |
Select the version of the database to be used. When the database to be used is RDS Aurora, you need to select Mysql 5. |
Host |
Enter the IP address of the database server. |
Port |
Enter the listening port number of the database server. |
Database |
Enter the name of the database to be used. |
Additional JDBC parameters |
Specify additional connection properties for the database |
Username and |
Enter the database user authentication data. To enter the password, click the […] button next to the |
Advanced settings
Connection pool |
In this area, you configure, for each Spark executor, the connection pool used to control
|
Evict connections |
Select this check box to define criteria to destroy connections in the connection pool. The
|
Usage
Usage rule |
This component is used with no need to be connected to other components. The configuration in a tMysqlConfiguration component This component, along with the Spark Streaming component Palette it belongs to, appears Note that in this documentation, unless otherwise explicitly stated, a scenario presents |
Spark Connection |
In the Spark
Configuration tab in the Run view, define the connection to a given Spark cluster for the whole Job. In addition, since the Job expects its dependent jar files for execution, you must specify the directory in the file system to which these jar files are transferred so that Spark can access these files:
This connection is effective on a per-Job basis. |
Related scenarios
No scenario is available for the Spark Streaming version of this component
yet.