tRedshiftOutputBulkExec
Executes the Insert action on the data provided.
As a dedicated component, it allows gains in performance during Insert
operations to Amazon Redshift.
The tRedshiftOutputBulk and tRedshiftBulkExec components can be used together in a two step process
to load data to Amazon Redshift from a delimited/CSV file on Amazon S3. In the first
step, a delimited/CSV file is generated. In the second step, this file is used in the
INSERT statement used to feed Amazon Redshift. These two steps are fused together in the
tRedshiftOutputBulkExec component. The
advantage of using two separate steps is that the data can be transformed before it is
loaded to Amazon Redshift.
This component receives data from the preceding component, generates a single
delimited/CSV file and uploads the file to Amazon S3, finally it
loads the data from Amazon S3 to Redshift.
tRedshiftOutputBulkExec Standard properties
These properties are used to configure tRedshiftOutputBulkExec running in the Standard Job framework.
The Standard
tRedshiftOutputBulkExec component belongs to the Cloud and the Databases families.
The component in this framework is available in all Talend
products.
connector. The properties related to database settings vary depending on your database
type selection. For more information about dynamic database connectors, see Dynamic database components.
Basic settings
Database |
Select a type of database from the list and click |
Property Type |
Either Built-In or Repository. |
 |
Built-In: No property |
 |
Repository: Select the |
Use an existing |
Select this check box and in the Component List click the relevant connection component to |
Host |
Type in the IP address or hostname of the |
Port |
Type in the listening port number of the |
Database |
Type in the name of the database. |
Schema |
Type in the name of the schema. |
Username and Password |
Type in the database user authentication To enter the password, click the […] button next to the |
Additional JDBC |
Specify additional JDBC properties for the connection you are creating. The |
Table Name |
Specify the name of the table to be written. |
Action on table |
On the table defined, you can perform one of
|
Schema and Edit schema |
A schema is a row description. It defines the number of fields |
 |
Built-In: You create and store the schema locally for this component |
 |
Repository: You have already created the schema and stored it in the |
 |
Click Edit
|
Data file path at local |
Specify the local path to the file to be Note that the file is generated on the same |
Append the local file |
Select this check box to append data to the |
Create directory if not |
Select this check box to create the directory |
Use an existing S3 connection |
Select this check box and in the Component List click the relevant connection component to |
Access Key |
Specify the Access Key ID that uniquely Note: This option is available when both Use an existing S3 connection and Inherit credentials from AWS role are cleared.
|
Secret Key |
Specify the Secret Access Key, constituting To enter the secret key, click the […] button next to Note: This option is available when both Use an existing S3 connection and Inherit credentials from AWS role are cleared.
|
Inherit credentials from AWS |
Select this check box to obtain AWS security credentials Note: This option is available when
Use an existing S3 connection is not selected. |
S3 Assume Role |
If you temporarily need some access permissions associated Ensure that access to this role has been Note: This option is available when
Use an existing S3 connection is not selected.
For an example about an IAM role and its related policy types, see Create and Manage AWS IAM Roles from the AWS |
Region |
Specify the AWS region by selecting a region name from the Note: This field is available when Use an existing S3
connection is not selected. |
Bucket |
Type in the name of the Amazon S3 bucket, The bucket and the Redshift database to be used |
Key |
Type in an object key to assign to the file |
Redshift Assume Role |
Select this check box and specify the
For more information on IAM Role ARNs |
Advanced settings
Fields terminated by |
Enter the character used to separate |
Enclosed by |
Select the character in a pair of which the |
Compressed by |
Select this check box and select a compression This field disappears when the Append the local file check box |
Encrypt |
Select this check box to generate and upload By default, this check box is cleared and the For more information about the client-side and Note: This field is available when Use an existing S3
connection is not selected. |
Encoding |
Select an encoding type for the data in the |
Delete local file after putting it |
Select this check box to delete the local file |
Date format |
Select one of the following items from the
|
Time format |
Select one of the following items from the
|
Settings |
Click the [+] button below the table to specify more
For more information about the parameters, |
Config client |
Select this check box to configure client
For information about S3 client parameterts , go to Client Configuration. |
JDBC url |
Select a way to access to an Amazon Redshift database from the
JDBC url drop-down list.
|
tStatCatcher |
Select this check box to gather the Job |
Global Variables
Global Variables |
ERROR_MESSAGE: the error message generated by the A Flow variable functions during the execution of a component while an After variable To fill up a field or expression with a variable, press Ctrl + For further information about variables, see |
Usage
Usage rule |
This component is mainly used when no |
Dynamic settings |
Click the [+] button to add a row in the table The Dynamic settings table is For examples on using dynamic parameters, see Reading data from databases through context-based dynamic connections and Reading data from different MySQL databases using dynamically loaded connection parameters. For more information on Dynamic |
Related scenario
For a related scenario, see Loading/unloading data to/from Amazon S3.