July 30, 2023

tMSSqlConnection – Docs for ESB 7.x

  2. Talend for ESB Docs
  3. Docs 7.x
  4. tMSSqlConnection – Docs for ESB 7.x

tMSSqlConnection

Opens a connection to the specified database that can then be reused in the
subsequent subjob or subjobs.

tMSSqlConnection opens a connection
to a Microsoft SQL Server database or a Microsoft Azure SQL database.

tMSSqlConnection Standard properties

These properties are used to configure tMSSqlConnection running in the Standard Job framework.

The Standard
tMSSqlConnection component belongs to the Databases and the ELT families.

The component in this framework is available in all Talend
products.

Note: This component is a specific version of a dynamic database
connector. The properties related to database settings vary depending on your database
type selection. For more information about dynamic database connectors, see Dynamic database components.

Basic settings

Database

Select a type of database from the list and click
Apply.

Property type

Either Built-in or
Repository.

 

Built-in: No property data stored
centrally.

 

Repository: Select the repository file
in which the properties are stored. The fields that follow are completed
automatically using the data retrieved.

JDBC Provider

Select the provider of the JDBC driver to be used, either Microsoft (recommended) or Open
source JTDS.

When using this component with Datasource in Talend Runtime, you need
to use the Open source JTDS driver.

Note that when Microsoft is selected, you
need to download the Microsoft JDBC Driver for SQL Server on Microsoft Download Center, unpack
the downloaded zip file, choose a jar in the unzipped folder based on your JRE version,
rename the jar to mssql-jdbc.jar and install it manually. For more
information about choosing the jar, see the System Requirements information on Microsoft Download Center.

Host

Database server IP address.

Port

Listening port number of DB server.

Schema

Schema name.

Database

Name of the database.

Username and Password

DB user authentication data.

To enter the password, click the […] button next to the
password field, and then in the pop-up dialog box enter the password between double quotes
and click OK to save the settings.

Additional JDBC parameters

Specify additional connection properties for the database
connection you are creating. The properties are separated by semicolon and
each property is a key-value pair. For example, encrypt=true;trustServerCertificate=false;
hostNameInCertificate=*.database.windows.net;loginTimeout=30; for
Azure SQL database connection.

Use or register a shared DB Connection

Select this check box to share your
database connection or fetch a database connection shared by a parent or child Job,
and in the Shared DB Connection Name field displayed, enter the
name for the shared database connection. This allows you to share one single database
connection (except the database schema setting) among several database connection
components from different Job levels that can be either parent or child.

This option is
incompatible with the Use dynamic job and Use an
independent process to run subjob options of the
tRunJob component. Using a shared connection together with a
tRunJob component with either of these two options enabled
will cause your Job to fail.

This check box is not available when the Specify a data source
alias check box is selected.

Specify a data source alias

Select this check box and specify the alias of a data source created on the
Talend Runtime
 side to use the shared connection pool defined in the data source configuration. This
option works only when you deploy and run your Job in
Talend Runtime
.

This check box is not visible when the Use or register a
shared DB Connection check box is selected.

Data source alias

Enter the alias of the data source created on the
Talend Runtime
 side.

This field is available only when the Specify a data
source alias check box is selected.

Advanced settings

Auto Commit

Select this check box to commit any changes to the database
automatically upon the transaction.

With this check box selected, you cannot use the corresponding
commit component to commit changes to the database; likewise, when using the
corresponding commit component, this check box has to be cleared. By
default, the auto commit function is disabled and changes must be committed
explicitly using the corresponding commit component.

Note that the auto commit function commits each SQL statement as a
single transaction immediately after the statement is executed while the
commit component does not commit only until all of the statements are
executed. For this reason, if you need more room to manage your transactions
in a Job, it is recommended to use the commit component.

Share identity insert in multi table

Select this check box to share IDENTITY_INSERT among multiple
Microsoft SQL tables that accept data through the same database connection.

This option prevents errors caused by setting IENTITY_INSERT
to ON (or OFF) repeatedly when writing
Microsoft SQL tables through a database connection. It is necessary to check
this option when the component is used along with multiple
tMSSqlOutput components with their Turn on
Identity insert options checked in the Basic
settings tab.

Note that checking this option may decrease the execution performance.

tStatCatcher Statistics

Select this check box to gather the job processing metadata at a Job
level as well as at each component level.

Usage

Usage rule

This component is more commonly used with other tMSSql* components,
especially with the tMSSqlCommit and
tMSSqlRollback components.

Limitation

Due to license incompatibility, one or more JARs required to use
this component are not provided. You can install the missing JARs for this particular
component by clicking the Install button
on the Component tab view. You can also
find out and add all missing JARs easily on the Modules tab in the
Integration
 perspective of your studio. You can find more details about how to install external modules in
Talend Help Center (https://help.talend.com).

Inserting data into a database table and extracting useful information from
it

The scenario describes a Job that reads the employee data from a text file, inserts the
data into a table of an MSSQL database, then extracts useful data from the table, and
displays the information on the console.

tMSSqlConnection_1.png

This scenario involves the following components:

  • tMSSqlConnection: establishes a connection to the
    MSSQL server.

  • tFileInputDelimited: reads the input file,
    defines the data structure and sends it to the next component.

  • tMSSqlOutput: writes data it receives from the
    preceding component into a table of an MSSQL database.

  • tMSSqlInput: extracts data from the table based
    on an SQL query.

  • tLogRow: displays the information it receives
    from the preceding component on the console.

  • tMSSqlCommit: commits the transaction in the
    connected MSSQL server.

Setting up the Job

  1. Drop the following components from the Palette onto the design workspace: tMSSqlConnection, tFileInputDelimited, tMSSqlOutput, tMSSqlInput,
    tLogRow, and tMSSqlCommit.
  2. Connect tMSSqlConnection to tFileInputDelimited using a Trigger > OnSubjobOk
    link.
  3. Do the same to connect tFileInputDelimited to
    tMSSqlInput and tMSSqlInput to tMSSqlCommit.
  4. Connect tFileInputDelimited to tMSSqlOutput using a Row > Main link.
  5. Do the same to connect tMSSqlInput to
    tLogRow.

Configuring the components

Opening a connection to the MSSQL server

  1. Double-click the tMSSqlConnection component
    to open its Basic settings view in theComponent tab.

    tMSSqlConnection_2.png

  2. In the Host field, type in the IP address or
    hostname of the MSSQL server, 192.168.30.47
    in this example.
  3. In the Port field, type in the port number of
    the database server, 1433 in this
    example.
  4. In the Schema field, type in the schema name,
    dbo in this example.
  5. In the Database field, type in the database
    name, talend in this example.
  6. In the Username and Password fields, enter the credentials for the MSSQL
    connection.

Reading the input data

  1. Double-click the tFileInputDelimited
    component to open its Component view.

    tMSSqlConnection_3.png

  2. Click the […] button next to the File Name/Stream field to browse to the input file.
    In this example, it is D:/Input/Employee_Wage.txt. This text file holds three columns:
    id, name and wage.
    id;name;wage
    51;Harry;2300
    40;Ronald;3796
    17;Theodore;2174
    21;James;1986
    2;George;2591
    89;Calvin;2362
    84;Ulysses;3383
    4;Lyndon;2264
    17;Franklin;1780
    86;Lyndon;3999
  3. In the Header field, type in 1 to skip the first row of the input file.
  4. Click Edit schema to define the data to pass
    on to the tMSSqlOutput component. In this
    example, we define id as the key, and specify
    the length and precision for each column respectively.

    Click OK to close the schema editor. A dialog
    box opens, and you can choose to propagate the schema to the next
    component.
    tMSSqlConnection_4.png

    Related topic: tFileInputDelimited.

Writing the data into the database table

  1. Double-click the tMSSqlOutput component to
    open its Basic settings view in the Component tab.

    tMSSqlConnection_5.png

  2. Type in required information for the connection or use the existing connection
    you have configured before. In this example, we select the Use an existing connection check box. If multiple connections
    are available, select the connection you want to use from the Component List drop-down list.
  3. In the Table field, type in the name of the
    table you want to write the data to: Wage_Info in this example. You can also click the […] button next to the Table field to open a dialog box and select a proper
    table.
  4. Select Create table if not exists from the
    Action on table drop-down list.
  5. Select Insert if not exists from the
    Action on data drop-down list.
  6. Click Sync columns to retrieve the schema
    from the preceding component.

Extracting useful information from the table

  1. Double-click the tMSSqlInput component to
    open its Basic settings view in the Component tab.

    tMSSqlConnection_6.png

  2. Select the Use an existing connection check
    box. If multiple connections are available, select the connection you want to
    use from the Component List drop-down
    list.
  3. Click Edit schema to define the data
    structure to be read from the table. In this example, we need to read all three
    columns from the table.

    tMSSqlConnection_7.png

  4. In the Table Name field, type in the name of
    the table you want to read the data from: Wage_Info in this example.
  5. In the Query field, fill in the SQL query to
    be executed on the table specified. To obtain the data of employees whose wages
    are above the average value and order them by id, enter the SQL query as
    follows:SELECT *
    FROM Wage_Info
    WHERE wage >
    (SELECT avg(wage)
    FROM Wage_Info)
    ORDER BY id

Displaying information on the console

  1. Double-click the tLogRow component to open
    its Basic settings view.
  2. In the Mode area, select Table (print values in cells of a table).

Committing the transaction and closing the connection

  1. Double-click the tMSSqlCommit component to
    open its Basic settings view.

    tMSSqlConnection_8.png

  2. Select the Close Connection check box.

Saving and executing the Job

  1. Press Ctrl+S to save your Job.
  2. Execute the Job by pressing F6 or clicking
    Run on the Run tab.

    The information of employees whose wages are above the average value ordered
    by id is displayed on the console.
    tMSSqlConnection_9.png

Document get from Talend https://help.talend.com
Thank you for watching.
Docs 7.x
Subscribe
Notify of
guest
0 Comments
Inline Feedbacks
View all comments
0
Would love your thoughts, please comment.x
()
x