August 16, 2023

tSybaseIQBulkExec – Docs for ESB 6.x

tSybaseIQBulkExec

Gains in performance during the upload of data into a Sybase IQ database table
from a flat file or other database table.

tSybaseIQBulkExec Standard properties

These properties are used to configure tSybaseIQBulkExec
running in the Standard Job framework.

The Standard
tSybaseIQBulkExec component belongs to the
Databases family.

The component in this framework is generally available.

Basic settings

Property Type

Either Built-In
or Repository
.

  • Built-In: No property data
    stored centrally.

  • Repository: Select the
    repository file in which the properties are stored. The fields
    that follow are completed automatically using the data
    retrieved.

Use an existing connection

Select this check box and in the Component
List
click the relevant connection component to reuse the connection
details you already defined.

Note:

When a Job contains the parent Job and the child Job, if you need to share an
existing connection between the two levels, for example, to share the connection created by
the parent Job with the child Job, you have to:

  1. In the parent level, register the database connection to be shared
    in the Basic settings view of the
    connection component which creates that very database connection.

  2. In the child level, use a dedicated connection component to read
    that registered database connection.

For an example about how to share a database connection across Job levels, see


Talend Studio
User Guide
.

This property is available only when
Sybase IQ 12/15 by JDBC or Sybase IQ 16 by
JDBC
is selected from the DB Version and API type
drop-down list.

DB Version and API type

Select the version of the Sybase IQ database to be used and the API used for setting
up the database connection. The valid values are Sybase IQ 12/15 by
JDBC
, Sybase IQ 15 by ODBC, and Sybase
IQ 16 by JDBC
.

Note that for Sybase IQ 12 and Sybase IQ 16, the file to be bulk-loaded must be
located on the same machine as the Sybase IQ server. And for Sybase IQ 15, the file to
be bulk-loaded can be located on a remote machine, however, this means certain setup
on the Sybase IQ server. For more information, see Sybase IQ client-side load support
enhancements
.

Host

Enter the IP address of the Sybase IQ server.

This property is available only when
Sybase IQ 12/15 by JDBC or Sybase IQ 16 by
JDBC
is selected from the DB Version and API type
drop-down list.

Port

Enter the listening port number of the Sybase IQ server.

This property is available only when
Sybase IQ 12/15 by JDBC or Sybase IQ 16 by
JDBC
is selected from the DB Version and API type
drop-down list.

Data Source

Select the type of the data source to be used and complete the corresponding DSN
information in the field alongside. The available types are DSN
and FILEDSN.

When FILEDSN is selected, a […]
button is available next to the Data Source field to allow you
to browse to the data source file of interest.

This property is available only when Sybase IQ 15 by ODBC is
selected from the DB Version and API type drop-down list.

Database

Enter the name of the database.

Username and Password

Enter the DB user authentication data.

To enter the password, click the […] button next to the
password field, and then in the pop-up dialog box enter the password between double quotes
and click OK to save the settings.

Table

Enter the name of the table to be written. Note that only
one table can be written at a time and that the table must exist for the
insert operation to succeed.

Action on table

On the table defined, you can perform one of the
following operations:

  • Default: No operation is
    carried out.

  • Drop and create table:
    The table is removed and created again.

  • Create table: The table
    does not exist and gets created.

  • Create table if does not
    exist
    : The table is created if it does not
    exist.

  • Drop table if exists and
    create
    : The table is removed if it already
    exists and created again.

  • Clear table: The table
    content is deleted.

  • Truncate table: The table
    content is deleted. You do not have the possibility to rollback
    the operation.

Local filename

Specify the path to the file to be loaded.

Schema and Edit schema

A schema is a row description, it defines the number of
fields to be processed and passed on to the next component. The schema
is either Built-In or stored
remotely in the Repository.

Click Edit schema to make changes to the schema.
If the current schema is of the Repository type, three
options are available:

  • View schema: choose this option to view the
    schema only.

  • Change to built-in property: choose this
    option to change the schema to Built-in for
    local changes.

  • Update repository connection: choose this
    option to change the schema stored in the repository and decide whether to propagate
    the changes to all the Jobs upon completion. If you just want to propagate the
    changes to the current Job, you can select No
    upon completion and choose this schema metadata again in the [Repository Content] window.

 

Built-In: You create and store the
schema locally for this component only. Related topic: see
Talend Studio

User Guide.

 

Repository: You have already created
the schema and stored it in the Repository. You can reuse it in various projects and
Job designs. Related topic: see
Talend Studio

User Guide.

Use Insert-Location

Select this check box and specify the source database
table from which you import data into the Sybase IQ table.

Server

Enter the name of the server that stores the data to be
imported.

This field is available only when the Use Insert-Location check box is
selected.

Database

Enter the name of the database that stores the data to be
imported.

This field is available only when the Use Insert-Location check box is
selected.

Schema

Enter the name of the source schema.

This field is available only when the Use Insert-Location check box is
selected.

Table

Enter the name of the source table.

This field is available only when the Use Insert-Location check box is
selected.

Use Source Filter

Select this check box and specify the row filter on the
source table.

This check box is available only when the Use Insert-Location check box is
selected.

Where Clause

Enter the where clause to filter the rows you want to
import into the Sybase IQ table.

This field is available only when the Use Source Filter check box is
selected.

Columns Mapping

Complete this table to specify the mapping relationship
between the source table columns and the Sybase IQ table columns.

  • Column: the name of the
    Sybase IQ table column. By default, the fields in the Column column are same as what
    they are in the schema.

  • Columns in Source Table:
    the name of the corresponding column in the table from which the
    data will be imported.

This table is available only when the Use Insert-Location check box is
selected.

Advanced settings

Additional JDBC Parameters

Specify additional connection properties in the existing
DB connection, to allow specific character set support.

Lines terminated by

Enter the character or sequence of characters used to
separate lines.

This field is not visible when the Use Insert-Location check box is
selected.

Fields terminated by

Enter the character, string or regular expression used to
separate fields.

Note:

With the row/field separators compliant with the
Sybase syntax, this component allows the use of Sybase-oriented
separators, such as x09.

This field is not visible when the Use Insert-Location check box is
selected.

Use enclosed quotes

Select this check box to use data enclosure
characters.

This check box is not visible when the Use Insert-Location check box is
selected.

Use fixed length

Select this check box to set a fixed width for data
lines.

This check box is not visible when the Use Insert-Location check box is
selected.

Include Header

Select this check box if the file that will be loaded
includes header.

This check box is not visible when the Use Insert-Location check box is
selected.

Blank as null

Select this check box to store the input zero-length
varchars as NULLs instead of blanks in the database during the load
operation.

This check box is not visible when the Use Insert-Location or Use fixed length check box is
selected.

Location Options

Select this check box to display the location options.
For more information about the location options, see http://infocenter.sybase.com/help/index.jsp?topic=/com.sybase.infocenter.dc00801.1510/html/iqrefso/X315746.htm.

This check box is available only when the Use Insert-Location check box is
selected.

Encrypted Password

Select this check box to specify the use of Open Client
Library default password encryption when connecting to the remote source
server.

This check box is available only when the Location Options check box is
selected.

Use TDS Packet Size

Select this check box and in the Packet Size field displayed specify the
TDS packet size in bytes.

This check box is available only when the Location Options check box is
selected.

Quoted Identifier

Select this check box and from the Status drop-down list displayed specify
the setting of the QUOTED_IDENTIFIER option on the remote server.

This check box is available only when the Location Options check box is
selected.

Set Isolation Level

Select this check box and from the Isolation Level drop-down list
displayed select the isolation level for the connection to the remote
server.

This check box is available only when the Location Options check box is
selected.

Insert Load Options

Select this check box to display the insert load
options. For more information about the insert load options, see http://infocenter.sybase.com/help/index.jsp?topic=/com.sybase.infocenter.dc00801.1510/html/iqrefso/X315746.htm.

This check box is available only when the Use Insert-Location check box is
selected.

Limit Number

Specify the maximum number of rows to be inserted into
the Sybase IQ table.

This field is available only when the Insert Load Options check box is
selected.

Notify Number

Specify that you will be notified with a message each
time the number of rows are successfully inserted into the Sybase IQ
table.

This field is available only when the Insert Load Options check box is
selected.

Skip Number

Specify the number of rows to be skiped at the beginning
of the source table.

This field is available only when the Insert Load Options check box is
selected.

Start Row ID

Specify the ID of the row in the Sybase IQ table where
you want to start the insert.

Note:

Note that Sybase IQ 16 doesn’t support this
parameter.

This field is available only when the Insert Load Options check box is
selected.

Insert Select Load Options

Select this check box to display the insert select load
options. For more information about the insert select load options, see
http://infocenter.sybase.com/help/index.jsp?topic=/com.sybase.infocenter.dc00801.1510/html/iqrefso/X315750.htm.

This check box is available only when the Use Insert-Location check box is
selected.

Word Skip Number

Enter the number of times the error Words exceeding the maximum permitted word length not supported
is ignored when loading data into the Sybase IQ table.

This field is available only when the Insert Select Load Options check box is
selected.

Ignore Constraint

Select this check box and in the table displayed you can
specify the integrity constraint violation to ignore when loading data
into the Sybase IQ table by clicking the [+] button to add as many rows as needed, each row for
a constraint violation, and setting the value of the following columns
for each constraint violation:

  • Constraint Type: Click
    the cell and from the drop-down list displayed select the type
    of the constraint violation to ignore.

  • Number: Enter the
    maximum number of the constraint violation to ignore before
    initiating a rollback during a load.

This check box is available only when the Insert Select Load Options check box is
selected.

Log In File

Select this check box if you want to log the constraint
violation information in files.

This check box is available only when the Insert Select Load Options check box is
selected.

Message Log

Specify the path to the MESSAGE LOG file.

This field is available only when the Log In File check box is selected.

Row Log

Specify the path to the ROW LOG file.

This field is available only when the Log In File check box is selected.

Log Delimited By

Specify the separator between data values in the ROW LOG
file.

This field is available only when the Log In File check box is selected.

Log Filter

Select this check box and from the Only Log drop-down list displayed
select the type of the constraint violation information to be
logged.

This check box is available only when the Log In File check box is selected.

tStatCatcher Statistics

Select this check box to gather the job processing
metadata at a job level as well as at each component level.

Usage

Usage rule

This dedicated component offers performance and
flexibility of Sybase IQ DB query handling.

Dynamic settings

Click the [+] button to add a
row in the table and fill the Code field
with a context variable to choose your database connection dynamically from
multiple connections planned in your Job. This feature is useful when you
need to access database tables having the same data structure but in
different databases, especially when you are working in an environment where
you cannot change your Job settings, for example, when your Job has to be
deployed and executed independent of
Talend Studio
.

The Dynamic settings table is
available only when the Use an existing
connection
check box is selected in the Basic settings view. Once a dynamic parameter is
defined, the Component List box in the
Basic settings view becomes unusable.

For examples on using dynamic parameters, see Scenario: Reading data from databases through context-based dynamic connections and Scenario: Reading data from different MySQL databases using dynamically loaded connection parameters. For more information on Dynamic
settings
and context variables, see
Talend Studio User Guide
.


Document get from Talend https://help.talend.com
Thank you for watching.
Subscribe
Notify of
guest
0 Comments
Inline Feedbacks
View all comments
0
Would love your thoughts, please comment.x
()
x