August 16, 2023

tLibraryLoad – Docs for ESB 6.x

  2. Talend for ESB Docs
  3. Docs 6.x
  4. tLibraryLoad – Docs for ESB 6.x

tLibraryLoad

Loads useable Java libraries in a Job.

Depending on the Talend solution you
are using, this component can be used in one, some or all of the following Job
frameworks:

tLibraryLoad Standard properties

These properties are used to configure tLibraryLoad running in the Standard Job framework.

The Standard
tLibraryLoad component belongs to the Custom Code family.

The component in this framework is generally available.

Basic settings

Library

Select the library you want to import from the list, or click on the […] button to browse to the library in your directory.

Advanced settings

Dynamic Libs

Lib Paths: Enter the access path to your library, between
double quotation marks.

Import

Enter the Java code required to import, if required, the external library used in
the code editing field of the Basic settings tab of the
components such as tJava,or tJavaFlex.

Global Variables

Global Variables

ERROR_MESSAGE: the error message generated by the
component when an error occurs. This is an After variable and it returns a string. This
variable functions only if the Die on error check box is
cleared, if the component has this check box.

A Flow variable functions during the execution of a component while an After variable
functions after the execution of the component.

To fill up a field or expression with a variable, press Ctrl +
Space to access the variable list and choose the variable to use from it.

For further information about variables, see
Talend Studio

User Guide.

Usage

Usage rule

This component may be used alone, although it is more logical to
use it as part of a Job.

Limitation

The library is loaded locally.

Scenario: Checking the format of an e-mail address

This scenario uses two components, a tLibraryLoad and
a tJava. The goal of this scenario is to check the
format of an e-mail address and verify whether the format is valid or not.

Use_Case_tLibraryLoad1.png

Setting up the Job

  1. In the Palette, open the Custom_Code folder, and slide a tLibraryLoad and tJava
    component onto the workspace.
  2. Connect tLibraryLoad to tJava using a Trigger > OnSubjobOk
    link.

Configuring the tLibraryLoad component

  1. Double-click on tLibraryLoad to display
    its Basic settings. From the Library list, select
    jakarta-oro-2.0.8.jar.
  2. In the Import field of the Advanced settings tab, type import
    org.apache.oro.text.regex.*;

    Use_Case_tLibraryLoad2.png

Configuring the tJava component

  1. Double-click on tJava to display its
    Component view.
  2. In the Basic settings tab, enter your
    code, as in the screenshot below. The code allows you to check whether the
    character string pertains to an e-mail address, based on the regular
    expression: "^[\w_.-]+@[\w_.-]+\.[\w]+$".

    Use_Case_tLibraryLoad3.png

Job execution

Press F6 to save and run the Job.

Use_Case_tLibraryLoad4.png

The Console displays the boolean
false. Hence, the e-mail address is not valid as the format
is incorrect.

tLibraryLoad MapReduce properties

These properties are used to configure tLibraryLoad running in the MapReduce Job framework.

The MapReduce
tLibraryLoad component belongs to the Custom Code family.

The component in this framework is available only if you have subscribed to one
of the
Talend
 solutions with Big Data.

Basic settings

Library

Select the library you want to import from the list, or click on the […] button to browse to the library in your directory.

Advanced settings

Dynamic Libs

Lib Paths: Enter the access path to your library, between
double quotation marks.

Import

Enter the Java code required to import, if required, the external library used in
the code editing field of the Basic settings tab of the
components such as tJavaMR in a Map/Reduce Job.

Global Variables

Global Variables

ERROR_MESSAGE: the error message generated by the
component when an error occurs. This is an After variable and it returns a string. This
variable functions only if the Die on error check box is
cleared, if the component has this check box.

A Flow variable functions during the execution of a component while an After variable
functions after the execution of the component.

To fill up a field or expression with a variable, press Ctrl +
Space to access the variable list and choose the variable to use from it.

For further information about variables, see
Talend Studio

User Guide.

Usage

Usage rule

In a
Talend
 Map/Reduce Job, this component is used standalone. It
generates native Map/Reduce code that can be executed directly in Hadoop.

You need to use the Hadoop Configuration tab in the
Run view to define the connection to a given Hadoop
distribution for the whole Job.

This connection is effective on a per-Job basis.

For further information about a
Talend
 Map/Reduce Job, see the sections
describing how to create, convert and configure a
Talend
 Map/Reduce Job of the

Talend Open Studio for Big Data Getting Started
Guide
.

Note that in this documentation, unless otherwise
explicitly stated, a scenario presents only Standard Jobs,
that is to say traditional
Talend
 data integration Jobs, and non Map/Reduce Jobs.

Limitation

The library is loaded locally.

Related scenarios

No scenario is available for the Map/Reduce version of this component yet.

tLibraryLoad properties for Apache Spark Batch

These properties are used to configure tLibraryLoad running in the Spark Batch Job framework.

The Spark Batch
tLibraryLoad component belongs to the Custom Code family.

The component in this framework is available only if you have subscribed to one
of the
Talend
 solutions with Big Data.

Basic settings

Library

Select the library you want to import from the list, or click on the […] button to browse to the library in your directory.

Advanced settings

Import

Enter the Java code required to import, if required, the external library used in
the code editing field of the Basic settings tab of the
components such as tJavaMR in a Map/Reduce Job.

Usage

Usage rule

This component is used with no need to be connected to other components.

This component, along with the Spark Batch component Palette it belongs to, appears only
when you are creating a Spark Batch Job.

Note that in this documentation, unless otherwise
explicitly stated, a scenario presents only Standard Jobs,
that is to say traditional
Talend
 data integration Jobs.

Spark Connection

You need to use the Spark Configuration tab in
the Run view to define the connection to a given
Spark cluster for the whole Job. In addition, since the Job expects its dependent jar
files for execution, you must specify the directory in the file system to which these
jar files are transferred so that Spark can access these files:

  • Yarn mode: when using Google
    Dataproc, specify a bucket in the Google Storage staging
    bucket     field in the Spark
    configuration     tab; when using other distributions, use a
    tHDFSConfiguration
    component to specify the directory.

  • Standalone mode: you need to choose
    the configuration component depending on the file system you are using, such
    as tHDFSConfiguration
    or tS3Configuration.

This connection is effective on a per-Job basis.

Limitation

The library is loaded locally.

Related scenarios

No scenario is available for the Spark Batch version of this component
yet.

tLibraryLoad properties for Apache Spark Streaming

These properties are used to configure tLibraryLoad running in the Spark Streaming Job framework.

The Spark Streaming
tLibraryLoad component belongs to the Custom Code family.

The component in this framework is available only if you have subscribed to Talend Real-time Big Data Platform or Talend Data
Fabric.

Basic settings

Library

Select the library you want to import from the list, or click on the […] button to browse to the library in your directory.

Advanced settings

Import

Enter the Java code required to import, if required, the external library used in
the code editing field of the Basic settings tab of the
components such as tJavaMR in a Map/Reduce Job.

Usage

Usage rule

This component is used with no need to be connected to other components.

This component, along with the Spark Streaming component Palette it belongs to, appears
only when you are creating a Spark Streaming Job.

Note that in this documentation, unless otherwise explicitly stated, a scenario presents
only Standard Jobs, that is to say traditional
Talend
 data
integration Jobs.

Spark Connection

You need to use the Spark Configuration tab in
the Run view to define the connection to a given
Spark cluster for the whole Job. In addition, since the Job expects its dependent jar
files for execution, you must specify the directory in the file system to which these
jar files are transferred so that Spark can access these files:

  • Yarn mode: when using Google
    Dataproc, specify a bucket in the Google Storage staging
    bucket     field in the Spark
    configuration     tab; when using other distributions, use a
    tHDFSConfiguration
    component to specify the directory.

  • Standalone mode: you need to choose
    the configuration component depending on the file system you are using, such
    as tHDFSConfiguration
    or tS3Configuration.

This connection is effective on a per-Job basis.

Limitation

The library is loaded locally.

Related scenarios

No scenario is available for the Spark Streaming version of this component
yet.

Document get from Talend https://help.talend.com
Thank you for watching.
Docs 6.x
Subscribe
Notify of
guest
0 Comments
Inline Feedbacks
View all comments
0
Would love your thoughts, please comment.x
()
x