tHMapRecord

Runs a
Talend Data Mapper
map where input and output structures may differ, as a Spark streaming
execution.

Warning:

This component is available in the Palette of the Studio only if you have subscribed to one of
the
Talend
solutions with Big Data.

tHMapRecord takes
one input connection from an upstream component and one or many output connections to
other components, in a Spark environment.

tHMapRecord properties for Apache Spark Streaming

These properties are used to configure tHMapRecord running in the Spark Streaming Job framework.

The Spark Streaming
tHMapRecord component belongs to the Processing family.

The component in this framework is available only if you have
subscribed to Talend Real-Time Big Data Platform or Talend Data Fabric .

Basic settings

Storage	To connect to an HDFS installation, select the Define a storage configuration component check box and then select the name of the component to use from those available in the drop-down list. This option requires you to have previously configured the connection to the HDFS installation to be used, as described in the documentation for the tHDFSConfiguration component. If you leave the Define a storage configuration component check box unselected, you can only convert files locally.
Open Map Editor	Click the […] button to open the map for editing in the Map Editor of Talend Data Mapper . For more information, see Talend Data Mapper User Guide.
Die on error	This check box is clear by default. Select the check box to stop running the Job when an error is encountered. If needed, you can retrieve the rows with errors via a Row > Rejects link.

Storage

To connect to an HDFS installation, select the Define a storage configuration component check box and then
select the name of the component to use from those available in the
drop-down list.

This option requires you to have previously configured the connection
to the HDFS installation to be used, as described in the documentation
for the tHDFSConfiguration
component.

If you leave the Define a storage
configuration component check box unselected, you can only
convert files locally.

Open Map Editor

Click the […] button to open the map for editing in the
Map Editor of
Talend Data Mapper
.

For more information, see
Talend Data Mapper User
Guide.

Die on error

This check box is clear by default. Select the check box to stop running the
Job when an error is encountered. If needed, you can retrieve the rows with
errors via a Row > Rejects link.

Usage

Usage rule	This component is used with a tHDFSConfiguration component which defines the connection to the HDFS storage, or as a standalone component for mapping local files only.

Document get from Talend https://help.talend.com

Thank you for watching.

Docs 6.x

0 Comments

Inline Feedbacks

View all comments

tHMapRecord – Docs for ESB 6.x

tHMapRecord

tHMapRecord properties for Apache Spark Streaming

Basic settings

Usage

My Website Links

Tags