July 30, 2023

tHMapRecord – Docs for ESB 7.x

tHMapRecord

Runs a
Talend Data Mapper
map where input and output structures may differ, as a Spark streaming
execution.

Warning:

This component is available in the Palette of the Studio only if you have subscribed to one of
the
Talend
solutions with Big Data.

tHMapRecord takes
one input connection from an upstream component and one or many output connections to
other components, in a Spark environment.

tHMapRecord properties for Apache Spark Streaming

These properties are used to configure tHMapRecord running in the Spark Streaming Job framework.

The Spark Streaming
tHMapRecord component belongs to the Processing family.

The component in this framework is available in Talend Real Time Big Data Platform and in Talend Data Fabric.

Basic settings

Storage

To connect to an HDFS installation, select the Define a storage configuration component check
box and then select the name of the component to use from those available in
the drop-down list.

This option requires you to have previously configured the
connection to the HDFS installation to be used, as described in the
documentation for the tHDFSConfiguration
component.

If you leave the Define a storage
configuration component
check box unselected, you can only
convert files locally.

Open Map Editor

Click the […] button
to open the tHMap Structure Generate/Select wizard where
you can either have the hierarchical mapper structure generated automatically
based on the schema, or select an existing hierarchical mapper structure. You
must do this for both the input and output sides of your Map.

When you connect multiple output connections to the tHMap, the page displays a
confirmation message that informs you that the mapper structures are generated
based on the output connections.

For more information, see
Talend Data Mapper
User Guide
.

Map Path

Click […] to select an
existing map. The window displays a wizard that allows you to select a map from
the Hierarchical Mapper view of Talend Data Mapper.

Die on error

Select the check box to stop the execution of the Job when an error occurs.

Clear the check box to skip any error and continue the Job execution process.

Usage

Usage rule

This component is used with a tHDFSConfiguration component which defines the
connection to the HDFS storage, or as a standalone component for mapping
local files only.

Drag-and-drop feature If you have an existing tHMapRecord map in the Data Mapping view, you
can easily drag-and-drop the map:

  • When you drag-and-drop the tHMapRecord map into the design workspace, the
    tHMapRecord component is automatically created
  • When you drag-and-drop the tHMapRecord map into an existing tHMapRecord
    component, the label and the map reference of the component are
    automatically updated


Document get from Talend https://help.talend.com
Thank you for watching.
Subscribe
Notify of
guest
0 Comments
Inline Feedbacks
View all comments
0
Would love your thoughts, please comment.x
()
x