July 30, 2023

tPaloOutputMulti – Docs for ESB 7.x

  2. Talend for ESB Docs
  3. Docs 7.x
  4. tPaloOutputMulti – Docs for ESB 7.x

tPaloOutputMulti

Takes the input stream and writes it to a given Palo cube.

The tPaloOutputMulti writes data (elements as well as
values) into a Palo cube.

tPaloOutputMulti Standard properties

These properties are used to configure tPaloOutputMulti running in the Standard Job framework.

The Standard
tPaloOutputMulti component belongs to the Business Intelligence family.

The component in this framework is available in all Talend
products.

Basic settings

Use an existing connection

Select this check box and in the Component List click the relevant connection component to
reuse the connection details you already defined.

Note that when a Job contains the parent Job and the child Job,
Component List presents only the
connection components in the same Job level.

Host Name

Enter the host name or the IP address of the host server.

Server Port

Type in the listening port number of the Palo server.

Username and
Password

Enter the Palo user authentication data.

To enter the password, click the […] button next to the
password field, and then in the pop-up dialog box enter the password between double quotes
and click OK to save the settings.

Database

Type in the name of the database where the cube of interest
resides.

Cube

Type in the name of the cube in which the incoming data is
written.

Cube type

Select the cube type from the drop-down list for the cube of
concern. This type may be:

– Normal

– Attribut

– System

– User Info

Commit size

Type in the row count of each batch to be written into the
cube.

Schema and Edit
Schema

A schema is a row description. It defines the number of fields
(columns) to be processed and passed on to the next component. When you create a Spark
Job, avoid the reserved word line when naming the
fields.

Click Edit
schema to make changes to the schema. If the current schema is of the Repository type, three options are available:

  • View schema: choose this
    option to view the schema only.

  • Change to built-in property:
    choose this option to change the schema to Built-in for local changes.

  • Update repository connection:
    choose this option to change the schema stored in the repository and decide whether
    to propagate the changes to all the Jobs upon completion. If you just want to
    propagate the changes to the current Job, you can select No upon completion and choose this schema metadata
    again in the Repository Content
    window.

 

Built-in: The schema is created
and stored locally for this component only. Related topic: see

Talend Studio User
Guide.

 

Repository: The schema already
exists and is stored in the Repository, hence can be reused. Related
topic: see
Talend Studio User
Guide.

Measure value

Select the column from the input stream which holds the Measure or
Text values.

Splash mode

Select the splash mode used to write data into a consolidated
element. The mode may be:

– Add: it writes values to the
underlying elements.

– Default: it uses the default
splash mode.

– Set: it simply sets or
replaces the current value and make the distribution based on the
other values.

– Disable: it applies no
splashing.

For further information about the Palo splash modes, see Palo’s
user guide.

Add values

Select this check box to add new values to the current values for
a sum. Otherwise these new values will overwrite the current
ones.

Use eventprocessor

Select this check box to call the supervision server.

Die on error

This check box is cleared by default, meaning to skip the row on
error and to complete the process for error-free rows.

Advanced settings

tStat
Catcher Statistics

Select this check box to collect log data at the component
level.

Enable parallel execution

Select this check box to perform high-speed data processing, by treating
multiple data flows simultaneously. Note that this feature depends on the database or
the application ability to handle multiple inserts in parallel as well as the number of
CPU affected. In the Number of parallel executions
field, either:

  • Enter the number of parallel executions desired.
  • Press Ctrl + Space and select the
    appropriate context variable from the list. For further information, see
    Talend Studio User Guide    .
  • The Action on
    table     field is not available with the
    parallelization function. Therefore, you must use a tCreateTable component if you
    want to create a table.
  • When parallel execution is enabled, it is not
    possible to use global variables to retrieve return values in a
    subjob.

Global Variables

Global Variables

ERROR_MESSAGE: the error message generated by the
component when an error occurs. This is an After variable and it returns a string. This
variable functions only if the Die on error check box is
cleared, if the component has this check box.

A Flow variable functions during the execution of a component while an After variable
functions after the execution of the component.

To fill up a field or expression with a variable, press Ctrl +
Space to access the variable list and choose the variable to use from it.

For further information about variables, see
Talend Studio

User Guide.

Usage

Usage rule

This component requires an input component.

Connections

Outgoing links (from this component to another):

Row: Main

Trigger: Run if; On Component Ok;
On Component Error.

Incoming links (from one component to this one):

Row: Main; Reject

For further information regarding connections, see

Talend Studio User
Guide.

Limitation

Numeric measures are only be accepted as Double or String type.
When the string type is used, write the value to be processed
between quotation marks.

Due to license incompatibility, one or more JARs required to use
this component are not provided. You can install the missing JARs for this particular
component by clicking the Install button
on the Component tab view. You can also
find out and add all missing JARs easily on the Modules tab in the
Integration
 perspective of your studio. You can find more details about how to install external modules in
Talend Help Center (https://help.talend.com).

Writing data into a given cube

The Job in this scenario writes new values in the Sales
cube given as demo in the Demo database installed with Palo.

tPaloOutputMulti_1.png

To replicate this scenario, proceed as follows:

Setting up the Job

  1. Drop tFixedFlowInput and tPaloOutputMulti from the component Palette onto the design workspace.
  2. Right-click tFixedFlowInput to open its
    contextual menu.
  3. In this menu, select Row > Main to connect this component to tPaloOutputMulti.

Configuring the input component

  1. Double-click the tFixedFlowInput
    component to open its Component
    view.

    tPaloOutputMulti_2.png

  2. Click the three-dot button to open the schema editor.

    tPaloOutputMulti_3.png

  3. In the schema editor, click the plus button to add 7 rows and rename them
    respectively as Products, Regions, Months, Years, Datatypes,
    Measures     and Values. The order of these
    rows must be consistent with that of the corresponding dimensions in the
    Sales cube and the type of the
    Value column where the measure value resides is set
    to double/Double.
  4. Click OK to validate the editing and
    accept the propagation prompted by the dialog box that pops up. Then the
    schema column labels display automatically in the Value table under the Use single
    table     check box, in the Mode
    area.
  5. In the Value table, type in values for
    each row in the Value column. In this
    example, these values are: Desktop L, Germany, Jan, 2009, Actual,
    Turnover, 1234.56    .

Configuring the output component

  1. Double-click tPaloOutputMulti to open its
    Component view.

    tPaloOutputMulti_4.png

  2. In the Server Port field, type in the
    listening port number of the Palo server. In this scenario, it is
    7777.
  3. In the Username field and the Password field, type in the authentication
    information. In this example, both of them are
    admin.
  4. In the Database field, type in the
    database name in which you want to create the cube,
    Demo in this example.
  5. In the Cube field, type in the name of
    the cube you want to write data in, for example,
    Sales.
  6. In the Cube type field, select the
    Normal type from the drop-down list for
    the cube to be created, meaning this cube will be normal and default.
  7. In the Measure Value field, select the
    Measure element. In this scenario, select Value.

Job execution

Press F6 to run the Job.

The inflow data has been written into the Sales cube.

tPaloOutputMulti_5.png

Rejecting inflow data when the elements to be written do not
exist in a given cube

The Job in this scenario tries to write data into the Sales cube but as the elements of interest do not exist in this cube, the inflow
data is rejected.

tPaloOutputMulti_6.png

To replicate this scenario, proceed as follows:

Setting up the Job

  1. Drop tFixedFlowInput, tPaloCheckElements, tPaloOutputMulti and tLogRow from the component Palette onto the design workspace.
  2. Right-click tFixedFlowInput to open its
    contextual menu.
  3. In this menu, select Row > Main to connect this component to tPaloCheckElements.
  4. Do the same to connect tPaloOutputMulti
    using row link.
  5. Right-click tPaloCheckElements to open
    its contextual menu.
  6. In this menu, select Row > Reject to connect this component to tLogRow.

Configuring the input component

  1. Double-click the tFixedFlowInput
    component to open its Component
    view.

    tPaloOutputMulti_2.png

  2. Click the three-dot button to open the schema editor.

    tPaloOutputMulti_3.png

  3. In the schema editor, click the plus button to add 7 rows and rename them
    respectively as Products, Regions, Months, Years, Datatypes,
    Measures     and Values. The order of these
    rows must be consistent with that of the corresponding dimensions in the
    Sales cube and the type of the
    Value column where the measure value resides is set
    to double/Double.
  4. Click OK to validate the editing and
    accept the propagation prompted by the dialog box that pops up. Then the
    schema column labels display automatically in the Value table under the Use single
    table     check box, in the Mode
    area.
  5. In the Value table, type in values for
    each row in the Value column. In this
    example, these values are: Smart Products, Germany, Jan, 2009,
    Actual, Turnover, 1234.56    . The Smart
    Products     element does not exist in the
    Sales cube.

Configuring the tPaloCheckElements component

  1. Double-click tPaloCheckElements to open
    its Component view.

    tPaloOutputMulti_9.png

  2. In the Host name field, type in
    localhost.
  3. In the Server Port field, type in the
    listening port number of the Palo server. In this scenario, it is
    7777.
  4. In the Username field and the Password field, type in the authentication
    information. In this example, both of them are
    admin.
  5. In the Database field, type in the
    database name in which you want to create the cube,
    Demo in this example.
  6. In the Cube field, type in the name of
    the cube you want to write data in, for example,
    Sales.
  7. In the On Element error field, select
    Reject row from the drop-down
    list.
  8. In the element table at the bottom of the Basic
    settings     view, click the Element
    type     column in the Value row and select
    Measure from the drop down list.

Configuring the output component

  1. Double-click tPaloOutputMulti to open its
    Component view.

    tPaloOutputMulti_4.png

  2. In the Server Port field, type in the
    listening port number of the Palo server. In this scenario, it is
    7777.
  3. In the Username field and the Password field, type in the authentication
    information. In this example, both of them are
    admin.
  4. In the Database field, type in the
    database name in which you want to create the cube,
    Demo in this example.
  5. In the Cube field, type in the name of
    the cube you want to write data in, for example,
    Sales.
  6. In the Cube type field, select the
    Normal type from the drop-down list for
    the cube to be created, meaning this cube will be normal and default.
  7. In the Measure Value field, select the
    Measure element. In this scenario, select Value.

Job execution

Press F6 to run the Job.

The data to be written is rejected and displayed in the console of the Run view. You can read that the error message is
Smart Products.

tPaloOutputMulti_11.png

Document get from Talend https://help.talend.com
Thank you for watching.
Docs 7.x
Subscribe
Notify of
guest
0 Comments
Inline Feedbacks
View all comments
0
Would love your thoughts, please comment.x
()
x