August 15, 2023

Creating a Job for aggregating Snowflake data – Docs for ESB 6.x

Creating a Job for aggregating Snowflake data

elt_snowflake_using_variables_job.png

  • A new Job has been created and the context variables
    SourceTableS with the value
    STUDENT, SourceTableT with
    the value TEACHER, and
    TargetTable with the value
    FULLINFO have been added to the Job. For more
    information about how to use context variables, see the related
    documentation about using contexts and variables.

  • The source table STUDENT with three columns,
    SID and TID of
    NUMBER(38,0) type and SNAME of VARCHAR(50) type, has
    been created in Snowflake, and the following data has been written into the
    table.

  • The source table TEACHER with three columns,
    TID of NUMBER(38,0) type and
    TNAME and TPHONE of
    VARCHAR(50) type, has been created in Snowflake, and the following data has
    been written into the table.

  1. Add a tSnowflakeConnection component, a
    tSnowflakeClose component, two
    tELTJDBCInput components, a
    tELTJDBCMap component, and a
    tELTJDBCOutput component to your Job.
  2. On the Basic setting view of the first
    tELTJDBCInput component, enter the name of the first
    source table in the Default Table Name field. In this
    example, it is the context variable
    context.SourceTableS.

    elt_snowflake_using_variables_teltjdbcinput_basic_settings.png

  3. Do the same to set the value of the default table name for the second
    tELTJDBCInput component and the
    tELTJDBCOutput component to
    context.SourceTableT and
    context.TargetTable respectively.
  4. Link the first tELTJDBCInput component to the
    tELTJDBCMap component using the Link > context.SourceTableS (Table) connection.
  5. Link the second tELTJDBCInput component to the
    tELTJDBCMap component using the Link > context.SourceTableT (Table) connection.
  6. Link the tELTJDBCMap component to the
    tELTJDBCOutput component using the Link > *New Output* (Table) connection. The link will be renamed automatically to
    context.TargetTable (Table).
  7. Link the tSnowflakeConnection component to the
    tELTJDBCMap component using a Trigger > On Subjob Ok connection.
  8. Do the same to link the tELTJDBCMap component to the
    tSnowflakeClose component.

Document get from Talend https://help.talend.com
Thank you for watching.
Subscribe
Notify of
guest
0 Comments
Inline Feedbacks
View all comments
0
Would love your thoughts, please comment.x
()
x