tBigQueryOutputBulk – Docs for ESB 5.x

Component family

Big Data / Google BigQuery

Function

This component writes given data into a .txt or .csv
file, ready to be transferred to Google BigQuery.

Purpose

This component creates a .txt
or .csv file for the data of
large size so that you can process it according to your needs before
transferring it to Google BigQuery.

Basic settings

Schema and Edit
Schema

A schema is a row description. It defines the number of fields to be processed and passed on
to the next component. The schema is either Built-In or
stored remotely in the Repository.

Since version 5.6, both the Built-In mode and the Repository mode are
available in any of the Talend solutions.

Click Edit schema to make changes to the schema. If the
current schema is of the Repository type, three options are
available:

Property type

Built-In: You create and store the schema locally for this
component only. Related topic: see Talend Studio
User Guide.

Repository: You have already created the schema and
stored it in the Repository. You can reuse it in various projects and Job designs. Related
topic: see Talend Studio User Guide.

Since version 5.6, both the Built-In mode and the Repository mode are
available in any of the Talend solutions.

File name

Browse, or enter the path to the .txt or .csv file
you need to generate.

Append

Select the check box to write new data at the end of the existing
data. Otherwise, the existing data will be overwritten.

Field Separator

Enter character, string or regular expression to separate fields for the transferred
data.

Select this check box to create the directory you defined in the File field for Google Cloud Storage, if it does not exist.

Custom the flush buffer size

Enter the number of rows to be processed before the memory is freed.

Check disk space

Select the this check box to throw an exception during execution
if the disk is full.

Encoding

Select the encoding from the list or select Custom and
define it manually. This field is compulsory for database data handling.

tStatCatcher Statistics

Select this check box to collect the log data at the component
level/

Global Variables

NB_LINE: the number of rows read by an input component or
transferred to an output component. This is an After variable and it returns an
integer.

ERROR_MESSAGE: the error message generated by the
component when an error occurs. This is an After variable and it returns a string. This
variable functions only if the Die on error check box is
cleared, if the component has this check box.

A Flow variable functions during the execution of a component while an After variable
functions after the execution of the component.

To fill up a field or expression with a variable, press Ctrl +
Space to access the variable list and choose the variable to use from it.

For further information about variables, see Talend Studio
User Guide.

Usage

This is an output component which needs the data provided by its
preceding component.

Log4j

The activity of this component can be logged using the log4j feature. For more information on this feature, see Talend Studio User
Guide.

For more information on the log4j logging levels, see the Apache documentation at http://logging.apache.org/log4j/1.2/apidocs/org/apache/log4j/Level.html.

Limitation

N/A