tWriteAvroFields
Transforms the incoming data into Avro files.
tWriteAvroFields generates Avro
binaries to be used by the components requiring serialized data as input such as tKafkaOutput.
tWriteAvroFields properties for Apache Spark Streaming
These properties are used to configure tWriteAvroFields running in the Spark Streaming Job framework.
The Spark Streaming
tWriteAvroFields component belongs to the Processing
family.
The streaming version of this component is available in Talend Real Time Big Data Platform and in
Talend Data Fabric.
Basic settings
Schema and Edit |
A schema is a row description. It defines the number of fields The schema of this component is read-only. You can click This read-only schema of tWriteAvroFields receives data That is to say, it does not require the input flow to have the identical schema. For |
Usage
Usage rule |
This component is used as an intermediate step. This component, along with the Spark Streaming component Palette it belongs to, appears Note that in this documentation, unless otherwise explicitly stated, a scenario presents |
Spark Connection |
In the Spark
Configuration tab in the Run view, define the connection to a given Spark cluster for the whole Job. In addition, since the Job expects its dependent jar files for execution, you must specify the directory in the file system to which these jar files are transferred so that Spark can access these files:
This connection is effective on a per-Job basis. |
Related scenarios
No scenario is available for the Spark Streaming version of this component
yet.