Transforms the incoming data into Avro files.
tWriteAvroFields generates Avro
binaries to be used by the components requiring serialized data as input such as tKafkaOutput.
tWriteAvroFields properties for Apache Spark Streaming
These properties are used to configure tWriteAvroFields running in the Spark Streaming Job framework.
The Spark Streaming
tWriteAvroFields component belongs to the Processing
Schema and Edit
A schema is a row description. It defines the number of fields
The schema of this component is read-only. You can click
This read-only schema of tWriteAvroFields receives data
That is to say, it does not require the input flow to have the identical schema. For
This component is used as an intermediate step.
This component, along with the Spark Streaming component Palette it belongs to, appears
Note that in this documentation, unless otherwise explicitly stated, a scenario presents
In the Spark
Configuration tab in the Run
view, define the connection to a given Spark cluster for the whole Job. In
addition, since the Job expects its dependent jar files for execution, you must
specify the directory in the file system to which these jar files are
transferred so that Spark can access these files:
This connection is effective on a per-Job basis.
No scenario is available for the Spark Streaming version of this component