Schema and Edit
Schema

A schema is a row description. It defines the number of fields
(columns) to be processed and passed on to the next component. When you create a Spark
Job, avoid the reserved word line when naming the
fields.

Click Edit
schema to make changes to the schema. If the current schema is of the Repository type, three options are available:

• View schema: choose this
  option to view the schema only.

• Change to built-in property:
  choose this option to change the schema to Built-in for local changes.

• Update repository connection:
  choose this option to change the schema stored in the repository and decide whether
  to propagate the changes to all the Jobs upon completion. If you just want to
  propagate the changes to the current Job, you can select No upon completion and choose this schema metadata
  again in the Repository Content
  window.

Built-In: You create and store the schema locally for this component
only.

Repository: You have already created the schema and stored it in the
Repository. You can reuse it in various projects and Job designs.

Mode

Select the mode that you want to use to generate the data
stream.

• Use Inline Content: enter the
  data that you want to generate.

• Use context variable: enter
  the name of variable to be used to provide data. This variable
  must have been defined in the Contexts tab of the current Job.

  The syntax to call a variable is context.VariableName.

In either mode, the data you provide must use the separators you have
defined in the Row separator, Field Separator and Micro batch separator fields.

Usage rule

This component is used as a start component and requires an output link.

This component is added automatically to a test case being created to provide input
data.

Spark Connection

This connection is effective on a per-Job basis.