July 30, 2023

tKafkaCreateTopic – Docs for ESB 7.x

tKafkaCreateTopic

Creates a Kafka topic that the other Kafka components can use.

This component allows you to visually issue the command to create a topic with various topic-level properties.

tKafkaCreateTopic Standard properties

These properties are used to configure tKafkaCreateTopic running in the Standard Job framework.

The Standard
tKafkaCreateTopic component belongs to the Internet family.

The component in this framework is available in all Talend products with Big Data
and in Talend Data Fabric.

Basic settings

Version

Select the version of the Kafka cluster to be used.

Use an existing connection

Select this check box and in the Component List click the relevant connection component to
reuse the connection details you already defined.

Zookeeper quorum list

Enter the address of the Zookeeper service of the Kafka cluster to be used.

The form of this address should be hostname:port. This
information is the name and the port of the hosting node in this Kafka cluster.

If you need to specify several addresses, separate them using a comma (,).

Action on topic

Select how a topic is created.

  • Create topic: it creates a
    topic. If this topic exists already, the entire Job is
    stopped.

  • Create topic if not exists:
    it creates a topic when this topic does not exist. If this topic
    exists, the Job skip the creation to move to the next
    step.

Topic name

Enter the name of the topic to be created.

Replication factor

Enter the number of the replicas to be created for the logs (the message sets) of the
topic partitions.

Number of partitions

Enter the number of partitions to be created for the topic.

Set topic retention time
(ms)

Select this check box to define the maximum time in milliseconds during which the contents
of the topic are retained.

At the end of the time, the contents are removed or compacted depending on the policy you
define in the Topic properties table in the Advanced settings view.

Advanced settings

Topic properties

Add the Kafka topic properties you need to customize to this table.

For further information about the topic-level properties you can define in this table, see
the section describing the topic-level configuration in Kafka’s documentation in http://kafka.apache.org/documentation.html#topic-config.

tStatCatcher Statistics

Select this check box to gather the processing metadata at the Job
level as well as at each component level.

Usage

Usage rule

This component is used standalone to create a topic that the other
Kafka components can use in the other Jobs or subJobs.

Limitation

Due to license incompatibility, one or more JARs required to use
this component are not provided. You can install the missing JARs for this particular
component by clicking the Install button
on the Component tab view. You can also
find out and add all missing JARs easily on the Modules tab in the
Integration
perspective of your studio. You can find more details about how to install external modules in
Talend Help Center (https://help.talend.com)
.

Related scenarios

No scenario is available for the Standard version of this component yet.


Document get from Talend https://help.talend.com
Thank you for watching.
Subscribe
Notify of
guest
0 Comments
Inline Feedbacks
View all comments
0
Would love your thoughts, please comment.x
()
x