tHDFSDelete
(HDFS).
tHDFSDelete Standard properties
These properties are used to configure tHDFSDelete running in the Standard Job framework.
The Standard
tHDFSDelete component belongs to the Big Data and the File families.
The component in this framework is available in all Talend products with Big Data
and in Talend Data Fabric.
Basic settings
Property type |
Either Built-in or Repository Built-in: No property data stored centrally.
Repository: Select the repository file in which the |
Use an existing connection |
Select this check box and in the Component List click the HDFS connection component from which Note that when a Job contains the parent Job and the child Job, |
Distribution |
Select the cluster you are using from the drop-down list. The options in the
list vary depending on the component you are using. Among these options, the following ones requires specific configuration:
|
Version |
Select the version of the Hadoop distribution you are using. The available |
Scheme | Select the URI scheme of the file system to be used from the Scheme drop-down list. This scheme could be
The schemes present on this list vary depending on the distribution you Once a scheme is If you have selected
ADLS, the connection parameters to be defined become:
For a |
NameNode URI |
Type in the URI of the Hadoop NameNode, the master node of a |
Use kerberos authentication |
If you are accessing the Hadoop cluster running
with Kerberos security, select this check box, then, enter the Kerberos principal name for the NameNode in the field displayed. This enables you to use your user name to authenticate against the credentials stored in Kerberos.
This check box is available depending on the Hadoop distribution you are |
Use a keytab to authenticate |
Select the Use a keytab to authenticate Note that the user that executes a keytab-enabled Job is not necessarily |
User name |
User authentication name of HDFS. |
Group |
Enter the membership including the authentication user under which the HDFS |
File or Directory Path |
Browse to, or enter the path to the file or folder to be deleted on HDFS. |
Advanced settings
Hadoop properties |
If you need to use custom configuration for the Hadoop of For further information about the properties required by Hadoop, |
tStatCatcher Statistics |
Select this check box to collect log data at the component |
Global Variables
Global Variables |
DELETE_PATH: the path to the deleted file or folder. This
CURRENT_STATUS: the execution result of the component.
ERROR_MESSAGE: the error message generated by the A Flow variable functions during the execution of a component while an After variable To fill up a field or expression with a variable, press Ctrl + For further information about variables, see |
Usage
Usage rule |
This component is used to compose a single-component Job or |
Dynamic settings |
Click the [+] button to add a row in the The Dynamic settings table is For examples on using dynamic parameters, see Reading data from databases through context-based dynamic connections and Reading data from different MySQL databases using dynamically loaded connection parameters. For more information on Dynamic |
Prerequisites |
The Hadoop distribution must be properly installed, so as to guarantee the interaction
For further information about how to install a Hadoop distribution, see the manuals |
Limitations |
JRE 1.6+ is required. |
Related scenarios
No scenario is available for the Standard version of this component yet.