August 15, 2023

Configuring the connection to the file system to be used by Spark – Docs for ESB 6.x

  2. Talend for ESB Docs
  3. Docs 6.x
  4. Configuring the connection to the file system to be used by Spark – Docs for ESB 6.x

Configuring the connection to the file system to be used by Spark

  1. Double-click tHDFSConfiguration to open its
    Component view.
  2. In the Version area, select the Hadoop
    distribution you need to connect to and its version.
  3. In the NameNode URI
    field, enter the location of the machine hosting the NameNode service of the
    cluster. If you are using WebHDFS, the location should be
    webhdfs://masternode:portnumber; if this WebHDFS is secured
    with SSL, the scheme should be swebhdfs and you need to use
    a tLibraryLoad in the Job to load the library required by
    the secured WebHDFS.
  4. In the Username field, enter the authentication
    information used to connect to the HDFS system to be used.
Document get from Talend https://help.talend.com
Thank you for watching.
Docs 6.x
Subscribe
Notify of
guest
0 Comments
Inline Feedbacks
View all comments
0
Would love your thoughts, please comment.x
()
x