# HDFS Writer

HDFS stands for **Hadoop Distributed File System**. It is a distributed file system designed to store and manage large data sets in a reliable, fault-tolerant, and scalable way. HDFS is a core component of the Apache Hadoop ecosystem and is used by many big data applications.

This task writes the data in HDFS(**Hadoop Distributed File System).**

**Please follow the below steps to configure the meta information of HDFS Writer:**

<figure><img src="https://363587200-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2Fuq3RSHHup7fjHYaspk7y%2Fuploads%2FXNqODKct7svS52GvQKER%2Fimage.png?alt=media&#x26;token=9e183af0-6f45-4126-aaa2-f8a9f47b0973" alt=""><figcaption><p>HDFS Writer Task</p></figcaption></figure>

* **Host IP Address:** Enter the host IP address for HDFS.
* **Port:** Enter the Port.
* **Table:** Enter the table name where the data has to be written.
* **Zone:** Enter the Zone for HDFS in which the data has to be written. Zone is a special directory whose contents will be transparently encrypted upon write and transparently decrypted upon read.
* **File Format:** Select the file format in which the data has to be written:
  * _**CSV**_
  * _**JSON**_
  * _**PARQUET**_
  * _**AVRO**_
* **Save Mode:** Select the save mode.
* **Schema file name:** Upload spark schema file in JSON format.
* **Partition Columns**: Provide a unique Key column name to partition data in Spark.
