Sandbox Writer

A Sandbox writer is used to writer data within a configured sandbox environment.

All component configurations are classified broadly into the following sections:

• ​​Basic Information​​

• Meta Information

• Resource Configuration​​

• ​Connection Validation

Check out the given Walk-through on the Sandbox Writer component.

Sandbox writer as a part of the Pipeline workflow

Configuring the Meta Information Tab

Please follow the below mentioned steps to configure the Meta Information Tab of Sandbox Writer:

• Storage Type: This field is pre-defined.

• Sandbox File: Enter the file name.

• File Type: Select the file type in which the data has to be written. There are 4 files types supported here:

  • CSV

  • JSON

  • Parquet

  • AVRO

  • Text

• Save Mode: Select the Save mode from the drop down.

  • Append

  • Overwrite

• Schema File Name: Upload spark schema file in JSON format.

• Column Filter: There is also a section for the selected columns in the Meta Information tab if the user can select some specific columns from the table to read data instead of selecting a complete table so this can be achieved by using the Column Filter section. Select the columns which you want to read and if you want to change the name of the column, then put that name in the alias name section otherwise keep the alias name the same as of column name and then select a Column Type from the drop-down menu.

  • Use Download Data and Upload File options to select the desired columns.

    • Upload File: The user can upload the existing system files (CSV, JSON) using the Upload File icon (file size must be less than 2 MB).

    • Download Data: Users can download the schema structure in JSON format by using the Download Data icon.

Meta Information tab for the Sandbox Writer