MongoDB Writer

The MongoDB writer component is designed to write the data in the MongoDB collection.

All component configurations are classified broadly into the following sections:

• ​​Basic Information​​

• Meta Information

• Resource Configuration​​

• ​Connection Validation​

Follow the given steps in the demonstration to configure the Mongo (Spark) Writer component.

Configuring the MongoDB Writer​ (Spark) as part of Pipeline Workflow

Please Note: ​In the Connection Type field, you can choose one of the three options: SRV, Standard, and Connection String.

Configuring the Meta Information tab of the MongoDB Writer

Please Note: The fields marked as (*) are mandatory fields.

• Connection Type: Select the connection type from the drop-down:

  • Standard

  • SRV

  • Connection String

• Host IP Address (*): Hadoop IP address of the host.

• Port(*): Port number (It appears only with the Standard Connection Type).

• Username(*): Provide username.

• Password(*): Provide a valid password to access the MongoDB.

• Database Name(*): Provide the name of the database from where you wish to read data.

• Collection Name(*): Provide the name of the collection.

• Schema File Name: Upload Spark Schema file in JSON format.

• Additional Parameters: Provide the additional parameters to connect with MongoDB. This field is optional.

• Enable SSL: Check this box to enable SSL for this components. MongoDB connection credentials will be different if this option is enabled.

  To use a MongoDB Writer with SSL, the user needs to upload the following files on the certificate upload page:

  • JKS file (Java KeyStore file, typically with a .jks extension).

  • JKS Truststore (Java KeyStore Truststore file, typically with a .jks extension).

  • JKS file password (password for the JKS file).

  • JKS trust store password (password for the JKS Truststore).

• Certificate Folder: This option will appear when the Enable SSL field is checked-in. The user has to select the certificate folder from drop down which contains the files which has been uploaded to the admin settings for connecting MongoDB with SSL. Please refer the below given images for the reference.

• Save Mode: Select the Save mode from the drop down.

  • Append: This operation adds the data to the collection.

  • Ignore: "Ignore" is an operation that skips the insertion of a record if a duplicate record already exists in the database. This means that the new record will not be added, and the database will remain unchanged. "Ignore" is useful when you want to prevent duplicate entries in a database.

  • Upsert: It is a combination of update and insert options. It is an operation that updates a record if it already exists in the database or inserts a new record if it does not exist. This means that "upsert" updates an existing record with new data or creates a new record if the record does not exist in the database.