Mongo Writer(Docker)
Last updated
Last updated
All component configurations are classified broadly into 3 section
Metadata
Please follow the demonstration to configure the component.
The PyMongo Writer writes the data to the mongo database.
i) Drag & drop the PyMongo Writer component to the Workflow Editor.
ii) Click the dragged PyMongo Writer component to open the component properties tabs below.
iii) Basic Information: It is the default tab to open for the PyMongo Writer while configuring the component.
1. Select an Invocation type from the drop-down menu to confirm the running mode of the reader component. Select ‘Real-Time’ or ‘Batch’ from the drop-down menu.
2. Deployment Type: It displays the deployment type for the component. This field comes preselected.
3. Container Image Version: It displays the image version for the docker container. This field comes pre-selected.
4. Failover Event: Select a failover Event from the drop-down menu.
5. Batch Size: Provide the maximum number of records to be processed in one execution cycle.
iv) Open the ‘Meta Information tab and configure all the connection-specific details for the PyMongo Writer.
1. Connection Type: Select either of the options out of ‘Standard’, ‘SRV’, and ‘Connection String’ connection types.
2. Port number (*): Provide the Port number (It appears only with the ‘Standard’ connection type).
3. Host IP Address (*): IP address of the host.
4. Username (*): Provide username.
5. Password (*): Provide a valid password to access the Mongo DB.
6. Database Name (*): Provide the name of the database where you wish to write data.
7. Collection Name (*): Provide the name of the collection.
8. Safe Mode: Select an option from the drop-down menu (the supported options are Upsert and Append).
9. Composite Keys (*): This field appears only when the selected save mode is ‘Upsert’. The user can enter multiple composite keys separated by commas on the basis of which upsert happens.
10. Additional Parameters: Provide details of the additional parameters.
11. Connection String (*): Provide a connection string.
The Meta Information fields vary based on the selected ‘Connection Type’ option.
1. Meta Information Tab with Standard as the Connection Type.
2. Meta Information Tab with SRV as the Connection Type.
3. Meta Information Tab with Connection String as the Connection Type.
v) Selected Columns: The users can select some specific columns to change the column name or data type while writing it to the collection. Users have to type the name of the column in the name field that has to be modified. If you went to change the name of the column, then put the name of your choice in the alias name section otherwise keep it the same as of column name. Then select the Column Type from the drop-down menu into which you want to change the datatype of that particular column. Once this is done, while writing the selected column data type and column name will be converted to your given choice.
or
Use ‘Download Data’ and ‘Upload File’ options to select the desired columns.
Upload File: The user can upload the existing system files (CSV, JSON) using the ‘Upload File’ icon (file size must be less than 2 MB).
2. Download Data (Schema): Users can download the schema structure in JSON format by using the ‘Download Data’ icon.
vi) Click the ‘Save Component in Storage’ icon for the PyMongo Writer component.
vii) A message appears to notify the successful update of the component.
viii) Click on activate pipeline icon.
ix) Pymongo Writer will write the data for the collection.
