Docker Reader
This page covers the configuration steps for the Mongo DB Reader.
Last updated
This page covers the configuration steps for the Mongo DB Reader.
Last updated
All component configurations are classified broadly into the following sections:
Metadata
Please follow the demonstration to configure the component.
MongoDB Reader reads data from the specified database’s Collection. It also has an option to filter the data using Mongo Query Language(MQL), Which will run the MQL directly on the MongoDB Server, and push the data to the out event.
Check out the below-given walk through about the PyMongo Reader.
Drag & drop the PyMongo Reader component to the Workflow Editor.
Click on the dragged reader component.
The component properties tabs open below.
It is the default tab to open for the PyMongo Reader while configuring the component.
Select an Invocation Type from the drop-down menu to confirm the running mode of the reader component. Select Real-Time or Batch from the drop-down menu.
Deployment Type: It displays the deployment type for the component (This field comes pre-selected).
Container Image Version: It displays the image version for the docker container (This field comes pre-selected).
Failover Event: Select a failover Event from the drop-down menu.
Batch Size (min 10): Provide the maximum number of records to be processed in one execution cycle (Min limit for this field is 10).
Please Note: The Grace Period Field appears when the Batch is selected as the Invocation Type option in the Basic Information tab. You can now give a grace period for components to go down gracefully after that time by configuring this field.
Open the Meta Information tab and fill in all the connection-specific details of PyMongo Reader. The Meta Information tab opens with the below given fields:
Please Note: The Meta Information fields may vary based on the selected Connection Type option.
Connection Type: Select either of the options out of Standard, SRV, and Connection String connection types.
Port number (*): Provide the Port number (It appears only with the Standard connection type).
Host IP Address (*): The IP address of the host.
Username (*): Provide a username.
Password (*): Provide a valid password to access the Mongo DB.
Database Name (*): Provide the name of the database where you wish to write data.
Collection Name (*): Provide the name of the collection.
Additional Parameters: Provide details of the additional parameters.
Connection String (*): Provide a connection string (It appears only with the Connection String connection type).
Query: Provide a relevant query service.
We can write Mongo queries in the below-given manner:
After configuring the required configuration fields, click the Save Component in Storage icon provided in the reader configuration panel to save the component.
A confirmation message appears to notify the component properties are saved.
Click on the Update Pipeline icon to update the pipeline.
A confirmation message appears to inform the user.
Click on the Activate Pipeline icon.
The Confirm dialog box appears to ask the user permission.
Click the YES option.
A confirmation message appears to inform that the pipeline has been activated.
Click on the Toggle Log Panel icon.
The Log Panel opens displaying the Logs and Advance Logs tabs.
Please Note:
The Pod logs for the components appears in the Advanced Logs tab.
The overall component logs will be displayed in the Logs tab.
A configured component will display some more tabs such as the Configuration, Logs, and Pod Logs tabs (as displayed below for the PyMongo reader component).
