Import Model

External models can be imported into the Data Science Lab and experimented inside the Notebooks.

Please Note:

• The External models can be registered to the Data Pipeline module and they can be inferred using the Data Science Lab script runner.

• Only the Native prediction functionality will work for the External models.

Importing a Model

• Navigate to the Model tab for a Repo Sync Project.

• Click the Import Model option.

the Import Model option

• The user gets redirected to upload the model file. Select and upload the file.

• A notification message appears.

• The imported model gets added to the model list.

Please Note: The Imported models are referred as External models in model list and they are marked with as pre-fix to their names (as displayed in the above-given image).

Exporting the Model to Data Pipeline

The user needs to start a new .ipynb file with wrapper function that includes Data, Imported Model, Predict function, and output Dataset with predictions.

• Create a new .ipynb file or navigate to an existing .ipynb file.

• Use the code cell to write the needed wrapper function.

• Access the Imported Model inside this .ipynb file.

• Load it and use the model number inside your script.

• Run the script.

• Run the code cell with the inference script to get the preview of the data.

• Register the model using the Models tab inside the .ipynb file.

• The Register Model dialog box appears to confirm about the model registration.

• Click the Yes option.

• A notification message appears, and the model gets registered.

• Export the script using the Export functionality provided for the .ipynb file.

• The Export to Pipeline window appears.

• Select the Export to pipeline option.

• Select a specific script from the Notebook. or Choose the Select All option to select the full script.

• Select the Next option.

• Click the Validate icon to validate the script.

• A notification message appears to assure the validity of the script.

• Click the Export to Pipeline option.

• A notification message appears to assure that the selected Notebook has been exported.

Please Note: The imported model gets registered to the Data Pipeline module as a script.

Accessing the Exported Model within the Pipeline User interface

• Navigate to the Data Pipeline Workflow editor.

• Drag the DS Lab Runner component and configure the Basic Information.

• Open the Meta Information tab of the DS Lab Runner component.

• Configure the following information for the Meta Information tab.

  • Select Script Runner as the Execution Type.

  • Select function input type.

  • Select the project name.

  • Select the Script Name from the drop-down option. The same name given to the imported model appears as the script name.

  • Provide details for the External Library (if applicable).

  • Select the Start Function from the drop-down menu.

• The exported model along with the script can be accessed inside the Script section.

• The user can connect the DS Lab Script Runner component to an Input Event.

• Run the Pipeline.

• The model predictions can be generated in the Preview tab of the connected Input Event.

Please Note:

• The Imported Models can be accessed through the Script Runner component inside the Data Pipeline module.

• The other models can be accessed through the Model Runner component inside the Data Pipeline.

Try out the Import Model Functionality yourself

Some of the Sample models and related scripts are provided below for the user to try his hands on this functionality. Please download them by a click, and use them in your Notebook by following the above mentioned steps.

Sample files for Sklearn

923B

SklearnModel.pkl

Open

Sample Sklearn model for import.

6KB

Importmodels_Sklearn_Inference.ipynb

Open

Sample python script based on the imported Sklearn model.

Sample files for Keras

18KB

KersModel.h5

Open

Sample Keras model for import.

6KB

Importmodels_Keras_Inference.ipynb

Open

Sample python script based on the imported Keras model.

Sample files for PyTorch

8KB

Pytorch_Model.pth

Open

Sample PyTorch model for import.

10KB

ImportModel_Pytorch_Inference.ipynb

Open

Sample python script based on the imported PyTorch model.

Please Note:

• The supported extensions for External models - .pkl, .h5, .pth & .pt

• Refer the Data Science Lab Quick Start Flow page to get an overview of the Data Science Lab module in nutshell.