Feature Stores

The Feature Store component allows users to create and schedule feature stores for machine learning tasks. It serves as a central repository to manage and store features, ensuring they are available for use in models.

Users can create a feature store, monitor its status, and schedule it for periodic updates based on defined concurrency policies. This feature provides a streamlined process for maintaining and automating feature engineering workflows.

Best Situations to Use

Use the Feature Store when you want to:

• Create a centralized repository to store machine learning features.

• Schedule regular updates for features that feed into your ML models.

• Automate the process of validating, updating, and managing features for predictive modeling.

• Monitor and update feature stores with real-time status indicators and logs.

Not Recommended for:

• Small datasets that do not require frequent updates or versioning.

• Scenarios that do not involve machine learning workflows or model deployment.

Steps to Create a Feature Store

Creating a Feature Store

Navigation Path: Data Center > My Connectors > Standard Connectors > Options for a Data Connector

• Navigate to the Standard Connectors list.

• Click the Create Feature Store option from the Options context menu.

• The Create Feature Store form will open.

• Provide the Featureset Name.

• Select a Connector using the drop-down menu.

• Write or get an SQL query by selecting a table/metadata from the Tab Info/Metadata panel.

• Validate the query using the Validate option.

  • A notification will appear confirming that the query is validated.

• Click the Create option.

• The user gets redirected to the Feature Stores page, and the newly created feature store will be added at the top of the list.

  • A notification message will ensure the user that the intended Feature Store is being created.

• Click the Refresh icon to check the status of the newly created feature store.

• The feature store will have a status of Initializing, Started, or Completed.

Scheduling a Feature Store

You can schedule a Feature Store from the Create form of a Feature Store.

1. Navigate to the Create Feature Store form.

2. Provide the Featureset Name and select a connector as before.

3. Write or get an SQL query, then validate it.

4. Click the Schedule option.

   • The Schedule page will appear.

5. In the Concurrency Policy section, choose one of the following options:

   • Allow (Parallel): Multiple instances can run simultaneously, suitable for independent tasks.

   • Forbid (Prevent, Deny): Only one instance can run at a time; new instances are skipped if the previous one is still running.

   • Replace (Terminate, ReplaceOlder): A new instance starts, and the previous one is terminated. Ideal when the latest instance should take priority.

6. In the Cron Generator section, select either Monthly or Yearly, and provide the necessary information.

7. Based on your selection in the Cron Generator, the Scheduler Time will be automatically populated.

8. Click Apply to schedule the feature store.

   • A notification will appear confirming that the Feature Store is scheduled.

   • A check mark will appear next to the Scheduler option to indicate that the store has been successfully scheduled.

Monitoring and Managing Feature Store Status

Navigation Path: Data Center > My Connectors > Standard Connector > Feature Store tab (for a selected connector)

1. Once the feature store is created and scheduled, you can access it from the Feature Store list.

2. The newly created Feature Store will be added at the top of the page.

3. A status column will indicate the state of the feature store job (e.g., Initializing, Started, Completed).

4. Click the Refresh icon to update the status.

   • The feature store status will change from Initializing to Started.

   • Click Refresh again to change the status to Completed.

5. Once completed, the Stop Scheduling icon will be enabled.

6. Click the Stop Schedule icon if you need to stop the scheduled feature store job.

Options Provided to a Feature Store

1. Feature Store Info: Displays the Feature Store details.

2. Stop Scheduling: Stops the schedule.

3. Edit: Reopens the Feature Store form to edit the modifiable details.

4. Delete: Removes the Feature Store.

Notes:

• Stop Schedule: The Stop Schedule option will remain enabled when the scheduled Feature Store reaches the scheduled time limit. Users can click the Stop Schedule icon to halt the schedule at any time during this period.

• Status Indicators: The feature store will go through different status stages:

  • Initializing: Feature store job is in the process of being set up.

  • Started: The feature store job is running.

  • Completed: The feature store job has finished successfully.

• Scheduling Conflicts: If the selected concurrency policy is Forbid (Prevent, Deny), the new instance will be skipped if a previous one is still running.

• Scheduling Flexibility: The Cron Generator gives flexibility for scheduling jobs on a monthly or yearly basis, making it suitable for long-term, recurring feature updates.