The SQL Component also provides an option of using aggregation functions on the complete streaming data processed by the component.
With this component, you can use SQL transformations on Spark data frames.
All component configurations are classified broadly into 3 section
Basic
Metadata
Resource Configuration
Follow the given steps in the demonstration to configure the SQL transformation component.
Please Note: The schema file that can be uploaded here is a JSON spark schema.
Last updated 3 years ago