Pipeline : PySpark Component (PySpark Job)

PySpark code can be built via Data Science Lab PySpark and can be deployed as component in pipeline. This allows us to utilise distributed processing capabilities of Spark and flexibility of Python.