apache spark pipelines

Databricks open-sourced its ETL framework, Apache Spark Declarative Pipelines, democratizing enterprise-grade data workflow automation for the Spark community. The framework…