News

Declarative pipelines use the same execution engine as scripted pipelines, but they add a number of new benefits.
Data + AI Summit -- Databricks, the Data and AI company, today announced it is open-sourcing the company's core declarative ETL framework as Apache Spark™ Declarative Pipelines. This initiative ...
With Apache Spark Declarative Pipelines, engineers describe what their pipeline should do using SQL or Python, and Apache Spark handles the execution.
SAN FRANCISCO, June 11, 2025 /PRNewswire/ -- Data + AI Summit -- Databricks, the Data and AI company, today announced it is open-sourcing the company's core declarative ETL framework as Apache Spark™ ...
In addition to a declarative syntax for defining a pipeline, Spark Declarative Pipelines also supports change data capture (CDC), batch and stream logic, built in retry logic, and observability hooks.
PALO ALTO, Calif., Nov. 15, 2019 – Ascend, provider of the world’s first Autonomous Dataflow Service, today announced the general availability of Declarative Pipeline Workflows, the first and only ...
Looking to get more out of your DevOps tooling? The declarative Jenkins pipeline helps take continuous integration and continuous delivery to new heights.
Spark Declarative Pipelines provides an easier way to define and execute data pipelines for both batch and streaming ETL workloads across any Apache Spark-supported data source, including cloud ...
Spark Declarative Pipelines provides an easier way to define and execute data pipelines for both batch and streaming ETL workloads across any Apache Spark-supported data source, including cloud ...
This battle-tested declarative framework for building data pipelines helps engineers address common pain points like complex pipeline authoring, manual operations overhead and siloed batch/streaming.