Databricks Contributes Spark Declarative Pipelines to Apache Spark
Databricks is contributing the technology behind Delta Live Tables (DLT) to the Apache Spark project as Spark Declarative Pipelines, simplifying the development of streaming pipelines.
Databricks targets AI bottlenecks with Lakeflow Designer
Lakeflow and OpenFlow reflect two philosophies: Databricks integrates data engineering into a Spark-native, open orchestration fabric, while Snowflake's OpenFlow offers declarative workflow control.
Snowflake acquires Crunchy Data for enterprise-grade PostgreSQL to counter Databricks' Neon buy
The competition between Snowflake and Databricks has evolved into a quest for AI-native data foundations, integrating various data management capabilities.
Delta Lake and Iceberg communities collide - in a good way
Databricks collaborates on the Iceberg table format, enhancing interoperability with its own Delta Lake format, aiming to optimize analytics performance.