#data-lakes

[ follow ]
Medium
3 months ago
Scala

Data Engineering: Getting Started with Delta Lake

Delta Lake is gaining popularity in the realm of Data Lakes compared to Apache Hudi and Apache Iceberg.
This article provides a simple introduction to Delta Lake using Apache Spark + Scala programming language on Spark Shell. [ more ]
TechRepublic
3 months ago
Artificial intelligence

Zetaris: Federated Data Lakes Could Make Sense of Enterprise Data 'Mess' to Power AI

Data in Australian organisations has moved from data marts to data warehouses, data lakes, and now lakehouses.
The concept of the federated lakehouse, where data is accessed where it resides, is gaining traction. [ more ]
thenewstack.io
6 months ago
Data science

Integrating a Data Warehouse and a Data Lake

The Delta Lake open source project integrates data lakes and data warehouses to provide more performance and features in the data lake.
Delta Lake breaks down the barriers between data warehouses and data lakes by providing ACID transactions, RPI ingestions, and metadata scalability.
Databricks is working on providing ways for anyone to contribute their connectors through Delta Lake, allowing compatibility with different databases. [ more ]
thenewstack.io
6 months ago
Data science

Integrating a Data Warehouse and a Data Lake

The Delta Lake open source project integrates data lakes and data warehouses to provide more performance and features in the data lake.
Delta Lake breaks down the barriers between data warehouses and data lakes by providing ACID transactions, RPI ingestions, and metadata scalability.
Databricks is working on providing ways for anyone to contribute their connectors through Delta Lake, allowing compatibility with different databases. [ more ]
[ Load more ]