What is this delta lake thing?
Aug 24, 2022 12:00 AM

What is this delta lake thing?

External YouTube Channel

You may be using a lake for your data and it may just be regular parquet files. In this video, Stijn joins us to explain why you should be using a delta lake instead and how this works in Azure Synapse Analytics.

Azure Synapse Analytics is compatible with Linux Foundation Delta Lake. Delta Lake is an open-source storage layer that brings ACID (atomicity, consistency, isolation, and durability) transactions to Apache Spark and big data workloads.

https://docs.microsoft.com/en-gb/azure/synapse-analytics/spark/apache-spark-what-is-delta-lake

Delta Lake is an open source project that enables building a Lakehouse architecture on top of data lakes. Delta Lake provides ACID transactions, scalable metadata handling, and unifies streaming and batch data processing on top of existing data lakes, such as S3, ADLS, GCS, and HDFS.

https://docs.delta.io/latest/delta-intro.html