"Fabric was launched in 2023 as a unified cloud platform for data and analytics. Later that same year, mirroring was added, a feature that allows data from existing warehouses and databases to be added and managed without complex ETL processes or self-built data pipelines. With the latest update, organizations can replicate a snapshot of Oracle and BigQuery databases to OneLake, the lakehouse system within Fabric, where the copies remain synchronized with the source databases in near real time."
"According to Arun Ulag, senior vice president of Azure Data, a snapshot is taken on first use to serve as a baseline. From that point on, Fabric automatically keeps the database up to date, with a delay of less than five minutes. This, he says, eliminates the need for customers to maintain their own pipelines. However, there are some technical requirements."
"Microsoft emphasizes that customers do not incur any additional costs for the computing power required for mirroring. The company also provides storage in OneLake. Microsoft states that this approach makes data fully accessible and usable in open formats. To this end, Microsoft uses Apache Parquet and the Delta Lake open table format, which is native to OneLake. Support for Apache Iceberg has also been added. This is another open table format that is now widely used by parties such as Google and Snowflake."
Microsoft expanded Fabric to mirror Oracle and Google BigQuery, enabling replication of snapshots into OneLake with near-real-time synchronization. Mirroring takes an initial snapshot as a baseline, then updates the copied databases automatically, typically within five minutes, removing the need for customer-managed pipelines. On-premises or firewall-protected sources require a Fabric enterprise gateway for access. Microsoft supplies compute and OneLake storage for mirroring without additional customer charges, and stores data in open formats. Fabric uses Apache Parquet and Delta Lake and now supports Apache Iceberg. A new graph database is also being introduced to the platform.
Read at Techzine Global
Unable to calculate read time
Collection
[
|
...
]