Follow Datanami:
April 6, 2023

Dremio Team Authoring O’Reilly’s Definitive Guide on Apache Iceberg

SANTA CLARA, Calif., April 6, 2023 — Dremio today announced the early release of its forthcoming O’Reilly book, Apache Iceberg: The Definitive Guide | Data Lakehouse Functionality, Performance, and Scalability on the Data Lake, which features the opening chapter in preview, with more to come. As the only book on Apache Iceberg, the comprehensive tome will include lessons for achieving interactive, batch, machine learning and streaming analytics, all without duplicating data into many different proprietary systems and formats.

Apache Iceberg provides the capabilities, performance, scalability and savings that fulfill the promise of an open data lakehouse. The recent Subsurface LIVE conference from Dremio highlighted Apache Iceberg’s emergence as the high performance open table format for various analytical workloads and the clear standard that is enabling data lakehouse architecture.

“Open source Apache Iceberg, which originated in Netflix engineering, continues to evolve as the preferred option for enterprises creating a modern data infrastructure,” said Dremio Developer Advocate Dipankar Mazumdar, one of the book’s authors. “This O’Reilly book will cover the architecture of Iceberg, optimization techniques and hands-on, real-world use cases with Iceberg, as well as how to use Iceberg with popular compute engines such as Apache Spark, Apache Flink and Dremio Sonar. We’re excited to share the book’s preview.” The other authors include Dremio CPO Tomer Shiran, Director of Technical Advocacy Jason Hughes, and Developer Advocate Alex Merced.

Apache Iceberg was also the star of Subsurface LIVE 2023. The conference from Dremio, which recently wrapped, featured a keynote address and panels with technology leaders from companies such as Apple, Uber, Wayfair, Pinterest, Shell, Shopify and many others.

Keynote – The Year of the Data Lakehouse: Enabling data lakehouse architecture, Apache Iceberg has grown at a tremendous rate with almost 40M downloads to emerge as the de facto standard open table format. Iceberg is currently supported by Amazon, Snowflake, Google, Tabular and Dremio, among others. A rapid rate of innovation is guaranteed by having the diverse community Iceberg now boasts.

Panel – The State of Apache Iceberg: Iceberg developers shared exciting use cases enabled by new features and discussed the future of the project. Panel participants also explained the benefits of open table formats, scalability and cost savings through Apache Iceberg, as well as the state of the community and adoption.

“The driver is about bringing ACID to the data lake, bringing better confidence in the data that we have there,” said Tony Baer, recognized data industry expert and principal of dbInsight, who moderated the panel. “Iceberg has been rapidly gaining industry support and will become one of the major lakehouse table formats to make the cut.”

To learn more about data lakehouse performance with Apache Iceberg, check out Dremio’s blogs:

About Dremio

Dremio is the easy and open data lakehouse, providing self-service analytics with data warehouse functionality and data lake flexibility across all of your data. Use Dremio’s lightning-fast SQL query service and any other processing engine on the same data. Dremio increases agility with a revolutionary data-as-code approach that enables Git-like data experimentation, version control, and governance. In addition, Dremio eliminates data silos by enabling queries across data lakes, databases, and data warehouses, and by simplifying ingestion into the lakehouse. Dremio’s fully managed service helps organizations get started with analytics in minutes, and automatically optimizes data for every workload. As the original creator of Apache Arrow and committed to Arrow and Iceberg’s community-driven standards, Dremio is on a mission to reinvent SQL for data lakes and meet customers where they are on their lakehouse journey.

Source: Dremio

Datanami

Share