Apache Iceberg’s Hidden Superpowers: Governance, Experimentation, and Agentic Futures

Shekhar Prasad Rajak

English Session #datalake

Most Apache Iceberg talks wax poetic about time travel and ACID compliance—yawn. But what about the features nobody’s shouting about? The ones that turn chaos into control, experiments into wins, and static tables into agentic powerhouses - let your data platform think for itself ? Welcome, here we will learn Iceberg’s hidden toolkit.

Here’s the plan for our 30-minute dive: Start with a 5-minute intro on why Iceberg’s hidden gems outshine the basics. Spend 6 minutes on governance—snapshots for compliance, REST Catalog for dynamic control. Next, 6 minutes on branching—snapshots and Nessie for risk-free experimentation. Then, 5 minutes on metrics—reporting and scan stats to boost speed. Another 6 minutes on agentic Iceberg—REST Catalog plus Model Context Protocol (MCP), a futuristic vision where Iceberg collaborates with AI agents.

Speakers:


Shekhar is deeply passionate about open source software and actively contributes to various projects, including SymPy, Ruby gems like daru and daru-view (which he authored), Bundler, NumPy, and SciPy. He successfully completed Google Summer of Code in 2016 and 2017 and has served as an admin for SciRuby, mentoring multiple organizations. Shekhar has spoken at prominent conferences such as RubyConf 2018, PyCon 2017, ApacheCon 2020, and Community Over Code 2024, as well as numerous regional meetups. Currently, he works at Apple as a Software Development Engineer.