RBIR: Rewrite Bigdata in Rust

Hao Ding

Chinese Session 2025-07-27 16:45 GMT+8  (ROOM : JingYi Hall) #rust

Rust is rapidly becoming a key player in data infrastructure, with many new big data systems being developed in Rust. This trend, known as “Rewrite Bigdata in Rust” (RBIR), aims to build a modern big data ecosystem using Rust. RBIR consists of three approaches: creating new Rust-based projects, re-implementing existing systems in Rust, and integrating Rust-powered components into other languages. The movement is driven by Rust’s thriving community, excellent tooling, and strong return on investment. This talk will explore the motivations behind RBIR, highlight successful projects, and discuss how developers can contribute to this growing ecosystem.

Speakers:


Hao Ding: ASF Member, Apache OpenDAL PMC Chair, Database Engineer at Databend Labs.

Hao Ding (as known as Xuanwo) is a passionate advocate for Data Freedom and an active contributor to the open-source community. As an ASF Member, Apache OpenDAL PMC Chair, and a mentor at the Apache Incubator, Xuanwo is dedicated to building an ecosystem where users can access ANY data, across ANY service, using ANY method, in ANY language.

With deep expertise in Rust and distributed data systems, Xuanwo actively contributes to and maintains multiple high-impact open-source projects, including:

opendal – A unified data access layer enabling seamless integration with diverse storage services. iceberg-rust – Rust implementations of Apache Iceberg. paimon-rust – Rust implementations of Apache Paimon. arrow-rs – The official Rust implementation of Apache Arrow. databend – A modern cloud data warehouse optimized for real-time analytics. sccache - Shared Compilation Cache written in rust.