Abstract:

This presentation introduces a paradigm shift for China Mobile Cloud DataStudio : building a next-generation Federated Data Fabric by integrating Apache SeaTunnel (the high-performance data engine) with Apache Gravitino (the unified metadata brain).

By decoupling metadata governance from data execution, we achieve a true Zero-ETL experience. Gravitino provides centralized catalogs, security, and schema governance, while SeaTunnel executes ultra-fast, distributed data synchronization based on these policies.

Key Innovations:

• Zero-Config Integration: Metadata-driven pipelines eliminate manual configurations.
• Automated Schema Evolution: Secure, governed DDL changes across data lakes.
• Real-Time Lineage: 100% accurate column-level lineage captured during data movement.
• Unified Security: Cross-cloud, token-based data access for enterprise compliance. Together, they empower DataStudio to deliver a highly secure, agile, and intelligent Lakehouse architecture for the multi-cloud era.

Speakers:

li jie: cmss-suzhou-engineer

Dec. 2024 – Present | Mobile Cloud