From Natural Language to Reliable Data Pipelines: Building an AI-Powered CLI for Apache SeaTunnel

Xin Zhang

Chinese Session 2026-08-09 15:15 GMT+8  (ROOM : Mtn WanShou Hall) #dataops

Modern DataOps is not only about moving data faster, but also about making pipeline development easier, safer, and more accessible to engineers and data teams. In this talk, I will introduce seatunnel-cli, a new Python-based CLI for Apache SeaTunnel that generates HOCON pipeline configurations directly from natural language descriptions in both English and Chinese.The tool is designed as an AI-powered multi-agent workflow: Planner, Config Generator, Validator, and Auto-fix. It combines a three-tier knowledge base, a connector catalog automatically generated from SeaTunnel Java source code, dry-run validation, and iterative repair to help users produce runnable pipeline configurations with less manual effort. It also supports multiple LLM providers, persistent session memory, interactive exploration, and single-shot scripting usage.I will share the technical design behind the CLI, including how we extract and resolve connector metadata at scale, how validation and auto-fix loops improve configuration quality, and how this approach can reduce the barrier to building SeaTunnel jobs in real-world DataOps scenarios. The session will also cover practical lessons from testing across multilingual inputs, multiple model providers, and broken-config recovery cases.

Speakers:


Xin Zhang: Amaozn Web Services, Solution Architect

Xin Zhang is an AWS Solutions Architect, responsible for solution consulting and design based on the AWS Cloud platform. He has a rich experience in R&D and architecture practice in the fields of system architecture, data warehousing, and real-time computing.