guide
guide5 min read

AI Agents for Amazon S3 Tables and Apache Iceberg on AWS

S3 Tables manage the Iceberg storage. Data Workers agents manage the work around it: schema changes, backfills, quality and access.

AI agents for Amazon S3 Tables and Apache Iceberg take on the work that table storage cannot: catching a schema change before it breaks readers, backfilling the right partitions after a bad load, keeping quality checks honest and handling access requests. S3 Tables already manage the Iceberg storage layer for you.

Data Workers manages the operations around those tables across Glue, Athena, EMR, Redshift and the tools that read them.

Key Takeaways

  • •S3 Tables are managed Iceberg tables on S3. AWS handles table maintenance and has kept adding Iceberg v3 features, streaming ingestion from Kinesis and direct query from Amazon Quick.
  • •The awslabs S3 Tables MCP server gives coding agents table access, read-only unless --allow-write is set.
  • •Iceberg makes schema evolution safe for the table. It does not make it safe for every Glue job, Redshift query and dashboard that reads the table.
  • •Data Workers agents map every reader of an Iceberg table, catch breaking changes in review, run scoped backfills behind approval and verify the result.
  • •Your tables stay in your S3 table buckets, registered where they are today.

What S3 Tables give you

FeatureWhat it doesWhen
Managed Iceberg tablesTable buckets with built-in table maintenanceGA
Iceberg v3 data typesVariant (Jul 2026), then all Iceberg v3 data typesSep 30, 2026
Kinesis streaming tablesKinesis Data Streams deliver straight into S3 TablesAug 2026
Amazon Quick direct queryDashboards read S3 Tables without a copyMay 2026
S3 Tables MCP server (awslabs)Coding-agent access to table buckets and tables; read-only unless --allow-writeAvailable

That covers the storage side well. It is a big reason more AWS teams are moving their lake to S3 Tables.

The work S3 Tables leave to your team

Schema changes with readers you can't see. Iceberg lets you add, rename and drop columns without rewriting data. The table is fine. The Glue job that selects the old name, the Athena view with SELECT *, the Redshift Spectrum query and the Quick dataset are not. Nobody has the full reader list in one place.

Backfills after a bad load. When a Glue job or a stream writes bad rows into an Iceberg table, the fix is a scoped rewrite of the affected partitions, a rebuild of the models that read them, and a check that the downstream numbers match. Iceberg's snapshots help you roll back; deciding what to rewrite and in what order is still manual.

Quality across engines. The same table is read by Athena, EMR, Redshift and dbt. A null spike or a volume drop needs to be caught once and traced to its source, not discovered separately in each engine.

Access to the right rows and columns. Lake Formation governs who can read what. The requests to change that pile up in a queue.

How Data Workers agents work on S3 Tables

Data Workers connects to S3 Tables over the S3 Tables MCP server, and to the Glue Data Catalog, Lake Formation, Redshift and DMS over the AWS API or MCP servers. The Data Context Wizard builds lineage from each source through the Iceberg table to every reader.

  • •Schema evolution with a reader list. The Schema Evolution agent reads the proposed change, whether a dbt model, a Glue job or a DDL statement, and lists every downstream reader that would break, with owners. The fix for each reader is proposed before the column changes.
  • •Scoped backfills. When bad data lands, the Incident Debugging agent finds the affected snapshots and partitions, and the Pipeline Building agent drafts the rewrite and the downstream rebuild as one approved change.
  • •Quality checked once, traced to the source. The Quality Monitoring agent watches freshness, volume and values on the table and ties anomalies to the job or stream that caused them.
  • •Streaming tables too. For Kinesis streaming tables, the Streaming agent watches delivery and lag next to the batch jobs that read the same table.
  • •Access through Lake Formation. The Data Access Governance agent proposes least-privilege grants on Iceberg tables for Lake Formation to apply.

Every change records why it was made, what it touched, who approved it and how to undo it, which pairs naturally with Iceberg's own snapshot history.

A column rename on an Iceberg table

This is an illustration, not a customer case.

  1. 1.A dbt pull request renames customer_tier to loyalty_tier in a model that writes an S3 Tables table.
  2. 2.Data Workers lists the readers: an Athena view used by support, a Glue export to a partner bucket, a Redshift query behind the finance mart and a Quick dataset.
  3. 3.The pull request gets the reader list and a proposed fix for each, plus the rollback plan.
  4. 4.After the owners approve, the change ships with the reader fixes. Data Workers checks that each reader returns the expected rows and records the receipt.

Without step 2, the rename is safe for the table and breaks four things the next morning.

Getting started

Connect Data Workers read-only to your S3 table buckets, the Glue Data Catalog and Lake Formation, plus your dbt project and orchestrator. In observe mode you get lineage through every Iceberg table and an impact report on every schema change. Move schema changes to propose mode first; that is where the biggest wins are. For background on the format itself, see Apache Iceberg for data engineering, and for the full AWS picture, agentic data engineering on AWS.

Frequently Asked Questions

Do S3 Tables need AI agents if AWS already manages the tables?

S3 Tables manage the storage layer: table maintenance and Iceberg features. Agents handle the operational work around the tables: schema changes that affect readers, backfills, cross-engine quality and access requests.

Can AI agents handle Iceberg schema evolution safely?

Yes, when they can see every reader. Data Workers maps each Iceberg table's readers across Glue, Athena, EMR, Redshift and BI, and proposes the reader fixes before the column changes.

Does Data Workers work with the S3 Tables MCP server?

Yes. Data Workers connects to S3 Tables over the S3 Tables MCP server, and your engineers can keep that server in their own coding agent too.

Does Data Workers copy our Iceberg data?

No. Your tables stay in your table buckets. Data Workers stores metadata and PII-redacted facts about your data, not copies of your tables.

Sources