Skip to main content

Amazon Redshift Data Warehouse Modernization Playbook (2026): Zero-ETL, Serverless, and Spectrum

Data & AnalyticsUpdated Palaniappan P2 min read

Quick summary: For a retailer DW exit (~42 TB logical, 18 nightly Glue jobs), Aurora→Redshift zero-ETL retired 11 jobs and cut dashboard freshness from 6h to ~15 min. Concurrency scaling on zero-ETL (March 2026) absorbed Monday open spikes.

Key Takeaways

  • For a retailer DW exit (~42 TB logical, 18 nightly Glue jobs), Aurora→Redshift zero-ETL retired 11 jobs and cut dashboard freshness from 6h to ~15 min
  • Concurrency scaling on zero-ETL (March 2026) absorbed Monday open spikes
  • In March 2026, Redshift announced concurrency scaling support for auto-copy and zero-ETL, so ingest peaks can add compute instead of stalling dashboards (What's New)
  • It does not cover Serverless vs provisioned tier choice or the S3 Tables / Iceberg lake reference architecture, and it is not a Glue-only ETL tutorial
  • Benchmark silhouette (not a cited client): Retail analytics, legacy DW ~42 TB logical, 18 nightly Glue jobs, dashboard freshness ~6 hours
Amazon Redshift Data Warehouse Modernization Playbook (2026): Zero-ETL, Serverless, and Spectrum
Table of Contents

Zero-ETL integrations make operational data available in Amazon Redshift without you maintaining a classic ETL fleet for supported sources, including Aurora MySQL/PostgreSQL, RDS MySQL/PostgreSQL/Oracle, DynamoDB, and listed SaaS/apps (Redshift zero-ETL). In March 2026, Redshift announced concurrency scaling support for auto-copy and zero-ETL, so ingest peaks can add compute instead of stalling dashboards (What’s New).

This is the warehouse modernization playbook. It does not cover Serverless vs provisioned tier choice or the S3 Tables / Iceberg lake reference architecture, and it is not a Glue-only ETL tutorial.

Artifacts: path matrix, TCO worksheet, architecture diagram (draw.io).

Modernization sequence

  1. Assess: freshness SLOs, license cost, job inventory
  2. Land: zero-ETL for supported sources; Glue only for true transforms
  3. Size: Serverless default; RA3 if flat-high baseline (tier post)
  4. Park cold: S3 / Iceberg + Spectrum; lake detail in modern data lake post
  5. Cut over: BI first, then delete duplicate jobs

Opinionated take: Delete Glue jobs only after consumers read the zero-ETL schema for two billing cycles. Early deletion is how you recreate the pipeline under an incident bridge.

Reference flow

Aurora / RDS / DynamoDB ──► Zero-ETL ──► Redshift (Serverless or RA3)
On-prem / complex transforms ──► Glue ──► Redshift + S3
S3 cold / Iceberg ──► Spectrum / lake query ──► same BI tools

Target prerequisites include case sensitivity and IAM/resource policy setup (configure Redshift target).

Path matrix

Use modernization-path-matrix.md to choose Serverless vs RA3 vs zero-ETL vs Spectrum-heavy designs.

What broke: case sensitivity

What to do this week

  1. List every nightly job and tag replicate vs transform.
  2. Enable zero-ETL on one Aurora or RDS source into a Serverless workgroup.
  3. Turn on case sensitivity and confirm concurrency scaling eligibility in your Region.
  4. Fill the TCO worksheet with your license line items.

What this post doesn’t cover

  • Detailed Serverless RPU tuning (see tier-choice post)
  • Full lakehouse governance (SageMaker Catalog operating model)
  • Streaming-first architectures (Kinesis/MSK)
  • Oracle Exadata-specific exit tooling beyond DMA/partner programs

Frequently asked questions

When should we NOT use zero-ETL?
When the source is unsupported, you need heavy mid-flight transforms before analytics, or you only need a one-time historical dump. Use Glue/Spark or DMS-style pipelines for those cases.
Serverless or provisioned for the modern warehouse?
Default Serverless for spiky BI. Choose RA3 provisioned when baseline compute is flat and high 24×7. Details are in the Serverless vs provisioned post; this playbook focuses on the modernization program.
What could go wrong with zero-ETL cutover?
Case-sensitivity (`enable_case_sensitive_identifier`) left off on the Redshift target, missing IAM/resource policies, and assuming Glue jobs can be deleted before consumers switch. Validate row counts and critical metrics before decommissioning ETL.
Where does Spectrum fit?
Cold/historical data on S3 (including Iceberg/lake patterns). Keep hot facts in Redshift local/managed storage. Do not run your entire hot path through Spectrum.
How is this different from the modern data lake S3 Tables post?
That post designs the lake/Iceberg plane. This playbook modernizes the warehouse consumer plane and operational replication into Redshift.
Did concurrency scaling change zero-ETL behavior in 2026?
Yes. March 2026 GA added concurrency scaling support for auto-copy and zero-ETL ingestion on Serverless and RA3, which helps peak ingest without freezing BI reads.
Palaniappan P
Palaniappan P

AWS Cloud Architect & AI Expert

AWS-certified cloud architect and AI expert with deep expertise in cloud migrations, cost optimization, and generative AI on AWS.

AWS ArchitectureCloud MigrationGenAI on AWSCost OptimizationDevOps

Recommended Reading

Explore All Articles »