Skip to content

chore(stats): retire legacy s3 lake - #52515

Merged
adamdotdevin merged 1 commit into
devfrom
remove-s3-lake
Oct 2, 2026
Merged

adamdotdevin merged 1 commit into
devfrom
remove-s3-lake

Conversation

@adamdotdevin

@adamdotdevin adamdotdevin commented Oct 1, 2026 •

Copy link
Copy Markdown
Member

Issue for this PR

Legacy S3 lake retirement; no separate issue.

Type of change

  • Refactor / code improvement

What does this PR do?

Remove the retired S3 table, catalog, Athena workgroup, query results and delivery-error bucket. Move LakeVpc and LakeCluster into stats.ts with the same names and arguments so R2 stats sync keeps its deployed network and service.

The production raw archive is fully verified: 20,772,423,321 records, 378 date/type groups and all original fields. Development history and delivery failures are also preserved in R2. Analytics removal is complete in anomalyco/anomaly#676; the inference reader is deployed in anomalyco/anomaly#677 and #679. The normal scheduled hourly refresh and archive/live Requests rebuild succeeded on the new reader. Obsolete inference AWS bindings and repository credentials are removed. The three requested manual checks remain on hold, with their published data unchanged.

How did you verify your code works?

Dev and production previews add exactly seven expected lake deletions compared with unchanged-source previews. Builder, image and task revisions also appear in both baselines; the VPC, cluster and ECS service are preserved. All hosted checks pass. Both current stats-sync services are healthy and read R2 generation data. Full raw readback and representative hourly, boundary, Financials, User Cost and monthly Requests controls pass; the complete latest mixed-source Requests collector also passes read-only production queries.

Screenshots / recordings

No UI change.

Checklist

  • I have tested my changes locally
  • I have not included unrelated changes in this PR

@adamdotdevin adamdotdevin changed the title chore(stats): remove the S3 data lake chore(stats): retire legacy s3 lake Oct 1, 2026
@adamdotdevin
adamdotdevin marked this pull request as ready for review October 2, 2026 03:21
@adamdotdevin
adamdotdevin merged commit 1ddb087 into dev Oct 2, 2026
16 checks passed
@adamdotdevin
adamdotdevin deleted the remove-s3-lake branch October 2, 2026 03:21
@adamdotdevin adamdotdevin mentioned this pull request Oct 2, 2026
3 tasks done
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant