Skip to content

docs: F7 covers both CI flakes; second one ties to F10 - #165

Merged
jcschaff merged 1 commit into
mainfrom
docs/f7-second-flake
Sep 11, 2026
Merged

docs: F7 covers both CI flakes; second one ties to F10#165
jcschaff merged 1 commit into
mainfrom
docs/f7-second-flake

Conversation

@jcschaff

Copy link
Copy Markdown
Contributor

Summary

A second flake surfaced while merging #164 — itself a docs-only change — so F7 is no longer accurate as written.

The new one is a different failure mode. Docker Hub reset the connection while pulling postgres:15 for the testcontainer:

docker.errors.APIError: 500 Server Error ... fromImage=postgres
  Head "https://registry-1.docker.io/v2/library/postgres/manifests/15": ...
  read: connection reset by peer

A rerun passed. Nothing in the repo is at fault, and nothing in the repo defends against it either: no retry, no registry mirror, no pre-pull step.

What changed

  • F7 retitled and rewritten to cover both: the NATS producer/subscriber race (a race) and the image pull (an external dependency). Both were seen on docs-only PRs in one afternoon, which is the point — neither could have been caused by the change under review.
  • The rate is now stated correctly. Two of the nine tests that execute in CI are unreliable, roughly a 22% false-failure rate on the entire signal, not the 11% previously recorded.
  • New link to F10. platform's CI is coupled to third-party uptime through live API calls; ours through container image pulls. Same exposure, different door. Worth noting that any fix for F1 which adds containers widens this surface — the SLURM cluster in A4 pulls ~2.8 GB — so a mirror or pull-retry belongs inside that work rather than after it.
  • Group E gains the image-pull decision (retry, mirror, or explicitly accepted risk) next to the race fix.

Checked that no stale "single flaky test" or "eleven percent" wording survives elsewhere. make check clean; mkdocs build -s passes.

🤖 Generated with Claude Code

https://claude.ai/code/session_018TgVbCXXWAWhNjtKTzrxvN

A second flake surfaced while merging #164, a docs-only change: Docker Hub
reset the connection pulling postgres:15 for the testcontainer. A rerun
passed. That is a different failure mode from the NATS race already recorded
-- an external dependency rather than a race -- so F7 now documents both and
is retitled accordingly.

Two of the nine tests that actually execute in CI are therefore unreliable,
roughly a 22% false-failure rate on the entire signal. Both were observed on
docs-only PRs in one afternoon, so neither could have been caused by the
change under review.

The image-pull flake connects to F10: platform's CI is coupled to third-party
uptime through live API calls, ours through container image pulls. Same
exposure, different door, and neither repo defends against it -- no retry, no
registry mirror, no pre-pull. Noted that any fix for F1 which adds containers
widens this surface rather than narrowing it: the SLURM cluster in A4 pulls
about 2.8 GB, so a mirror or pull-retry belongs inside that work.

Group E gains the image-pull decision alongside the race fix.

Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_018TgVbCXXWAWhNjtKTzrxvN
@jcschaff
jcschaff merged commit 32f39e8 into main Sep 11, 2026
11 checks passed
@jcschaff
jcschaff deleted the docs/f7-second-flake branch September 11, 2026 21:37
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant