Skip to content

docs: make test readability requirements explicit - #810

Merged
alexanderbianchi merged 1 commit into
mainfrom
codex/testing-guidelines
Oct 28, 2026
Merged

alexanderbianchi merged 1 commit into
mainfrom
codex/testing-guidelines

Conversation

@alexanderbianchi

Copy link
Copy Markdown
Collaborator

Tests have repeatedly hidden their configuration or expected behavior behind helpers, loops, and separate snapshot files. Add concrete test-design rules to AGENTS.md: make scenarios readable in place, share infrastructure without hiding intent, exercise public behavior, and keep coverage focused.

Align the Iceberg and contributor testing guides so their advice to keep tests small does not encourage hiding the scenario. Prefer existing configuration hooks and compact inline snapshots, while allowing fixture loops, focused unit tests, and external snapshots when appropriate.

The rules synthesize recurring review feedback:

Validation: git diff --check; verified relative links and the target heading. Documentation only; no runtime tests run.

Developed with AI assistance.

@alexanderbianchi
alexanderbianchi merged commit 9569b7e into main Oct 28, 2026
38 checks passed
@alexanderbianchi
alexanderbianchi deleted the codex/testing-guidelines branch October 28, 2026 17:25
gabotechs added a commit that referenced this pull request Oct 30, 2026
## Summary

The Deploy Documentation workflow has been failing on every push to
`main` since #810. That PR added a relative link to `../../../AGENTS.md`
in `docs/source/contributor-guide/03-tests.md`. The link points outside
the Sphinx source tree, so MyST emits a `myst.xref_missing` warning, and
the build fails because warnings are treated as errors:

```
docs/source/contributor-guide/03-tests.md:61: WARNING: Unknown source document '.../AGENTS' [myst.xref_missing]
```

This replaces it with the absolute GitHub URL. The other
contributor-guide pages already link this way to repo files outside
`docs/`, such as the benchmarks README.

## Validation

`make html` in `docs/` with `docs/requirements.txt` installed: `build
succeeded.`, no warnings.

🤖 Generated with [Claude Code](https://claude.com/claude-code)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants