Skip to content

docs: note that tests/smoketest.sh is not run by any CI workflow - #715

Open
UgaTheDev wants to merge 1 commit into
instructlab:mainfrom
UgaTheDev:docs/note-smoketest-sh-orphaned
Open

docs: note that tests/smoketest.sh is not run by any CI workflow#715
UgaTheDev wants to merge 1 commit into
instructlab:mainfrom
UgaTheDev:docs/note-smoketest-sh-orphaned

Conversation

@UgaTheDev

Copy link
Copy Markdown

docs/ci.md points at tests/smoketest.sh under "Smoke tests" without
saying whether CI runs it. It doesn't: smoke.yaml invokes
tox -e py3-smoke, which (tox.ini) runs pytest tests/smoke, never
tests/smoketest.sh. The script still covers axes the pytest matrix doesn't
(flash-attention on/off, Granite on/off, FSDP+LoRA), so it's not redundant —
just orphaned and easy to mistake for something CI already checks.

This adds one sentence making that explicit and pointing at #705, where the
consolidation question (fold smoketest.sh's cases into
test_training_feature_matrix, or delete it) is still open and needs a
maintainer decision — actually reconciling the two test surfaces is a bigger
change than a docs PR should carry.

Originally flagged in #705 (comment from 2026-07-29): "There's a second smoke test nobody runs... No workflow calls it anymore, since smoke.yaml invokes tox -e py3-smoke which only points at tests/smoke/. It's dead as far as CI goes but still checked in and still exercising real coverage."

One-line diff, docs/ci.md only.

docs/ci.md pointed at tests/smoketest.sh without saying whether CI runs
it. It doesn't: smoke.yaml runs tox -e py3-smoke, which only invokes
pytest tests/smoke, never smoketest.sh. The script still covers axes
the pytest matrix doesn't (flash-attention, Granite, FSDP+LoRA), so
it's orphaned rather than redundant. Notes that explicitly and points
at instructlab#705 where the consolidation question is still open.

Ref: instructlab#705

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Signed-off-by: Kush Zingade <kush.zingade@gmail.com>
@coderabbitai

coderabbitai Bot commented Aug 24, 2026

Copy link
Copy Markdown

Warning

Review limit reached

Next included review available in 59 minutes.

View limit details

Limit details: You’ve used the included review currently available.

You've used all free OSS reviews for now. Wait for the free limit to reset to keep reviewing this public repository.

Learn how review limits work.

Review configuration:

⚙️ Run configuration

Configuration used: defaults

Review profile: CHILL

Plan: Pro Plus

Run ID: e0a84d33-f392-4b7c-a8ac-5336bbf7d437

📥 Commits

Reviewing files that changed from the base of the PR and between da76404 and c85096b.

📒 Files selected for processing (1)
  • docs/ci.md

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant