Skip to content

[https://nvbugs/5836830][test] Remove DeepSeek-R1 W4AFP8 8-GPU quickstart test from QA list - #18979

Merged
brnguyen2 merged 1 commit into
NVIDIA:mainfrom
brnguyen2:user/brnguyen/remove-dsr1-w4afp8-test
Sep 10, 2026
Merged

[https://nvbugs/5836830][test] Remove DeepSeek-R1 W4AFP8 8-GPU quickstart test from QA list#18979
brnguyen2 merged 1 commit into
NVIDIA:mainfrom
brnguyen2:user/brnguyen/remove-dsr1-w4afp8-test

Conversation

@brnguyen2

@brnguyen2 brnguyen2 commented Sep 9, 2026

Copy link
Copy Markdown
Collaborator

Summary

Removes test_ptp_quickstart_advanced_deepseek_r1_w4afp8_8gpus[DeepSeek-R1-W4AFP8-DeepSeek-R1/DeepSeek-R1-W4AFP8] from the QA core test list and drops its now-orphaned SKIP waive.

Why

The test has been failing on Hopper (OOM while constructing the PyExecutor) and was SKIP-waived against nvbug 5836830. The bug is being retargeted to a later release, and QA no longer needs this case in the core list. The test function itself in test_e2e.py is left intact.

Changes

  • tests/integration/test_lists/qa/llm_function_core.txt — remove the test entry
  • tests/integration/test_lists/waives.txt — remove the orphaned SKIP (https://nvbugs/5836830) waive

Dev Engineer Review

Removes the failing DeepSeek-R1 W4AFP8 8-GPU test from the QA core list. Removes its obsolete nvbug 5836830 waiver. The test implementation remains intact, so no runtime code or API behavior changes occur.

QA Engineer Review

Removes test_e2e.py::test_ptp_quickstart_advanced_deepseek_r1_w4afp8_8gpus from tests/integration/test_lists/qa/llm_function_core.txt. Removes the matching SKIP waiver from tests/integration/test_lists/waives.txt. The test function remains in tests/integration/defs/test_e2e.py; no matching CI test-db/ entry was identified. Coverage is sufficient.

Per-File QA Perspective

  • tests/integration/test_lists/qa/llm_function_core.txt: Stops manual QA scheduling of the DeepSeek-R1 W4AFP8 8-GPU test, which fails with a Hopper OOM during PyExecutor construction.
  • tests/integration/test_lists/waives.txt: Removes the obsolete nvbug 5836830 SKIP waiver. No test behavior changes.

@brnguyen2
brnguyen2 requested a review from a team as a code owner September 9, 2026 21:55
@coderabbitai

coderabbitai Bot commented Sep 9, 2026

Copy link
Copy Markdown
Contributor

Review Change StackReview Change Stack

No actionable comments were generated in the recent review. 🎉

ℹ️ Recent review info
⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Enterprise

Run ID: 49e5e172-f021-4cc8-842a-7ee341c4fb84

📥 Commits

Reviewing files that changed from the base of the PR and between 5f7e4cc and 8e79b94.

📒 Files selected for processing (2)
  • tests/integration/test_lists/qa/llm_function_core.txt
  • tests/integration/test_lists/waives.txt
💤 Files with no reviewable changes (2)
  • tests/integration/test_lists/waives.txt
  • tests/integration/test_lists/qa/llm_function_core.txt

Included review availability: Your plan provides up to 12 included reviews per hour; 11 remain after this review.


Walkthrough

The pull request removes the DeepSeek R1 W4AFP8 eight-GPU PTP quickstart test from the QA test list and removes its corresponding skip configuration.

Changes

DeepSeek PTP test cleanup

Layer / File(s) Summary
Remove test and waive entries
tests/integration/test_lists/qa/llm_function_core.txt, tests/integration/test_lists/waives.txt
The QA entry and skip configuration for test_ptp_quickstart_advanced_deepseek_r1_w4afp8_8gpus were removed.

Priority: ⬇️ Low

Estimated code review effort: 1 (Trivial) | ~2 minutes

Merge Risk: ⚪ Minimal · up to 8e79b

This change removes an OOM-prone quickstart test and its associated waive entry; no concrete merge-blocking risk is identified.

🚥 Pre-merge checks | ✅ 5
✅ Passed checks (5 passed)
Check name Status Explanation
Title check ✅ Passed The title follows the required NVBugs and type format. It clearly identifies removal of the DeepSeek-R1 W4AFP8 8-GPU quickstart test from the QA list.
Description check ✅ Passed The description explains the reason for the change, identifies both modified files, and states that the test function remains intact. It does not include a separate Test Coverage section or completed …
Docstring Coverage ✅ Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check. Docstring coverage is scoped to functions touched by this diff. Analyzed 0 functions across 0…
Linked Issues check ✅ Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check ✅ Passed Check skipped because no linked issues were found for this pull request.
✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests

Comment @coderabbitai help to get the list of available commands.

@brnguyen2
brnguyen2 force-pushed the user/brnguyen/remove-dsr1-w4afp8-test branch from 47b2e90 to 5d12195 Compare September 9, 2026 21:59
…tart test from QA list

test_ptp_quickstart_advanced_deepseek_r1_w4afp8_8gpus has been failing on
Hopper (OOM while constructing the PyExecutor) and was SKIP-waived against
nvbug 5836830. The bug is being retargeted to a later release and QA no
longer needs this case in the core list.

Remove the test from the QA core list and drop the now-orphaned waive.

Signed-off-by: Brian Nguyen <brnguyen@nvidia.com>
@brnguyen2

Copy link
Copy Markdown
Collaborator Author

/bot run

@brnguyen2
brnguyen2 force-pushed the user/brnguyen/remove-dsr1-w4afp8-test branch from 5d12195 to 8e79b94 Compare September 9, 2026 22:10
@coderabbitai

coderabbitai Bot commented Sep 9, 2026

Copy link
Copy Markdown
Contributor

Note

GitHub couldn't provide a complete incremental comparison for this pull request, so CodeRabbit is performing a full review instead. This review may take a little longer.

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #72544 [ run ] triggered by Bot. Commit: 8e79b94 Link to invocation

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #72544 [ run ] completed with state SUCCESS. Commit: 8e79b94
/LLM/main/L0_MergeRequest_PR pipeline #59551 completed with status: 'SUCCESS'

CI Report

Link to invocation

@crazydemo crazydemo left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Review summary - Approve

Reviewed the full diff; no blocking or major issues found.

Automated review by NVCortex Lite, run by @crazydemo.

@github-actions

Copy link
Copy Markdown

Automatically added "ci: full pre-merge approved" because this PR has satisfied the required GitHub review approvals. Unresolved review conversations and other required checks remain independent merge requirements.

@brnguyen2
brnguyen2 merged commit 3150406 into NVIDIA:main Sep 10, 2026
15 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants