Skip to content
Draft
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
106 commits
Select commit Hold shift + click to select a range
870a68e
Changed VERSION to 2.19.0.dev0 (#3228)
KshitijLakhani Jul 21, 2026
622a3ee
[PyTorch] NCCL EP zero copy with symmem pool and user provided recv_t…
YangFei1990 Jul 21, 2026
73c72ff
[Common] Migrate NCCL EP submodule to NVIDIA/nccl-extensions (#3222)
phu0ngng Jul 22, 2026
098b496
[PyTorch] Enable fused FP8 block-scaling path in GroupedLinear module…
denera Jul 22, 2026
8280f02
Fix nccl-extensions submodule name (#3239)
phu0ngng Jul 22, 2026
7b55d30
[JAX] Schedule EP dispatch/combine on XLA collective stream (#3231)
phu0ngng Jul 22, 2026
c9a1f5a
Generalized Tensor Parallelism (GTP) (#3005)
fanshiqing Jul 22, 2026
8abfa2e
Update list of authorized CI users (#3241)
timmoon10 Jul 22, 2026
4adad4c
[Common] Fix Build: NCCL EP build to respect `MAX_JOBS` (#3138)
phu0ngng Jul 22, 2026
c39f36d
Build Fix: Avoid invalid make -j 0 in NCCL EP submodule build (#3243)
phu0ngng Jul 23, 2026
debab90
[JAX] Support axes orthogonal to EP in ep_bootstrap via mesh-derived …
phu0ngng Jul 23, 2026
0d1594a
[Common/PyTorch] bugfix: Token-linear fused RoPE impl. for THD tensor…
plugyawn Jul 23, 2026
6c9a604
[PyTorch][torch.compile] Make get_attention_backend traceable without…
pggPL Jul 23, 2026
c0f0bdb
[PyTorch] Enable FP8 block scaling for fusible ops (#3242)
denera Jul 23, 2026
f037a7e
[PyTorch][torch.compile] DotProductAttention: declarative packed QKV/…
pggPL Jul 23, 2026
5d51790
[JAX] Keep MoE aux-loss cotangent scalar (#3237)
tdophung Jul 24, 2026
0c8cf2c
[PyTorch][torch.compile] Support for UnfusedDotProductAttention (#3201)
pggPL Jul 24, 2026
bb5d5f4
Enable Weight Preswizzling only when Swizzle fusion is available (#3232)
vthumbe1503 Jul 24, 2026
ea41e08
[Common] Make MXFP8 specialized kernel respect noop flag as well (#3246)
kainzhong Jul 24, 2026
f1d5f8d
[PyTorch][common] NVFP4: enable row-scaled transpose quantization for…
cael-ling Jul 25, 2026
cf4e534
fix(pytorch): add missing f-string prefixes to error messages (#3256)
andrewwhitecdw Jul 27, 2026
65bdbe3
[CI] Minor CMake refactoring (#3227)
fheinecke Jul 27, 2026
35eef89
Single grouped weight fixes (#3225)
CarlosGomes98 Jul 27, 2026
3c4f9af
[PyTorch] Allow multi-version Flash Attention tests to use checkpoint…
timmoon10 Jul 27, 2026
994adb4
[PyTorch] Fix NCCL communicator init in cuSOLVERMp context creation (…
vcherepanov-nv Jul 27, 2026
c7766dd
[CI] Fix old NVCC dependency in GH CI (#3230)
fheinecke Jul 27, 2026
98524e5
[PyTorch] NCCL EP eager mode and drop-on-overflow policy (#3229)
phu0ngng Jul 27, 2026
8685aa0
[PyTorch] Fix shape and size() for columnwise-only quantized tensors …
pggPL Jul 28, 2026
5767680
Opt in trusted FA CI checkpoints to pickle loading (#3247)
sudhakarsingh27 Jul 28, 2026
591a625
Make NVTE tensor handle pool size configurable (#3090)
lhb8125 Jul 28, 2026
37d03ba
test(pytorch): cover QuantizedTensor view NotImplementedError (#3257)
andrewwhitecdw Jul 28, 2026
6d3280c
[JAX] Add attention tutorials (#3162)
KshitijLakhani Jul 28, 2026
64da9f5
[Bugfix][PyTorch][FlashAttention][CP] Honor requested FA padding in C…
sudhakarsingh27 Jul 29, 2026
8c606ca
[PyTorch] Build the attention padding mask without host syncs (#3268)
pggPL Jul 29, 2026
3e7ae6c
Single group mxfp8 grouped mlp (#3267)
sraman-rgb Jul 29, 2026
6bafd34
Acquire the GIL in lazy init_extension (#3255)
xiuhu17 Jul 29, 2026
0ee1320
[Common, PyTorch] Improve mHC to match DeepSeek's implementation (#2978)
kainzhong Jul 29, 2026
4e755d8
Add capture_time_hooks to make_graphed_callables for non-capturable p…
buptzyb Jul 29, 2026
096f054
Bugfix spec check for DP+FSDP configurations (#3272)
dinodeep Jul 29, 2026
a6c70f4
Fix CUDA graph parameter grad lifetime (#2937)
buptzyb Jul 30, 2026
5a9bcd9
Add cuDNN FE to source build requirements (#3278)
vcherepanov-nv Jul 30, 2026
869f99c
Avoid unit probability tensors in grouped MLP quant GEMMs (#3293)
sraman-rgb Jul 31, 2026
2884b76
[PyTorch][CI] Connect test files that are not wired into qa, fix the …
pggPL Jul 31, 2026
60697de
Update list of authorized CI users (#3292)
timmoon10 Jul 31, 2026
91d53a0
[JAX] Bump collective stream min JAX version to 0.10.1 (#3295)
phu0ngng Jul 31, 2026
40cd2a3
Add opt-in reduced precision output for cuDNN MXFP8 norm (#3288)
sraman-rgb Jul 31, 2026
bffde8f
[JAX] [PyT] [Common] Enable D=256 BWD cuDNN fused attn for Blackwell …
KshitijLakhani Jul 31, 2026
a9e635a
[CI] Pin JAX image to 2026-07-21 (#3250)
fheinecke Aug 3, 2026
6b23ad3
[Common] Remove `nv-internal-*` comments (#3280)
ksivaman Aug 3, 2026
cb7e2de
Pin nltk to work around breaking change in tests (#3306)
fheinecke Aug 3, 2026
72f4e23
[JAX] EP Dispatch with overflow detection option (#3277)
phu0ngng Aug 4, 2026
82a0f6e
[JAX] Add NLTK pin <3.10.1 in encoder requirements (#3314)
aybchan Aug 4, 2026
429c1bc
Fix typo in contribution guidelines (#3308)
cupkk Aug 4, 2026
bce8162
[Pytorch][Common] Hybrid quantization (#2817)
negvet Aug 4, 2026
c71c2ca
[Common] Enable arch support for Rubin (#3275)
denera Aug 4, 2026
d35eedf
[PyTorch] Add architecture gate to NVFP4 split_quantize RHT path (#3265)
davidkny22 Aug 4, 2026
af1ed44
[Pytorch] [NCCL EP] Allow zero tokens for an EP rank in eager mode (#…
YangFei1990 Aug 5, 2026
8ff60f8
Enable THD with hierarchical context parallelism (#3290)
sudhakarsingh27 Aug 5, 2026
bf4b2b9
[PyTorch][torch.compile] Add TensorProto mechanism (#3153)
pggPL Aug 5, 2026
4ff5fdf
[common] Fix UE8M0 code 0 (2^-127) and code 255 (NaN) expansion in pt…
xiuhu17 Aug 5, 2026
a7aec21
[Pytorch] Add function to check if EP is bootstrapped (#3321)
YangFei1990 Aug 5, 2026
66b6d25
[JAX] Migrate EP collective-stream annotation to region-based compute…
phu0ngng Aug 6, 2026
46e0edf
[PyTorch]Fused ScaledActivation Kernel in TE Ops and reducing CPU ove…
vthumbe1503 Aug 6, 2026
dd96595
Add support for fused Q Up-Proj GEMM/RoPE/Quant. (#3303)
chaseblock Aug 7, 2026
da28058
[Pytorch] Add support for row-wise quanted input for grouped gemm (#3…
YangFei1990 Aug 7, 2026
8260f49
Use a temp directory for CMake build (#3254)
fheinecke Aug 7, 2026
731f242
[PyTorch] Preserve FP8 recompute state for inner autocast (#3284)
nvegesna-netizen Aug 10, 2026
32f7096
[JAX][Fix] Gate collective-stream compute_on on import and silence py…
phu0ngng Aug 10, 2026
598b9ea
[Bug] use_single_group_runtime_offsets arg is not supported for Scale…
vthumbe1503 Aug 10, 2026
f07a860
[Common] Fix pointer arithmatic to generate correct LDS/STS instructi…
kainzhong Aug 10, 2026
07e281f
[Common] MXFP8: Add swizzled-scale fast path for cast-only quantizati…
WanZzzzzz Aug 11, 2026
b54bb1e
Enable runtime resolution of CUDA header path for NVRTC (#3252)
fheinecke Aug 11, 2026
56a05e7
[Common][PyTorch] EP dispatch with unfused MXFP8 quantization (#3270)
phu0ngng Aug 12, 2026
734ce31
[PyTorch] Advance FusedAdam step counter for empty param groups (#3318)
adityasingh2400 Aug 12, 2026
fc1fc0e
[Common] Fix NVFP4 stochastic rounding on architectures without cvt.r…
davidkny22 Aug 12, 2026
1ad30c6
[Pytorch] Fix swizzle scale output shape in variable shape case (#3344)
YangFei1990 Aug 12, 2026
779f17d
[Common] Upgrade nccl-extensions commit (#3349)
phu0ngng Aug 12, 2026
2d80391
Improve device-init grouped linear module with single grouped weight …
zhongbozhu Aug 12, 2026
67c26e2
fix: allgather striped window_size (5,0) id says (8,0) (#3374)
andrewwhitecdw Aug 13, 2026
910be8b
fix: remove redundant second export of XLA_FLAGS in L0 (#3377)
andrewwhitecdw Aug 13, 2026
900ac82
fix: remove unused `import time` (#3364)
andrewwhitecdw Aug 13, 2026
7d0365b
Stabilize FlashAttention CI environments (#3341)
sudhakarsingh27 Aug 13, 2026
c280e7c
fix: typo and unnecessary f-string in BRCM skip message (#3370)
andrewwhitecdw Aug 13, 2026
a22f4cd
[Pytorch] Enable TE Op to consume extra_outputs from a previously run…
vthumbe1503 Aug 13, 2026
d8815c4
Add 2d quant for mxfp8 (#2634)
kunlunl Aug 13, 2026
621da35
[PyTorch] Enable NVFP4 row-scaled (per-token) backward for GroupedLin…
cael-ling Aug 14, 2026
86e3487
[JAX] Move ffi type definition before ffi target definitions (#3382)
jberchtold-nvidia Aug 14, 2026
a0a2d08
Fix FlashAttention local version validation (#3356)
vcherepanov-nv Aug 14, 2026
e61a2fb
[Pytorch] Optimize CPU overhead for NCCL EP eager mode (#3378)
YangFei1990 Aug 15, 2026
172bd93
[Common] Ensure quantization kernels handle noop properly (#3271)
kainzhong Aug 15, 2026
55b2cba
Change VERSION to 2.19.0
fheinecke Aug 17, 2026
bcc72f3
[JAX] Support synchronous collectives in HLO collective bytes assert …
jberchtold-nvidia Aug 18, 2026
245b9ff
[JAX] SBHD reorder skip uses original shape instead of swapped tensor…
andrewwhitecdw Aug 19, 2026
176ba83
[JAX] Bump min compute_on version (#3406)
jberchtold-nvidia Aug 20, 2026
867fa95
Fix build issues with 26.08 JAX container images (#3404)
fheinecke Aug 20, 2026
08d6906
Loosen fp16 atol in ONNX export tests for onnxruntime 1.29 CPU numeri…
pggPL Aug 20, 2026
396ab31
[PyTorch][CI] Surface comm overlap rank errors (#3384)
sudhakarsingh27 Aug 21, 2026
b447576
[PyTorch][Test-Fix] Scale test_multi_process_ep outer timeout with la…
phu0ngng Aug 22, 2026
ca49c3a
Disable async on distributed softmax test on 8x GPU jobs due to bug w…
fheinecke Aug 24, 2026
1d5d725
[JAX] Return max_logit from TE fused attn (#3112)
KshitijLakhani Aug 25, 2026
d1905b6
[PyTorch] Add newton_schulz_tp optimizer step function (#2920)
vcherepanov-nv Aug 25, 2026
330fefa
[JAX] Fix counting of synced and wrapped (async, fusion) collectives …
aybchan Aug 21, 2026
42e953e
[JAX] Fix classification of sync-tagged collective start instructions…
KshitijLakhani Aug 26, 2026
d483de5
Plumb FP8+THD (#2994)
sudhakarsingh27 Aug 26, 2026
0bf88ec
[JAX] Optimize MoE block (#3354)
jberchtold-nvidia Aug 27, 2026
9afa5c8
[ROCm] IFU v2.19: Resolve merge conflicts and adapt for ROCm
matthiasdiener Aug 28, 2026
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
18 changes: 12 additions & 6 deletions .github/workflows/build.yml
Original file line number Diff line number Diff line change
Expand Up @@ -16,13 +16,16 @@ jobs:
name: 'Core'
runs-on: ubuntu-latest
container:
image: nvcr.io/nvidia/cuda:12.1.0-devel-ubuntu22.04
image: nvcr.io/nvidia/cuda:12.9.2-devel-ubuntu22.04
options: --user root
steps:
- name: 'Dependencies'
run: |
apt-get update
apt-get install -y git python3.9 pip cudnn9-cuda-12
apt-mark unhold libnccl2 libnccl-dev
apt-get install -y git python3 python3-pip cudnn9-cuda-12 \
libnccl2=2.30.7-1+cuda12.9 \
libnccl-dev=2.30.7-1+cuda12.9
pip install cmake==3.21.0 pybind11[global] ninja "nvidia-cudnn-frontend>=1.25.0"
- name: 'Checkout'
uses: actions/checkout@v3
Expand Down Expand Up @@ -70,13 +73,16 @@ jobs:

- name: Start named container
run: |
docker run -v $(pwd):$(pwd) -w $(pwd) --name builder -d nvcr.io/nvidia/cuda:12.8.0-devel-ubuntu22.04 sleep infinity
docker run -v $(pwd):$(pwd) -w $(pwd) --name builder -d nvcr.io/nvidia/cuda:12.9.2-devel-ubuntu22.04 sleep infinity

- name: 'Dependencies'
run: |
docker exec builder bash -c '\
apt-get update && \
apt-get install -y git python3.9 pip cudnn9-cuda-12 && \
apt-mark unhold libnccl2 libnccl-dev && \
apt-get install -y git python3 python3-pip cudnn9-cuda-12 \
libnccl2=2.30.7-1+cuda12.9 \
libnccl-dev=2.30.7-1+cuda12.9 && \
pip install cmake torch ninja pydantic importlib-metadata>=1.0 packaging pybind11 numpy einops onnxscript "nvidia-cudnn-frontend>=1.25.0" && \
apt-get clean \
'
Expand All @@ -92,7 +98,7 @@ jobs:
name: 'JAX'
runs-on: ubuntu-latest
container:
image: ghcr.io/nvidia/jax:jax
image: ghcr.io/nvidia/jax:jax-2026-07-21
options: --user root
steps:
- name: 'Dependencies'
Expand Down Expand Up @@ -143,7 +149,7 @@ jobs:

- name: Start named container
run: |
docker run -v $(pwd):$(pwd) -w $(pwd) --name builder -d ghcr.io/nvidia/jax:jax sleep infinity
docker run -v $(pwd):$(pwd) -w $(pwd) --name builder -d ghcr.io/nvidia/jax:jax-2026-07-21 sleep infinity

- name: 'Dependencies'
run: |
Expand Down
2 changes: 2 additions & 0 deletions .github/workflows/trigger-ci.yml
Original file line number Diff line number Diff line change
Expand Up @@ -62,6 +62,8 @@ jobs:
|| github.actor == 'jomitchellnv'
|| github.actor == 'fheinecke'
|| github.actor == 'janekb04'
|| github.actor == 'YangFei1990'
|| github.actor == 'sraman-rgb'
)
steps:
- name: Check if comment is issued by authorized person
Expand Down
6 changes: 3 additions & 3 deletions .gitmodules
Original file line number Diff line number Diff line change
Expand Up @@ -30,6 +30,6 @@
[submodule "3rdparty/ck_jit"]
path = 3rdparty/ck_jit
url = https://github.com/ROCm/ck-jit.git
[submodule "3rdparty/nccl"]
path = 3rdparty/nccl
url = https://github.com/NVIDIA/nccl.git
[submodule "3rdparty/nccl-extensions"]
path = 3rdparty/nccl-extensions
url = https://github.com/NVIDIA/nccl-extensions.git
1 change: 0 additions & 1 deletion 3rdparty/nccl
Submodule nccl deleted from b87848
1 change: 1 addition & 0 deletions 3rdparty/nccl-extensions
Submodule nccl-extensions added at 9f47d6
2 changes: 1 addition & 1 deletion CONTRIBUTING.rst
Original file line number Diff line number Diff line change
Expand Up @@ -13,7 +13,7 @@ Coding Guidelines
-----------------

* We follow `Google C++ Style Guide <https://google.github.io/styleguide/cppguide.html>`_. When no
rules can be found, follow the already occuring conventions. If there is no precedence in our
rules can be found, follow the already occurring conventions. If there is no precedence in our
codebase we are open to discussion.
* Prior to your contribution, please make sure that the code passes the linter check. We do both C++
and Python linting. To invoke the check, please use
Expand Down
2 changes: 1 addition & 1 deletion README.rst
Original file line number Diff line number Diff line change
Expand Up @@ -510,7 +510,7 @@ System Requirements
* Compiler: GCC 9+ or Clang 10+ with C++17 support
* Python: 3.12 recommended

* **Source Build Requirements:** CMake 3.18+, Ninja, Git 2.17+, pybind11 2.6.0+
* **Source Build Requirements:** CMake 3.18+, Ninja, Git 2.17+, pybind11 2.6.0+, nvidia-cudnn-frontend 1.25.0+

* **Notes:** FP8 features require Compute Capability 8.9+ (Ada/Hopper/Blackwell)

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -13,21 +13,21 @@

Example:

python benchmarks/linear/benchmark_graph_safe_grouped_linear.py
python benchmarks/linear/benchmark_graph_safe_grouped_mlp.py

Forward-only:

python benchmarks/linear/benchmark_graph_safe_grouped_linear.py --fwd-only
python benchmarks/linear/benchmark_graph_safe_grouped_mlp.py --fwd-only

Nsight Systems:

(optionally: unset DEBUGINFOD_URLS)

nsys profile \
--output=./benchmarks/linear/graph_safe_grouped_linear_mxfp8 \
--output=./benchmarks/linear/graph_safe_grouped_mlp_mxfp8 \
--force-overwrite true \
--trace=cuda,nvtx,cudnn,cublas \
python benchmarks/linear/benchmark_graph_safe_grouped_linear.py --profile
python benchmarks/linear/benchmark_graph_safe_grouped_mlp.py --profile
"""

# Match the Qwen MXFP8 SFT launch toggles before importing TE.
Expand Down
Loading
Loading