All pull requests

Pull requests

• Recover legacy Torch checkpoints in zero_to_fp32

  #8901·Levius-Fubuki opened Oct 24, 2026·

  ·

• Use nvtx's module-level API so NVTX domain ranges work on older nvtx releases

  #8900·hwchen2017 opened Oct 24, 2026Contributor·

  ·
  1

• Complete ZeRO-3 serial checkpoint handoff for universal loads and rank boundaries

  #8898·Levius-Fubuki opened Oct 24, 2026·

  ·
  2

• Validate ZeRO checkpoint DP size before serial-load synchronization

  #8897·Levius-Fubuki opened Oct 24, 2026·

  ·
  2

• Stop the comms logger exiting on all_gather_object and monitored_barrier

  #8896·vineethsaivs opened Oct 23, 2026Contributor·

  ·

• Fix inference normalization row bounds and small-channel dispatch

  #8895·wpyaoxueros opened Oct 23, 2026·

  ·

• Vectorize partition_balanced dynamic programming inner loop

  #8893·deep1blue opened Oct 22, 2026·

  ·
  1

• Restore fp32 masters for ZeRO-3 and the ZeRO-1 BF16 optimizer

  #8892·sfc-gh-truwase opened Oct 22, 2026Collaborator·1 of 2 tasks·

  ·
  6

• Keep fp32 masters on ZeRO-1 and ZeRO-2 when a resume skips optimizer state

  #8891·sfc-gh-truwase opened Oct 22, 2026Collaborator·1 of 2 tasks·

  ·
  8

• [BUG] Fix universal checkpoint resume device/dtype mismatch for fused/capturable optimizers (#8884)

  #8889·ArjunPakhan opened Oct 22, 2026·

  ·
  1

  4

• Avoid O(W^2) linear scans in ProcessTopology and PipelineParallelGrid

  #8888·deep1blue opened Oct 22, 2026·

  ·
  4

• XPU: register pinned host memory via Level Zero ext_memmap

  #8887·delock opened Oct 22, 2026Collaborator·

  ·
  9

• Fix out-of-bounds row access in inference v2 layer_norm/rms_norm kernels for hidden sizes <= 128

  #8886·rapsealk opened Oct 22, 2026Contributor·

  ·
  1

  6

• [AffineIR] Affine storage maps for live ZeRO parameters and optimizer states

  #8885·jinyouzhi opened Oct 22, 2026Contributor·

  ·
  8

• Scope ZeRO-3 __params_to_release cache per coordinator and trace

  #8883·deep1blue opened Oct 22, 2026·

  ·
  3

• Strip ANSI color codes before parsing FAILED lines in cpu-multi-triage

  #8882·delock opened Oct 22, 2026Collaborator·

  ·
  1

  10

• Precompute optimizer param_id counts in _check_for_duplicates

  #8878·deep1blue opened Oct 21, 2026·

  ·
  3

• [AutoEP] Ensure consistent order of partition groups in all-gather when ZeRO-3

  will-review
  #8876·jinyouzhi opened Oct 21, 2026Contributor·

  ·
  1

• Fix ZeRO-3 external parameter discovery for resident weights

  #8875·DimensionSTP opened Oct 21, 2026·

  ·
  1

  4

• Fix double-transpose crash loading fused QKV checkpoints (megatron_v2)

  #8873·udsy19 opened Oct 21, 2026·

  ·
  1

  4

• [checkpoint] universal state keys for non-Adam optimizers (fix #8608)

  #8870·Asthenia0412 opened Oct 20, 2026·

  ·
  1

• Report skipped optimizer steps from the non-ZeRO optimizer wrappers

  #8869·0z5a opened Oct 20, 2026Contributor·

  ·
  6

• Make the Triton device guards accelerator-agnostic

  #8868·VenusTZZ opened Oct 20, 2026Contributor·17 tasks done·

  ·
  9

• Move test_klxpu_accelerator.py to tests/unit/v1/accelerator/

  #8867·GuCarpenter opened Oct 20, 2026Contributor·

  ·
  1

• Keep the tensors a model names for fp32 in fp32 in init_inference

  #8864·udsy19 opened Oct 20, 2026·

  ·
  1

  4