Conversation
|
Thanks for the contribution!
中文感谢你的贡献!
|
6e4e237 to
79cd4b8
Compare
This comment was marked as outdated.
This comment was marked as outdated.
…ge-20260922 # Conflicts: # perf-changelog.yaml
|
InferenceX has switched away from unmaintainable bash scripts to YAML files that don't repeat the same stuff over and over again. Please merge the latest |
TP2 GPU-resident KV now covers [1, 4, 8, 12] and TP2 HiCache [16, 20, 24, 28, 32, 36, 40]; every HiCache variant pins hicache-size 253. Drops the now-unused tp2_c16/tp2_c20 resident variants and adds tp2_c16_hicache so each matrix point resolves to exactly one recipe variant. Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
|
Closing in favor of #3455, which ports this PR's changes onto the srt-slurm recipe that #3428 switched |
Summary
qwen3.5-fp4-mi355x-sglang-agentic-mtpfromlmsysorg/sglang-rocm:v0.5.19-rocm720-mi35x-20260915tolmsysorg/sglang-rocm:v0.5.20-rocm720-mi35x-20260924(Docker Hub tag HTTP 200, digestsha256:baadaba198e23c46c1dd651b5edefae8000bd5430943bd10b246b563905b3ecf).[1, 4, 8, 12, 16]. Move TP2 conc 16 onto HiCache and drop TP2 GPU-resident conc 20. TP2 resident is[1, 4, 8, 12]; TP2 HiCache is[16, 20, 24, 28, 32, 36, 40].--hicache-size 253(overrides--hicache-ratio). Other recipe flags are unchanged. Sweep image comes fromconfigs/amd-master.yaml.Details
origin/mainstill pins the 20260915 AgentX image and the older TP2 grid (resident [1, 4, 8, 12, 16, 20], HiCache starting at 20). This PR only updates that AgentX arm. Fixed-seq MI355X SGLang arms are a separate PR.AI model disclosure
Cursor Grok 4.6 prepared the image bump, HiCache size pin, changelog, and this PR text.