Skip to content

Allow models to customize tensor parallel plans - #15197

Closed
yzhautouskay wants to merge 1 commit into
huggingface:mainfrom
yzhautouskay:yzhautouskay/tp-plan-resolution
Closed

yzhautouskay wants to merge 1 commit into
huggingface:mainfrom
yzhautouskay:yzhautouskay/tp-plan-resolution

use _get_tp_plan for overrides.

feb7dfd
Select commit
Loading
Failed to load commit list.
Sign in for the full log view