Skip to content

fix(LlamaEmbeddingContext): automatically set the batch size for non-causal embedding models - #691

Open
giladgd wants to merge 2 commits into
masterfrom
gilad/handleNonCasualEmbeddingModels
Open

giladgd wants to merge 2 commits into
masterfrom
gilad/handleNonCasualEmbeddingModels

Commits

  1. Commits on Nov 17, 2026

  2. Commits on Nov 18, 2026