Skip to content

fix(LlamaEmbeddingContext): automatically set the batch size for non-causal embedding models - #691

Open
giladgd wants to merge 2 commits into
masterfrom
gilad/handleNonCasualEmbeddingModels
Open

giladgd wants to merge 2 commits into
masterfrom
gilad/handleNonCasualEmbeddingModels