Skip to content
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
10 changes: 9 additions & 1 deletion core/cli/run_socket_activation_test.go
Original file line number Diff line number Diff line change
Expand Up @@ -7,6 +7,8 @@ import (
"os"
"strconv"

"golang.org/x/sys/unix"

. "github.com/onsi/ginkgo/v2"
. "github.com/onsi/gomega"
)
Expand Down Expand Up @@ -53,7 +55,13 @@ var _ = Describe("systemdActivatedListeners", func() {
Expect(err).NotTo(HaveOccurred())
Expect(original.Close()).To(Succeed())

listeners, err := listenersFromSystemdFDs(int(file.Fd()), 1)
// The activation helper takes ownership of a raw descriptor. Give it a
// duplicate so file's finalizer cannot close a later user of that descriptor.
fd, err := unix.Dup(int(file.Fd()))
Expect(err).NotTo(HaveOccurred())
Expect(file.Close()).To(Succeed())

listeners, err := listenersFromSystemdFDs(fd, 1)
Expect(err).NotTo(HaveOccurred())
Expect(listeners).To(HaveLen(1))
DeferCleanup(listeners[0].Close)
Expand Down
23 changes: 23 additions & 0 deletions docs/content/features/model-gallery.md
Original file line number Diff line number Diff line change
Expand Up @@ -39,6 +39,29 @@ Both views use the same model selection and store the view, search, filter, and
selection in the URL. Installing from Explore does not move you away from the
catalog; the entry updates in place when the operation finishes.

## Index-Translate-9B

[Index-Translate-9B](https://huggingface.co/IndexTeam/Index-Translate-9B) provides
text translation across 150 languages with terminology and formatting instructions.
The gallery includes Q4_K_M and Q8_0 GGUF builds for llama.cpp, with a 32,768-token
context, thinking disabled, and temperature 0, following the publisher's serving examples.

Install with automatic variant selection:

```bash
local-ai models install index-translate-9b
```

To select Q8_0 explicitly:

```bash
local-ai models install index-translate-9b --variant index-translate-9b-q8
```

In chat, include the target language and any constraints in the user message, for example:
"Translate to Italian. Preserve the placeholder {name}: Hello, {name}!"
These entries provide text translation; they do not configure image or speech input.

## Cyber-Ornith 1.5 9B

Cyber-Ornith 1.5 is a Qwen3.5 fine-tune for security auditing, terminal tasks, and tool use.
Expand Down
70 changes: 70 additions & 0 deletions gallery/index.yaml
Original file line number Diff line number Diff line change
@@ -1,4 +1,74 @@
---
- name: "index-translate-9b"
variants:
- model: index-translate-9b-q8
url: "github:mudler/LocalAI/gallery/virtual.yaml@master"
urls:
- https://huggingface.co/IndexTeam/Index-Translate-9B
- https://huggingface.co/mradermacher/Index-Translate-9B-GGUF
description: |
Index-Translate-9B is a Qwen3.5-based text translation model for 150 languages,
with support for terminology, formatting, style, and context instructions.
This Q4_K_M GGUF uses llama.cpp with thinking disabled and greedy decoding.
license: "apache-2.0"
tags:
- llm
- gguf
- translation
- cpu
- gpu
overrides:
backend: llama-cpp
context_size: 32768
known_usecases:
- chat
options:
- use_jinja:true
chat_template_kwargs:
enable_thinking: false
template:
use_tokenizer_template: true
parameters:
model: llama-cpp/models/index-translate-9b/Index-Translate-9B.Q4_K_M.gguf
temperature: 0
files:
- filename: llama-cpp/models/index-translate-9b/Index-Translate-9B.Q4_K_M.gguf
sha256: 5ff8911559a6736d926183fcb20e2548416b589033660dd530d059c7b74e2c32
uri: https://huggingface.co/mradermacher/Index-Translate-9B-GGUF/resolve/6537a9d04a02397200903eee74634eec8b78ebd6/Index-Translate-9B.Q4_K_M.gguf
- name: "index-translate-9b-q8"
url: "github:mudler/LocalAI/gallery/virtual.yaml@master"
urls:
- https://huggingface.co/IndexTeam/Index-Translate-9B
- https://huggingface.co/mradermacher/Index-Translate-9B-GGUF
description: |
Index-Translate-9B is a Qwen3.5-based text translation model for 150 languages,
with support for terminology, formatting, style, and context instructions.
This Q8_0 GGUF uses llama.cpp with thinking disabled and greedy decoding.
license: "apache-2.0"
tags:
- llm
- gguf
- translation
- cpu
- gpu
overrides:
backend: llama-cpp
context_size: 32768
known_usecases:
- chat
options:
- use_jinja:true
chat_template_kwargs:
enable_thinking: false
template:
use_tokenizer_template: true
parameters:
model: llama-cpp/models/index-translate-9b/Index-Translate-9B.Q8_0.gguf
temperature: 0
files:
- filename: llama-cpp/models/index-translate-9b/Index-Translate-9B.Q8_0.gguf
sha256: 89efba722c7fab5439a98c8062c1365879470215453dd19d7406bd7fcf0b0dac
uri: https://huggingface.co/mradermacher/Index-Translate-9B-GGUF/resolve/6537a9d04a02397200903eee74634eec8b78ebd6/Index-Translate-9B.Q8_0.gguf
- name: "ternary-bonsai-2-27b"
url: "github:mudler/LocalAI/gallery/virtual.yaml@master"
urls:
Expand Down
Loading