Skip to content

gallery: add AMD Instella MoE 16B variants - #11308

Merged
mudler merged 1 commit into
masterfrom
cron/model-gallery-20260803-instella
Aug 3, 2026
Merged

mudler merged 1 commit into
masterfrom
cron/model-gallery-20260803-instella

Conversation

@localai-org-maint-bot

Copy link
Copy Markdown
Collaborator

Summary

  • add AMD Instella-MoE-16B-A3B-Think to the model gallery
  • provide Q4_K_M and Q8_0 GGUF builds as host-selectable variants
  • configure llama.cpp with the embedded Jinja tokenizer template and tool-parsing fallback
  • record SHA256 values independently confirmed from Hugging Face LFS metadata and x-linked-etag headers

Validation

  • git diff --check
  • confirmed both artifact URLs resolve and their x-linked-etag values match the recorded SHA256 values
  • go test ./core/gallery/... could not start locally because the environment returned HTTP 403 while fetching golang.org/x/sys@v0.0.0-20210809222454-d867a43fc93e from both the default proxy and direct source; CI is expected to run the gallery suite

Model sources

Add Q4_K_M and Q8_0 GGUF builds for the trending Instella-MoE-16B-A3B-Think model, with host-selectable variant metadata and verified Hugging Face LFS hashes.

Assisted-by: Codex:gpt-5
@mudler
mudler merged commit 7f9ffd9 into master Aug 3, 2026
55 of 56 checks passed
@mudler
mudler deleted the cron/model-gallery-20260803-instella branch August 3, 2026 10:16
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants