Skip to content

feat(abacus): add missing text-generation models from RouteLLM catalog - #4705

Merged
rekram1-node merged 1 commit into
anomalyco:devfrom
sorenjuul:feat/abacus-missing-text-models
Aug 14, 2026
Merged

rekram1-node merged 1 commit into
anomalyco:devfrom
sorenjuul:feat/abacus-missing-text-models

Conversation

@sorenjuul

@sorenjuul sorenjuul commented Aug 14, 2026 •

Copy link
Copy Markdown
Contributor

Summary

Adds 14 missing text-generation models to the Abacus provider, sourced from the live RouteLLM models endpoint. All entries point to existing lab metadata via base_model and override only provider-specific cost, context/output limits, and modalities.

Models added

Abacus ID Base model
claude-opus-5 anthropic/claude-opus-5
gemini-3-pro-image google/gemini-3-pro-image
gemini-3.1-flash-image google/gemini-3.1-flash-image
gemini-3.5-flash-lite google/gemini-3.5-flash-lite
gemini-3.6-flash google/gemini-3.6-flash
gemini-3.7-flash google/gemini-3.7-flash
gpt-realtime-whisper openai/gpt-realtime-whisper
grok-4.6 xai/grok-4.6
moonshotai/Kimi-K2.7-Code moonshotai/kimi-k2.7-code
moonshotai/Kimi-K3 moonshotai/kimi-k3
muse-spark-1.2 meta/muse-spark-1.2
qwen3.7-max alibaba/qwen3.7-max
qwen3.8-max alibaba/qwen3.8-max
thinkingmachines/Inkling thinkingmachines/inkling

Reasoning options

Abacus exposes no reasoning toggle, effort, or budget field for these IDs (confirmed in provider metadata and consistent with existing Abacus entries), so reasoning_options = [] is set where the underlying lab model supports reasoning.

Validation

  • bun validate passes
  • git diff --check passes

Source

@github-actions

Copy link
Copy Markdown
Contributor

Action items

  • [high] [possible mistake] providers/abacus/models/gpt-realtime-whisper.toml:238 - Check: Provider overrides must reflect the host’s real surface for the underlying lab model, and Abacus additions in this PR are scoped as text-generation catalog entries. Why: base_model = "openai/gpt-realtime-whisper" is lab-defined as streaming speech-to-text (input = ["audio"], output = ["text"], limits 0/0), but this entry forces input/output = ["text"], context = 16_000, output = 2_000, and cost.input = 283.3333 with output = 0. That combination looks like a mis-mapped STT/realtime SKU (or audio pricing reported as text tokens), not a normal chat text model, and will mislead API consumers. Action: Re-check the RouteLLM row for this ID against Abacus request/response behavior. If it is not a usable chat/text-generation endpoint, remove the file. If it is STT/realtime audio, set modalities (and cost keys such as input_audio if applicable) to match the real wire surface; if it truly is text-only on Abacus, document that delta in the leading comment and justify the ~$283/MTok text input rate from the provider source.

@sorenjuul
sorenjuul force-pushed the feat/abacus-missing-text-models branch from 9d2f0e1 to 7155679 Compare August 14, 2026 10:50
@sorenjuul

Copy link
Copy Markdown
Contributor Author

Removed "gpt-realtime-whisper" from this PR. The RouteLLM row exposes it with text modalities and an anomalous input rate, but the underlying lab model is streaming STT/audio, so it does not belong in a text-generation catalog addition.

@github-actions

Copy link
Copy Markdown
Contributor

Action items

  • [medium] [violation] providers/abacus/models/claude-opus-5.toml:10 - Check: After base_model, keep only provider-specific fields and real deltas (no identical restated data). Why: Several new entries restate values already correct on the lab base, which breaks override-only inheritance and will drift when lab metadata changes. Action: Drop redundant fields and keep only real Abacus deltas:
    • All 13 files: remove restated reasoning = true (inherit from base; keep reasoning_options = [] + cost).
    • Remove fully identical [limit]: claude-opus-5, gemini-3-pro-image, gemini-3.5-flash-lite, gemini-3.6-flash, gemini-3.7-flash, moonshotai/Kimi-K2.7-Code, moonshotai/Kimi-K3, muse-spark-1.2, qwen3.8-max.
    • Remove fully identical [modalities]: gemini-3-pro-image, grok-4.6, moonshotai/Kimi-K2.7-Code, moonshotai/Kimi-K3, qwen3.7-max.
    • Where only one limit differs, override just that key (deep-merge), e.g. grok-4.6 → only limit.output = 32_768; qwen3.7-max → only limit.output = 64_000.
    • Keep modality overrides that actually differ (e.g. dropped pdf/video/audio vs lab).

@sorenjuul
sorenjuul force-pushed the feat/abacus-missing-text-models branch from 7155679 to 3d8c10e Compare August 14, 2026 10:58
@sorenjuul

Copy link
Copy Markdown
Contributor Author

Cleaned up all 13 provider files to be strictly override-only: removed restated "reasoning = true", dropped identical [limit] and [modalities] tables, and reduced partial-difference limits to only the changed key (e.g. grok-4.6 output, qwen3.7-max output).

Adds 14 Abacus RouteLLM provider entries that were present in the live https://routellm.abacus.ai/v1/models endpoint but missing from the repo.

All entries use existing lab metadata via base_model and override only provider-specific cost, context/output limits, and modalities per Abacus API values.

Validation: bun validate passes.

Co-authored-by: Sisyphus <clio-agent@sisyphuslabs.ai>
@sorenjuul
sorenjuul force-pushed the feat/abacus-missing-text-models branch from 3d8c10e to bda912c Compare August 14, 2026 11:03
@github-actions

Copy link
Copy Markdown
Contributor

No actionable findings.

@github-actions github-actions Bot added the reviewer: ready Automated review found no actionable items label Aug 14, 2026
@sorenjuul

Copy link
Copy Markdown
Contributor Author

@rekram1-node new models added so they are available for users of abacus

@rekram1-node
rekram1-node merged commit 296272e into anomalyco:dev Aug 14, 2026
2 checks passed
sorenjuul added a commit to sorenjuul/models.dev that referenced this pull request Sep 24, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

reviewer: ready Automated review found no actionable items

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants