Skip to content

Openshell Inference set multiple models #1825

Description

@bmahabirbu

Problem Statement

a provider like claude or a local one can have multiple models associated with a single endpoint. The inference argument should have the ability to set --model model1 model2

then in the sandbox implicitly it will switch a model based on the model name

Proposed Design

openshell inference set --model1 model2

Alternatives Considered

a method to switch models implicitly intead of having to reset the inference update

Agent Investigation

No response

Checklist

  • I've reviewed existing issues and the architecture docs
  • This is a design proposal, not a "please build this" request

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions