Supporting Vertex-based models using google auth

Eg, something like:

{
  "$schema": "https://opencode.ai/config.json",
  "theme": "openai",
  "provider": {
    "vertexai": {
      "npm": "@ai-sdk/google-vertex",
      "options": {
        "project": "my-project-1",
        "location": "us-central1",
        "googleAuthOptions": {
          "keyFile": "creds.json"
        }
      },
      "models": {
        "gemini-2.5-pro": {},
        "gemini-2.0-flash": {},
        "gemini-2.5-flash": {},
        "claude-4.0-sonnet": {},
        "claude-4.0-opus": {}
      }
    }
  }
}

And actually this isn't fully accurate, @ai-sdk/google-vertex works for Gemini models but @ai-sdk/google-vertex/anthropic is needed for Claude models hosted on Vertex.

Alternatively, what I did for now is simply use my litellm proxy gateway running in a seperate process with the following config:

{
  "$schema": "https://opencode.ai/config.json",
  "theme": "openai",
  "provider": {
    "ollama": {
      "npm": "@ai-sdk/openai-compatible",
      "options": {
        "baseURL": "http://localhost:4000/v1",
        "apiKey": "sk-demo-1234"
      },
      "models": {
        "gemini-2.5-pro": {},
        "gemini-2.0-flash": {},
        "gemini-2.5-flash": {},
        "claude-4.0-sonnet": {},
        "claude-4.0-opus": {},
        "claude-3.7-sonnet": {},
        "o4-mini-high": {},
        "o4-mini": {},
        "o3": {}
      }
    }
  }
}

The only problem with this is you don't get token/cost tracking data. I think a fair number of people do this, so it could be nice to simply flag somehow that the model you're passing through is the "official" model from models.dev?

@thdxr

Oh yes, I need this, all my credits are in Vertex.

@thdxr, happy to help with the implementation. I won't jump into it right now, as you're assigned, but please let me know.

I would also like to see Vertex AI support for Anthropic models. I believe most large companies already provide their employees access to LLMs through Vertex AI due to corporate policies. What is the current status of this feature? I look forward to helping with this.

This worked for me, targeting a GCP project in Vertex AI (aiplatform.googleapis.com):

{
  "$schema": "https://opencode.ai/config.json",
  "theme": "system",
  "autoupdate": true,
  "provider": {
    "google-vertex": {
      "models": {
        "gemini-2.5-flash": {},
        "gemini-2.5-pro": {}
      },
      "options": {
        "project": "{env:GOOGLE_CLOUD_PROJECT}",
        "location": "{env:GOOGLE_CLOUD_LOCATION}"
      }
    }
  }
}

Authentication seems to be made under the hood by gcloud auth - or was it the fact that I ran opencode auth and gave it the access token from gclound auth application-default print-access-token? 🤷
I can see from cloud logs I'm making authenticated requests, so I can see that it really works.

@fredrikaverpil

This is interesting, @fredrikaverpil. How would you define the model if you are using Claude through Vertex?

@NachoVazquez

@NachoVazquez not sure what you mean. I'm using gemini-cli and various Neovim plugins (codecompanion, avante) as well as opencode with the Gemini models in Vertex, namely flash 2.5 and pro 2.5. The models are specified in the snippet above.

I'm trying to use Claude Code through Vertex. That's how I use it with Claude Code. I tried following your config, but it doesn't seem to work for me.

...
  "model": "vertex/claude-sonnet-4",
  "provider": {
    "vertex": {
      "models": {
        "claude-sonnet-4": {}
      },
      "options": {
        "project": "{env:GOOGLE_CLOUD_PROJECT}",
        "location": "{env:GOOGLE_CLOUD_LOCATION}"
      }
    }
  },

Some development is needed, it seems, as stated in the issue description.

Claude is not listed under Vertex in https://models.dev, which is what opencode uses.

Right, there are two PRs related to this, but it would probably not be enough since @ai-sdk/google-vertex is not enough; @ai-sdk/google-vertex/anthropic is needed here.

I will try to put a PR together this weekend.

anomalyco/models.dev#23
anomalyco/models.dev#60

Both the PRs are merged I think we can work on bringing the anthropic SDK into opencode?

Opened #2028 and confirmed its enough, theres probably a more elegant way, but it gets me off to the races for now!

Any updates on this PR? I think this is the only thing between me and being able to use opencode at work 🤞

@thdxr

@thdxr is this something that qualifies for open source contribution (I'm unsure what the line is for "core features") and/or would you be able to take a look?

more to come on this v soon

This works now right?

  "provider": {
    "google-vertex": {
      "options": {
        "location": "us-west4",
        "project": "<project>"
      }
    },

ill fix this this week, we're getting setup on vertex ourselves

yessssssss can't wait

Can't wait. Google gave us credits and fire up Opus with OpenCode

opened PR #2347

@bqrkhn

@bqrkhn can't use your credits with anthropic models.

Any updates on this? There's been a couple minor version updates and I keep hoping one of them will make my vertex stuff start working

@thdxr

@thdxr said they are working on it, they actually will be using vertex for a bunch of their work internally so I expect the vertex support to be really good once it is here

Would love to see this work, I believe this will help opencode's adoption soar higher

Would love seeing this, their TPS is off the charts.

I check this daily in the hope I can finally use this at work 😢

i am sitting on $100K in gcp credits and a super high vertex rate limit, would love to experiment with opencode if we could get this through: #2347

Merge pull request anomalyco#272 from Latitudes-Dev/shuvcode-dev

chore(config): governance and config foundation (anomalyco#292)

Navigation Menu

Repository navigation

Supporting Vertex-based models using google auth #272

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

Supporting Vertex-based models using google auth #272

Description

Activity

NachoVazquez commented on Jun 22, 2025

admSla99 commented on Jul 9, 2025

fredrikaverpil commented on Jul 22, 2025

NachoVazquez commented on Jul 22, 2025

fredrikaverpil commented on Jul 22, 2025

NachoVazquez commented on Jul 22, 2025

NachoVazquez commented on Jul 22, 2025

fredrikaverpil commented on Jul 22, 2025

NachoVazquez commented on Jul 22, 2025

king-11 commented on Aug 15, 2025

jacobmikesell commented on Aug 18, 2025

cafreeman commented on Aug 20, 2025

jacobmikesell commented on Aug 22, 2025

rekram1-node commented on Aug 22, 2025

evatths commented on Aug 26, 2025

thdxr commented on Aug 27, 2025

chris-freeman-glean commented on Aug 27, 2025

bqrkhn commented on Aug 29, 2025

yukukotani commented on Sep 2, 2025

nefthy commented on Sep 5, 2025

cafreeman commented on Sep 10, 2025

rekram1-node commented on Sep 10, 2025

phase7 commented on Sep 18, 2025

dan-myles commented on Sep 23, 2025

jonnypillar-cio commented on Sep 25, 2025

rawwerks commented on Oct 1, 2025

Metadata

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

Issue actions