Google Vertex AI

Guide#

This guide walks through setting up Google Vertex AI language models for use with Nexus.

Google Vertex AI and Google AI Studio serve the same models. However, Vertex AI has enterprise-grade features that may be useful for your school.

Create a Service Account for Nexus#

Go to the Google Cloud Console Service Accounts Page

Select your project and click Create Service Account.

Give your Service Account a name and a description.

On the Permissions tab, grant the service account the Agent Platform User role.

Create a New Key for the Service Account#

Click your newly created Service Account → Keys → Add Key → Create new key.

Select JSON as the key type and click Create. The key will be automatically downloaded to your computer.

Navigate to Language Models#

Access the Admin Panel from your user profile icon, then navigate to Configuration → Language Models.

Configure Google Vertex AI#

Select Google Cloud Vertex AI from the available providers.

Give this configuration a Display Name.

Upload your JSON key to the Credentials File field.

If relevant, specify a Location.

Choose Visible Models#

In the Advanced Options, you will see a list of all models available from this provider. You may choose which models are visible to your users in Nexus.

Setting visible models is useful when a provider publishes multiple models and versions of the same model.

Designate Provider Access#

Lastly, decide whether the provider should be public to all users in Nexus.

If set to private, the provider's models will be available to Admins and User Groups you explicitly assign the provider to.