Vercel AI Gateway

App · 9 actions

Use Vercel AI Gateway models for chat, responses, token counting and message batches.

Actions

ActionWhat it does
Cancel message batchCancel message batch.
Count message tokensCount message tokens.
Create message batchCreate message batch.
Generate Anthropic-compatible messageGenerate Anthropic-compatible message.
Generate chat completionGenerate chat completion.
Generate responseGenerate response.
Get message batchGet message batch.
List available modelsList available models.
List message batchesList message batches.

Cancel message batch

Cancel message batch.

Inputs

Batch idbatch_idtextRequired
Batch id.

Outputs

dataobject
Result.
Example output
{
  "data": {
    "created_at": "example",
    "ended_at": "example",
    "id": "example",
    "processing_status": "example",
    "request_counts": {},
    "results_url": "example",
    "type": "example"
  }
}

Count message tokens

Count message tokens.

Inputs

ModelmodeltextRequired
Model.
MessageprompttextRequired
Prompt.
Systemsystemtext
System.

Outputs

dataobject
Result.
Example output
{
  "data": {
    "input_tokens": 1
  }
}

Create message batch

Create message batch.

Inputs

RequestsrequestslistRequired
Requests.

Outputs

dataobject
Result.
Example output
{
  "data": {
    "created_at": "example",
    "ended_at": "example",
    "id": "example",
    "processing_status": "example",
    "request_counts": {},
    "results_url": "example",
    "type": "example"
  }
}

Generate Anthropic-compatible message

Generate Anthropic-compatible message.

Inputs

ModelmodeltextRequired
Model.
MessageprompttextRequired
Prompt.
Systemsystemtext
System.
Max tokensmax_tokensnumberRequired
Max tokens.From 1 to 128000.

Outputs

dataobject
Result.
Example output
{
  "data": {
    "content": [],
    "id": "example",
    "model": "example",
    "role": "example",
    "stop_reason": "example",
    "type": "example",
    "usage": {
      "input_tokens": 1,
      "output_tokens": 1
    }
  }
}

Generate chat completion

Generate chat completion.

Inputs

ModelmodeltextRequired
Model.
MessageprompttextRequired
Prompt.
Systemsystemtext
System.
Max tokensmax_tokensnumber
Max tokens.From 1 to 128000.

Outputs

dataobject
Result.
Example output
{
  "data": {
    "choices": [],
    "id": "example",
    "model": "example",
    "object": "example",
    "usage": {
      "completion_tokens": 1,
      "prompt_tokens": 1,
      "total_tokens": 1
    }
  }
}

Generate response

Generate response.

Inputs

ModelmodeltextRequired
Model.
InputinputtextRequired
Input.
Instructionsinstructionstext
Instructions.
Max output tokensmax_output_tokensnumber
Max output tokens.At least 1.

Outputs

dataobject
Result.
Example output
{
  "data": {
    "id": "example",
    "model": "example",
    "output": [],
    "status": "example",
    "usage": {}
  }
}

Get message batch

Get message batch.

Inputs

Batch idbatch_idtextRequired
Batch id.

Outputs

dataobject
Result.
Example output
{
  "data": {
    "created_at": "example",
    "ended_at": "example",
    "id": "example",
    "processing_status": "example",
    "request_counts": {},
    "results_url": "example",
    "type": "example"
  }
}

List available models

List available models.

Inputs

None.

Outputs

dataobject
Result.
Example output
{
  "data": {
    "data": [],
    "object": "example"
  }
}

List message batches

List message batches.

Inputs

Limitlimitnumber
Limit.From 1 to 1000.
Before idbefore_idtext
Before id.
After idafter_idtext
After id.

Outputs

dataobject
Result.
Example output
{
  "data": {
    "data": [],
    "first_id": "example",
    "has_more": false,
    "last_id": "example"
  }
}

On this page