Vercel AI Gateway
App · 9 actions
Use Vercel AI Gateway models for chat, responses, token counting and message batches.
Actions
| Action | What it does |
|---|---|
| Cancel message batch | Cancel message batch. |
| Count message tokens | Count message tokens. |
| Create message batch | Create message batch. |
| Generate Anthropic-compatible message | Generate Anthropic-compatible message. |
| Generate chat completion | Generate chat completion. |
| Generate response | Generate response. |
| Get message batch | Get message batch. |
| List available models | List available models. |
| List message batches | List message batches. |
Cancel message batch
Cancel message batch.
Inputs
- Batch id
batch_idtextRequired - Batch id.
Outputs
dataobject- Result.
Example output
{
"data": {
"created_at": "example",
"ended_at": "example",
"id": "example",
"processing_status": "example",
"request_counts": {},
"results_url": "example",
"type": "example"
}
}Count message tokens
Count message tokens.
Inputs
- Model
modeltextRequired - Model.
- Message
prompttextRequired - Prompt.
- System
systemtext - System.
Outputs
dataobject- Result.
Example output
{
"data": {
"input_tokens": 1
}
}Create message batch
Create message batch.
Inputs
- Requests
requestslistRequired - Requests.
Outputs
dataobject- Result.
Example output
{
"data": {
"created_at": "example",
"ended_at": "example",
"id": "example",
"processing_status": "example",
"request_counts": {},
"results_url": "example",
"type": "example"
}
}Generate Anthropic-compatible message
Generate Anthropic-compatible message.
Inputs
- Model
modeltextRequired - Model.
- Message
prompttextRequired - Prompt.
- System
systemtext - System.
- Max tokens
max_tokensnumberRequired - Max tokens.From 1 to 128000.
Outputs
dataobject- Result.
Example output
{
"data": {
"content": [],
"id": "example",
"model": "example",
"role": "example",
"stop_reason": "example",
"type": "example",
"usage": {
"input_tokens": 1,
"output_tokens": 1
}
}
}Generate chat completion
Generate chat completion.
Inputs
- Model
modeltextRequired - Model.
- Message
prompttextRequired - Prompt.
- System
systemtext - System.
- Max tokens
max_tokensnumber - Max tokens.From 1 to 128000.
Outputs
dataobject- Result.
Example output
{
"data": {
"choices": [],
"id": "example",
"model": "example",
"object": "example",
"usage": {
"completion_tokens": 1,
"prompt_tokens": 1,
"total_tokens": 1
}
}
}Generate response
Generate response.
Inputs
- Model
modeltextRequired - Model.
- Input
inputtextRequired - Input.
- Instructions
instructionstext - Instructions.
- Max output tokens
max_output_tokensnumber - Max output tokens.At least 1.
Outputs
dataobject- Result.
Example output
{
"data": {
"id": "example",
"model": "example",
"output": [],
"status": "example",
"usage": {}
}
}Get message batch
Get message batch.
Inputs
- Batch id
batch_idtextRequired - Batch id.
Outputs
dataobject- Result.
Example output
{
"data": {
"created_at": "example",
"ended_at": "example",
"id": "example",
"processing_status": "example",
"request_counts": {},
"results_url": "example",
"type": "example"
}
}List available models
List available models.
Inputs
None.
Outputs
dataobject- Result.
Example output
{
"data": {
"data": [],
"object": "example"
}
}List message batches
List message batches.
Inputs
- Limit
limitnumber - Limit.From 1 to 1000.
- Before id
before_idtext - Before id.
- After id
after_idtext - After id.
Outputs
dataobject- Result.
Example output
{
"data": {
"data": [],
"first_id": "example",
"has_more": false,
"last_id": "example"
}
}