# Vercel AI Gateway

> Use Vercel AI Gateway models for chat, responses, token counting and message batches.

App · 9 actions. Web page: https://docs.lodol.com/docs/integrations/vercel-ai-gateway

## Actions

### Cancel message batch

Cancel message batch.

**Inputs**

- Batch id (`batch_id`, text, required): Batch id.

**Outputs**

- `data` (object): Result.

**Example output**

```json
{
  "data": {
    "created_at": "example",
    "ended_at": "example",
    "id": "example",
    "processing_status": "example",
    "request_counts": {},
    "results_url": "example",
    "type": "example"
  }
}
```

### Count message tokens

Count message tokens.

**Inputs**

- Model (`model`, text, required): Model.
- Message (`prompt`, text, required): Prompt.
- System (`system`, text): System.

**Outputs**

- `data` (object): Result.

**Example output**

```json
{
  "data": {
    "input_tokens": 1
  }
}
```

### Create message batch

Create message batch.

**Inputs**

- Requests (`requests`, list, required): Requests.

**Outputs**

- `data` (object): Result.

**Example output**

```json
{
  "data": {
    "created_at": "example",
    "ended_at": "example",
    "id": "example",
    "processing_status": "example",
    "request_counts": {},
    "results_url": "example",
    "type": "example"
  }
}
```

### Generate Anthropic-compatible message

Generate Anthropic-compatible message.

**Inputs**

- Model (`model`, text, required): Model.
- Message (`prompt`, text, required): Prompt.
- System (`system`, text): System.
- Max tokens (`max_tokens`, number, required): Max tokens. From 1 to 128000.

**Outputs**

- `data` (object): Result.

**Example output**

```json
{
  "data": {
    "content": [],
    "id": "example",
    "model": "example",
    "role": "example",
    "stop_reason": "example",
    "type": "example",
    "usage": {
      "input_tokens": 1,
      "output_tokens": 1
    }
  }
}
```

### Generate chat completion

Generate chat completion.

**Inputs**

- Model (`model`, text, required): Model.
- Message (`prompt`, text, required): Prompt.
- System (`system`, text): System.
- Max tokens (`max_tokens`, number): Max tokens. From 1 to 128000.

**Outputs**

- `data` (object): Result.

**Example output**

```json
{
  "data": {
    "choices": [],
    "id": "example",
    "model": "example",
    "object": "example",
    "usage": {
      "completion_tokens": 1,
      "prompt_tokens": 1,
      "total_tokens": 1
    }
  }
}
```

### Generate response

Generate response.

**Inputs**

- Model (`model`, text, required): Model.
- Input (`input`, text, required): Input.
- Instructions (`instructions`, text): Instructions.
- Max output tokens (`max_output_tokens`, number): Max output tokens. At least 1.

**Outputs**

- `data` (object): Result.

**Example output**

```json
{
  "data": {
    "id": "example",
    "model": "example",
    "output": [],
    "status": "example",
    "usage": {}
  }
}
```

### Get message batch

Get message batch.

**Inputs**

- Batch id (`batch_id`, text, required): Batch id.

**Outputs**

- `data` (object): Result.

**Example output**

```json
{
  "data": {
    "created_at": "example",
    "ended_at": "example",
    "id": "example",
    "processing_status": "example",
    "request_counts": {},
    "results_url": "example",
    "type": "example"
  }
}
```

### List available models

List available models.

**Inputs**: None.

**Outputs**

- `data` (object): Result.

**Example output**

```json
{
  "data": {
    "data": [],
    "object": "example"
  }
}
```

### List message batches

List message batches.

**Inputs**

- Limit (`limit`, number): Limit. From 1 to 1000.
- Before id (`before_id`, text): Before id.
- After id (`after_id`, text): After id.

**Outputs**

- `data` (object): Result.

**Example output**

```json
{
  "data": {
    "data": [],
    "first_id": "example",
    "has_more": false,
    "last_id": "example"
  }
}
```
