SambaNova Cloud

App · 8 actions

Discover SambaNova models and generate text, responses and embeddings.

Actions

ActionWhat it does
ChatChat.
CompleteComplete.
Count message tokensCount message tokens.
Create embeddingsCreate embeddings.
Create messageCreate message.
Create responseCreate response.
Get modelGet model.
List modelsList models.

Chat

Chat.

Inputs

ModelmodeltextRequired
The model ID to use (e.g. gpt-oss-120b). See available [models](https://docs.sambanova.ai/docs/en/models/sambacloud-models)
Max tokensmax_tokensnumber
The maximum number of tokens that can be generated in the chat completion. The total length of input tokens and generated tokens is limited by the model's context length.
Max completion tokensmax_completion_tokensnumber
The maximum number of tokens that can be generated in the chat completion. The total length of input tokens and generated tokens is limited by the model's context length.
Temperaturetemperaturenumber
What sampling temperature to use, determines the degree of randomness in the response. between 0 and 2, Higher values like 0.8 will make the output more random, while lower values like 0.2 will make it more focused and deterministic. Is recommended altering this, top_p or top_k but not more than one of these.From 0 to 2. Default: 0.7.
Top ptop_pnumber
Cumulative probability for token choices. An alternative to sampling with temperature, called nucleus sampling, where the model considers the results of the tokens with top_p probability mass. So 0.1 means only the tokens comprising the top 10% probability mass are considered. Is recommended altering this, top_k or temperature but not more than one of these.From 0 to 1.
Top ktop_knumber
Amount limit of token choices. An alternative to sampling with temperature, the model considers the results of the first K tokens with higher probability. So 10 means only the first 10 tokens with higher probability are considered. Is recommended altering this, top_p or temperature but not more than one of these.From 1 to 100.
Presence penaltypresence_penaltynumber
Number between -2.0 and 2.0. Positive values penalize new tokens based on whether they appear in the text so far, increasing the model's likelihood to talk about new topics. Not currently implemented; accepted for API compatibilityFrom -2 to 2. Default: 0.
Frequency penaltyfrequency_penaltynumber
Number between -2.0 and 2.0. Positive values penalize new tokens based on their existing frequency in the text so far, decreasing the model's likelihood to repeat the same line verbatim. Not currently implemented; accepted for API compatibilityFrom -2 to 2. Default: 0.
Repetition penaltyrepetition_penaltynumber
Penalizes repeated tokens. A value of 1.0 applies no penalty; values above 1.0 discourage repetition. Only supported for some models (currently MiniMax and gpt-oss models); silently ignored on models that do not support it.From 1 to 2.
Stopstoptext
Sequences where the API will stop generating tokens. The returned text will not contain the stop sequence.
Stream options include usagestream_options_include_usagetrue/false
Whether to include the usage metrics in a final chunk or not
Response format json schemaresponse_format_json_schemaobject
A JSON Schema definition the model's structured output. Follows standard JSON Schema syntax.
Response format typeresponse_format_typetext
Response format type.One of: json_schema (Json schema).
Reasoning effortreasoning_efforttext
Value specifying the amount of reasoning the model is allowed to do, increasing it will increase the number of output reasoning tokens generated by the model, but will improve quality of the responses. allowed values are 'low', 'medium', 'high'One of: low, medium, high.
Tool choicetool_choicetext
Controls which (if any) tool is called by the model. `none` means the model will not call any tool and instead generates a message. `auto` means the model can pick between generating a message or calling one or more tools. `required` means the model must call one or more tools. Specifying a particular tool via `{"type": "function", "function": {"name": "my_function"}}` forces the model to call that tool.One of: none, auto, required.
Parallel tool callsparallel_tool_callstrue/false
Whether to enable parallel function calling during tool use.
Toolstoolslist
A list of tools the model may call. Use this to provide a list of functions the model may generate JSON inputs for.
Chat template kwargs enable thinkingchat_template_kwargs_enable_thinkingtrue/false
Enables the model's internal reasoning or "thinking" mode, if supported by the chat template (deepseek models).
Logprobslogprobstrue/false
Whether to return log probabilities of the output tokens or not. If true, returns the log probabilities of each output token returned in the `content` of `message`.Default: false.
Top logprobstop_logprobsnumber
An integer between 0 and 20 specifying the number of most likely tokens to return at each token position, each with an associated log probability. `logprobs` must be set to `true` if this parameter is used.From 0 to 20.
Nnnumber
How many completions to generate for each prompt. **Note:** Because this parameter generates many completions, it can quickly consume your token quota. Use carefully and ensure that you have reasonable settings for `max_tokens`.From 1 to 8. Default: 1.
Logit biaslogit_biasobject
Modify the likelihood of specified tokens appearing in the generation. Accepts a JSON object that maps tokens (specified by their token ID in the model tokenizer) to an associated bias value from -100 to 100. Mathematically, the bias is added to the logits generated by the model prior to sampling. Values between -1 and 1 should decrease or increase likelihood of selection; values like -100 or 100 should result in a ban or exclusive selection of the relevant token.
Seedseednumber
If specified, our system will make a best effort to sample deterministically, such that repeated requests with the same `seed` and parameters should return the same result. Determinism is not guaranteed, and you should refer to the `system_fingerprint` response parameter to monitor changes in the backend.
PromptprompttextRequired
The message to send to the model.

Outputs

dataobject
chat completion response returned by the model
Example output
{
  "data": {
    "choices": [],
    "created": 1.0,
    "id": "example",
    "model": "example",
    "object": "chat.completion",
    "system_fingerprint": "example",
    "usage": {
      "acceptance_rate": 1.0,
      "completion_tokens": 1,
      "completion_tokens_after_first_per_sec": 1.0,
      "completion_tokens_after_first_per_sec_first_ten": 1.0,
      "completion_tokens_after_first_per_sec_graph": 1.0,
      "completion_tokens_details": {
        "reasoning_tokens": 1
      },
      "completion_tokens_per_sec": 1.0,
      "end_time": 1.0,
      "is_last_response": true,
      "prompt_tokens": 1,
      "prompt_tokens_details": {
        "cached_tokens": 1
      },
      "start_time": 1.0,
      "stop_reason": "example",
      "time_to_first_token": 1.0,
      "time_to_first_token_graph": 1.0,
      "total_latency": 1.0,
      "total_tokens": 1,
      "total_tokens_per_sec": 1.0
    }
  }
}

Complete

Complete.

Inputs

ModelmodeltextRequired
The model ID to use (e.g. gpt-oss-120b). See available [models](https://docs.sambanova.ai/docs/en/models/sambacloud-models)
PromptprompttextRequired
Prompt to send to the model.
Max tokensmax_tokensnumber
The maximum number of tokens that can be generated in the chat completion. The total length of input tokens and generated tokens is limited by the model's context length.
Max completion tokensmax_completion_tokensnumber
The maximum number of tokens that can be generated in the chat completion. The total length of input tokens and generated tokens is limited by the model's context length.
Temperaturetemperaturenumber
What sampling temperature to use, determines the degree of randomness in the response. between 0 and 2, Higher values like 0.8 will make the output more random, while lower values like 0.2 will make it more focused and deterministic. Is recommended altering this, top_p or top_k but not more than one of these.From 0 to 2. Default: 0.7.
Top ptop_pnumber
Cumulative probability for token choices. An alternative to sampling with temperature, called nucleus sampling, where the model considers the results of the tokens with top_p probability mass. So 0.1 means only the tokens comprising the top 10% probability mass are considered. Is recommended altering this, top_k or temperature but not more than one of these.From 0 to 1.
Top ktop_knumber
Amount limit of token choices. An alternative to sampling with temperature, the model considers the results of the first K tokens with higher probability. So 10 means only the first 10 tokens with higher probability are considered. Is recommended altering this, top_p or temperature but not more than one of these.From 1 to 100.
Presence penaltypresence_penaltynumber
Number between -2.0 and 2.0. Positive values penalize new tokens based on whether they appear in the text so far, increasing the model's likelihood to talk about new topics. Not currently implemented; accepted for API compatibilityFrom -2 to 2. Default: 0.
Frequency penaltyfrequency_penaltynumber
Number between -2.0 and 2.0. Positive values penalize new tokens based on their existing frequency in the text so far, decreasing the model's likelihood to repeat the same line verbatim. Not currently implemented; accepted for API compatibilityFrom -2 to 2. Default: 0.
Repetition penaltyrepetition_penaltynumber
Penalizes repeated tokens. A value of 1.0 applies no penalty; values above 1.0 discourage repetition. Only supported for some models (currently MiniMax and gpt-oss models); silently ignored on models that do not support it.From 1 to 2.
Stopstoptext
Sequences where the API will stop generating tokens. The returned text will not contain the stop sequence.
Stream options include usagestream_options_include_usagetrue/false
Whether to include the usage metrics in a final chunk or not
Logprobslogprobstrue/false
This is not yet supported by our models in completions API. Whether to return log probabilities of the output tokens or not. If true, returns the log probabilities of each output token returned in the `content` of `message`.Default: false.
Top logprobstop_logprobsnumber
This is not yet supported by our models in completions API. An integer between 0 and 20 specifying the number of most likely tokens to return at each token position, each with an associated log probability. `logprobs` must be set to `true` if this parameter is used.From 0 to 20.
Nnnumber
How many completions to generate for each prompt. **Note:** Because this parameter generates many completions, it can quickly consume your token quota. Use carefully and ensure that you have reasonable settings for `max_tokens`.From 1 to 1. Default: 1.
Logit biaslogit_biasobject
Modify the likelihood of specified tokens appearing in the generation. Accepts a JSON object that maps tokens (specified by their token ID in the model tokenizer) to an associated bias value from -100 to 100. Mathematically, the bias is added to the logits generated by the model prior to sampling. Values between -1 and 1 should decrease or increase likelihood of selection; values like -100 or 100 should result in a ban or exclusive selection of the relevant token.
Seedseednumber
If specified, our system will make a best effort to sample deterministically, such that repeated requests with the same `seed` and parameters should return the same result. Determinism is not guaranteed, and you should refer to the `system_fingerprint` response parameter to monitor changes in the backend.

Outputs

dataobject
ompletion response returned by the model
Example output
{
  "data": {
    "choices": [],
    "created": 1.0,
    "id": "example",
    "model": "example",
    "object": "chat.completion",
    "system_fingerprint": "example",
    "usage": {
      "acceptance_rate": 1.0,
      "completion_tokens": 1,
      "completion_tokens_after_first_per_sec": 1.0,
      "completion_tokens_after_first_per_sec_first_ten": 1.0,
      "completion_tokens_after_first_per_sec_graph": 1.0,
      "completion_tokens_details": {
        "reasoning_tokens": 1
      },
      "completion_tokens_per_sec": 1.0,
      "end_time": 1.0,
      "is_last_response": true,
      "prompt_tokens": 1,
      "prompt_tokens_details": {
        "cached_tokens": 1
      },
      "start_time": 1.0,
      "stop_reason": "example",
      "time_to_first_token": 1.0,
      "time_to_first_token_graph": 1.0,
      "total_latency": 1.0,
      "total_tokens": 1,
      "total_tokens_per_sec": 1.0
    }
  }
}

Count message tokens

Count message tokens.

Inputs

ModelmodeltextRequired
Model identifier.
Systemsystemtext
System prompt for the conversation. Accepts either a single string (most common) or an array of text blocks (used when individual segments need `cache_control` markers). Multiple text blocks are joined with newlines and prepended to the conversation as a `role: system` message.
Thinking typethinking_typetext
Thinking type.One of: disabled.
Toolstoolslist
Tool definitions the model may call.
Tool choice typetool_choice_typetext
Tool choice type.One of: auto.
Tool choice disable parallel tool usetool_choice_disable_parallel_tool_usetrue/false
Silently dropped.
PromptprompttextRequired
The message to send to the model.

Outputs

dataobject
Token count for the supplied prompt.
Example output
{
  "data": {
    "input_tokens": 1
  }
}

Create embeddings

Create embeddings.

Inputs

ModelmodeltextRequired
The model ID to use See available [models](https://docs.sambanova.ai/docs/en/models/sambacloud-models)
InputinputtextRequired
Input text to embed. to embed multiple inputs in a single request, pass an array of strings. The input must not exceed the max input tokens for the model
Encoding formatencoding_formattext
The format to return the embeddings in. Can be either `float` or `base64`. Omitted from the request when not set.One of: float, base64. Default: float.

Outputs

dataobject
Embeddings response returned by the model
Example output
{
  "data": {
    "data": [],
    "model": "example",
    "object": "list",
    "usage": {
      "acceptance_rate": 1.0,
      "completion_tokens": 1,
      "completion_tokens_after_first_per_sec": 1.0,
      "completion_tokens_after_first_per_sec_first_ten": 1.0,
      "completion_tokens_after_first_per_sec_graph": 1.0,
      "completion_tokens_details": {
        "reasoning_tokens": 1
      },
      "completion_tokens_per_sec": 1.0,
      "end_time": 1.0,
      "is_last_response": true,
      "prompt_tokens": 1,
      "prompt_tokens_details": {
        "cached_tokens": 1
      },
      "start_time": 1.0,
      "stop_reason": "example",
      "time_to_first_token": 1.0,
      "time_to_first_token_graph": 1.0,
      "total_latency": 1.0,
      "total_tokens": 1,
      "total_tokens_per_sec": 1.0
    }
  }
}

Create message

Create message.

Inputs

ModelmodeltextRequired
The model ID to use (e.g. gpt-oss-120b). See available [models](https://docs.sambanova.ai/docs/en/models/sambacloud-models)
Max tokensmax_tokensnumberRequired
Maximum number of tokens to generate. The combined input + output token count is bounded by the model's context window.At least 1.
Systemsystemtext
System prompt for the conversation. Accepts either a single string (most common) or an array of text blocks (used when individual segments need `cache_control` markers). Multiple text blocks are joined with newlines and prepended to the conversation as a `role: system` message.
Temperaturetemperaturenumber
Sampling temperature in `[0.0, 2.0]`. Higher values produce more random output, lower values more deterministic. Adjust only one of `temperature`, `top_p`, `top_k`.From 0 to 2.
Top ptop_pnumber
Nucleus sampling. Considers tokens with cumulative probability mass up to `top_p`.From 0 to 1.
Top ktop_knumber
Top-k sampling. Considers only the K most likely tokens at each step. Set to 0 to disable.At least 0.
Stop sequencesstop_sequenceslist
Custom strings that, when generated, cause the model to stop.
Metadata user idmetadata_user_idtext
External identifier for the end-user making the request. Mapped internally to the Chat Completions `user` field.
Thinking typethinking_typetext
Thinking type.One of: disabled.
Toolstoolslist
Tool definitions the model may call.
Tool choice typetool_choice_typetext
Tool choice type.One of: auto.
Tool choice disable parallel tool usetool_choice_disable_parallel_tool_usetrue/false
Silently dropped.
Service tierservice_tiertext
Service-tier preference. **In v1**: silently droppedOne of: auto, standard_only (Standard only).
Containercontainertext
Existing code-execution container ID to reuse. **In v1**: silently dropped
PromptprompttextRequired
The message to send to the model.

Outputs

dataobject
Non-streaming response from `POST /messages`. Wire-compatible with the official Anthropic Messages API.
Example output
{
  "data": {
    "container": {
      "expires_at": "example",
      "id": "example"
    },
    "content": [],
    "id": "example",
    "model": "example",
    "role": "assistant",
    "stop_details": {
      "category": "cyber",
      "type": "refusal"
    },
    "stop_reason": "end_turn",
    "stop_sequence": "example",
    "type": "message",
    "usage": {
      "cache_creation": {},
      "cache_creation_input_tokens": 1,
      "cache_read_input_tokens": 1,
      "inference_geo": "example",
      "input_tokens": 1,
      "output_tokens": 1,
      "server_tool_use": {},
      "service_tier": "example"
    }
  }
}

Create response

Create response.

Inputs

ModelmodeltextRequired
The model ID to use (e.g. gpt-oss-120b). See available [models](https://docs.sambanova.ai/docs/en/models/sambacloud-models)
InputinputtextRequired
Text input to the model, or a structured list of input items representing the full conversation turn. A plain string is equivalent to a single user message.
Instructionsinstructionstext
Inserts a system (or developer) message as the first item in the model's context. Equivalent to a system-role message prepended to input[].
Max output tokensmax_output_tokensnumber
Upper bound on the number of tokens the model may generate, including visible output tokens and reasoning tokens.
Temperaturetemperaturenumber
Controls randomness in generation. Range: 0 to 2. It is recommended to alter this, top_p, or top_k but not more than one at a time.From 0 to 2. Default: 0.7.
Top ptop_pnumber
Nucleus sampling cutoff. Range: 0 to 1. It is recommended to alter this, temperature, or top_k but not more than one at a time.From 0 to 1. Default: 1.
Top ktop_knumber
Limits sampling to the top K most probable tokens. It is recommended to alter this, top_p, or temperature but not more than one at a time.From 1 to 100.
Top logprobstop_logprobsnumber
Number of top log-probability entries to return per output token. Null means log probabilities are not returned.
Frequency penaltyfrequency_penaltynumber
Number between -2.0 and 2.0. Positive values penalize new tokens based on their existing frequency in the text so far, decreasing the model's likelihood to repeat the same line verbatim. Not currently implemented; accepted for API compatibility and echoed in the response.From -2 to 2. Default: 0.
Presence penaltypresence_penaltynumber
Number between -2.0 and 2.0. Positive values penalize new tokens based on whether they appear in the text so far, increasing the model's likelihood to talk about new topics. Not currently implemented; accepted for API compatibility and echoed in the response.From -2 to 2. Default: 0.
Toolstoolslist
Tools available to the model. Only type: "function" is supported; all other tool types are filtered server-side.
Parallel tool callsparallel_tool_callstrue/false
Whether the model may issue multiple tool calls in parallel within one turn.Default: true.
Max tool callsmax_tool_callsnumber
Maximum number of tool calls the model may make in a single response turn. Not currently implemented; accepted for API compatibility.
Tool choicetool_choicetext
Controls which tool (if any) the model calls. String values: "none" disables tool calls; "auto" lets the model decide; "required" forces at least one tool call. To force a specific function, provide a ResponseNamedToolChoice object.One of: none, auto, required.
Text formattext_formatobject
Controls the format of the model's output for the Responses API text.format field. "text" returns plain text (default). "json_object" returns a raw JSON object. "json_schema" enforces structured output matching a provided JSON Schema definition (fields are flat , no json_schema wrapper key).
Reasoning effortreasoning_efforttext
Reasoning effort level. "low" is faster with less depth; "high" is deeper at higher token cost.One of: low, medium, high. Default: medium.
Userusertext
Included for API compatibility, but only echoed back in response
Metadatametadataobject
Included for API compatibility, but not supported
Storestoretrue/false
SambaNova is stateless - this field is accepted for API compatibility but has no effect. Always echoed back as false.Default: false.
Truncationtruncationtext
Accepted for API compatibility and echoed in the response. Context truncation behavior is not currently configurable via this field in SambaNova.One of: auto, disabled. Default: disabled.
Previous response idprevious_response_idtext
Not supported. SambaNova is stateless and does not maintain server-side conversation state. Accepted for API compatibility but ignored; clients must supply the full conversation history in input[].
Backgroundbackgroundtrue/false
Accepted for API compatibility and echoed back in the response. Has no effect on server behavior.
Service tierservice_tiertext
Accepted for API compatibility and echoed back in the response. Has no effect on server behavior.

Outputs

dataobject
A response object returned by POST /responses (non-streaming). Contains the model's output items, echoed input parameters, lifecycle metadata, and token usage.
Example output
{
  "data": {
    "background": false,
    "completed_at": 1,
    "created_at": 1,
    "error": {
      "code": "example",
      "message": "example"
    },
    "frequency_penalty": 1.0,
    "id": "example",
    "incomplete_details": {
      "reason": "example"
    },
    "instructions": "example",
    "max_output_tokens": 1,
    "max_tool_calls": 1,
    "metadata": {},
    "model": "example",
    "object": "response",
    "output": [],
    "parallel_tool_calls": false,
    "presence_penalty": 1.0,
    "previous_response_id": "example",
    "reasoning": {
      "effort": "low",
      "summary": "example"
    },
    "service_tier": "example",
    "status": "completed",
    "store": false,
    "temperature": 1.0,
    "text": {
      "format": {
        "type": "text"
      }
    },
    "tool_choice": "none",
    "tools": [],
    "top_k": 1,
    "top_logprobs": 1,
    "top_p": 1.0,
    "truncation": "auto",
    "usage": {
      "acceptance_rate": 1.0,
      "end_time": 1.0,
      "input_tokens": 1,
      "input_tokens_details": {
        "cached_tokens": 1
      },
      "is_last_response": false,
      "output_tokens": 1,
      "output_tokens_after_first_per_sec": 1.0,
      "output_tokens_details": {
        "reasoning_tokens": 1
      },
      "output_tokens_per_sec": 1.0,
      "start_time": 1.0,
      "time_to_first_token": 1.0,
      "total_latency": 1.0,
      "total_tokens": 1,
      "total_tokens_per_sec": 1.0
    },
    "user": "example"
  }
}

Get model

Get model.

Inputs

Modelmodel_idtextRequired
model id to get metadata

Outputs

dataobject
model metadata
Example output
{
  "data": {
    "context_length": 1,
    "id": "example",
    "max_completion_tokens": 1,
    "object": "model",
    "owned_by": "example",
    "pricing": {
      "completion": 1.0,
      "duration_per_hour": 1.0,
      "prompt": 1.0
    },
    "sn_metadata": {}
  }
}

List models

List models. Returns one page; use the continuation fields for more results.

Inputs

None.

Outputs

dataobject
object containing available models and metadata
Example output
{
  "data": {
    "data": [],
    "object": "list"
  }
}

On this page