Skip to main content
LLM API logo
  • Category: artificial intelligence
  • Auth: API_KEY
  • Composio-managed OAuth available? N/A
  • Tools: 12
  • Triggers: 0
  • Slug: LLM_API
  • Version: 20261101_00

Tools

Slug: LLM_API_CANCEL_BATCHRequest best-effort cancellation of an in-progress batch. Return the provider’s actual batch state without implying cancellation took effect; work may still finish and incur charges before the request is applied.

Input Parameters

string
required
ID of the batch whose cancellation should be requested.

Output

string
required
Data from the action execution
string
Error if any occurred during the execution of the action
boolean
required
Whether or not the action execution was successful or not
Slug: LLM_API_COUNT_ANTHROPIC_MESSAGE_TOKENSCount input tokens for an Anthropic-compatible message request without generating a model response.

Input Parameters

string
required
Model ID or alias whose tokenizer and message framing should be used.
array
Anthropic-compatible tool definitions whose framing should be included in the count.
string
System prompt as text or Anthropic-compatible content blocks to include in the count.
array
required
Ordered, non-empty Anthropic-compatible messages to include in the token count.
object
Anthropic-compatible tool-selection configuration to include in the message framing.

Output

string
required
Data from the action execution
string
Error if any occurred during the execution of the action
boolean
required
Whether or not the action execution was successful or not
Slug: LLM_API_CREATE_ANTHROPIC_MESSAGEGenerate one complete, non-streaming Anthropic-compatible message with flexible content blocks, system prompts, and tool use with your own connection. Instant supports the Claude models listed in its pricing, with plain-text messages and a plain-text system prompt; tools, content blocks and other models are rejected before provider execution.

Input Parameters

string
required
Claude-family or other model ID exposed through the Anthropic-compatible Messages contract.
array
Anthropic-compatible tool definitions available to the model.
number
Nucleus-sampling probability from 0 through 1, when supported.
string
Anthropic-compatible system prompt as text or supported content blocks.
array
required
Ordered, non-empty Anthropic-compatible conversation messages.
integer
required
Maximum number of output tokens to generate.
number
Sampling temperature from 0 through 1, when supported by the model.
object
Anthropic-compatible tool-selection configuration.
array
Custom text sequences that stop generation.

Output

string
required
Data from the action execution
string
Error if any occurred during the execution of the action
boolean
required
Whether or not the action execution was successful or not
Slug: LLM_API_CREATE_CHAT_COMPLETIONGenerate a complete, non-streaming OpenAI-compatible chat response. Instant supports only the models listed in its pricing, with plain-text messages: no tools, multimodal content, web search, or reasoning-effort overrides. Unsupported Instant requests are rejected before provider execution. With your own connection, use models and capabilities supported by your provider project.

Input Parameters

string
required
Model ID or alias from Discover Models that supports chat completions. Instant supports only the models listed in this action’s pricing; other models require your own connection.
array
OpenAI-compatible function or provider tool definitions available to the model.
number
Nucleus-sampling probability accepted by the selected model; supported ranges are model-dependent.
array
required
Ordered OpenAI-compatible conversation messages with model-supported content and tool-call fields.
integer
Maximum tokens to generate for models using the legacy max_tokens field.
Enable provider web search when the selected model and project support it with your own connection. Instant requires false or omission; true is rejected before provider execution.
number
Sampling temperature accepted by the selected model; supported ranges are model-dependent.
string
How the model may select supplied tools, using the OpenAI-compatible form supported by the model.
boolean
Disable reasoning when supported, including non-reasoning selection for auto routing.
object
OpenAI-compatible response-format object for text, JSON, or a model-supported JSON schema.
string
Reasoning effort for models that advertise this parameter with your own connection. Instant requires omission.
object
Provider web-search options for your own connection. Instant requires omission; even an empty object enables search at the provider and is rejected.
integer
Maximum completion tokens for models using the newer field. Avoid setting both token limits unless the model supports them.

Output

string
required
Data from the action execution
string
Error if any occurred during the execution of the action
boolean
required
Whether or not the action execution was successful or not
Slug: LLM_API_CREATE_EMBEDDINGSCreate vector embeddings for one text or a batch of texts with a selected embedding model. Requires your own connection; this action is unavailable through Instant.

Input Parameters

string
Stable, non-sensitive end-user identifier for provider abuse monitoring.
string
required
One text or a non-empty list of texts to embed in one request.
string
required
Embedding model ID or alias from the model catalog.
integer
Requested vector length when the selected model supports configurable dimensions.
string ("float" | "base64")
Return each embedding as numeric floats or a base64-encoded string.

Output

string
required
Data from the action execution
string
Error if any occurred during the execution of the action
boolean
required
Whether or not the action execution was successful or not
Slug: LLM_API_CREATE_RESPONSEGenerate one complete, non-streaming OpenAI Responses-compatible result from text or structured input, preserving reasoning and tool items. Requires your own connection; this action is unavailable through Instant.

Input Parameters

object
Responses text-output configuration supported by the selected model.
string
required
Text or OpenAI Responses-compatible input messages/items, including model-supported multimodal content.
string
required
Model ID or alias that supports the Responses API binding.
array
Responses-compatible tools available to the model.
object
Reasoning configuration, such as an effort level, for supported models.
string
Responses-compatible tool-selection policy.
string
High-level instructions applied to the response.
object
Compatibility response-format object supported by the selected model.
integer
Maximum output tokens. The provider requires at least 16 when supplied.

Output

string
required
Data from the action execution
string
Error if any occurred during the execution of the action
boolean
required
Whether or not the action execution was successful or not
Slug: LLM_API_DELETE_FILEPermanently delete a caller-owned or explicitly authorized project file. This destructive operation cannot be undone; a missing file fails with not found rather than reporting a successful deletion.

Input Parameters

string
required
ID of a caller-owned or explicitly authorized project file to delete permanently. This destructive operation cannot be undone.

Output

string
required
Data from the action execution
string
Error if any occurred during the execution of the action
boolean
required
Whether or not the action execution was successful or not
Slug: LLM_API_DISCOVER_MODELSReturn one model’s full live capabilities by ID, or browse a compact, bounded view of the live model catalog using local capability filters.

Input Parameters

string
Optional exact catalog kind to retain, such as chat or embedding.
string
Exact model ID or alias to inspect; omit to browse the catalog.
boolean
When browsing, return only models cataloged as free. This does not guarantee that the connected account can invoke them.
integer
Maximum matching catalog entries to return after local filtering (1-200).
boolean
Exclude deprecated models from catalog browsing.
boolean
Include deactivated models in catalog browsing.
string
Optional capability or supported parameter that returned models must advertise, such as tools or image_input.

Output

string
required
Data from the action execution
string
Error if any occurred during the execution of the action
boolean
required
Whether or not the action execution was successful or not
Slug: LLM_API_GET_ACCOUNT_AND_CREDITSReturn the connected user, project, organization, purchased and bonus credit balances, funding mode, and balance gating in one account-status read.

Output

string
required
Data from the action execution
string
Error if any occurred during the execution of the action
boolean
required
Whether or not the action execution was successful or not
Slug: LLM_API_LIST_OR_GET_BATCHESReturn one asynchronous batch and its latest lifecycle, token, and cost status by ID, or one provider-default page of project batches when no batch ID is supplied. List mode supports provider cursor pagination.

Input Parameters

string
In list mode, return the page after this batch ID. Pass the prior response’s last_id to continue.
integer
In list mode, maximum number of batches for the provider to return.
string
Exact batch ID whose current status should be returned; omit to return one provider-default page of batches.

Output

string
required
Data from the action execution
string
Error if any occurred during the execution of the action
boolean
required
Whether or not the action execution was successful or not
Slug: LLM_API_LIST_OR_GET_FILESReturn metadata for one project file by ID, or one provider-default page of project file metadata when no file ID is supplied. List mode supports purpose filtering and provider cursor pagination.

Input Parameters

string
In list mode, return the page after this file ID. When has_more is true, pass the final files[].id from the previous response.
integer
In list mode, maximum number of files for the provider to return.
string
Exact file ID to inspect; omit to return one provider-default page of project files.
string
In list mode, return only files uploaded for this purpose.

Output

string
required
Data from the action execution
string
Error if any occurred during the execution of the action
boolean
required
Whether or not the action execution was successful or not
Slug: LLM_API_SUBMIT_BATCHCreate an asynchronous batch for chat completions or responses from an existing purpose=batch file ID, or upload a JSONL input file and create the batch. If batch creation fails after upload, the tool attempts to delete the uploaded file.

Input Parameters

string ("/v1/chat/completions" | "/v1/responses")
required
Endpoint used by every JSONL request in this batch.
object
JSONL batch request file to upload before submission.
string
Existing purpose=batch file ID. Provide exactly one of input_file_id or input_file.
string
Provider completion window. The only documented value is 24h.

Output

string
required
Data from the action execution
string
Error if any occurred during the execution of the action
boolean
required
Whether or not the action execution was successful or not