Skip to main content
RunPod logo
  • Category: developer tools
  • Auth: API_KEY
  • Composio-managed OAuth available? N/A
  • Tools: 13
  • Triggers: 0
  • Slug: RUNPOD
  • Version: 20261101_00

Tools

Slug: RUNPOD_CREATE_CLUSTERTool to create a new GPU cluster for multi-node distributed computing workloads on RunPod. Use when you need to deploy multiple pods with shared configuration for parallel processing, ML training, or HPC workloads.

Input Parameters

array
Optional list of environment variables to set in the container. Each entry should be a dict with ‘key’ and ‘value’ fields.
string ("APPLICATION" | "TRAINING" | "SLURM")
required
Type of cluster to create: APPLICATION for general-purpose workloads, TRAINING for ML training jobs, or SLURM for high-performance computing with SLURM scheduler.
string
Optional comma-separated list of ports to expose on the pods.
integer
required
Integer specifying the number of pods in the cluster. Must be at least 1.
boolean
Optional flag to enable SSH access on each pod. Default is false.
string
Optional Docker image name to use for the pods. If not specified, the template’s default image is used.
integer
Optional network throughput specification for the volume in MB/s.
string
Optional encryption key for the volume.
number
Optional maximum deployment cost threshold. If specified, deployment will fail if the estimated cost exceeds this value.
string
Optional Docker run arguments to pass when starting the container.
string
required
String identifier for the GPU type to use in the cluster (e.g., ‘NVIDIA GeForce RTX 3070’, ‘NVIDIA A100 80GB PCIe’).
string
Optional template ID to use for pod configuration. References a pre-configured pod template with specific Docker image and settings.
string
Optional name to identify the cluster. If not provided, a default name will be generated.
integer
Optional size in GB for the persistent volume to attach to each pod.
boolean
Optional flag to automatically start JupyterLab on each pod. Default is false.
string
Optional data center ID to specify the geographical location for cluster deployment.
string
Optional minimum CUDA version required for the cluster.
integer
required
Integer specifying the number of GPUs per pod. Must be at least 1.
string
Optional network volume ID to attach to all pods in the cluster for shared storage.
string
Optional path where the volume should be mounted inside the container.
integer
Optional size in GB for the container disk. This is ephemeral storage that is reset when the pod restarts.
array
Optional list of allowed CUDA versions for the cluster.

Output

string
required
Data from the action execution
string
Error if any occurred during the execution of the action
boolean
required
Whether or not the action execution was successful or not
Slug: RUNPOD_CREATE_SECRETTool to create a new secure secret in RunPod for credential management. Use when you need to store sensitive values like API keys, passwords, or tokens that will be accessible in pods and endpoints via environment variables (RUNPOD_SECRET_<name>).

Input Parameters

string
required
Unique identifier name for the secret. This name will be used to reference the secret in pods and endpoints (accessible via environment variable RUNPOD_SECRET_<name>). Must be unique within your account.
string
required
The secret value to store securely. This will be encrypted and stored securely by RunPod.
string
Optional human-readable description of what this secret is used for. Helps with secret management and documentation.

Output

string
required
Data from the action execution
string
Error if any occurred during the execution of the action
boolean
required
Whether or not the action execution was successful or not
Slug: RUNPOD_DELETE_REGISTRY_AUTHTool to delete container registry authentication from RunPod. Use when you need to remove stored registry credentials.

Input Parameters

string
required
The ID of the container registry authentication to delete. This is the unique identifier returned when the registry authentication was created.

Output

string
required
Data from the action execution
string
Error if any occurred during the execution of the action
boolean
required
Whether or not the action execution was successful or not
Slug: RUNPOD_DELETE_TEMPLATETool to remove a RunPod template via GraphQL mutation. Use when you need to delete a template that is no longer needed. The template must not be in use by any pods or assigned to any serverless endpoints, otherwise the operation will fail.

Input Parameters

string
required
The name of the template to delete. The template must not be in use by any pods or assigned to any serverless endpoints.

Output

string
required
Data from the action execution
string
Error if any occurred during the execution of the action
boolean
required
Whether or not the action execution was successful or not
Slug: RUNPOD_GET_GPU_TYPESTool to retrieve available GPU types and their specifications, pricing, and availability from RunPod. Use when you need to find GPU options for deployment.

Input Parameters

object
Filter options for querying GPU types.

Output

string
required
Data from the action execution
string
Error if any occurred during the execution of the action
boolean
required
Whether or not the action execution was successful or not
Slug: RUNPOD_GET_MYSELFRetrieve basic information about the authenticated Runpod user, including ID, email, terms of service status, and MFA settings.

Output

string
required
Data from the action execution
string
Error if any occurred during the execution of the action
boolean
required
Whether or not the action execution was successful or not
Slug: RUNPOD_GET_PODRetrieve a Runpod pod by ID, including its configuration, GPU count, memory, hourly cost, and desired status.

Input Parameters

string
required
The unique identifier of the pod to retrieve. This is the pod ID assigned by RunPod when the pod was created.

Output

string
required
Data from the action execution
string
Error if any occurred during the execution of the action
boolean
required
Whether or not the action execution was successful or not
Slug: RUNPOD_LIST_CPU_TYPESTool to retrieve available CPU types and their specifications from RunPod. Use when you need to view CPU options for provisioning pods or selecting hardware configurations.

Output

string
required
Data from the action execution
string
Error if any occurred during the execution of the action
boolean
required
Whether or not the action execution was successful or not
Slug: RUNPOD_SAVE_ENDPOINTTool to create or update a RunPod serverless endpoint with GPU configuration and scaling settings. Use when configuring new GPU-accelerated serverless endpoints or modifying existing endpoint parameters. Include ‘id’ parameter to update an existing endpoint, omit it to create a new one.

Input Parameters

string
Endpoint ID to update an existing endpoint. If provided, the mutation will update the existing endpoint instead of creating a new one. Omit this field to create a new endpoint.
string
required
Name of the endpoint (required for creation). Must be a descriptive identifier for the serverless endpoint.
string
required
GPU type identifier for the endpoint (required for creation). Examples: ‘NVIDIA RTX A4000’, ‘NVIDIA A40’, ‘NVIDIA RTX A5000’. Specify the exact GPU model string from RunPod’s available GPU types.
string
Comma-separated list of data center locations where the endpoint should run. Example: ‘US-CA-1,US-OR-1’. If not specified, RunPod will choose automatically.
string
Type of autoscaling algorithm to use. Options: ‘QUEUE_DELAY’ (scale based on queue wait time), ‘REQUEST_COUNT’ (scale based on number of requests). QUEUE_DELAY is recommended for most use cases.
string
required
Template ID for the endpoint configuration (required for creation). This is the ID of a pre-configured template in your RunPod account.
integer
Maximum number of workers (GPU instances) to scale up to. This is the upper limit for autoscaling. Must be >= workers_min.
integer
Minimum number of workers (GPU instances) to keep running. Set to 0 to allow scaling down to zero when idle. Set to 1 or higher to maintain always-on capacity.
integer
Idle timeout in seconds before workers are scaled down. Workers will be terminated after being idle for this duration. Common values: 5, 10, 30, 60.
integer
Target value for the scaler. For QUEUE_DELAY: target delay in seconds before scaling up. For REQUEST_COUNT: target number of requests per worker. Common values: 1-10 for QUEUE_DELAY, 1-100 for REQUEST_COUNT.
string
Network volume ID to attach to the endpoint for persistent storage. If specified, this network volume will be mounted to all workers.

Output

string
required
Data from the action execution
string
Error if any occurred during the execution of the action
boolean
required
Whether or not the action execution was successful or not
Slug: RUNPOD_SAVE_REGISTRY_AUTHTool to save container registry authentication credentials for accessing private Docker images in RunPod. Use when you need to store credentials for a private container registry.

Input Parameters

string
required
A user-defined name for the container registry authentication credential. This name must be unique across all registry authentications in your account.
string
required
The password for authenticating with the container registry.
string
required
The username for authenticating with the container registry.

Output

string
required
Data from the action execution
string
Error if any occurred during the execution of the action
boolean
required
Whether or not the action execution was successful or not
Slug: RUNPOD_SAVE_TEMPLATECreate or update a Runpod template with container configuration for pods or serverless endpoints; set the volume size to 0 for serverless templates. Updates also send Docker arguments and environment variables, defaulting to an empty string and empty list when omitted.

Input Parameters

array
List of environment variables to set in the container. Each entry must have ‘key’ and ‘value’ fields. Pass empty array if no env vars needed.
string
required
Unique name for the template. Must be unique across your account. Used to identify the template for pod or serverless deployment.
string
Comma-separated list of ports to expose from the container. Format: ‘port/protocol’ or just ‘port’. Example: ‘8080/http,8888/http’
string
Markdown-formatted readme documentation for the template. Use this to document usage instructions, requirements, and configuration details.
string
required
Docker image to use for the template. Can be from Docker Hub or a private registry. Include the full image path with tag.
string
Additional Docker arguments to pass when starting the container. Use this for advanced Docker configuration. Leave empty if not needed.
string
ID of an existing template to update. Leave empty to create a new template. Provide the template ID to modify an existing template.
integer
required
Network volume size in gigabytes for persistent storage. Set to 0 if no persistent volume is needed. For serverless templates, always use 0.
boolean
required
Whether this template is for serverless endpoints (true) or standard pods (false). Serverless templates must have volumeInGb set to 0.
string
Mount path for the network volume inside the container. Only applicable if volumeInGb > 0. Example: /workspace or /data
integer
required
Container disk size in gigabytes. This is ephemeral storage that gets reset on pod restart. Minimum 10 GB recommended. Used for temporary files and cache.

Output

string
required
Data from the action execution
string
Error if any occurred during the execution of the action
boolean
required
Whether or not the action execution was successful or not
Slug: RUNPOD_UPDATE_REGISTRY_AUTHUpdate an existing Runpod container registry authentication credential by supplying its ID, username, and password.

Input Parameters

string
required
The authentication credential identifier to update
string
required
The new password for registry authentication
string
required
The new username for registry authentication

Output

string
required
Data from the action execution
string
Error if any occurred during the execution of the action
boolean
required
Whether or not the action execution was successful or not
Slug: RUNPOD_UPDATE_USER_SETTINGSUpdate the authenticated Runpod user’s SSH public key for pod access.

Input Parameters

string
required
SSH public key to associate with the user account. This key will be used for SSH access to pods. Must be a valid SSH public key in OpenSSH format (e.g., ‘ssh-rsa AAAAB3…’ or ‘ssh-ed25519 AAAAC3…’).

Output

string
required
Data from the action execution
string
Error if any occurred during the execution of the action
boolean
required
Whether or not the action execution was successful or not