> ## Documentation Index
> Fetch the complete documentation index at: https://composio-preview.mintlify.site/llms.txt
> Use this file to discover all available pages before exploring further.

# RunPod

> The Cloud Built for AI - GPU cloud computing platform for AI and machine learning workloads

![RunPod logo](https://mintcdn.com/composio-preview/YYC5iurbUCUzEs77/images/toolkits/runpod.svg?fit=max\&auto=format\&n=YYC5iurbUCUzEs77\&q=85\&s=21ff3c0591364dd09264cda4309b3b7c)

* **Category:** developer tools
* **Auth:** API\_KEY
* **Composio-managed OAuth available?** N/A
* **Tools:** 13
* **Triggers:** 0
* **Slug:** `RUNPOD`
* **Version:** 20261101\_00

## Tools

> [accordion] Create RunPod Cluster
>
> **Slug:** `RUNPOD_CREATE_CLUSTER`
>
> Tool to create a new GPU cluster for multi-node distributed computing workloads on RunPod. Use when you need to deploy multiple pods with shared configuration for parallel processing, ML training, or HPC workloads.
>
> #### Input Parameters
>
> **env** `array`
>
> Optional list of environment variables to set in the container. Each entry should be a dict with 'key' and 'value' fields.
>
> **type** `string ("APPLICATION" | "TRAINING" | "SLURM")` *required*
>
> Type of cluster to create: APPLICATION for general-purpose workloads, TRAINING for ML training jobs, or SLURM for high-performance computing with SLURM scheduler.
>
> **ports** `string`
>
> Optional comma-separated list of ports to expose on the pods.
>
> **pod\_count** `integer` *required*
>
> Integer specifying the number of pods in the cluster. Must be at least 1.
>
> **start\_ssh** `boolean`
>
> Optional flag to enable SSH access on each pod. Default is false.
>
> **image\_name** `string`
>
> Optional Docker image name to use for the pods. If not specified, the template's default image is used.
>
> **throughput** `integer`
>
> Optional network throughput specification for the volume in MB/s.
>
> **volume\_key** `string`
>
> Optional encryption key for the volume.
>
> **deploy\_cost** `number`
>
> Optional maximum deployment cost threshold. If specified, deployment will fail if the estimated cost exceeds this value.
>
> **docker\_args** `string`
>
> Optional Docker run arguments to pass when starting the container.
>
> **gpu\_type\_id** `string` *required*
>
> String identifier for the GPU type to use in the cluster (e.g., 'NVIDIA GeForce RTX 3070', 'NVIDIA A100 80GB PCIe').
>
> **template\_id** `string`
>
> Optional template ID to use for pod configuration. References a pre-configured pod template with specific Docker image and settings.
>
> **cluster\_name** `string`
>
> Optional name to identify the cluster. If not provided, a default name will be generated.
>
> **volume\_in\_gb** `integer`
>
> Optional size in GB for the persistent volume to attach to each pod.
>
> **start\_jupyter** `boolean`
>
> Optional flag to automatically start JupyterLab on each pod. Default is false.
>
> **data\_center\_id** `string`
>
> Optional data center ID to specify the geographical location for cluster deployment.
>
> **min\_cuda\_version** `string`
>
> Optional minimum CUDA version required for the cluster.
>
> **gpu\_count\_per\_pod** `integer` *required*
>
> Integer specifying the number of GPUs per pod. Must be at least 1.
>
> **network\_volume\_id** `string`
>
> Optional network volume ID to attach to all pods in the cluster for shared storage.
>
> **volume\_mount\_path** `string`
>
> Optional path where the volume should be mounted inside the container.
>
> **container\_disk\_in\_gb** `integer`
>
> Optional size in GB for the container disk. This is ephemeral storage that is reset when the pod restarts.
>
> **allowed\_cuda\_versions** `array`
>
> Optional list of allowed CUDA versions for the cluster.
>
> #### Output
>
> **data** `string` *required*
>
> Data from the action execution
>
> **error** `string`
>
> Error if any occurred during the execution of the action
>
> **successful** `boolean` *required*
>
> Whether or not the action execution was successful or not

> [accordion] Create Secret
>
> **Slug:** `RUNPOD_CREATE_SECRET`
>
> Tool to create a new secure secret in RunPod for credential management. Use when you need to store sensitive values like API keys, passwords, or tokens that will be accessible in pods and endpoints via environment variables (RUNPOD\_SECRET\_\<name>).
>
> #### Input Parameters
>
> **name** `string` *required*
>
> Unique identifier name for the secret. This name will be used to reference the secret in pods and endpoints (accessible via environment variable RUNPOD\_SECRET\_\<name>). Must be unique within your account.
>
> **value** `string` *required*
>
> The secret value to store securely. This will be encrypted and stored securely by RunPod.
>
> **description** `string`
>
> Optional human-readable description of what this secret is used for. Helps with secret management and documentation.
>
> #### Output
>
> **data** `string` *required*
>
> Data from the action execution
>
> **error** `string`
>
> Error if any occurred during the execution of the action
>
> **successful** `boolean` *required*
>
> Whether or not the action execution was successful or not

> [accordion] Delete Container Registry Authentication
>
> **Slug:** `RUNPOD_DELETE_REGISTRY_AUTH`
>
> Tool to delete container registry authentication from RunPod. Use when you need to remove stored registry credentials.
>
> #### Input Parameters
>
> **registry\_auth\_id** `string` *required*
>
> The ID of the container registry authentication to delete. This is the unique identifier returned when the registry authentication was created.
>
> #### Output
>
> **data** `string` *required*
>
> Data from the action execution
>
> **error** `string`
>
> Error if any occurred during the execution of the action
>
> **successful** `boolean` *required*
>
> Whether or not the action execution was successful or not

> [accordion] Delete Template
>
> **Slug:** `RUNPOD_DELETE_TEMPLATE`
>
> Tool to remove a RunPod template via GraphQL mutation. Use when you need to delete a template that is no longer needed. The template must not be in use by any pods or assigned to any serverless endpoints, otherwise the operation will fail.
>
> #### Input Parameters
>
> **template\_name** `string` *required*
>
> The name of the template to delete. The template must not be in use by any pods or assigned to any serverless endpoints.
>
> #### Output
>
> **data** `string` *required*
>
> Data from the action execution
>
> **error** `string`
>
> Error if any occurred during the execution of the action
>
> **successful** `boolean` *required*
>
> Whether or not the action execution was successful or not

> [accordion] Get GPU Types
>
> **Slug:** `RUNPOD_GET_GPU_TYPES`
>
> Tool to retrieve available GPU types and their specifications, pricing, and availability from RunPod. Use when you need to find GPU options for deployment.
>
> #### Input Parameters
>
> **input** `object`
>
> Filter options for querying GPU types.
>
> #### Output
>
> **data** `string` *required*
>
> Data from the action execution
>
> **error** `string`
>
> Error if any occurred during the execution of the action
>
> **successful** `boolean` *required*
>
> Whether or not the action execution was successful or not

> [accordion] Get authenticated user info
>
> **Slug:** `RUNPOD_GET_MYSELF`
>
> Retrieve basic information about the authenticated Runpod user, including ID, email, terms of service status, and MFA settings.
>
> #### Output
>
> **data** `string` *required*
>
> Data from the action execution
>
> **error** `string`
>
> Error if any occurred during the execution of the action
>
> **successful** `boolean` *required*
>
> Whether or not the action execution was successful or not

> [accordion] Get Pod Details
>
> **Slug:** `RUNPOD_GET_POD`
>
> Retrieve a Runpod pod by ID, including its configuration, GPU count, memory, hourly cost, and desired status.
>
> #### Input Parameters
>
> **pod\_id** `string` *required*
>
> The unique identifier of the pod to retrieve. This is the pod ID assigned by RunPod when the pod was created.
>
> #### Output
>
> **data** `string` *required*
>
> Data from the action execution
>
> **error** `string`
>
> Error if any occurred during the execution of the action
>
> **successful** `boolean` *required*
>
> Whether or not the action execution was successful or not

> [accordion] List CPU Types
>
> **Slug:** `RUNPOD_LIST_CPU_TYPES`
>
> Tool to retrieve available CPU types and their specifications from RunPod. Use when you need to view CPU options for provisioning pods or selecting hardware configurations.
>
> #### Output
>
> **data** `string` *required*
>
> Data from the action execution
>
> **error** `string`
>
> Error if any occurred during the execution of the action
>
> **successful** `boolean` *required*
>
> Whether or not the action execution was successful or not

> [accordion] Save Serverless Endpoint
>
> **Slug:** `RUNPOD_SAVE_ENDPOINT`
>
> Tool to create or update a RunPod serverless endpoint with GPU configuration and scaling settings. Use when configuring new GPU-accelerated serverless endpoints or modifying existing endpoint parameters. Include 'id' parameter to update an existing endpoint, omit it to create a new one.
>
> #### Input Parameters
>
> **id** `string`
>
> Endpoint ID to update an existing endpoint. If provided, the mutation will update the existing endpoint instead of creating a new one. Omit this field to create a new endpoint.
>
> **name** `string` *required*
>
> Name of the endpoint (required for creation). Must be a descriptive identifier for the serverless endpoint.
>
> **gpu\_ids** `string` *required*
>
> GPU type identifier for the endpoint (required for creation). Examples: 'NVIDIA RTX A4000', 'NVIDIA A40', 'NVIDIA RTX A5000'. Specify the exact GPU model string from RunPod's available GPU types.
>
> **locations** `string`
>
> Comma-separated list of data center locations where the endpoint should run. Example: 'US-CA-1,US-OR-1'. If not specified, RunPod will choose automatically.
>
> **scaler\_type** `string`
>
> Type of autoscaling algorithm to use. Options: 'QUEUE\_DELAY' (scale based on queue wait time), 'REQUEST\_COUNT' (scale based on number of requests). QUEUE\_DELAY is recommended for most use cases.
>
> **template\_id** `string` *required*
>
> Template ID for the endpoint configuration (required for creation). This is the ID of a pre-configured template in your RunPod account.
>
> **workers\_max** `integer`
>
> Maximum number of workers (GPU instances) to scale up to. This is the upper limit for autoscaling. Must be >= workers\_min.
>
> **workers\_min** `integer`
>
> Minimum number of workers (GPU instances) to keep running. Set to 0 to allow scaling down to zero when idle. Set to 1 or higher to maintain always-on capacity.
>
> **idle\_timeout** `integer`
>
> Idle timeout in seconds before workers are scaled down. Workers will be terminated after being idle for this duration. Common values: 5, 10, 30, 60.
>
> **scaler\_value** `integer`
>
> Target value for the scaler. For QUEUE\_DELAY: target delay in seconds before scaling up. For REQUEST\_COUNT: target number of requests per worker. Common values: 1-10 for QUEUE\_DELAY, 1-100 for REQUEST\_COUNT.
>
> **network\_volume\_id** `string`
>
> Network volume ID to attach to the endpoint for persistent storage. If specified, this network volume will be mounted to all workers.
>
> #### Output
>
> **data** `string` *required*
>
> Data from the action execution
>
> **error** `string`
>
> Error if any occurred during the execution of the action
>
> **successful** `boolean` *required*
>
> Whether or not the action execution was successful or not

> [accordion] Save Container Registry Authentication
>
> **Slug:** `RUNPOD_SAVE_REGISTRY_AUTH`
>
> Tool to save container registry authentication credentials for accessing private Docker images in RunPod. Use when you need to store credentials for a private container registry.
>
> #### Input Parameters
>
> **name** `string` *required*
>
> A user-defined name for the container registry authentication credential. This name must be unique across all registry authentications in your account.
>
> **password** `string` *required*
>
> The password for authenticating with the container registry.
>
> **username** `string` *required*
>
> The username for authenticating with the container registry.
>
> #### Output
>
> **data** `string` *required*
>
> Data from the action execution
>
> **error** `string`
>
> Error if any occurred during the execution of the action
>
> **successful** `boolean` *required*
>
> Whether or not the action execution was successful or not

> [accordion] Save Template
>
> **Slug:** `RUNPOD_SAVE_TEMPLATE`
>
> Create or update a Runpod template with container configuration for pods or serverless endpoints; set the volume size to 0 for serverless templates. Updates also send Docker arguments and environment variables, defaulting to an empty string and empty list when omitted.
>
> #### Input Parameters
>
> **env** `array`
>
> List of environment variables to set in the container. Each entry must have 'key' and 'value' fields. Pass empty array if no env vars needed.
>
> **name** `string` *required*
>
> Unique name for the template. Must be unique across your account. Used to identify the template for pod or serverless deployment.
>
> **ports** `string`
>
> Comma-separated list of ports to expose from the container. Format: 'port/protocol' or just 'port'. Example: '8080/http,8888/http'
>
> **readme** `string`
>
> Markdown-formatted readme documentation for the template. Use this to document usage instructions, requirements, and configuration details.
>
> **image\_name** `string` *required*
>
> Docker image to use for the template. Can be from Docker Hub or a private registry. Include the full image path with tag.
>
> **docker\_args** `string`
>
> Additional Docker arguments to pass when starting the container. Use this for advanced Docker configuration. Leave empty if not needed.
>
> **template\_id** `string`
>
> ID of an existing template to update. Leave empty to create a new template. Provide the template ID to modify an existing template.
>
> **volume\_in\_gb** `integer` *required*
>
> Network volume size in gigabytes for persistent storage. Set to 0 if no persistent volume is needed. For serverless templates, always use 0.
>
> **is\_serverless** `boolean` *required*
>
> Whether this template is for serverless endpoints (true) or standard pods (false). Serverless templates must have volumeInGb set to 0.
>
> **volume\_mount\_path** `string`
>
> Mount path for the network volume inside the container. Only applicable if volumeInGb > 0. Example: /workspace or /data
>
> **container\_disk\_in\_gb** `integer` *required*
>
> Container disk size in gigabytes. This is ephemeral storage that gets reset on pod restart. Minimum 10 GB recommended. Used for temporary files and cache.
>
> #### Output
>
> **data** `string` *required*
>
> Data from the action execution
>
> **error** `string`
>
> Error if any occurred during the execution of the action
>
> **successful** `boolean` *required*
>
> Whether or not the action execution was successful or not

> [accordion] Update Registry Auth
>
> **Slug:** `RUNPOD_UPDATE_REGISTRY_AUTH`
>
> Update an existing Runpod container registry authentication credential by supplying its ID, username, and password.
>
> #### Input Parameters
>
> **id** `string` *required*
>
> The authentication credential identifier to update
>
> **password** `string` *required*
>
> The new password for registry authentication
>
> **username** `string` *required*
>
> The new username for registry authentication
>
> #### Output
>
> **data** `string` *required*
>
> Data from the action execution
>
> **error** `string`
>
> Error if any occurred during the execution of the action
>
> **successful** `boolean` *required*
>
> Whether or not the action execution was successful or not

> [accordion] Update User Settings
>
> **Slug:** `RUNPOD_UPDATE_USER_SETTINGS`
>
> Update the authenticated Runpod user's SSH public key for pod access.
>
> #### Input Parameters
>
> **pub\_key** `string` *required*
>
> SSH public key to associate with the user account. This key will be used for SSH access to pods. Must be a valid SSH public key in OpenSSH format (e.g., 'ssh-rsa AAAAB3...' or 'ssh-ed25519 AAAAC3...').
>
> #### Output
>
> **data** `string` *required*
>
> Data from the action execution
>
> **error** `string`
>
> Error if any occurred during the execution of the action
>
> **successful** `boolean` *required*
>
> Whether or not the action execution was successful or not
