Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 2 additions & 2 deletions api-reference-v2/openapi.json
Original file line number Diff line number Diff line change
Expand Up @@ -5568,7 +5568,7 @@
"get": {
"operationId": "getPodLogs",
"summary": "Stream pod logs",
"description": "Streams pod logs as Server-Sent Events. The `source` query parameter\nselects which log source to include.\n\nThe SSE `data` payload shape is:\n`{ \"source\": \"container\", \"line\": \"...\", \"ts\": \"...\" }`.\nLog-event `id` values are the event `ts` timestamp so\nbrowser/EventSource reconnects can resume with `Last-Event-ID`.\n",
"description": "Stream Pod logs as Server-Sent Events. Choose a log source, receive source, line, and ts fields, and resume using Last-Event-ID.",
"tags": [
"Pods"
],
Expand Down Expand Up @@ -7093,7 +7093,7 @@
"get": {
"operationId": "getWorkerLogs",
"summary": "Stream serverless worker logs",
"description": "Streams a serverless worker's logs as Server-Sent Events. The `source`\nquery parameter selects which log source to include.\n\nThe SSE `data` payload shape is:\n`{ \"source\": \"container\", \"line\": \"...\", \"ts\": \"...\" }`.\nLog-event `id` values are the event `ts` timestamp so browser/EventSource\nreconnects can resume with `Last-Event-ID`.\n",
"description": "Stream Serverless worker logs as Server-Sent Events. Choose a log source, receive source, line, and ts fields, and resume using Last-Event-ID.",
"tags": [
"Serverless"
],
Expand Down
2 changes: 2 additions & 0 deletions instant-clusters.mdx
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
---

Check warning on line 1 in instant-clusters.mdx

View check run for this annotation

Mintlify / Mintlify Validation (runpod-b18f5ded) - vale-spellcheck

instant-clusters.mdx#L1

Try to keep the Automated Readability Index (10.21) below 8.

Check warning on line 1 in instant-clusters.mdx

View check run for this annotation

Mintlify / Mintlify Validation (runpod-b18f5ded) - vale-spellcheck

instant-clusters.mdx#L1

Try to keep the Flesch reading ease score (48.35) above 70.

Check warning on line 1 in instant-clusters.mdx

View check run for this annotation

Mintlify / Mintlify Validation (runpod-b18f5ded) - vale-spellcheck

instant-clusters.mdx#L1

Try to keep the SMOG grade (12.06) below 10.

Check warning on line 1 in instant-clusters.mdx

View check run for this annotation

Mintlify / Mintlify Validation (runpod-b18f5ded) - vale-spellcheck

instant-clusters.mdx#L1

Try to keep the LIX score (44.89) below 35.

Check warning on line 1 in instant-clusters.mdx

View check run for this annotation

Mintlify / Mintlify Validation (runpod-b18f5ded) - vale-spellcheck

instant-clusters.mdx#L1

Try to keep the Coleman–Liau Index grade (13.26) below 9.

Check warning on line 1 in instant-clusters.mdx

View check run for this annotation

Mintlify / Mintlify Validation (runpod-b18f5ded) - vale-spellcheck

instant-clusters.mdx#L1

Try to keep the Gunning-Fog index (11.35) below 10.

Check warning on line 1 in instant-clusters.mdx

View check run for this annotation

Mintlify / Mintlify Validation (runpod-b18f5ded) - vale-spellcheck

instant-clusters.mdx#L1

Try to keep the Flesch–Kincaid grade level (9.77) below 8.
title: "Overview"
sidebarTitle: "Overview"
description: "Fully managed compute clusters for multi-node training and AI inference. Review configuration and operations guidance for Runpod Clusters."
Expand All @@ -18,6 +18,8 @@

## Get started

For distributed inference across multiple nodes, follow the [Ray and vLLM deployment guide](/instant-clusters/ray-vllm).

Check warning on line 21 in instant-clusters.mdx

View check run for this annotation

Mintlify / Mintlify Validation (runpod-b18f5ded) - vale-spellcheck

instant-clusters.mdx#L21

Use the Oxford comma in ', follow the Ray and vLLM deployment guide.'.

<CardGroup cols={3}>
<Card title="Deploy a Slurm cluster" href="/instant-clusters/slurm-clusters" icon="splotch" horizontal>
Managed Slurm for HPC workloads.
Expand All @@ -35,7 +37,7 @@

## How it works

Runpod provisions multiple GPU nodes in the same <DataCenterTooltip /> connected with high-speed networking. One node is designated primary (`NODE_RANK=0`), and all nodes receive pre-configured environment variables for distributed communication.

Check warning on line 40 in instant-clusters.mdx

View check run for this annotation

Mintlify / Mintlify Validation (runpod-b18f5ded) - vale-spellcheck

instant-clusters.mdx#L40

Use parentheses judiciously.

Check warning on line 40 in instant-clusters.mdx

View check run for this annotation

Mintlify / Mintlify Validation (runpod-b18f5ded) - vale-spellcheck

instant-clusters.mdx#L40

In general, use active voice instead of passive voice ('is designated').

<div style={{ marginLeft: '4rem'}}>
```mermaid
Expand Down Expand Up @@ -74,24 +76,24 @@
```
</div>

The high-speed interfaces (`ens1`-`ens8`) handle inter-node communication for <PyTorchTooltip />, <TensorFlowTooltip />, and <SlurmTooltip />. The `eth0` interface on the primary node handles external traffic. See the [configuration reference](/instant-clusters/configuration) for environment variables and network details.

Check warning on line 79 in instant-clusters.mdx

View check run for this annotation

Mintlify / Mintlify Validation (runpod-b18f5ded) - vale-spellcheck

instant-clusters.mdx#L79

Use parentheses judiciously.

## Supported hardware

| GPU | Network speed | Nodes |
| --- | ------------- | ----- |
| B200 | 3200 Gbps | 2-8 nodes (16-64 GPUs) |

Check warning on line 85 in instant-clusters.mdx

View check run for this annotation

Mintlify / Mintlify Validation (runpod-b18f5ded) - vale-spellcheck

instant-clusters.mdx#L85

Use parentheses judiciously.
| H200 | 3200 Gbps | 2-8 nodes (16-64 GPUs) |

Check warning on line 86 in instant-clusters.mdx

View check run for this annotation

Mintlify / Mintlify Validation (runpod-b18f5ded) - vale-spellcheck

instant-clusters.mdx#L86

Use parentheses judiciously.
| H100 | 3200 Gbps | 2-8 nodes (16-64 GPUs) |

Check warning on line 87 in instant-clusters.mdx

View check run for this annotation

Mintlify / Mintlify Validation (runpod-b18f5ded) - vale-spellcheck

instant-clusters.mdx#L87

Use parentheses judiciously.
| A100 | 1600 Gbps | 2-8 nodes (16-64 GPUs) |

Check warning on line 88 in instant-clusters.mdx

View check run for this annotation

Mintlify / Mintlify Validation (runpod-b18f5ded) - vale-spellcheck

instant-clusters.mdx#L88

Use parentheses judiciously.

For clusters larger than 8 nodes (up to 512 GPUs), [contact our sales team](https://ecykq.share.hsforms.com/2MZdZATC3Rb62Dgci7knjbA).

Check warning on line 90 in instant-clusters.mdx

View check run for this annotation

Mintlify / Mintlify Validation (runpod-b18f5ded) - vale-spellcheck

instant-clusters.mdx#L90

Use parentheses judiciously.

Check warning on line 90 in instant-clusters.mdx

View check run for this annotation

Mintlify / Mintlify Validation (runpod-b18f5ded) - vale-spellcheck

instant-clusters.mdx#L90

Try to avoid using first-person plural like 'our'.

## Pricing

Pricing is based on GPU type and number of nodes. See [Instant Clusters pricing](https://www.runpod.io/pricing) for current rates.

Check warning on line 94 in instant-clusters.mdx

View check run for this annotation

Mintlify / Mintlify Validation (runpod-b18f5ded) - vale-spellcheck

instant-clusters.mdx#L94

In general, use active voice instead of passive voice ('is based').

Custom pricing is available for enterprise workloads. [Contact our sales team](https://ecykq.share.hsforms.com/2MZdZATC3Rb62Dgci7knjbA) for details.

Check warning on line 96 in instant-clusters.mdx

View check run for this annotation

Mintlify / Mintlify Validation (runpod-b18f5ded) - vale-spellcheck

instant-clusters.mdx#L96

Try to avoid using first-person plural like 'our'.

<Note>
All accounts have a default spending limit. To deploy larger clusters, contact [help@runpod.io](mailto:help@runpod.io).
Expand Down
4 changes: 4 additions & 0 deletions tutorials/introduction/overview.mdx
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
---

Check warning on line 1 in tutorials/introduction/overview.mdx

View check run for this annotation

Mintlify / Mintlify Validation (runpod-b18f5ded) - vale-spellcheck

tutorials/introduction/overview.mdx#L1

Try to keep the Flesch reading ease score (11.29) above 70.

Check warning on line 1 in tutorials/introduction/overview.mdx

View check run for this annotation

Mintlify / Mintlify Validation (runpod-b18f5ded) - vale-spellcheck

tutorials/introduction/overview.mdx#L1

Try to keep the Automated Readability Index (13.87) below 8.

Check warning on line 1 in tutorials/introduction/overview.mdx

View check run for this annotation

Mintlify / Mintlify Validation (runpod-b18f5ded) - vale-spellcheck

tutorials/introduction/overview.mdx#L1

Try to keep the Flesch–Kincaid grade level (14.58) below 8.

Check warning on line 1 in tutorials/introduction/overview.mdx

View check run for this annotation

Mintlify / Mintlify Validation (runpod-b18f5ded) - vale-spellcheck

tutorials/introduction/overview.mdx#L1

Try to keep the Gunning-Fog index (17.24) below 10.

Check warning on line 1 in tutorials/introduction/overview.mdx

View check run for this annotation

Mintlify / Mintlify Validation (runpod-b18f5ded) - vale-spellcheck

tutorials/introduction/overview.mdx#L1

Try to keep the Coleman–Liau Index grade (18.45) below 9.

Check warning on line 1 in tutorials/introduction/overview.mdx

View check run for this annotation

Mintlify / Mintlify Validation (runpod-b18f5ded) - vale-spellcheck

tutorials/introduction/overview.mdx#L1

Try to keep the LIX score (54.52) below 35.

Check warning on line 1 in tutorials/introduction/overview.mdx

View check run for this annotation

Mintlify / Mintlify Validation (runpod-b18f5ded) - vale-spellcheck

tutorials/introduction/overview.mdx#L1

Try to keep the SMOG grade (15.47) below 10.
title: "Overview"
sidebarTitle: "Overview"
description: "Step-by-step guides for building and deploying AI/ML applications on Runpod. Follow the setup and implementation steps in this Runpod tutorial."
Expand All @@ -11,6 +11,8 @@

## Serverless

For CPU-based inference, follow the [Ollama Serverless tutorial](/tutorials/serverless/run-ollama-inference).

<CardGroup cols={3}>
<Card title="Create an image generation endpoint" href="/tutorials/serverless/run-your-first" icon="image" horizontal>
Deploy a Stable Diffusion endpoint and generate your first AI image.
Expand Down Expand Up @@ -63,7 +65,7 @@
</Card>
</CardGroup>

## Public Endpoints

Check warning on line 68 in tutorials/introduction/overview.mdx

View check run for this annotation

Mintlify / Mintlify Validation (runpod-b18f5ded) - vale-spellcheck

tutorials/introduction/overview.mdx#L68

'Public Endpoints' should use sentence-style capitalization.

<CardGroup cols={3}>
<Card title="Build a text-to-video pipeline" href="/tutorials/public-endpoints/text-to-video-pipeline" icon="video" horizontal>
Expand All @@ -73,6 +75,8 @@

## More resources

Review [container tutorials](/containers) for packaging guidance, or browse [community video resources](/references/video-resources) for additional walkthroughs.

<CardGroup cols={2}>
<Card title="Container tutorials" href="/containers" icon="container-storage" horizontal>
Learn container fundamentals, Dockerfile creation, persistence, and common Docker commands.
Expand Down
Loading