GPU clouds

A GPU cloud is a provider that rents GPUs and other AI accelerators by the hour, the month, or under multi-year contracts, so teams can train, fine-tune, and serve models without buying hardware. Unlike an inference provider, a GPU cloud hands over machines or clusters, and the customer runs the software stack.

The market has three broad groups. Hyperscalers such as AWS, Google Cloud, Microsoft Azure, and Oracle sell GPUs next to their full cloud services. Neoclouds such as CoreWeave, Lambda, Nebius, Crusoe, and Nscale specialize in AI capacity, often with InfiniBand-connected clusters and managed Kubernetes or Slurm. Marketplaces and developer clouds such as Vast.ai, Runpod, SF Compute, and Shadeform aggregate capacity or focus on quick self-serve access.

The right choice usually depends on the accelerator generation a workload needs, how long it needs it, whether jobs span many nodes, and where data must stay. AMD-focused clouds such as TensorWave and Hot Aisle, and European providers such as Verda, Scaleway, and OVHcloud, widen the options further.

GPU clouds compared

PlatformOpen sourceDeploymentBest for
AWS (EC2 GPUs and Trainium)NoManaged cloud, API, CLIGPU and custom-chip capacity inside AWS
CoreWeaveNoManaged cloud, APILarge NVIDIA clusters with managed Kubernetes
CrusoeNoManaged cloud, APILarge clusters from a vertically integrated provider
DenvrNoManaged cloud, APICanadian-hosted GPU compute
DigitalOcean (GPU Droplets and Paperspace)NoManaged cloud, API, CLISimple GPU instances next to a general developer cloud
FluidstackNoManaged cloudFrontier-scale dedicated clusters
GMI CloudNoManaged cloud, APIMoving from inference APIs to dedicated GPU clusters
Google Cloud (GPUs and TPUs)NoManaged cloud, API, CLITPUs and GPUs for teams on Google Cloud
Hot AisleNoManaged cloud, API, CLISelf-serve AMD Instinct GPUs
HyperstackNoManaged cloud, APIOn-demand NVIDIA virtual machines and clusters
IRENNoManaged cloudLarge GPU clusters in renewable-powered data centers
JarvislabsNoManaged cloud, APIQuick single-GPU instances for experiments
LambdaNoManaged cloud, APIOn-demand NVIDIA instances and reserved clusters
Massed ComputeNoManaged cloud, APIShort-term GPU rentals without contracts
Microsoft Azure (AI infrastructure)NoManaged cloud, API, CLIGPU clusters for teams standardized on Azure
NebiusNoManaged cloud, APIFull-stack AI cloud with European and US regions
NscaleNoManaged cloud, APISovereign European GPU capacity
NVIDIA DGX Cloud LeptonNoManaged cloud, API, CLIFinding NVIDIA capacity across partner clouds
Oracle Cloud Infrastructure (GPUs)NoManaged cloud, API, CLIBare-metal GPU superclusters from a hyperscaler
OVHcloud GPU instancesNoManaged cloud, APIEuropean public cloud GPUs with managed AI tools
Prime IntellectNoManaged cloud, API, CLITeams training their own models with reinforcement learning
Radiant (formerly Ori)NoManaged cloudSovereign AI clouds built and operated end to end
RunpodNoManaged cloud, API, CLISelf-serve GPUs and serverless endpoints for developers
SaladCloudNoManaged cloud, APIBatch and inference jobs on low-cost consumer GPUs
Scaleway GPU InstancesNoManaged cloud, APIEU-resident GPU instances
SF ComputeNoManaged cloud, CLIFlexible short-term access to large clusters
ShadeformNoManaged cloud, APIComparing and launching GPUs across many clouds
TensorWaveNoManaged cloudAMD Instinct capacity for training and inference
Thunder ComputeNoManaged cloud, API, CLIGPU sandboxes for agents and quick developer instances
Vast.aiNoManaged cloud, API, CLILow-cost GPUs from a broad pool of hosts
Verda (formerly DataCrunch)NoManaged cloud, APIEuropean GPU instances and instant clusters
Voltage ParkNoManaged cloudDedicated H100 and Blackwell clusters
VultrNoManaged cloud, API, CLIAMD and NVIDIA GPUs across many global regions

Profiles

  • AWS (EC2 GPUs and Trainium) logo

    AWS (EC2 GPUs and Trainium)

    Amazon Web Services · aws.amazon.com

    Amazon Web Services rents NVIDIA GPUs through EC2 P-series and G-series instances, along with its own Trainium and Inferentia chips, and offers UltraServers and SageMaker HyperPod for large managed training clusters.

    • Managed cloud
    • API
    • CLI
  • CoreWeave logo

    CoreWeave

    coreweave.com · Livingston, New Jersey, United States · founded 2017

    CoreWeave is an AI cloud that rents NVIDIA GPU clusters through CoreWeave Kubernetes Service and Slurm, and, after acquiring Weights & Biases, adds experiment tracking, serverless inference, and fine-tuning in its CoreWeave Forge suite.

    • Managed cloud
    • API
  • Crusoe logo

    Crusoe

    crusoe.ai · founded 2018

    Crusoe builds AI data centers with an energy-first approach and runs Crusoe Cloud, which offers NVIDIA and AMD GPUs, managed Kubernetes and Slurm, fault-tolerant AutoClusters, and Managed Inference.

    • Managed cloud
    • API
  • Denvr logo

    Denvr

    denvr.com

    Denvr runs an AI cloud from sovereign data centers in Canada and the United States, offering NVIDIA and Intel Gaudi accelerators as bare metal, VMs, or containers, plus OpenAI-compatible dedicated inference endpoints.

    • Managed cloud
    • API
  • DigitalOcean (GPU Droplets and Paperspace)

    DigitalOcean · digitalocean.com · founded 2011

    DigitalOcean offers GPU Droplets and bare-metal GPU servers alongside its AI platform for serverless inference, agents, and knowledge bases, and also runs Paperspace, the GPU cloud it acquired in 2023.

    • Managed cloud
    • API
    • CLI
  • Fluidstack logo

    Fluidstack

    fluidstack.io

    Fluidstack builds and operates gigawatt-scale AI data centers and large GPU clusters in the United States, focusing on dedicated capacity for large AI training and inference workloads rather than self-serve instances.

    • Managed cloud
  • GMI Cloud logo

    GMI Cloud

    gmicloud.ai

    GMI Cloud is an AI cloud that offers serverless inference for open models, dedicated GPU clusters with RDMA-ready networking, and bare-metal servers on one platform.

    • Managed cloud
    • API
  • Google Cloud (GPUs and TPUs)

    Google Cloud · cloud.google.com

    Google Cloud offers NVIDIA GPUs on Compute Engine and Google Kubernetes Engine, plus its own Tensor Processing Units, packaged in the AI Hypercomputer architecture for training and serving large models.

    • Managed cloud
    • API
    • CLI
  • Hot Aisle logo

    Hot Aisle

    hotaisle.xyz

    Hot Aisle is an AMD-only GPU cloud offering MI300X and MI355X accelerators, from a single-GPU virtual machine to full bare-metal clusters, provisioned through a terminal UI, API, or CLI with per-minute billing.

    • Managed cloud
    • API
    • CLI
  • Hyperstack logo

    Hyperstack

    NexGen Cloud · hyperstack.cloud

    Hyperstack is the GPU cloud platform of NexGen Cloud, offering on-demand and reserved NVIDIA GPUs as virtual machines and clusters with an API, Kubernetes, and storage for AI training and inference.

    • Managed cloud
    • API
  • IREN logo

    IREN

    iren.com

    IREN builds data centers powered by renewable energy in British Columbia and Texas and operates IREN AI Cloud, which provides GPU clusters for AI training and inference along with colocation and build-to-suit facilities.

    • Managed cloud
  • Jarvislabs logo

    Jarvislabs

    jarvislabs.ai

    Jarvislabs rents NVIDIA GPUs, including H100 and H200, as on-demand instances with per-minute billing and ready-made environments reached through JupyterLab, VS Code, or SSH for training, fine-tuning, and serving models.

    • Managed cloud
    • API
  • Lambda logo

    Lambda

    lambda.com

    Lambda rents NVIDIA GPUs as on-demand instances and reserved clusters, from single machines to large multi-node deployments, and is winding down its serverless Inference API in favor of models self-hosted on its GPU instances.

    • Managed cloud
    • API
  • Massed Compute logo

    Massed Compute

    massedcompute.com

    Massed Compute rents NVIDIA GPUs, from current data center accelerators to workstation cards, as on-demand virtual machines with CUDA preinstalled, hourly billing, and no long-term contracts, for training, fine-tuning, and inference.

    • Managed cloud
    • API
  • Microsoft Azure (AI infrastructure) logo

    Microsoft Azure (AI infrastructure)

    Microsoft · azure.microsoft.com

    Microsoft Azure provides NVIDIA and AMD GPU virtual machines, including the ND-series built for AI training and inference with InfiniBand networking, managed through Azure Kubernetes Service, CycleCloud, and Azure Machine Learning.

    • Managed cloud
    • API
    • CLI
  • Nebius logo

    Nebius

    nebius.com · Amsterdam, Netherlands

    Nebius runs an AI cloud with NVIDIA GPU clusters, managed Kubernetes and Slurm, storage, and the Token Factory inference service, from data centers in Europe and the United States.

    • Managed cloud
    • API
  • Nscale logo

    Nscale

    nscale.com · London, United Kingdom · founded 2024

    Nscale, a British AI infrastructure company, runs a full-stack AI cloud from its own data centers in Norway, the United Kingdom, and the United States, offering GPU instances, managed Kubernetes and Slurm, and inference endpoints.

    • Managed cloud
    • API
  • NVIDIA DGX Cloud Lepton logo

    NVIDIA DGX Cloud Lepton

    NVIDIA · nvidia.com

    NVIDIA DGX Cloud Lepton is a platform that connects developers to GPU capacity from NVIDIA Cloud Partners, GPU marketplaces, and other cloud providers through a single interface for development, training, and inference.

    • Managed cloud
    • API
    • CLI
  • Oracle Cloud Infrastructure (GPUs) logo

    Oracle Cloud Infrastructure (GPUs)

    Oracle · oracle.com

    Oracle Cloud Infrastructure rents NVIDIA and AMD GPUs as bare-metal and virtual machine instances and builds OCI Supercluster deployments with RDMA networking for large-scale training and inference.

    • Managed cloud
    • API
    • CLI
  • OVHcloud GPU instances logo

    OVHcloud GPU instances

    OVHcloud · ovhcloud.com · Roubaix, France · founded 1999

    OVHcloud, a French cloud provider, offers NVIDIA H200, H100, L40S, and L4 GPU instances in its Public Cloud, along with AI Notebooks, AI Training, and AI Endpoints for managed AI workloads.

    • Managed cloud
    • API
  • Prime Intellect logo

    Prime Intellect

    primeintellect.ai · San Francisco, United States · founded 2024

    Prime Intellect pairs GPU compute sourced from multiple providers with open-source tools for distributed and reinforcement learning training, inference, and sandboxes, for teams that train and improve their own models.

    • Managed cloud
    • API
    • CLI
  • Radiant (formerly Ori) logo

    Radiant (formerly Ori)

    Radiant · radiant.co

    Radiant, which absorbed the London-based GPU cloud Ori, builds and operates AI factories and delivers dedicated bare metal, isolated virtual machines, and managed Kubernetes and Slurm on NVIDIA hardware through its FlightDeck software.

    Ori merged with Brookfield-backed Radiant in February 2026, and the Ori platform now continues as part of Radiant.

    • Managed cloud
  • Runpod logo

    Runpod

    runpod.io

    Runpod is a GPU cloud for developers that offers Pods for persistent GPU instances, Serverless endpoints that scale to zero, multi-node Clusters, and a Hub for deploying open-source models and templates.

    • Managed cloud
    • API
    • CLI
  • SaladCloud logo

    SaladCloud

    Salad Technologies · salad.com

    SaladCloud orchestrates containerized AI workloads across a distributed network of idle consumer GPUs, and also offers Salad Dedicated reserved servers and an OpenAI-compatible inference gateway.

    • Managed cloud
    • API
  • Scaleway GPU Instances logo

    Scaleway GPU Instances

    Scaleway · scaleway.com · Paris, France

    Scaleway, a French cloud provider, offers NVIDIA B300, H100, and L4 GPU instances in Paris and Warsaw, with data kept in Europe and pay-as-you-go billing without egress fees.

    • Managed cloud
    • API
  • SF Compute logo

    SF Compute

    The San Francisco Compute Company · sfcompute.com

    SF Compute is a marketplace for buying and reselling time on large, vetted GPU clusters, from short reservations to longer terms, managed from the command line.

    • Managed cloud
    • CLI
  • Shadeform

    shadeform.com

    Shadeform is a GPU cloud marketplace that lets teams find, launch, and manage GPU instances across many cloud providers through one console and API instead of separate accounts.

    • Managed cloud
    • API
  • TensorWave logo

    TensorWave

    tensorwave.com

    TensorWave is a GPU cloud built entirely on AMD Instinct accelerators, offering dedicated compute for training and inference to teams that want an alternative to NVIDIA GPUs.

    • Managed cloud
  • Thunder Compute logo

    Thunder Compute

    thundercompute.com

    Thunder Compute offers persistent GPU instances that developers reach over SSH and short-lived, isolated Ubuntu GPU sandboxes for AI agents that run ML experiments, with per-second and per-minute billing.

    • Managed cloud
    • API
    • CLI
  • Vast.ai logo

    Vast.ai

    vast.ai

    Vast.ai is a GPU marketplace where independent hosts and data centers rent out hardware, from consumer cards to data center accelerators, as on-demand or interruptible instances that run Docker containers.

    • Managed cloud
    • API
    • CLI
  • Verda (formerly DataCrunch) logo

    Verda (formerly DataCrunch)

    Verda · verda.com · Helsinki, Finland · founded 2020

    Verda is a Helsinki-based AI cloud that offers NVIDIA GPU instances, self-service instant clusters with InfiniBand, serverless containers, and a preview inference API for open-weight models.

    DataCrunch renamed itself Verda in November 2025, and datacrunch.io now redirects to verda.com.

    • Managed cloud
    • API
  • Voltage Park logo

    Voltage Park

    voltagepark.com

    Voltage Park operates NVIDIA H100 and Blackwell GPU infrastructure in Tier 3+ data centers, offered as on-demand instances, reserved dedicated clusters, bare metal, virtual machines, and managed Kubernetes.

    Voltage Park has merged with Lightning AI, and its GPU cloud continues to operate under the Voltage Park name.

    • Managed cloud
  • Vultr

    vultr.com · West Palm Beach, Florida, United States · founded 2014

    Vultr is a global cloud provider that offers AMD and NVIDIA GPUs on demand as virtual machines, bare metal, or self-service clusters, alongside its general compute, storage, and Kubernetes services.

    • Managed cloud
    • API
    • CLI

How to choose

01Accelerators
Which NVIDIA, AMD, or custom chips are available, from consumer cards to the newest data center systems, and in what quantities.
02Capacity model
On-demand, spot or interruptible, and reserved contracts each trade price, availability, and commitment differently.
03Cluster networking
Multi-node training and large-model serving need InfiniBand or RDMA networking and topology-aware placement.
04Orchestration
Managed Kubernetes, Slurm, containers, or bare metal determine how much infrastructure work stays with your team.
05Regions and sovereignty
Data center locations, data residency guarantees, and certifications matter for regulated or EU-bound workloads.
06Managed AI services
Storage, inference endpoints, fine-tuning, and observability on the same platform reduce the number of vendors to integrate.

Frequently asked questions

What is a GPU cloud provider?

A GPU cloud provider rents GPUs and other AI accelerators as virtual machines, bare-metal servers, or multi-node clusters, billed by the hour or under reserved contracts. Customers install their own drivers, frameworks, and serving software, or use the provider's managed Kubernetes, Slurm, or container services. CoreWeave, Lambda, Nebius, Runpod, and the GPU offerings of AWS, Google Cloud, and Azure are examples.

What is a neocloud?

A neocloud is a cloud provider that specializes in GPU capacity for AI instead of offering the full catalog of a general-purpose cloud. CoreWeave, Lambda, Nebius, Crusoe, and Nscale are commonly described this way. Neoclouds focus on recent NVIDIA or AMD accelerators, high-bandwidth cluster networking, and AI-specific managed services, and many sell capacity to AI labs under multi-year contracts as well as on demand.

Neocloud vs hyperscaler: what is the difference?

Hyperscalers such as AWS, Google Cloud, Microsoft Azure, and Oracle sell GPUs alongside databases, identity, networking, and hundreds of other services, which suits teams whose data and applications already run there. Neoclouds concentrate on AI accelerators and often offer simpler access to large clusters. Many organizations use both, for example training on a neocloud and serving inside their primary cloud.

Should you rent a GPU for LLM inference or use an API?

An inference API is simpler when traffic is variable or the models you need are already hosted, because billing is per token and there are no servers to manage. Renting GPUs makes sense for custom or fine-tuned weights, steady high throughput, full control over data and software, or models that providers do not host. Many teams prototype on an API and move to rented GPUs later.

Cloud GPU vs local: which should you use?

Local hardware, such as a workstation GPU or an Apple Silicon Mac, suits development, privacy-sensitive experiments, and small quantized models, with no hourly cost after purchase. Cloud GPUs suit training, large models that need data center memory and interconnects, and workloads that must scale or run around the clock. A common pattern is to develop locally with llama.cpp or Ollama and deploy to cloud GPUs.

Other categories

Product details change quickly; check each vendor’s site for current features, licensing and pricing.