$0.149/ hour≈ $108.69/mo
CPUAMD EPYC 7532 32-Core Processor16 physical cores
RAM31.4 GBsystem memory
GPU1× RTX 309024 GB VRAM / GPU
Storage239.7 GBstorage not reported
Network1,366.5 Mbpsreliability 1
Available · updated 08:53 PM
GPU Servers for LLM Inference
Find cost-efficient GPU rental options for serving language models and batch inference.
Available offers60
Providers2
Lowest listed price now$0.149 / hour
Last catalog refresh2026-08-21 17:54 UTC
At the latest catalog refresh, the lowest listed matching offer is $0.149 / hour from Vast.ai in Hong Kong, HK. Availability and final checkout pricing can change after this timestamp.
Cherry Servers392Hivelocity2814Vast.ai128RunPod49Scaleway Elastic Metal152OVHcloud2853Servers.com289
⌕
60 matching offers6,677 indexed · 6/7 live APIs · catalog 08:54 PM · showing 1–50
$0.149/ hour≈ $108.69/mo
CPUXeon® E5-2673 v312 physical cores
RAM31.3 GBsystem memory
GPU1× Titan RTX24 GB VRAM / GPU
Storage322.5 GBstorage not reported
Network465 Mbpsreliability 1
Available · updated 08:53 PM
$0.189/ hour≈ $137.89/mo
CPUAMD EPYC 7C13 64-Core Processor32 physical cores
RAM62.9 GBsystem memory
GPU1× Tesla V10032 GB VRAM / GPU
Storage291.8 GBstorage not reported
Network207.3 Mbpsreliability 1
Available · updated 08:53 PM
$0.195/ hour≈ $142.65/mo
CPUAMD EPYC 7K62 48-Core Processor24 physical cores
RAM47.2 GBsystem memory
GPU1× RTX 4080S32 GB VRAM / GPU
Storage301.4 GBstorage not reported
Network334.5 Mbpsreliability 1
Available · updated 08:53 PM
$0.22/ hour≈ $160.60/mo
CPU6 vCPUvirtual CPU allocation
RAM30 GBsystem memory
GPU1× RTX 309024 GB VRAM / GPU
Storage—storage not reported
Network—not reported
Available · updated 08:54 PM
$0.244/ hour≈ $178.44/mo
CPUXeon® E5-2673 v420 physical cores
RAM78.6 GBsystem memory
GPU2× Tesla V10032 GB VRAM / GPU
Storage271.6 GBstorage not reported
Network920.2 Mbpsreliability 1
Available · updated 08:53 PM
$0.253/ hour≈ $184.72/mo
CPUXeon® E5-2680 v414 physical cores
RAM94.4 GBsystem memory
GPU1× Q RTX 800048 GB VRAM / GPU
Storage701.3 GBstorage not reported
Network8,563.5 Mbpsreliability 1
Available · updated 08:53 PM
$0.27/ hour≈ $197.10/mo
CPU12 vCPUvirtual CPU allocation
RAM54 GBsystem memory
GPU1× RTX 3090 Ti24 GB VRAM / GPU
Storage—storage not reported
Network—not reported
Available · updated 08:54 PM
$0.27/ hour≈ $197.10/mo
CPU9 vCPUvirtual CPU allocation
RAM50 GBsystem memory
GPU1× RTX A500024 GB VRAM / GPU
Storage—storage not reported
Network—not reported
Available · updated 08:54 PM
$0.296/ hour≈ $215.76/mo
CPUXeon® E5-2673 v324 physical cores
RAM62.6 GBsystem memory
GPU2× Titan RTX24 GB VRAM / GPU
Storage645 GBstorage not reported
Network465 Mbpsreliability 1
Available · updated 08:53 PM
$0.34/ hour≈ $248.20/mo
CPU25 vCPUvirtual CPU allocation
RAM50 GBsystem memory
GPU1× RTX 409024 GB VRAM / GPU
Storage—storage not reported
Network—not reported
Available · updated 08:54 PM
$0.369/ hour≈ $269.07/mo
CPUAMD EPYC 7542 32-Core Processor16 physical cores
RAM94.5 GBsystem memory
GPU1× RTX 409048 GB VRAM / GPU
Storage533.7 GBstorage not reported
Network117.1 Mbpsreliability 1
Available · updated 08:53 PM
$0.375/ hour≈ $273.61/mo
CPUAMD Ryzen 7 7800X3D 8-Core Processor8 physical cores
RAM31 GBsystem memory
GPU1× RTX 509031.8 GB VRAM / GPU
Storage357.2 GBstorage not reported
Network177.2 Mbpsreliability 1
Available · updated 08:53 PM
$0.389/ hour≈ $283.78/mo
CPUAMD EPYC 7K62 48-Core Processor48 physical cores
RAM94.4 GBsystem memory
GPU2× RTX 4080S32 GB VRAM / GPU
Storage491.8 GBstorage not reported
Network375.1 Mbpsreliability 1
Available · updated 08:53 PM
$0.404/ hour≈ $294.70/mo
CPUAMD Ryzen 7 7800X3D 8-Core Processor16 physical cores
RAM30.5 GBsystem memory
GPU1× RTX 509031.8 GB VRAM / GPU
Storage590 GBstorage not reported
Network511.3 Mbpsreliability 1
Available · updated 08:53 PM
$0.44/ hour≈ $321.20/mo
CPU9 vCPUvirtual CPU allocation
RAM50 GBsystem memory
GPU1× A4048 GB VRAM / GPU
Storage—storage not reported
Network—not reported
Available · updated 08:54 PM
$0.487/ hour≈ $355.27/mo
CPUAMD EPYC 7302P 16-Core Processor16 physical cores
RAM62.8 GBsystem memory
GPU1× RTX 509031.8 GB VRAM / GPU
Storage654.5 GBstorage not reported
Network1,970.7 Mbpsreliability 0.9
Available · updated 08:53 PM
$0.49/ hour≈ $357.70/mo
CPU6 vCPUvirtual CPU allocation
RAM45 GBsystem memory
GPU1× L424 GB VRAM / GPU
Storage—storage not reported
Network—not reported
Available · updated 08:54 PM
$0.49/ hour≈ $357.70/mo
CPU6 vCPUvirtual CPU allocation
RAM62 GBsystem memory
GPU1× RTX 5000 Ada32 GB VRAM / GPU
Storage—storage not reported
Network—not reported
Available · updated 08:54 PM
$0.497/ hour≈ $363.16/mo
CPUAMD EPYC 7K62 48-Core Processor24 physical cores
RAM62.9 GBsystem memory
GPU2× RTX 408032 GB VRAM / GPU
Storage749.5 GBstorage not reported
Network736.6 Mbpsreliability 1
Available · updated 08:53 PM
$0.50/ hour≈ $365.00/mo
CPU32 vCPUvirtual CPU allocation
RAM125 GBsystem memory
GPU1× RTX 309024 GB VRAM / GPU
Storage—storage not reported
Network—not reported
Available · updated 08:54 PM
$0.505/ hour≈ $368.68/mo
CPUXeon® E5-2680 v428 physical cores
RAM188.9 GBsystem memory
GPU2× Q RTX 800048 GB VRAM / GPU
Storage1,402.5 GBstorage not reported
Network8,563.5 Mbpsreliability 1
Available · updated 08:53 PM
$0.53/ hour≈ $386.90/mo
CPU9 vCPUvirtual CPU allocation
RAM50 GBsystem memory
GPU1× RTX A600048 GB VRAM / GPU
Storage—storage not reported
Network—not reported
Available · updated 08:54 PM
$0.532/ hour≈ $388.47/mo
CPUAMD EPYC 7402P 24-Core Processor24 physical cores
RAM62.8 GBsystem memory
GPU2× RTX 309024 GB VRAM / GPU
Storage838.5 GBstorage not reported
Network5,839.9 Mbpsreliability 1
Available · updated 08:53 PM
$0.562/ hour≈ $410.42/mo
CPUAMD EPYC 7543 32-Core Processor26.9 physical cores
RAM106 GBsystem memory
GPU4× RTX 309024 GB VRAM / GPU
Storage872.2 GBstorage not reported
Network1,978.7 Mbpsreliability 1
Available · updated 08:53 PM
$0.57/ hour≈ $416.10/mo
CPU12 vCPUvirtual CPU allocation
RAM31 GBsystem memory
GPU1× RTX PRO 400024 GB VRAM / GPU
Storage—storage not reported
Network—not reported
Available · updated 08:54 PM
$0.59/ hour≈ $430.70/mo
CPU4 vCPUvirtual CPU allocation
RAM31 GBsystem memory
GPU1× PRO 6000 MIG 24GB24 GB VRAM / GPU
Storage—storage not reported
Network—not reported
Available · updated 08:54 PM
$0.601/ hour≈ $439.08/mo
CPUCore™ Ultra 7 270K Plus12 physical cores
RAM68.3 GBsystem memory
GPU1× RTX PRO 500047.8 GB VRAM / GPU
Storage921.5 GBstorage not reported
Network520.6 Mbpsreliability 1
Available · updated 08:53 PM
$0.602/ hour≈ $439.62/mo
CPUAMD EPYC 9474F 48-Core Processor12 physical cores
RAM125.9 GBsystem memory
GPU1× RTX 6000Ada48 GB VRAM / GPU
Storage678.4 GBstorage not reported
Network619.8 Mbpsreliability 1
Available · updated 08:53 PM
$0.69/ hour≈ $503.70/mo
CPU8 vCPUvirtual CPU allocation
RAM41 GBsystem memory
GPU1× RTX 509032 GB VRAM / GPU
Storage—storage not reported
Network—not reported
Available · updated 08:54 PM
$0.69/ hour≈ $503.70/mo
CPU9 vCPUvirtual CPU allocation
RAM125 GBsystem memory
GPU1× L4048 GB VRAM / GPU
Storage—storage not reported
Network—not reported
Available · updated 08:54 PM
$0.72/ hour≈ $525.60/mo
CPU8 vCPUvirtual CPU allocation
RAM54 GBsystem memory
GPU1× RTX PRO 450032 GB VRAM / GPU
Storage—storage not reported
Network—not reported
Available · updated 08:54 PM
$0.72/ hour≈ $525.60/mo
CPU16 vCPUvirtual CPU allocation
RAM94 GBsystem memory
GPU1× RTX PRO 4500 SE32 GB VRAM / GPU
Storage—storage not reported
Network—not reported
Available · updated 08:54 PM
$0.73/ hour≈ $532.63/mo
CPUAMD EPYC 7B12 64-Core Processor64 physical cores
RAM62.9 GBsystem memory
GPU2× RTX 509031.8 GB VRAM / GPU
Storage240.2 GBstorage not reported
Network334.3 Mbpsreliability 1
Available · updated 08:53 PM
$0.736/ hour≈ $536.96/mo
CPUAMD EPYC 7T83 64-Core Processor32 physical cores
RAM63 GBsystem memory
GPU1× A100 SXM440 GB VRAM / GPU
Storage385.4 GBstorage not reported
Network4,521.8 Mbpsreliability 1
Available · updated 08:53 PM
$0.74/ hour≈ $540.20/mo
CPU5 vCPUvirtual CPU allocation
RAM31 GBsystem memory
GPU1× RTX 409024 GB VRAM / GPU
Storage—storage not reported
Network—not reported
Available · updated 08:54 PM
$0.74/ hour≈ $540.20/mo
CPU14 vCPUvirtual CPU allocation
RAM78 GBsystem memory
GPU1× RTX 6000 Ada48 GB VRAM / GPU
Storage—storage not reported
Network—not reported
Available · updated 08:54 PM
$0.79/ hour≈ $576.43/mo
CPUXeon® E5-2640 v332 physical cores
RAM125.8 GBsystem memory
GPU1× A100 SXM439 GB VRAM / GPU
Storage1,327 GBstorage not reported
Network521 Mbpsreliability 1
Available · updated 08:53 PM
$0.79/ hour≈ $576.70/mo
CPU24 vCPUvirtual CPU allocation
RAM125 GBsystem memory
GPU1× L40S48 GB VRAM / GPU
Storage—storage not reported
Network—not reported
Available · updated 08:54 PM
$0.82/ hour≈ $598.60/mo
CPU20 vCPUvirtual CPU allocation
RAM54 GBsystem memory
GPU1× RTX PRO 500048 GB VRAM / GPU
Storage—storage not reported
Network—not reported
Available · updated 08:54 PM
$0.849/ hour≈ $620.12/mo
CPUAMD EPYC 9354 32-Core Processor16 physical cores
RAM55.1 GBsystem memory
GPU1× RTX PRO 500047.8 GB VRAM / GPU
Storage434.6 GBstorage not reported
Network6,899.5 Mbpsreliability 1
Available · updated 08:53 PM
$0.99/ hour≈ $722.70/mo
CPU16 vCPUvirtual CPU allocation
RAM60 GBsystem memory
GPU1× RTX 509032 GB VRAM / GPU
Storage—storage not reported
Network—not reported
Available · updated 08:54 PM
$0.99/ hour≈ $722.70/mo
CPU16 vCPUvirtual CPU allocation
RAM62 GBsystem memory
GPU1× L40S48 GB VRAM / GPU
Storage—storage not reported
Network—not reported
Available · updated 08:54 PM
$1.00/ hour≈ $730.00/mo
CPU32 vCPUvirtual CPU allocation
RAM125 GBsystem memory
GPU1× A100 SXM 40GB40 GB VRAM / GPU
Storage—storage not reported
Network—not reported
Available · updated 08:54 PM
$1.09/ hour≈ $795.70/mo
CPU16 vCPUvirtual CPU allocation
RAM62 GBsystem memory
GPU1× PRO 6000 MIG 48GB48 GB VRAM / GPU
Storage—storage not reported
Network—not reported
Available · updated 08:54 PM
$1.19/ hour≈ $868.70/mo
CPU8 vCPUvirtual CPU allocation
RAM125 GBsystem memory
GPU1× A100 PCIe80 GB VRAM / GPU
Storage—storage not reported
Network—not reported
Available · updated 08:54 PM
$1.39/ hour≈ $1,014.70/mo
CPU31 vCPUvirtual CPU allocation
RAM117 GBsystem memory
GPU1× A100 PCIe80 GB VRAM / GPU
Storage—storage not reported
Network—not reported
Available · updated 08:54 PM
$1.39/ hour≈ $1,014.70/mo
CPU32 vCPUvirtual CPU allocation
RAM125 GBsystem memory
GPU1× A100 SXM80 GB VRAM / GPU
Storage—storage not reported
Network—not reported
Available · updated 08:54 PM
$1.59/ hour≈ $1,160.70/mo
CPU16 vCPUvirtual CPU allocation
RAM117 GBsystem memory
GPU1× A100 SXM80 GB VRAM / GPU
Storage—storage not reported
Network—not reported
Available · updated 08:54 PM
$1.69/ hour≈ $1,233.70/mo
CPU14 vCPUvirtual CPU allocation
RAM125 GBsystem memory
GPU1× RTX PRO 600096 GB VRAM / GPU
Storage—storage not reported
Network—not reported
Available · updated 08:54 PM
Compare the full configuration, not only the headline price
ComputeRadar uses transparent minimum hardware filters for this workload page rather than claiming that every listed server is automatically optimal for every implementation.
Treat these results as a shortlist. Software stack, model size, concurrency, storage, network and provider-specific features can change the best choice.
Selection notes
What to check before renting
01
Compare cost per token, not only cost per GPU-hour.
02
VRAM determines which quantization and batch sizes fit.
03
Consumer GPUs can be economical when datacenter features are unnecessary.
FAQ
Common questions
How are LLM inference offers selected?
The page applies the hardware constraints shown in its description to the same normalized live catalog used by the main search.
Is this a benchmark ranking?
No. ComputeRadar is comparing available infrastructure and pricing, not claiming application-level performance without benchmark evidence.