GTX 1080 Ti vs MI300X

PascalvsCDNA 3Updated 35 days ago

The AMD Instinct MI300X dominates for prevalent AI workloads like LLM training and inference due to 1307 TFLOPS FP16, 192 GB HBM3, and 5300 GB/s bandwidth, dwarfing the GTX 1080 Ti's 8.9 TFLOPS and 11 GB GDDR5X. Modern compute prioritizes these metrics over the older GPU's low $0.60 per hour price.

GTX 1080 Ti from $0.30/hrMI300X from $1.99/hr

Specifications Compared

SpecGTX-1080MI300X
TDP180W750W
VRAM8-11 GB192 GB
CUDA Cores2,560
Memory TypeGDDR5XHBM3
ArchitecturePascalCDNA 3
Form FactorsPCIeOAM
InterconnectInfinity Fabric, PCIe 5.0
FP16 Performance8.9 TFLOPS1,307 TFLOPS
FP32 Performance8.9 TFLOPS163 TFLOPS
Memory Bandwidth320 GB/s5,300 GB/s

Performance Analysis

Raw compute reveals stark disparities: the MI300X delivers 1307 TFLOPS FP16 compared to the GTX 1080 Ti's 8.9 TFLOPS, enabling 147 times faster half-precision operations critical for deep learning training. FP32 performance shows the MI300X at 163 TFLOPS against 8.9 TFLOPS, a 18-fold increase suited for scientific simulations requiring full precision. The FP16 to FP32 ratio on MI300X, 1307 to 163, optimizes mixed-precision training, reducing time for large models, while the GTX 1080 Ti's parity limits scalability. Memory bandwidth defines real-world impact: 5300 GB/s on MI300X supports batch sizes up to hundreds for LLMs, versus 320 GB/s on GTX 1080 Ti capping at small batches prone to bottlenecks. Higher TDP of 750W on MI300X versus 180W reflects power for sustained AI inference, where PCIe form factor constrains GTX 1080 Ti in clusters.

Live Cloud Pricing

Real-time prices from 25+ providers. Updated every 60 seconds.

GTX 1080 Ti

ProviderGPU ModelVRAMHost SpecsRegionPriceStatusAction
LeaderGPU
LeaderGPU
4×NVIDIA GeForce GTX 1080
8GB VRAM
$0.30/GPU/hr
$1.20/hr total (4×)
Available
LeaderGPU
LeaderGPU
8×NVIDIA GeForce GTX 1080 Ti
11GB VRAM
$0.60/GPU/hr
$4.80/hr total (8×)
Available

MI300X

ProviderGPU ModelVRAMHost SpecsRegionPriceStatusAction
RunPod
RunPod
AMD Instinct MI300X
192GB VRAM
$1.99/GPU/hr
Hot Aisle
Hot Aisle
AMD Instinct MI300X
192GB VRAM
$1.99/GPU/hr
Available
Cirrascale
Cirrascale
8×AMD Instinct MI300X
192GB VRAM
$3.08/GPU/hr
$24.64/hr total (8×)
Crusoe
Crusoe
AMD Instinct MI300X
192GB VRAM
$3.45/GPU/hr
Cirrascale
Cirrascale
8×AMD Instinct MI300X
192GB VRAM
$3.47/GPU/hr
$27.76/hr total (8×)

Compare real-time pricing across 25+ providers

When to Choose the GTX 1080 Ti

The GTX 1080 Ti excels in cost-sensitive, low-power scenarios like gaming emulation or small-scale inference on models under 8 GB. Its $0.60 per hour pricing and 180W TDP make it ideal for hobbyists or edge deployments avoiding datacenter overhead. Legacy software optimized for Pascal architecture favors it over newer GPUs.

When to Choose the MI300X

Opt for the MI300X in high-throughput AI tasks demanding 192 GB VRAM, such as training billion-parameter LLMs or large-batch inference. Infinity Fabric and PCIe 5.0 enable scaling across nodes, with 5300 GB/s bandwidth handling memory-intensive scientific computing. Despite higher average $2.63 per hour cost, performance justifies enterprise use.

Use Cases

LLM Training
MI300X

MI300X's 1307 TFLOPS FP16 and 192 GB VRAM handle massive models, unlike GTX 1080 Ti's 8.9 TFLOPS and 11 GB limit.

LLM Inference
MI300X

High 5300 GB/s bandwidth supports large batches on MI300X; GTX 1080 Ti bottlenecks at 320 GB/s for models over 8 GB.

Fine-tuning
MI300X

MI300X 163 TFLOPS FP32 excels in precision adjustments; GTX 1080 Ti suits only tiny datasets.

Stable Diffusion
Either

GTX 1080 Ti runs basic generations at 8.9 TFLOPS FP16; MI300X accelerates complex pipelines with 1307 TFLOPS.

Scientific Computing
MI300X

MI300X's 5300 GB/s and Infinity Fabric scale simulations; GTX 1080 Ti's 320 GB/s restricts to small problems.

Frequently Asked Questions

Which GPU has more VRAM?

The MI300X offers 192 GB HBM3 versus the GTX 1080 Ti's 11 GB GDDR5X. This enables MI300X for large AI models while limiting GTX 1080 Ti to smaller tasks.

What is the FP16 performance difference?

MI300X achieves 1307 TFLOPS FP16, 147 times the GTX 1080 Ti's 8.9 TFLOPS. This gap accelerates training and inference significantly.

How do power consumptions compare?

GTX 1080 Ti draws 180W TDP; MI300X requires 750W. Lower power suits GTX 1080 Ti for edge use, MI300X for datacenters.

What are the cloud prices?

GTX 1080 Ti averages $0.60 per hour from one offer; MI300X starts at $0.50 but averages $2.63 per hour across nine offers.

Which is better for memory bandwidth?

MI300X provides 5300 GB/s, 16.6 times the GTX 1080 Ti's 320 GB/s. This impacts batch sizes in AI workloads heavily.

Can GTX 1080 Ti handle modern AI?

GTX 1080 Ti's 11 GB VRAM and 8.9 TFLOPS FP32 manage small models only. MI300X's 192 GB and 1307 TFLOPS FP16 are required for scale.

Which is cheaper to rent, the GTX 1080 or the MI300X?

Cloud rental prices for both the GTX 1080 and MI300X vary by provider, configuration, and availability. This page shows live pricing from 25+ providers updated every 60 seconds. Scroll to the Live Cloud Pricing section to compare current rates.

How much VRAM does the GTX 1080 have compared to the MI300X?

The GTX 1080 has 8 to 11 GB of GDDR5X memory. The MI300X has 192 GB of HBM3 memory.

Can I find GTX 1080 and MI300X GPUs available to rent right now?

Yes. This page shows real-time availability across 25+ cloud GPU providers. The Live Cloud Pricing section displays only in-stock offers with current pricing.

What is the main difference between the GTX 1080 and the MI300X?

The GTX 1080 uses the Pascal architecture (2016) while the MI300X uses CDNA 3 (2023). The MI300X delivers 146.9x the FP16 throughput and 16.6x the memory bandwidth of the GTX 1080.

GTX 1080 Ti vs MI300X: NVIDIA 11GB vs AMD 192GB | GPUPerHour