Skip to content
GPU Cloud · NVIDIA · Ampere

Rent NVIDIA A100 PCIE GPU by the hour

The NVIDIA A100 PCIE is a datacenter GPU built on the Ampere architecture, equipped with 40 GB of VRAM and a 250 W power envelope. It delivers about 15.6 TFLOPS of standard floating-point compute and about 1313 GB/s of memory bandwidth, supporting CUDA compute capability 8.0. On Cloudj, you can rent this hardware with per-hour billing, SSH access, and ready templates for PyTorch/CUDA, vLLM, Ollama, and ComfyUI.

Specifications

VRAM per GPU

40 GB

Architecture

NVIDIA Ampere

Compute capability

8

FP32 compute

≈ 15.6 TFLOPS

Memory bandwidth

≈ 1313 GB/s

Power limit

250 W

Values reported by the infrastructure provider for machines currently listed; real performance varies by machine.

Available configurations

Live stock and prices, updated continuously. The final price is confirmed before you order.

Rent now

What the A100 PCIE is good for

Large Language Model Inference

Serve language models using vLLM or Ollama, taking advantage of the 40 GB VRAM capacity and about 1313 GB/s memory bandwidth for token generation.

Deep Learning Fine-Tuning

Run training and fine-tuning jobs in PyTorch/CUDA on an Ampere datacenter architecture with compute capability 8.0.

High-Resolution Image Generation

Execute complex diffusion workflows in ComfyUI that require more memory than consumer cards provide.

Scientific and Data Computing

Process memory-intensive simulations and data analytics tasks utilizing about 15.6 TFLOPS of compute performance.

Is it the right GPU for you?

Choose the A100 PCIE 40 GB when your workloads exceed the memory limits of consumer GPUs and require high-bandwidth datacenter hardware. Opt for a smaller consumer GPU for lightweight inference, or step up to a higher-VRAM datacenter model if your unquantized models or batch sizes exceed 40 GB.

Compare with similar GPUs

GPUVRAM per GPUFP32 computePower limit
NVIDIA A100 PCIE40 GB≈ 15.6 TFLOPS250 W
NVIDIA A100 SXM440 GB≈ 15.6 TFLOPS400 WDetails →
NVIDIA A4045 GB≈ 29.9 TFLOPS300 WDetails →
NVIDIA L40S45 GB≈ 73.3 TFLOPS350 WDetails →
NVIDIA Tesla P4024 GB≈ 9.4 TFLOPS250 WDetails →

Frequently asked questions

Rent the A100 PCIE by the hour

Create an account, choose a configuration and connect over SSH. Billing stops when you delete the GPU.