Back to Glossary
GPU Cloud
NVLink
NVLink is NVIDIA's high-speed GPU interconnect providing up to 900 GB/s bandwidth between GPUs.
Definition
NVLink is NVIDIA's proprietary high-speed interconnect technology that enables direct GPU-to-GPU communication at much higher bandwidth than PCIe. NVLink 4.0 (used in H100, H200) provides 900 GB/s bidirectional bandwidth — 14x faster than PCIe 5.0 (64 GB/s). NVLink is essential for: (1) Multi-GPU training of large models, (2) Tensor parallelism in LLMs, (3) Passing intermediate results between GPUs without CPU involvement. Harch Corp's GPU clusters use NVLink 4.0 for maximum distributed training performance.
Related Keywords
nvlinknvidia nvlinkgpu interconnectnvlink 4.0gpu to gpu
Related Terms
InfiniBand
InfiniBand is a high-speed networking standard used in HPC and AI GPU clusters.
GPU Cluster
A GPU cluster is a network of GPUs working together for distributed AI training and HPC workloads.
Distributed Training
Distributed training splits AI model training across multiple GPUs or nodes for faster convergence.