AI Compute Infrastructure

  1. Home
  2. Infrastructure
  3. AI Compute Infrastructure

AI workloads require a significant amount of compute power for training.

These are workloads are typically met using high-performance servers and a cluster of GPUs connected together by high-speed interconnects.

img02
Fig.01: IBM AC922 Supercomputing Node.

Once a neural network has been trained, the weights file can pruned and optimized for running in inference mode.

An optimized weight file can be run on an embedded platforms or servers with GPUs that are optimized for inference workloads.