Environments Requirement#
Recommended Systems#
Xinference supports the following operating systems:
Ubuntu 20.04 / 22.04 (Recommended)
CentOS 7 / Rocky Linux 8
Windows 10/11 with WSL2
Recommended CUDA#
Xinference Recommended the following CUDA version:
Driver Version 550.127.08 - Download Driver
CUDA Version 12.4 - Download CUDA
Recommended Docker#
Here are the recommended Docker versions for different environments:
Docker >= 19.03 (recommended, but some distributions may include older versions of Docker. The minimum supported version is 1.12)
NVIDIA Container Toolkit >= 1.7.0