NVIDIA L40 Tensor Core GPU 48GB GDDR6 AI VDI Graphics 900-2G150-0000-000: Unleash Unprecedented Performance
Enterasource proudly presents the NVIDIA L40 Tensor Core GPU, a powerhouse designed to meet the rigorous demands of modern IT environments. With its cutting-edge NVIDIA Ada Lovelace architecture and a massive 48GB of GDDR6 memory, this GPU is engineered to deliver unparalleled performance for AI, machine learning, and virtual desktop infrastructure (VDI) applications. Whether you're an IT professional managing large-scale data centers or a researcher pushing the boundaries of AI, the NVIDIA L40 is your ultimate solution.
Key Features and Benefits of the NVIDIA L40 Tensor Core GPU 48GB GDDR6 AI VDI Graphics 900-2G150-0000-000
Revolutionary Performance
Equipped with 18176 CUDA cores and 568 Tensor cores, the NVIDIA L40 offers a staggering single-precision performance of 90.5 TF. For mixed-precision tasks, it delivers up to 362.1 TF*, making it ideal for complex computations and deep learning models. The GPU's base clock speed of 735 MHz and a maximum boost clock speed of 2490 MHz ensure that you get the best performance under varying workloads.
Advanced Memory and Bandwidth
The 48GB GDDR6 memory provides ample space for large datasets, while the PCIe 4.0 x16 interface ensures a high interconnect bandwidth of 864 GB/s. This combination allows for faster data transfer and reduced latency, crucial for real-time applications and high-performance computing tasks.
Energy Efficiency and Thermal Management
Designed with high energy efficiency, the NVIDIA L40 consumes only 300 W of power, making it a cost-effective choice for large-scale deployments. The passive cooling solution and bi-directional airflow support ensure optimal thermal management, maintaining an operating temperature range of 0°C to 50°C.
Robust Compatibility and Support
The NVIDIA L40 is compatible with various server platforms supporting NVIDIA GPUs, making it a versatile addition to your IT infrastructure. It supports a wide range of compute and graphics APIs, including CUDA, TensorRT, DirectX 12.075, and Vulkan 1.186. Additionally, it offers robust vGPU software support, including NVIDIA RTX Virtual Workstation (vWS) and NVIDIA AI Enterprise (NVAIE).
Enhanced Security and Reliability
With ECC support and SR-IOV support, the NVIDIA L40 ensures data integrity and secure multi-tenant environments. Its NEBS Level 3 readiness further guarantees reliability in demanding conditions, making it a trusted choice for mission-critical applications.
Versatile Application Support
Whether you're working on machine learning, deep learning, or virtual desktops, the NVIDIA L40 is designed to accelerate your workloads. Its encoder/decoder support, including AV1 encode and decode, further enhances its versatility, making it suitable for a wide range of applications.
* Shown with sparsity. Specifications 1/2 lower without sparsity.
Compute Performance
Acceleration Applications: Machine Learning, Deep Learning, Virtual Desktops. Compute APIs: CUDA, TensorRT, ONNX, DirectCompute, OpenCL, OpenACC. Graphics APIs: DirectX 12.075, Shader Model 5.175, OpenGL 4.686, Vulkan 1.186.
| INT4 Performance | 724 TOPS | 1448 TOPS* |
|---|---|
| INT8 Performance | 362 TOPS | 724 TOPS* |
| Mixed Precision | 181.05 TF | 362.1 TF* |
| Single Precision | 90.5 TF |
Features & Capabilities
vGPU Software: NVIDIA RTX Virtual Workstation (vWS), NVIDIA Virtual PC (vPC), NVIDIA Virtual Applications (vApps), NVIDIA AI Enterprise (NVAIE).
| Encoder/Decoder | 3 NVENC, 3 NVDEC (includes AV1 encode & decode) |
|---|---|
| Thermal Solution | Passive |

