Hello folks，我是 Luga，今天我们来聊一下人工智能应用场景中一个至关重要的解决方案：如何选型高效、灵活的 GPU 方案。   ...

Hello folks，我是 Luga，今天我们来聊一下人工智能应用场景中一个至关重要的组成部分：构建高效、灵活的计算架构的基石—NVIDIA GPU 产品线。     在人工智能和深度学习领域，NVIDIA 凭借其强大的 GPU ...

The training process requires at least one GPU with VRAM bigger than 40GB. We test the whole pipeline using Nvidia A100 gpu. Other GPUs are not tested but may be fine. For testing only, a GPU with ...

Nvidia has announced its new line of GPUs, the RTX 50-series. That includes four new graphics cards: the RTX 5090, RTX 5080, RTX 5070 Ti, and RTX 5070. They’re nearly as insane in price and ...

在科技的边缘，有一项新技术正在悄然改变我们对深度学习模型的理解。来自卡内基梅隆大学、华盛顿大学以及MetaAI的研究团队推出了一种名为MagicPIG的创新技术，它通过将注意力计算从GPU转移到CPU上，显著提高了大模型在解码任务中的吞吐量，提升幅度在1.76到4.99倍之间。 这一变化的背后，是KV缓存成为长上下文大模型（LLM）在推理过程中强化的关键瓶颈。以NVIDIA A100-40GB G ...

TensorFloat-32 (TF32) TensorFloat-32 (TF32) is the new math mode in NVIDIA A100 GPUs for handling the matrix math also called tensor operations. TF32 running on Tensor Cores in A100 GPUs can provide ...

英伟达推出 Project DIGITS，这是一款基于即将发布的 GB10 Grace Blackwell 超级芯片的小型 AI 超级计算机。它将于 5 月上市，为用户提供 1 petaflop 的 AI ...

NVIDIA is synonymous with AI computing, primarily due to very efficient and powerful GPUs. The latest AI chip from the company, NVIDIA A100, has revolutionized deep learning and neural network ...

Nvidia gained a staggering $2 trillion in market value last year amid the market's continued frenzy for artificial intelligence, and yet, the stock may have even more room to climb amid a flurry ...

a 16 GB GDDR7 memory is now confirmed. Moreover, this next-gen card will also have a 256-bit bus interface and outputs, including 3 DisplayPort and 1 HDMI connector. The box for the RTX 5080 custom ...