Gpus

Meta has detailed Prometheus, its gigawatt-scale supercluster in Ohio, which will house approximately 1 million GPUs at full scale. The supercluster was used to train Meta's Muse foundational models.

Infrastructure • Techmeme

DeepSeek released DeepInfer, the inference framework behind its large-scale model services, as open source. The framework supports Nvidia GPUs and Huawei Ascend processors and includes capabilities like distributed inference and speculative decoding.

Infrastructure • TechNode

Google has joined Amazon in releasing a developer tool that makes it easy for PyTorch users to move their applications off Nvidia GPUs, challenging Nvidia's dominance in AI development.

Infrastructure • TechCrunch AI