Categories
Misc

Boosting Llama 3.1 405B Throughput by Another 1.5x on NVIDIA H200 Tensor Core GPUs and NVLink Switch

The continued growth of LLMs capability, fueled by increasing parameter counts and support for longer contexts, has led to their usage in a wide variety of…

The continued growth of LLMs capability, fueled by increasing parameter counts and support for longer contexts, has led to their usage in a wide variety of applications, each with diverse deployment requirements. For example, a chatbot supports a small number of users at very low latencies for good interactivity. Meanwhile, synthetic data generation requires high throughput to process many items…

Source

Categories
Misc

Develop Academic and Industrial Applications with a New Specialized Math Model

Decorative image of stars in a geometric shape and colored pink, purple, blue, and green.Mathstral, an advanced AI model developed from the ground up, can deliver superior performance for enhanced learning of math, engineering, and science.Decorative image of stars in a geometric shape and colored pink, purple, blue, and green.

Mathstral, an advanced AI model developed from the ground up, can deliver superior performance for enhanced learning of math, engineering, and science.

Source

Categories
Misc

What’s the ROI? Getting the Most Out of LLM Inference

Large language models and the applications they power enable unprecedented opportunities for organizations to get deeper insights from their data reservoirs and to build entirely new classes of applications. But with opportunities often come challenges. Both on premises and in the cloud, applications that are expected to run in real time place significant demands on
Read Article

Categories
Misc

Flux and Furious: New Image Generation Model Runs Fastest on RTX AI PCs and Workstations

Image generation models — a popular subset of generative AI — can parse and understand written language, then translate words into images in almost any style.

Categories
Misc

Faster Assisted Generation with Dynamic Speculation

Categories
Misc

Scaling AI-based Data Processing with Hugging Face + Dask

Categories
Misc

NVIDIA AI Summit Highlights Game-Changing Energy Efficiency and AI-Driven Innovation

Accelerated computing is sustainable computing, Bob Pette, NVIDIA’s vice president and general manager of enterprise platforms, explained in a keynote at the NVIDIA AI Summit on Tuesday in Washington, D.C. NVIDIA’s accelerated computing isn’t just efficient. It’s critical to the next wave of industrial, scientific and healthcare transformations. “We are in the dawn of a
Read Article

Categories
Misc

Just Released: NVIDIA Modulus v24.09

NVIDIA Modulus v24.09 delivers utilities to physics-inform training and validation of any model, plus other enhancements.

NVIDIA Modulus v24.09 delivers utilities to physics-inform training and validation of any model, plus other enhancements.

Source

Categories
Misc

Accelerated Computing Key to Quantum Research

A recently released joint research paper by NVIDIA, Moderna and Yale reviews how techniques from quantum machine learning (QML) may enhance drug discovery methods by better predicting molecular properties. Ultimately, this could lead to the more efficient generation of new pharmaceutical therapies. The review also emphasizes that the key tool for exploring these methods is
Read Article

Categories
Misc

Pittsburgh Steels Itself for Innovation With Launch of NVIDIA AI Tech Community

Serving as a bridge for academia, industry and public-sector groups to partner on artificial intelligence innovation, NVIDIA is launching its inaugural AI Tech Community in Pittsburgh, Pennsylvania. Collaborations with Carnegie Mellon University and the University of Pittsburgh, as well as startups, enterprises and organizations based in the “city of bridges,” are part of the new
Read Article