Categories
Misc

Train Generative AI Models More Efficiently with New NVIDIA Megatron-Core Functionalities

First introduced in 2019, NVIDIA Megatron-LM sparked a wave of innovation in the AI community, enabling researchers and developers to use the underpinnings of…

First introduced in 2019, NVIDIA Megatron-LM sparked a wave of innovation in the AI community, enabling researchers and developers to use the underpinnings of this open-source library to further large language model (LLM) advancements. Today, many of the most popular LLM developer frameworks have been inspired by and built using the Megatron-LM library, spurring a wave of foundation models and AI…

Source

Categories
Misc

Event: WeAreDevelopers World Congress 2024

Join NVIDIA at WeAreDevelopers July 17-19 to learn how accelerated computing tools powered by GPUs are shaping the future.

Join NVIDIA at WeAreDevelopers July 17-19 to learn how accelerated computing tools powered by GPUs are shaping the future.

Source

Categories
Misc

Boosting Mathematical Optimization Performance and Energy Efficiency on the NVIDIA Grace CPU

Mathematical optimization is a powerful tool that enables businesses and people to make smarter decisions and reach any number of goals—from improving…

Mathematical optimization is a powerful tool that enables businesses and people to make smarter decisions and reach any number of goals—from improving operational efficiency to reducing costs to increasing customer satisfaction. Many of these are everyday use cases, such as scheduling a flight, pricing a hotel room, choosing a GPS route, routing delivery trucks, and more. However…

Source

Categories
Misc

Mile-High AI: NVIDIA Research to Present Advancements in Simulation and Gen AI at SIGGRAPH

NVIDIA is taking an array of advancements in rendering, simulation and generative AI to SIGGRAPH 2024, the premier computer graphics conference, which will take place July 28 – Aug. 1 in Denver. More than 20 papers from NVIDIA Research introduce innovations advancing synthetic data generators and inverse rendering tools that can help train next-generation models.
Read Article

Categories
Misc

Defending AI Model Files from Unauthorized Access with Canaries

An illustration showing a securit alert.As AI models grow in capability and cost of creation, and hold more sensitive or proprietary data, securing them at rest is increasingly important….An illustration showing a securit alert.

As AI models grow in capability and cost of creation, and hold more sensitive or proprietary data, securing them at rest is increasingly important. Organizations are designing policies and tools, often as part of data loss prevention and secure supply chain programs, to protect model weights. While security engineering discussions focus on prevention (How do we prevent X?), detection (Did X…

Source

Categories
Misc

Optimize AI Model Performance and Maintain Data Privacy with Hybrid RAG

The rapidly evolving field of generative AI is focused on building neural networks that can create realistic content such as text, images, audio, and synthetic…

The rapidly evolving field of generative AI is focused on building neural networks that can create realistic content such as text, images, audio, and synthetic data. Generative AI is revolutionizing multiple industries by enabling rapid creation of content, powering intelligent knowledge assistants, augmenting software development with coding co-pilots, and automating complex tasks across various…

Source

Categories
Misc

Spotlight: Siemens Energy Accelerates Power Grid Asset Simulation 10,000x Using NVIDIA Modulus

The world’s energy system is increasingly complex and distributed due to increasing renewable energy generation, decentralization of energy resources, and…

The world’s energy system is increasingly complex and distributed due to increasing renewable energy generation, decentralization of energy resources, and decarbonization of heavy industries. Energy producers are challenged to optimize operational efficiency and costs within hybrid power plants generating both renewable and carbon-based electricity. Grid operators have less time to dispatch energy…

Source

Categories
Misc

Next Generation of FlashAttention

NVIDIA is excited to collaborate with Colfax, Together.ai, Meta, and Princeton University on their recent achievement to exploit the Grace Hopper GPU…

NVIDIA is excited to collaborate with Colfax, Together.ai, Meta, and Princeton University on their recent achievement to exploit the Grace Hopper GPU architecture and Tensor Cores and accelerate key Fused Attention kernels using CUTLASS 3. FlashAttention-3 incorporates key techniques to achieve 1.5–2.0x faster performance than FlashAttention-2 with FP16, up to 740 TFLOPS. With FP8…

Source

Categories
Misc

Training Sim-to-Real Transferable Robotic Assembly Skills over Diverse Geometries

Most objects in home and industrial settings consist of multiple parts that must be assembled. While human workers typically perform assembly, in certain…

Most objects in home and industrial settings consist of multiple parts that must be assembled. While human workers typically perform assembly, in certain industries, such as automotive, robotic assembly is prevalent. Most of these robots are designed to perform highly repetitive tasks, dealing with specific parts in a carefully engineered setup. In high-mix, low-volume manufacturing (that is…

Source

Categories
Misc

How NuminaMath Won the 1st AIMO Progress Prize