Category: Misc

First introduced in 2019, NVIDIA Megatron-LM sparked a wave of innovation in the AI community, enabling researchers and developers to use the underpinnings of…

First introduced in 2019, NVIDIA Megatron-LM sparked a wave of innovation in the AI community, enabling researchers and developers to use the underpinnings of this open-source library to further large language model (LLM) advancements. Today, many of the most popular LLM developer frameworks have been inspired by and built using the Megatron-LM library, spurring a wave of foundation models and AI…

Source

Join NVIDIA at WeAreDevelopers July 17-19 to learn how accelerated computing tools powered by GPUs are shaping the future.

Join NVIDIA at WeAreDevelopers July 17-19 to learn how accelerated computing tools powered by GPUs are shaping the future.

Source

Mathematical optimization is a powerful tool that enables businesses and people to make smarter decisions and reach any number of goals—from improving…

Mathematical optimization is a powerful tool that enables businesses and people to make smarter decisions and reach any number of goals—from improving operational efficiency to reducing costs to increasing customer satisfaction. Many of these are everyday use cases, such as scheduling a flight, pricing a hotel room, choosing a GPS route, routing delivery trucks, and more. However…

Source

NVIDIA is taking an array of advancements in rendering, simulation and generative AI to SIGGRAPH 2024, the premier computer graphics conference, which will take place July 28 – Aug. 1 in Denver. More than 20 papers from NVIDIA Research introduce innovations advancing synthetic data generators and inverse rendering tools that can help train next-generation models.
Read Article

As AI models grow in capability and cost of creation, and hold more sensitive or proprietary data, securing them at rest is increasingly important….

As AI models grow in capability and cost of creation, and hold more sensitive or proprietary data, securing them at rest is increasingly important. Organizations are designing policies and tools, often as part of data loss prevention and secure supply chain programs, to protect model weights. While security engineering discussions focus on prevention (How do we prevent X?), detection (Did X…

Source

The rapidly evolving field of generative AI is focused on building neural networks that can create realistic content such as text, images, audio, and synthetic…

The rapidly evolving field of generative AI is focused on building neural networks that can create realistic content such as text, images, audio, and synthetic data. Generative AI is revolutionizing multiple industries by enabling rapid creation of content, powering intelligent knowledge assistants, augmenting software development with coding co-pilots, and automating complex tasks across various…

Source

NVIDIA is excited to collaborate with Colfax, Together.ai, Meta, and Princeton University on their recent achievement to exploit the Grace Hopper GPU…

NVIDIA is excited to collaborate with Colfax, Together.ai, Meta, and Princeton University on their recent achievement to exploit the Grace Hopper GPU architecture and Tensor Cores and accelerate key Fused Attention kernels using CUTLASS 3. FlashAttention-3 incorporates key techniques to achieve 1.5–2.0x faster performance than FlashAttention-2 with FP16, up to 740 TFLOPS. With FP8…

Source

The world’s energy system is increasingly complex and distributed due to increasing renewable energy generation, decentralization of energy resources, and…

The world’s energy system is increasingly complex and distributed due to increasing renewable energy generation, decentralization of energy resources, and decarbonization of heavy industries. Energy producers are challenged to optimize operational efficiency and costs within hybrid power plants generating both renewable and carbon-based electricity. Grid operators have less time to dispatch energy…

Source

Most objects in home and industrial settings consist of multiple parts that must be assembled. While human workers typically perform assembly, in certain…

Most objects in home and industrial settings consist of multiple parts that must be assembled. While human workers typically perform assembly, in certain industries, such as automotive, robotic assembly is prevalent. Most of these robots are designed to perform highly repetitive tasks, dealing with specific parts in a carefully engineered setup. In high-mix, low-volume manufacturing (that is…

Source