NVIDIA founder and CEO Jensen Huang and Meta founder and CEO Mark Zuckerberg will hold a public fireside chat on Monday, July 29, at the 50th edition of the SIGGRAPH graphics conference in Denver. The two leaders will discuss the future of AI and simulation and the pivotal role of research at SIGGRAPH, which focuses
Read Article
Geneformer is a recently introduced and powerful AI model that learns gene network dynamics and interactions using transfer learning from vast single-cell…
Geneformer is a recently introduced and powerful AI model that learns gene network dynamics and interactions using transfer learning from vast single-cell transcriptome data. This tool enables researchers to make accurate predictions about gene behavior and disease mechanisms even with limited data, accelerating drug target discovery and advancing understanding of complex genetic networks in…
First introduced in 2019, NVIDIA Megatron-LM sparked a wave of innovation in the AI community, enabling researchers and developers to use the underpinnings of…
First introduced in 2019, NVIDIA Megatron-LM sparked a wave of innovation in the AI community, enabling researchers and developers to use the underpinnings of this open-source library to further large language model (LLM) advancements. Today, many of the most popular LLM developer frameworks have been inspired by and built using the Megatron-LM library, spurring a wave of foundation models and AI…
Categories
Event: WeAreDevelopers World Congress 2024
Join NVIDIA at WeAreDevelopers July 17-19 to learn how accelerated computing tools powered by GPUs are shaping the future.
Join NVIDIA at WeAreDevelopers July 17-19 to learn how accelerated computing tools powered by GPUs are shaping the future.
Mathematical optimization is a powerful tool that enables businesses and people to make smarter decisions and reach any number of goals—from improving…
Mathematical optimization is a powerful tool that enables businesses and people to make smarter decisions and reach any number of goals—from improving operational efficiency to reducing costs to increasing customer satisfaction. Many of these are everyday use cases, such as scheduling a flight, pricing a hotel room, choosing a GPS route, routing delivery trucks, and more. However…
NVIDIA is taking an array of advancements in rendering, simulation and generative AI to SIGGRAPH 2024, the premier computer graphics conference, which will take place July 28 – Aug. 1 in Denver. More than 20 papers from NVIDIA Research introduce innovations advancing synthetic data generators and inverse rendering tools that can help train next-generation models.
Read Article
As AI models grow in capability and cost of creation, and hold more sensitive or proprietary data, securing them at rest is increasingly important….
As AI models grow in capability and cost of creation, and hold more sensitive or proprietary data, securing them at rest is increasingly important. Organizations are designing policies and tools, often as part of data loss prevention and secure supply chain programs, to protect model weights. While security engineering discussions focus on prevention (How do we prevent X?), detection (Did X…
The rapidly evolving field of generative AI is focused on building neural networks that can create realistic content such as text, images, audio, and synthetic…
The rapidly evolving field of generative AI is focused on building neural networks that can create realistic content such as text, images, audio, and synthetic data. Generative AI is revolutionizing multiple industries by enabling rapid creation of content, powering intelligent knowledge assistants, augmenting software development with coding co-pilots, and automating complex tasks across various…
The world’s energy system is increasingly complex and distributed due to increasing renewable energy generation, decentralization of energy resources, and…
The world’s energy system is increasingly complex and distributed due to increasing renewable energy generation, decentralization of energy resources, and decarbonization of heavy industries. Energy producers are challenged to optimize operational efficiency and costs within hybrid power plants generating both renewable and carbon-based electricity. Grid operators have less time to dispatch energy…
Categories
Next Generation of FlashAttention
NVIDIA is excited to collaborate with Colfax, Together.ai, Meta, and Princeton University on their recent achievement to exploit the Grace Hopper GPU…
NVIDIA is excited to collaborate with Colfax, Together.ai, Meta, and Princeton University on their recent achievement to exploit the Grace Hopper GPU architecture and Tensor Cores and accelerate key Fused Attention kernels using CUTLASS 3. FlashAttention-3 incorporates key techniques to achieve 1.5–2.0x faster performance than FlashAttention-2 with FP16, up to 740 TFLOPS. With FP8…