Month: August 2024

Large language models (LLM) are getting larger, increasing the amount of compute required to process inference requests. To meet real-time latency requirements…

Large language models (LLM) are getting larger, increasing the amount of compute required to process inference requests. To meet real-time latency requirements for serving today’s LLMs and do so for as many users as possible, multi-GPU compute is a must. Low latency improves the user experience. High throughput reduces the cost of service. Both are simultaneously important. Even if a large…

Source

NVIDIA has released RAPIDS cuDF unified memory and text data processing features that help data scientists continue to use pandas when working with larger and…

NVIDIA has released RAPIDS cuDF unified memory and text data processing features that help data scientists continue to use pandas when working with larger and text-heavy datasets in demanding workloads. Data scientists can now accelerate these workloads by up to 30x. RAPIDS is a collection of open-source GPU-accelerated data science and AI libraries. cuDF is a Python GPU DataFrame library for…

Source

The State of California today announced a first-of-its-kind AI education initiative with NVIDIA. The public-private collaboration supports the state’s goals in workforce training and economic development by giving universities, community colleges and adult education programs in California the resources to gain skills in generative AI. “AI will continue to become more advanced and more prominent
Read Article

NVIDIA CUDA-Q (formerly NVIDIA CUDA Quantum) is an open-source programming model for building hybrid-quantum classical applications that take full advantage of…

NVIDIA CUDA-Q (formerly NVIDIA CUDA Quantum) is an open-source programming model for building hybrid-quantum classical applications that take full advantage of CPU, GPU, and QPU compute abilities. Developing these applications today is challenging and requires a flexible, easy-to-use coding environment coupled with powerful quantum simulation capabilities to efficiently evaluate and improve the…

Source

GPUs are specially designed to crunch through massive amounts of data at high speed. They have a large amount of compute resources, called streaming…

GPUs are specially designed to crunch through massive amounts of data at high speed. They have a large amount of compute resources, called streaming multiprocessors (SMs), and an array of facilities to keep them fed with data: high bandwidth to memory, sizable data caches, and the capability to switch to other teams of workers (warps) without any overhead if an active team has run out of data.

Source

This GFN Thursday marks 2,000 games in the GeForce NOW library, with five new games joining this week, alongside a demo for Square Enix’s Visions of Mana and a new reward for members playing Elder Scrolls Online. From epic role-playing games (RPGs) to heart-pounding shooters, the GeForce NOW library offers a variety of adventures for
Read Article

Silicon Valley’s Figure has taken the wraps off of its next-generation Figure 02 conversational humanoid robot that taps into NVIDIA Omniverse and NVIDIA GPUs for fully autonomous tasks. Figure said it recently tested Figure 02 for data collection and use-case training at BMW Group’s Spartanburg, South Carolina, production line. Figure 02 comes just 10 months
Read Article