Categories
Misc

Powering the Future of AI-Enabled Medical Devices with NVIDIA Holoscan and RTI Connext

The demand for real-time insights and autonomous decision-making is growing across industries, and healthcare and medical devices are no exception. Relying on…

The demand for real-time insights and autonomous decision-making is growing across industries, and healthcare and medical devices are no exception. Relying on real-time edge AI, the next generation of healthcare promises to deliver more precise treatments, improve patient outcomes, and increase operational efficiencies. Operating rooms of the future, for example…

Source

Categories
Misc

Maximize GPU performance with Near-Real-Time Usage Stats on NVDashboard v0.10

A man working at a laptop.At NVIDIA GTC 2024, the RAPIDS team demonstrated new features on NVDashboard v0.10 a dashboard that runs on JupyterLab, for monitoring GPU usage to help…A man working at a laptop.

At NVIDIA GTC 2024, the RAPIDS team demonstrated new features on NVDashboard v0.10 a dashboard that runs on JupyterLab, for monitoring GPU usage to help maximize the efficiency of GPU resources. We are excited to follow that up by announcing that NVDashboard v0.10 is now available to use. This update introduces a host of improvements, including data streaming through WebSockets for…

Source

Categories
Misc

Just Released: cuDSS 0.3.0

cuDSS (Preview) is an accelerated direct sparse solver. It now supports multi-GPU multi-node platforms, and introduces a hybrid memory mode.

cuDSS (Preview) is an accelerated direct sparse solver. It now supports multi-GPU multi-node platforms, and introduces a hybrid memory mode.

Source

Categories
Misc

Decoding How the Generative AI Revolution BeGAN

Generative models have completely transformed the AI landscape — headlined by popular apps such as ChatGPT and Stable Diffusion.

Categories
Misc

Power Advanced Coding Capabilities with Deepseek Code LLM

Deepseek Coder v2, available as an NVIDIA NIM microservice, enhances project-level coding and infilling tasks.

Deepseek Coder v2, available as an NVIDIA NIM microservice, enhances project-level coding and infilling tasks.

Source

Categories
Misc

Addressing Hallucinations in Speech Synthesis LLMs with the NVIDIA NeMo T5-TTS Model

NVIDIA NeMo has released the T5-TTS model, a significant advancement in text-to-speech (TTS) technology. Based on large language models (LLMs), T5-TTS produces…

NVIDIA NeMo has released the T5-TTS model, a significant advancement in text-to-speech (TTS) technology. Based on large language models (LLMs), T5-TTS produces more accurate and natural-sounding speech. By improving alignment between text and audio, T5-TTS eliminates hallucinations such as repeated spoken words and skipped text. Additionally, T5-TTS makes up to 2x fewer word pronunciation errors…

Source

Categories
Misc

Achieving High Mixtral 8x7B Performance with NVIDIA H100 Tensor Core GPUs and TensorRT-LLM

As large language models (LLMs) continue to grow in size and complexity, the performance requirements for serving them quickly and cost-effectively continue to…

As large language models (LLMs) continue to grow in size and complexity, the performance requirements for serving them quickly and cost-effectively continue to grow. To deliver high LLM inference performance, an efficient parallel computing architecture and a flexible and highly-optimized software stack are required. Recently, NVIDIA Hopper GPUs running NVIDIA TensorRT-LLM inference software set…

Source

Categories
Misc

Checkpointing CUDA Applications with CRIU

Checkpoint and restore functionality for CUDA is exposed through a command-line utility called cuda-checkpoint. This utility can be used to transparently…

Source

Categories
Misc

Phi-3-Medium: Now Available on the NVIDIA API Catalog

Illustration representing Phi-3-Medium.Phi-3-Medium accelerates research with logic-rich features in both short (4K) and long (128K) context.Illustration representing Phi-3-Medium.

Phi-3-Medium accelerates research with logic-rich features in both short (4K) and long (128K) context.

Source

Categories
Misc

Advancing Security for Large Language Models with NVIDIA GPUs and Edgeless Systems

An image representing cybersecurity.Edgeless Systems introduced Continuum AI, the first generative AI (GenAI) framework that keeps prompts encrypted at all times with confidential computing by…An image representing cybersecurity.

Edgeless Systems introduced Continuum AI, the first generative AI (GenAI) framework that keeps prompts encrypted at all times with confidential computing by combining confidential VMs with NVIDIA H100 GPUs and secure sandboxing. The launch of this platform underscores a new era in AI deployment, where the benefits of powerful LLMs can be realized without compromising data privacy and…

Source