Categories
Misc

NVIDIA Releases NIM Microservices to Safeguard Applications for Agentic AI

AI agents are poised to transform productivity for the world’s billion knowledge workers with “knowledge robots” that can accomplish a variety of tasks. To develop AI agents, enterprises need to address critical concerns like trust, safety, security and compliance. New NVIDIA NIM microservices for AI guardrails — part of the NVIDIA NeMo Guardrails collection of
Read Article

Categories
Misc

How to Safeguard AI Agents for Customer Service with NVIDIA NeMo Guardrails

AI agents present a significant opportunity for businesses to scale and elevate customer service and support interactions. By automating routine inquiries and…

AI agents present a significant opportunity for businesses to scale and elevate customer service and support interactions. By automating routine inquiries and enhancing response times, these agents improve efficiency and customer satisfaction, helping organizations stay competitive. However, alongside these benefits, AI agents come with risks. Large language models (LLMs) are vulnerable to…

Source

Categories
Misc

Timm ❤️ Transformers: Use any timm model with transformers

Categories
Misc

Continued Pretraining of State-of-the-Art LLMs for Sovereign AI and Regulated Industries with iGenius and NVIDIA DGX Cloud

Stack diagram for LLM Megatron Core.In recent years, large language models (LLMs) have achieved extraordinary progress in areas such as reasoning, code generation, machine translation, and…Stack diagram for LLM Megatron Core.

In recent years, large language models (LLMs) have achieved extraordinary progress in areas such as reasoning, code generation, machine translation, and summarization. However, despite their advanced capabilities, foundation models have limitations when it comes to domain-specific expertise such as finance or healthcare or capturing cultural and language nuances beyond English.

Source

Categories
Misc

Introducing multi-backends (TRT-LLM, vLLM) support for Text Generation Inference

Categories
Misc

Strengthening Climate Resilience with AI-Powered Flood Modeling and 3D Visualizations

An aerial view of a flooded town.AI-driven flood modeling and 3D visualization tools are transforming how communities prepare for and respond to climate risks. In this NVIDIA GTC 2024 session,…An aerial view of a flooded town.

AI-driven flood modeling and 3D visualization tools are transforming how communities prepare for and respond to climate risks. In this NVIDIA GTC 2024 session, Guy Schumann and Guillaume Gallion from RSS-Hydro explore how next-generation geospatial applications and high-fidelity visualizations, including NVIDIA Omniverse, can enhance disaster resilience by providing dynamic tools for decision…

Source

Categories
Misc

How AI Is Enhancing Surgical Safety and Education

Troves of unwatched surgical video footage are finding new life, fueling AI tools that help make surgery safer and enhance surgical education. The Surgical Data Science Collective (SDSC) is transforming global surgery through AI-driven video analysis, helping to close the gaps in surgical training and practice. In this episode of the NVIDIA AI Podcast, Margaux
Read Article

Categories
Misc

GPU Memory Essentials for AI Performance

Generative AI has revolutionized how people bring ideas to life, and agentic AI represents the next leap forward in this technological evolution. By leveraging…

Generative AI has revolutionized how people bring ideas to life, and agentic AI represents the next leap forward in this technological evolution. By leveraging sophisticated, autonomous reasoning and iterative planning, AI agents can tackle complex, multistep problems with remarkable efficiency. As AI continues to revolutionize industries, the demand for running AI models locally has surged.

Source

Categories
Misc

Train 400x faster Static Embedding Models with Sentence Transformers

Categories
Misc

Upcoming Event: CUDA Developer Meet Up in Silicon Valley

Whether you’re just starting your GPU programming journey or you’re a CUDA ninja looking to share advanced techniques, join us in San Jose on 1/30/25.

Whether you’re just starting your GPU programming journey or you’re a CUDA ninja looking to share advanced techniques, join us in San Jose on 1/30/25.

Source