Nvidia is the tech giant behind the GPUs that power our games, run our creative suites, and - as of late - play a crucial role in training the generative AI models behind chatbots like ChatGPT. The company has dived deeper into the world of AI with the announcement of new software that could solve a big problem chatbots have - going off the rails and being a little…strange.
The newly-announced ‘NeMo Guardrails’ is a piece of software designed to ensure that smart applications powered by large language models (LLMs) like AI chatbots are “accurate, appropriate, on topic and secure”. Essentially, the guardrails are there to weed out inappropriate or inaccurate information generated by the chatbot, stop it from getting to the user, and inform the bot that the specific output was bad. It’ll be like an extra layer of accuracy and security - now without the need for user correction.
The open-source software can be used by AI developers to set up three types of boundaries for the AI models: Topical, safety and security guidelines. It’ll break down the details of each - and why this sort of software is both a necessity and a liability.
