The company that manufactures graphics processors Nvidia introduced a new tool Chat with RTX, which is a promising chatbot with artificial intelligence. The Verge tested the app and called it a little “crude” but useful.
What can a chatbot do?
Chat with RTX can analyze YouTube videos. Just enter a URL and it can find specific mentions in the transcripts or summarize the entire video in text form.
It takes a few seconds, but not everything is perfect yet, for example, malfunctions were detected when searching for information in video transcriptions, or the chatbot used the content of another video to search.
Chat with RTX also proved useful for processing files in a variety of formats, including TXT, PDF, DOC, and DOCX. Microsoft's Copilot is said to have a hard time processing the files, but Nvidia's chatbot pulled all the information it needed without a problem. Responses were also almost instantaneous, without the lag typically seen with cloud-based chatbots like ChatGPT or Copilot.
Also, with the help of the chatbot, the testers managed to create a relevant data set at Microsoft, which quickly summarized the entire strategy of the company.
Technical requirements
Chat with RTX is based on two language models – Mistral and Llama 2. This tool works directly on your computer, so there is no need to connect to the Internet. The main condition is to have a Windows operating system, an RTX series 30 or 40 graphics processor with at least 8 GB of video memory.
As for installing the program, it takes about 30 minutes and requires a lot of your PC's resources. It weighs almost 40 GB, and its Python instance uses about 3 GB of the 64 GB of RAM. Once launched, you access Chat with RTX through a browser while the command line runs in the background.
It's important to note that Chat with RTX is currently a developer demo and has its limitations and drawbacks.