Nvidia's new app will let you run an AI chatbot on your RTX-powered PC

Date:
Tue, 13 Feb 2024 20:05:59 +0000

Description:
Chat with RTX can summarize lengthy documents and YouTube videos, but its performance is shaky at best.

FULL STORY ======================================================================

Nvidia is offering users the opportunity to try out their new AI chatbot
that runs natively on your PC called Chat with RTX.

Well, its not a chatbot in the traditional sense like ChatGPT . Its more of
an AI summarizer as Chat with RTX doesnt come with its own knowledge base.
The data it references has to come from documents that you provide. According to the company, their software supports multiple file formats including .txt, .pdf, .doc, and .xml. The way it works is you upload a single file or an entire folder onto Chat with RTXs library. You then ask questions relating to the uploaded content or have it sum up the text into a bize-sized paragraph.

As TheVerge points out, the tool can help professionals analyze lengthy documents. And because it runs locally on your PC, you can ask Chat with RTX to process sensitive data without worrying about any potential leaks.

The software can also summarize YouTube videos. To do this, youll need to first change the dataset from Folder Path to YouTube URL then paste said URL of the clip into Chat with RTX. Itll then transcribe the entire video for the app to use as its knowledge base. URLs for YouTube playlists can be pasted as well. You can also list out how many videos are in the playlist. Regardless, the software will transcribe everything as normal. Rough around the edges

Keep in mind Chat with RTX is far from perfect. As TheVerge puts it, the app is a little rough around the edges.

Its reportedly pretty good at summarizing documents since it had no problem pulling out all the key information. However, it falters with YouTube videos. The publication uploaded one of their clips for Chat with RTX to transcribe. After looking through the summary, they discovered it was for a completely different video. Additionally, it doesnt understand context. If you ask a follow-up question based on the context of a previous question, the AI wont know what youre talking about. Each prompt must be treated as a completely
new one. Requirements

The demo is free for everyone to try out, although your computer must meet certain requirements. It needs to have a GeForce RTX 30 Series or higher graphics card running on the latest Nvidia drivers, at least 8GB of VRAM, and Windows 10 or Windows 11 on board.

TheVerge claims it took about 30 minutes for Chat with RTX to finish installing on their PC which housed an Intel Core i9-14900K CPU and a GeForce RTX 4090 GPU . So even if you have a powerful machine, itll still take a while. The file size for the app is nearly 40GB and will eat up around 3GB of RAM when activated.

We reached out to Nvidia asking if there are plans to expand support to RTX
20 Series graphics cards and when the final version will launch (assuming there is one). This story will be updated at a later time.

Until then, check out TechRadar's list of the best graphics cards for 2024 . You might also like Nvidia was briefly more valuable than Amazon as AI hype spikes again Nvidia RTX 4080 Super is out of stock is this GPU flying off shelves, or is there another reason behind it vanishing? AMDs mid-range RDNA
4 GPUs are shaping up to be Nvidia RTX 4080 and 4060 Ti killers but they may not arrive until 2025



======================================================================
Link to news story: https://www.techradar.com/computing/software/nvidias-new-app-will-let-you-run- an-ai-chatbot-on-your-rtx-powered-pc


--- Mystic BBS v1.12 A47 (Linux/64)
* Origin: tqwNet Technology News (1337:1/100)