A TypeScript API for NVIDIA ChatRTX

A client built with React and TypeScript to chat with NVIDIA ChatRTX: you send a message to the server and receive the model's response.

What is ChatRTX?

ChatRTX is an NVIDIA application that lets you customize a large language model (LLM) by connecting it to your own content —documents, notes, videos or other data— using retrieval-augmented generation (RAG), TensorRT-LLM and RTX acceleration. Since everything runs locally on your RTX PC, answers are fast and private.

The contribution

This project is a TypeScript port of the original Python API: a chatApi class with a sendMessage(message) that returns a promise with the server's response, ready to drop into any React/TypeScript app.

More about ChatRTX at NVIDIA. Source on GitHub.