![Article Image](https://www.freedomsphoenix.com/Uploads/Graphics/687-0525104435-localllm.jpg)
IPFS News Link • Robots and Artificial Intelligence
Looking at Hardware for Running Local Large Language Models
• Next Big Future - Brian WangChatRTX is a demo app that lets you personalize a GPT large language model (LLM) connected to your own content—docs, notes, images, or other data. Leveraging retrieval-augmented generation (RAG), TensorRT-LLM, and RTX acceleration, you can query a custom chatbot to quickly get contextually relevant answers. It all runs locally on your Windows RTX PC or workstation, you'll get fast and secure results.