Getting ChatGPT to run on a NAS is actually worth exploring — tech enthusiast puts an Nvidia RTX GPU in a 12-bay NAS powered by an AMD EPYC CPU, and the results are surprising

QNAP TS-h1290FX
(Image credit: QNAP)

If you’ve ever wondered what happens when you drop a GPU into a NAS and get it running AI, like a private ChatGPT, then StorageReview has the surprising answer.

For the base of his project, the site's Jordan Ranous used QNAP’s TS-h1290FX, a 12 NVMe NAS powered by an AMD EPYC 7302P CPU and boasting 256GB DRAM, 25GbE connectivity, and plenty of PCI slots. He chose that NAS as it has support for an internal GPU and the ability to host up to 737TB of raw storage. 

By adding an Nvidia RTX A4000 GPU to the TS-h1290FX and configuring it for AI using Virtualization Station (a hypervisor for the NAS), Ranous was able to run AI workflows seamlessly.

Nvidia’s Chat with RTX

Nvidia’s ChatRTX software package sorted the AI interaction side by providing a customized experience through a GPT-based LLM with a local, unique dataset. This allowed for rapid, context-aware responses while maintaining privacy and security. 

StorageReview detailed the process which involved verifying hardware compatibility, installing the GPU, updating QNAP firmware and software, and installing the OS on the VM, before configuring GPU passthrough, installing GPU drivers in the VM and verifying the passthrough functionality. 

The ease of setting up the GPU for AI on the QNAP NAS proves it could work as a cost-effective and efficient solution for businesses looking to leverage the power of AI. As Ranous says, “We’ve shown that adding a decent GPU to a QNAP NAS is relatively easy and inexpensive. We put an A4000 to work, and with a street price of about $1050, that’s not bad when you consider Virtualization Station is free and NVIDIA ChatRTX is available at no charge.”

More from TechRadar Pro

TOPICS
Wayne Williams
Editor

Wayne Williams is a freelancer writing news for TechRadar Pro. He has been writing about computers, technology, and the web for 30 years. In that time he wrote for most of the UK’s PC magazines, and launched, edited and published a number of them too.

Read more
Ugreen NASync iDX6011 and iDX6011 Pro models pictured side-by-side.
This outlandish 8-drive NAS claims to have an integrated LLM, and I can't wait for it to go on sale
A person's hand using DeepSeek on their mobile phone
'A virtual DPU within a GPU': Could clever hardware hack be behind DeepSeek's groundbreaking AI efficiency?
Nvidia HQ
Nvidia calls DeepSeek an 'excellent AI advancement' and praises the Chinese AI app's ingenuity
NVIDIA GeForce RTX 50 Series image
NVIDIA GeForce RTX 50 Series GPUs supercharge generative AI on your PC
Nvidia H800 GPU
A look at the unbelievable Nvidia GPU that powers DeepSeek's AI global ambition
Project DIGITS - front view
I am thrilled by Nvidia’s cute petaflop mini PC wonder, and it’s time for Jensen’s law: it takes 100 months to get equal AI performance for 1/25th of the cost
Latest in Pro
Epson EcoTank ET-4850 next to a TechRadar badge that reads Big Savings
I found the best printer deal you won't see in the Amazon Spring Sale and it's got a massive $150 saving
NVIDIA RTX PRO 6000 Blackwell Server Edition
Nvidia's most expensive Blackwell card gets massive price cut but it is not the RTX 5090
Microsoft Copiot Studio deep reasoning and agent flows
Microsoft reveals OpenAI-powered Copilot AI agents to bosot your work research and data analysis
Group of people meeting
Inflexible work policies are pushing tech workers to quit
Data leak
Top home hardware firm data leak could see millions of customers affected
Representational image depecting cybersecurity protection
Third-party security issues could be the biggest threat facing your business
Latest in News
Hisense U8 series TV on wall in living room
Hisense announces 2025 mini-LED TV lineup, with screen sizes up to 100 inches – and a surprising smart TV switch
Nintendo Music teaser art
Nintendo Music expands its library with songs from Kirby and the Forgotten Land and Tetris
Opera AI Tabs
Opera's new AI feature brings order to your browser tab chaos
An image of Pro-Ject's Flatten it closed and opened
Pro-Ject’s new vinyl flattener will fix any warped LPs you inadvertently buy on Record Store Day
The iPhone 16 Pro on a grey background
iPhone 17 Pro tipped to get 8K video recording – but I want these 3 video features instead
EA Sports F1 25 promotional image featuring drivers Oscar Piastri, Carlos Sainz and Oliver Bearman.
F1 25 has been officially announced, with this year's entry marking a return for Braking Point and a 'significant overhaul' for My Team mode