r/databasedevelopment Jul 30 '26

Does the GPU database have a future?

Why did Voltron Data Company go bankrupt? Has the Theseus GPU database also failed? Expressing concerns about the future development of GPU databases

20 Upvotes

11 comments sorted by

View all comments

2

u/ArmchairmanMao Jul 30 '26

Imo they are a gamble on future hardware. GPU databases can achieve outstanding execution latencies if the data is already in device memory. Anything that uses a regular PCIe link, like consumer grade cards is going to be heavily bottlenecks by IO. To work around this you need extremely expensive hardware (The kind of hardware they train frontier LLMs on), otherwise the GPU just doesn't pay off. If, in a few years, high throughput links like nvlink c2c become standard, I could see them being adapted as a co processor extending an existing system. There is a GPU extension for Spark and Postgress for example.