Ask HN: Can anyone run frontier AI models at usable speeds?
Eight months ago, EXO labs promised fast inference on local hardware. But it is not fast enough. It takes a minute and a half to get a response through hermes, using Kimi K2.6. Is there hardware that a dev can buy that can actually offset cloud bills?
Comments URL: https://news.ycombinator.com/item?id=50394913
Points: 1
# Comments: 0
原文：https://www.a8q9.cn/en/article/ask-hn-can-anyone-run-frontier-ai-models-at-usable-speeds-943346.html