It's built to be able to run inside a phone. So you know it can run on a GPU extremely well. I'm convinced the language model component has to be the weak link. At only 2.6 gigs the language side should be bad. Which means as well as it works, and as much as the language side would struggle to explain what it seeing, the visual side is just solid.