Qualcomm showcases PrismML's 1-bit Bonsai LLM for Snapdragon smart glasses
PrismML has adapted its tiny language models for smart glasses running on Qualcomm Snapdragon chips, with Qualcomm showcasing a 1-bit Bonsai LLM that runs locally on devices built on its AR1 Gen 1 Platform. No smart glasses using the model have been announced.
The model is a version of PrismML’s tiny language models adapted for smart glasses running on Qualcomm’s Snapdragon chips. PrismML is an AI lab founded by Caltech researchers and advised by UC Berkeley’s Ion Stoica.
The smart glasses version is a 2-billion-parameter model tuned for vision and language, so wearers can ask what they are looking at in real time, TechCrunch reported.
TechCrunch previously reported that PrismML’s claim to fame is that it shrinks larger models substantially, in this case by 4x, while retaining almost all of their performance on standard benchmarks.
PrismML’s larger goal is open-weight AI that runs on devices and makes better use of the computing power they already have. The startup pitches this as an alternative to depending on the privacy promises of proprietary AI labs and their insatiable need for more compute.
Releasing a model for Qualcomm’s chip is a step toward that vision, but no smart glasses running PrismML have been announced yet.