Bonsai 27B AI model fits on iPhone
PrismML has developed the Bonsai 27B AI model, which has 27 billion parameters and can run on an iPhone 17 Pro Max.
The model is compressed to 3.9 GB, making it small enough to fit on a smartphone.
The ternary variant of the model retains 94.6% of its full-precision benchmark performance and outperforms conventional models.