Bonsai 27B: A 27B-parameter AI model compressed to fit on an iPhone
PrismML compressed a 27-billion-parameter AI model to under 4 GB, enabling it to run on an iPhone while retaining 90% of its original performance.
Published 2j1 sourceNotable
Lire en français
≈ 27s
The fact
Internal benchmarks show minimal impact on math and coding capabilities despite the size reduction.
Apple is reportedly testing this compression technology to enhance its on-device AI and close the gap with competitors.
Click the link to read an article on the topic: