Key points
- The MLC group has launched a platform allowing users to run LLAMA models on the web and mobile devices.
- The web version offers a chat demo with model download, while the iOS and Android apps enable running 3B models on smartphones.
- The 3B model runs on an iPhone 13 with a response speed of 5-15 tokens per second.
The MLC group has launched a platform allowing users to run LLAMA models on the web and mobile devices. The web version offers a chat demo with model download, while the iOS and Android apps enable running 3B models on smartphones. The 3B model runs efficiently on iPhone 13, with a response speed of 5-15 tokens per second.
Leave a Reply