On Wednesday, Mistral, the French AI startup, unveiled “Les Ministraux,” its first generative AI models tailored for edge devices like laptops and smartphones. These adaptable models enable various applications, from text generation to collaborating with advanced systems for complex tasks, bringing powerful AI directly to users’ devices.
You can now enjoy two of Mistral’s Les Ministraux models, 3B, and 8B, boast a context window of 128,000 tokens, allowing them to process text comparable to 50 pages of a book. This makes them highly versatile for various applications.
In a Mistral’s blog post.
“Our most innovative customers and partners have increasingly been asking for local, privacy-first inference for critical applications such as on-device translation, internet-less smart assistants, local analytics, and autonomous robotics. Les Ministraux were built to provide a compute-efficient and low-latency solution for these scenarios.”
Mistral 8B is now available for research downloads, but developers need to contact the company for commercial licensing on both 8B and 3B models. Alternatively, users can access them via Mistral’s cloud platform, La Platforme, or partner clouds.
Pricing is set at 10 cents per million tokens for 8B and 4 cents for 3B. The trend is shifting towards smaller models, which are quicker and more cost-effective to train, as seen with Google and Microsoft’s offerings in the AI landscape.
Mistral declares that its Ministral 3B and 8B models outperform comparable Llama and Gemma models, as well as its own Mistral 7B, in key benchmarks assessing instruction-following and problem-solving skills.
The Paris-based startup, which recently secured $640 million in funding, is rapidly expanding its AI offerings. In recent months, Mistral introduced a free service for developers to test its models, launched an SDK for fine-tuning, and unveiled a new generative model for code called Codestral.
Mistral is making strides in the AI world with its focus on efficient models while starting to earn revenue. Aiming to compete with top models like GPT-4, Mistral is set to strengthen its position in the industry and continue providing innovative solutions.
