- Emergent Behavior
- Posts
- Mistral Falls
Mistral Falls
Microsoft announces a partnership with French AI startup, Mistral
🔷 Subscribe to get breakdowns of the most important developments in AI in your inbox every morning.
Microsoft announces a partnership (read: licensing their latest models + taking a small equity stake in the firm) with Mistral. Mistral is a French AI startup founded by ex-Meta AI lab researchers.
We're announcing a multi-year partnership with @MistralAI, as we build on our commitment to offer customers the best choice of open and foundation models on Azure.
— Satya Nadella (@satyanadella)
5:18 PM • Feb 26, 2024
Mistral originally focused on releasing smaller open-source models, scaling them up over the last 6 months until now, when it’s in striking distance of GPT-4.
The Mistral-Large model:
is natively fluent in English, French, Spanish, German and Italian
has 32k tokens context
has precise instruction following: don’t know how this claim is measured… as it could potentially be full AGI if it means what it’s supposed to mean (obviously not, but they chose the language)
function calling - JSON output formatting
They’re not open-sourcing it for now; it’s available via API or lease in its own environment from MSFT.
Interestingly, Mistral seems to have created multilingual versions of popular benchmarks, and this could be a significant contribution if they decide to open-source this
Mistral published these multilingual benchmarks. As far as I know there are no published translated versions of these anywhere.
Did they just use machine translation?
Does a translated version of HellaSwag even make sense?Please publish them or they are meaningless!
— xlr8harder (@xlr8harder)
7:29 PM • Feb 26, 2024
The model is priced at par with GPT-4.
mistral-large costs %20 less than gpt4-turbo, but mistrals tokenizer results in %20 more tokens on average. You just use a worse model for the same $$$
— Xeophon (@TheXeophon)
5:53 PM • Feb 26, 2024
Still haven’t beaten OpenAI, but we’re probably only a few months away at this point.
If mistral's new large model couldn't surpass gpt-4, what hope does anyone else have? OpenAI lead is > 1 year
— anton (@abacaj)
5:30 PM • Feb 26, 2024
Even in AI, the money train seems to be tightening.
Not gonna lie; I am sad about Mistral not open-sourcing any of their models 😢
I thought they were on the OSS team.
— Bindu Reddy (@bindureddy)
7:13 PM • Feb 26, 2024
As some had expected it to:
Told you so!*
(*that the only biz model for even the best model startups is being acquired by or otherwise entering into an encumbered relationship w one of the big US infra providers. Meaning there’s no chance rn for meaningful EU (or, other) competition w US AI giants.)
— Meredith Whittaker (@mer__edith)
6:57 PM • Feb 26, 2024
This also hedges MSFT position in OpenAI from regulatory scrutiny
Microsoft strikes a deal with Mistral . Here is what you need to know:
* $MSFT will help bring Mistral models to market. $MSFT gets a minority stake in Mistral
* Push gives $MSFT flexibility moving forward if OpenAI comes under regulatory scrutiny— Ralph Brooks (@ralphbrooks)
2:49 PM • Feb 26, 2024
Satya playing another masterstroke… you gotta think: Where is Andy Jassy at Amazon in all this?
Become a subscriber for daily breakdowns of what’s happening in the AI world:
Reply