Baidu's Ernie 5.1 uses only a third of the parameters of its predecessor and cuts pre-training costs by 94%, while still...

Source Brief

Baidu's Ernie 5.1 uses only a third of the parameters of its predecessor and cuts pre-training costs by 94%, while still delivering competitive performance. This could make powerful language models more accessible for smaller companies.