Russia's GigaChat MAX, its flagship LLM, has been criticized for being 'unremarkable' and ranked eighth among Russian language models, lagging behind international counterparts. The model, developed by Sberbank, was promoted by President Putin as a key part of the national AI strategy. However, experts indicate that GigaChat MAX is months behind its US and Chinese rivals, with concerns that the ongoing war in Ukraine has hindered Russia's AI talent pool and development capabilities. The lack of responses from representatives of GigaChat MAX and Yandex highlights potential transparency issues.
For now, GigaChat MAX, Russia's most developed LLM, is 'unremarkable,' Lukasz Olejnik, a visiting senior research fellow in cybersecurity at the War Studies department at King's College, London, told BI. On 'benchmarks' - standardized tests for AI effectiveness - the models' scores 'are much lower,' he said, adding that they don't surpass any of the cutting-edge, or 'frontier,' models.
Despite Putin emphasizing AI development as a crucial avenue for Russian foreign policy, GigaChat MAX is months behind American and Chinese competitors. The country's war against Ukraine has also drained it of expertise.
Collection
[
|
...
]