In order to assist builders globally perceive giant language fashions (LLMs) higher, the corporate has funded and revealed an expert translation of the Massive Multitask Language Understanding (MMLU) benchmark in 14 languages by way of Hugging Face.
“Supporting those who (developers) understand the unique cultures, economies, and social dynamics of their communities will help ensure that AI applications are tailored to meet local needs,” the corporate defined.
The MMLU benchmark is offered in a number of languages, together with Arabic, Bengali, Chinese, French, German, Hindi, Indonesian, Italian, Japanese, Korean, Portuguese, Spanish, Swahili, and Yoruba.
