China's Qwen model tops 'Open LLM Leaderboard v2,' which tests AI models for Hugging Face – GIGAZINE

Spread the love

Hugging Face has released version 2 of the Open LLM Leaderboard, which ranks open source language models from around the world. At the time of release, the top ranking was

This ranking is subject to change. At the time of writing, the breakdown from 1st to 10th place is as follows:

1st place: Qwen/ Qwen2-72B-Instruct
2nd place: meta-llama/ Meta-Llama-3-70B-Instruct
3rd place: Qwen/ Qwen2-72B
4th place: mistralai/ Mixtral-8x22B-Instruct-v0.1
5th place: HuggingFaceH4/ zephyr-orpo-141b-A35b-v0.1
6th place: microsoft/ Phi-3-medium-4k-instruct
7th place: 01-ai/ Yi-1.5-34B-Chat
8th place:CohereForAI/ c4ai-command-r-plus
9th place: abacusai/ Smaug-72B-v0.1
10th place: Qwen/ Qwen1.5-110B

As shown above, Qwen's models occupy three of the top 10 positions, demonstrating their overwhelming strength. Furthermore, ‘Smaug-72B,’ which ranked 9th this time, was the top model in Open LLM Leaderboard Version 1 as of February 2024. Smaug-72B is a model created by fine-tuning ‘Qwen-72B,’ which ranked 3rd this time.

Abacus AI's open-source LLM 'Smaug-72B' topped the Hugging Face Open LLM Leaderboard and outperformed GPT-3.5 in several benchmarks – GIGAZINE

Related Posts:
<< Next
Alibaba Cloud researchers unveil technology to interconnect 15,000 GPUs in AI data centers, abandoning NVIDIA technology in favor of Ethernet
Prev >>
DOJ asks Boeing to plead guilty to fraud, faces trial if it doesn't
in AI, Posted by log1p_kr

source

Leave a Comment

Your email address will not be published. Required fields are marked *

Scroll to Top