CLUE benchmark

All

50 repositories

2024h1
Public
中文大模型基准测评2024上半年度报告，Report of LLMs in Chinese, First Half of 2024
0•1•1•0•Updated Jul 9, 2024Jul 9, 2024
SuperCLUE-Video
Public
中文原生多层次文生视频测评基准
1•17•0•0•Updated Jul 8, 2024Jul 8, 2024
SuperCLUE-V
Public
中文原生多模态理解测评基准（测评方案）
0•3•0•0•Updated Jul 8, 2024Jul 8, 2024
SuperCLUE-Long
Public
中文原生长文本测评基准
0•5•0•0•Updated Jul 8, 2024Jul 8, 2024
SuperCLUE-Image
Public
中文原生文生图测评基准
0•8•0•0•Updated Jul 8, 2024Jul 8, 2024
SuperCLUE-Coder
Public
中文原生代码助手测评基准，产品级
0•0•0•0•Updated Jul 8, 2024Jul 8, 2024
SuperCLUElyb
Public
SuperCLUE琅琊榜：中文通用大模型匿名对战评价基准
6•143•3•1•Updated Jun 19, 2024Jun 19, 2024
SuperCLUE
Public
SuperCLUE: 中文通用大模型综合性基准 | A Benchmark for Foundation Models in Chinese
evaluation chinese gpt-4 foundation-models chatgpt
99•3k•35•0•Updated May 23, 2024May 23, 2024
CLUE
Public
中文语言理解测评基准 Chinese Language Understanding Evaluation Benchmark: datasets, baselines, pre-trained models, corpus and leaderboard
benchmark tensorflow nlu glue transformers pytorch dataset chinese pretrained-models language-model
Python
•542•4k•78•2•Updated May 23, 2024May 23, 2024
SuperCLUE-Fin
Public
中文金融大模型测评基准，六大类二十五任务、等级化评价，国内模型获得A级
0•8•0•0•Updated May 6, 2024May 6, 2024
SuperCLUE-ICabin
Public
汽车智能座舱大模型测评基准
0•9•0•0•Updated Apr 25, 2024Apr 25, 2024
SuperCLUE-Llama3-Chinese
Public
Llama3开源模型中文版-全方位测评，基于SuperCLUE基准 | Llama3 Chinese Evaluation with SuperCLUE
0•16•1•0•Updated Apr 21, 2024Apr 21, 2024
SuperCLUE-RAG
Public
中文原生检索增强生成测评基准
3•103•1•0•Updated Apr 18, 2024Apr 18, 2024
SuperCLUE-Code3
Public
中文原生等级化代码能力测试基准
1•12•1•0•Updated Apr 11, 2024Apr 11, 2024
SuperCLUE-Role
Public
SuperCLUE-Role中文原生角色扮演测评基准
1•24•0•0•Updated Apr 3, 2024Apr 3, 2024
SuperCLUE-Industry
Public
中文原生工业测评基准
0•13•0•0•Updated Mar 21, 2024Mar 21, 2024
SuperCLUE-Safety
Public
SC-Safety: 中文大模型多轮对抗安全基准
9•112•6•0•Updated Mar 15, 2024Mar 15, 2024
SuperCLUE-Math6
Public
SuperCLUE-Math6：新一代中文原生多轮多步数学推理数据集的探索之旅
Python
•5•50•0•0•Updated Feb 5, 2024Feb 5, 2024
SuperCLUE-Auto
Public
汽车行业中文大模型测评基准，基于多轮开放式问题的细粒度评测
3•29•2•0•Updated Dec 26, 2023Dec 26, 2023
SuperCLUE-Agent
Public
SuperCLUE-Agent: 基于中文原生任务的Agent智能体核心能力测评基准
2•79•7•0•Updated Nov 9, 2023Nov 9, 2023
SuperCLUE-Open
Public
中文通用大模型开放域多轮测评基准 | An Open Domain Benchmark for Foundation Models in Chinese
3•77•2•0•Updated Aug 25, 2023Aug 25, 2023
SuperCLUE-Llama2-Chinese
Public
Llama2开源模型中文版-全方位测评，基于SuperCLUE的OPEN基准 | Llama2 Chinese evaluation with SuperCLUE
evaluation chinese zhongwen superclue llama2
8•127•2•0•Updated Aug 2, 2023Aug 2, 2023
SuperCLUEgkzw
Public
SuperCLUE高考作文机器自动阅卷系统
0•13•1•0•Updated Jun 8, 2023Jun 8, 2023
PyCLUE
Public
Python toolkit for Chinese Language Understanding(CLUE) Evaluation benchmark
corpus tiny language-model bert xlnet chineseglue albert chinese-language evaluation-benchmark roberta-wwm-ext
Python
•
MIT License
•14•128•5•3•Updated May 22, 2023May 22, 2023
CLUENER2020
Public
CLUENER2020 中文细粒度命名实体识别 Fine Grained Named Entity Recognition
dataset named-entity-recognition chinese seq2seq sequence-to-sequence ner albert bert sequence-labeling chinese-ner
Python
•303•1.5k•57•1•Updated Nov 21, 2022Nov 21, 2022
CLUEDatasetSearch
Public
搜索所有中文NLP数据集，附常用英文NLP数据集
qa sentiment-analysis text-classification match machine-translation text-similarity corpus knowledge-graph chinese text-summarization
Python
•614•4.2k•9•0•Updated Nov 21, 2022Nov 21, 2022
LGEB
Public
LGEB: Benchmark of Language Generation Evaluation
Python
•1•16•1•1•Updated Oct 21, 2022Oct 21, 2022
CLUECorpus2020
Public
Large-scale Pre-training Corpus for Chinese 100G 中文预训练语料
nlp corpus chinese datasets albert bert chinese-corpus roberta pretrain
MIT License
•81•929•10•0•Updated Oct 17, 2022Oct 17, 2022
SimCLUE
Public
3000000+语义理解与匹配数据集。可用于无监督对比学习、半监督学习等构建中文领域效果最好的预训练模型
Python
•40•289•3•0•Updated Oct 11, 2022Oct 11, 2022
MobileQA
Public
离线端阅读理解应用 QA for mobile, Android & iPhone
android nlp qa tensorflow iphone chinese albert bert machine-reading-comprehension tflite
Python
•13•60•1•1•Updated Oct 6, 2022Oct 6, 2022