简体中文
CPM-Ant

CPM-Ant is an open-source Chinese pre-trained language model with 10B parameters. It is the first milestone of the CPM-Live live training process. The training process was cost-efficient and environment-friendly. CPM-Ant has also achieved promising results on the CUGE benchmark with delta tuning. Besides the full model, we also provide various compressed versions to fit different hardware configurations. The checkpoints are totally open and CPM-Ant adopts an open license.

Download
Original Model:
10B
Compressed Model:
0.3B
1B
3B
7B
201.86B Tokens Throughput
430813 Yuan Cost
68 Days Time Spent
Title Generation
Please click the button below to generate a title
Hot Title Generation
Text Content Toggle Sample Clear
Model Capability
Dataset CPM-Ant(10B) CPM-2 Yuan1.0
CCPM 92.13 91.6 89.71
KdConv 18.57 13.12 18.55
Math23K 71.6 69.4 76.9
Sogou-Log 38.02 35.9 28.12
LCSTS 30.08 35.9 40.82
C3 80.83 86.1 86.9
Model Params 10B 11B 13B
Trained Params 6.3M 11B UNK
© 2022 OpenBMB. All Rights Reserved