Code Generation On Bigcodebench Instruct
评估指标
Pass@1
评测结果
各个模型在此基准测试上的表现结果
模型名称 | Pass@1 | Paper Title | Repository |
|---|---|---|---|
| DeepSeek-Coder-V2-Instruct | 48.2 | BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions | - |
| GPT-4o-2024-05-13 | 51.1 | BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions | - |
0 of 2 row(s) selected.