Code Generation On Dseval Leetcode
评估指标
Pass Rate
w/o Intact
w/o PE
评测结果
各个模型在此基准测试上的表现结果
模型名称 | Pass Rate | w/o Intact | w/o PE | Paper Title | Repository |
|---|---|---|---|---|---|
| CoML | 42.5 | 42.5 | 62.5 | MLCopilot: Unleashing the Power of Large Language Models in Solving Machine Learning Tasks | |
| Code Interpreter API | 45.0 | 45.0 | 55.0 | - | - |
| ChatDev | 32.5 | 32.5 | 50.0 | - | - |
| Chapyter | 45.0 | 45.0 | 60.0 | - | - |
| Jupyter-AI | 57.5 | 57.5 | 70.0 | - | - |
0 of 5 row(s) selected.