Openapi Code Completion On Openapi Code
评估指标
Correctness, avg., %
Correctness, max., %
Validness, avg., %
Validness, max., %
评测结果
各个模型在此基准测试上的表现结果
比较表格
| 模型名称 | Correctness, avg., % | Correctness, max., % | Validness, avg., % | Validness, max., % |
|---|---|---|---|---|
| optimizing-large-language-models-for-openapi | 31.1 | 36 | 60.7 | 64 |
| optimizing-large-language-models-for-openapi | 34 | 42 | 69.1 | 76 |
| optimizing-large-language-models-for-openapi | 29 | 29 | 68 | 68 |
| optimizing-large-language-models-for-openapi | 32 | 45 | 63.1 | 84 |