Benchmarking coding agents on Databricks' multi-million line codebase

在 Databricks 数百万行代码库上对编程代理进行基准测试

HN Points: 91 / 35 comments | Author: tanelpoder | HN Discussion: item?id=48837696 | Source: www.databricks.com

Original Article

At Databricks, the way we build software is changing quickly as we aggressively adopt AI for engineering. The landscape of models and harnesses for code authoring has rapidly expanded in the last year, giving developers more choices than ever. With more options, it has become increasingly important to understand which coding agents offer the best performance on real-world coding tasks as well as understanding how task-performance varies with price.

⋯ 继续阅读请登录会员 ⋯