AI coding tools like Cursor and GitHub Copilot are believed to improve coding productivity by automating tasks. However, a study by METR revealed that experienced developers using these tools often slow down their workflow. In a randomized trial with 16 developers, those allowed to use AI tools completed tasks 19% slower than those who worked without them. Most developers anticipated a 24% reduction in task completion time but instead faced delays, raising doubts about the expected productivity improvements of AI coding tools in software engineering.
Surprisingly, we find that allowing AI actually increases completion time by 19%- developers are slower when using AI tooling.
Before completing their assigned tasks, the developers forecasted that using AI coding tools would reduce their completion time by 24%. That wasn't the case.
Collection
[
|
...
]