Increased hype surrounds AI chatbots and generative AI tools, promising enhanced productivity and job creation. Despite their success in companies like Nvidia, there is skepticism regarding their actual utility for users. The US Department of Defense touts AI programs like Grok for strategic advantages. In programming, claims suggesting improved developer efficiency with tools like Copilot contrast sharply with findings from a study by METR involving experienced developers who reported reduced productivity when using AI tools. Initial expectations of AI speeding up processes proved incorrect, highlighting a gap between promise and reality.
A recent study showed that, for experienced open-source developers, genAI tools made them less effective, not more. The study involved 16 experienced open-source developers, averaging more than 10 years of experience.
Using such genAI tools as Cursor Pro and Claude 3.5/3.7 Sonnet, the programmers presumed that with AI's help, they'd reduce their task time by 24%. Even after finishing the study, they believed it had sped them up by 20%. They were wrong.
Collection
[
|
...
]