- Emergent Behavior
- Posts
- AI Written Code Not That Clean
AI Written Code Not That Clean
Coders are committing more incorrect code, then coming back to correct it later
đź”· Subscribe to get breakdowns of the most important developments in AI in your inbox every morning.
![](https://media.beehiiv.com/cdn-cgi/image/fit=scale-down,format=auto,onerror=redirect,quality=80/uploads/asset/file/0e0158b6-b9cc-47dd-91d1-e485f8582d9b/Screenshot_2024-01-22_at_2.13.39_PM.png?t=1705950837)
GitHub CEO Thomas Dohmke in June 2023 posts a blog with the extraordinary claim that CoPilot would add $1.5 trillion to GDP:
![](https://github.blog/wp-content/uploads/2023/06/image1-3.png?w=1024&resize=1999%2C1050)
Too good to be true?
Of course, statistics like these are often calculated the same way lost productivity due to the Super Bowl is calculated, without thought to the balancing game theory that counters the effect. And sure enough, the good people at Gitclear evaluate these claims in detail:
![](https://media.beehiiv.com/cdn-cgi/image/fit=scale-down,format=auto,onerror=redirect,quality=80/uploads/asset/file/b89a96a4-7fd5-4528-89a1-01ba994bbfa1/Screenshot_2024-02-08_at_12.44.43_PM.png?t=1707425127)
Code Churn in light blue
Gitclear identified code “churn“:
percentage of code that was pushed to the repo, then
subsequently reverted, removed, or updated within 2 weeks by the same author
normal churn in 2020/2021 was about 3.4%
increased to a projected 7.1% in 2024
In effect coders are committing more incorrect code, then coming back to correct it later.
Gitclear draws the conclusion that this is AI-driven behavior, which I agree with, even though the evidence here is circumstantial at best.
![](https://media.beehiiv.com/cdn-cgi/image/fit=scale-down,format=auto,onerror=redirect,quality=80/uploads/asset/file/0e0158b6-b9cc-47dd-91d1-e485f8582d9b/Screenshot_2024-01-22_at_2.13.39_PM.png?t=1705950837)
Become a subscriber for daily breakdowns of what’s happening in the AI world:
Reply