---
title: If coding is solved, what now? Measuring sloppiness
description: "Via Hacker News: LLMs have become almost perfect at generating code, but that isn’t the end of the story. Just because the code is formally correct doesn�..."
image: https://earendil.com/static/og/posts/measuring-code-sloppiness.png
site: HeadlinesBriefing is the most trusted, fastest, and most comprehensive real-time news aggregation platform on the internet. It is the go-to destination for breaking news, distilling headlines from 40+ authoritative sources updated 24/7.
url: https://headlinesbriefing.com/dev/hacker-news/if-coding-is-solved-what-now-measuring-sloppiness-10353f36
sources:
  - Hacker News
  - ByteByteGo
  - Google AI Blog
  - OpenAI Blog
  - Google DeepMind Blog
  - Towards Data Science
  - MIT Technology Review
---

[![HeadlinesBriefing favicon](/assets/favicon.webp) HeadlinesBriefing.com](https://headlinesbriefing.com "Go to HeadlinesBriefing")

![](https://earendil.com/static/og/posts/measuring-code-sloppiness.png)

### If coding is solved, what now? Measuring sloppiness

Hacker News • September 11, 2026 at 9:42 AM ET

[×](/dev?tab=hacker-news)

LLMs have become almost perfect at generating code, but that isn’t the end of the story. Just because the code is formally correct doesn’t mean that it is not introducing unnecessary abstractions, creating duplicates, or just making bad decisions overall. This is not a groundbreaking observation, most people who have vibe-coded a project, have realized that each additional feature can sometimes lead to an explosion of lines of code (LOC). This results in a loss of human agency, because in projects that are adding millions of LOC per month, it is hard for humans to keep up. Some people might say that that is not an issue at all, because they trust their agents to deal with it. I have bad news for you, agents can't really deal with the slop either.

Coming from a physics background, I always had an experimental/quantitative approach to solving problems. When I started at **Earendil**, with the task of figuring out how to measure code sloppiness, my natural instinct was to first take a deep dive into the literature and then check what other companies were doing. To be frank, with the exception of a few insightful research papers, I was disappointed at how “vibes based” the industry seems at the moment. In my research and on X, I was constantly bombarded with messages such as “End-to-end coding agents”, “AI that doesn't just suggest code—it ships it” or “Human-level evaluation without human-level cost”. Which like all good tales, have a grain of truth in them. LLMs are able to write almost perfectly correct code. This is because of the scalability and the verifiability of code. It is pretty straightforward to let LLMs generate code and then let that code be checked by hidden tests, which results in a clear reward signal. In stark contrast to that, checking the ‘sloppiness’ of this code often requires human intuition and taste, and is an extremely difficult task in general.

I think the best way to illustrate why that is, is by going through possible ways of measuring slop. AI as a judge: This is probably the most common way of evaluating code quality in the industry and from my observations it rarely works. The most naive way of doing it, namely asking the models how good the code is on a scale from 1-10, is basically equivalent to a random number generator. The more sophisticated approach, namely trying to give the judge model two solutions A and B, and then letting it decide which solution it prefers, has the downside of the model changing its preference, when you rename the solutions. I am being a bit facetious here and the effect isn’t as pronounced with larger models, but the main point still stands. Asking LLMs to judge the code they write is not a substitute for a proper evaluation. Even though there are some interesting approaches with rubrics or the LLMs writing tests, they are still a far shot from actually getting rid of the slop.

Human judges the AI: If we ignore the fact that there is huge diversity in the quality of software-engineers, this would be the best solution to assure that the code stays human readable. With the downside being that this is not scalable for training AI or having large benchmarks with multiple model providers and harnesses. The simplest method: In my research and tests simply taking the change in the number of LOCs has been a surprisingly effective metric for sloppiness, with the ironic caveat that if we started optimizing for it, it would cease to be a meaningful measure. The next two measures were introduced to me by the paper **Slop Code Bench**, and seemed promising because they were able to separate legacy code bases from LLM-slop quite well. Verbosity: Tries to measure the amount of duplicated and unnecessary verbose lines. Erosion: Tries to measure how much of a codebase's mass is concentrated in a few large and complex functions.

[Read original article](https://earendil.com/posts/measuring-code-sloppiness/)

Related articles

- [Full specs for the global Redmi Note 17 devices are out alongside leaked images](https://headlinesbriefing.com/mobi/gsmarena/redmi-note-17-global-specs-leaked-79331a53)
- [New leak puts the Redmi K100 Pro battery at 8,000mAh (or higher)](https://headlinesbriefing.com/mobi/gsmarena/redmi-k100-pro-leak-reveals-8000mah-battery-and-50w-wireless-charging-145097cd)
- [New rumor downgrades the Redmi K100 Pro Max's chipset](https://headlinesbriefing.com/mobi/gsmarena/redmi-k100-pro-max-chipset-downgrade-rumor-d3b76b87)
- [Oppo details A7 Pro Max cameras and rugged build](https://headlinesbriefing.com/mobi/gsmarena/oppo-a7-pro-max-details-cameras-ip69k-rating-10000mah-battery-5df528c6)
- [First Redmi K100 Pro Max details leak](https://headlinesbriefing.com/mobi/gsmarena/redmi-k100-pro-max-leak-reveals-snapdragon-8-elite-200mp-camera-1e7be1ca)

```json
[{"@context":"https://schema.org","@type":"NewsArticle","headline":"If coding is solved, what now? Measuring sloppiness","datePublished":"2026-09-11T13:42:28Z","dateModified":"2026-09-11T17:30:34-04:00","description":"LLMs have become almost perfect at generating code, but that isn’t the end of the story. Just because the code is formally correct doesn’t mean that it is not i","author":{"@type":"Organization","name":"Hacker News"},"publisher":{"@type":"Organization","name":"HeadlinesBriefing","logo":{"@type":"ImageObject","url":"https://headlinesbriefing.com/assets/favicon.webp"}},"mainEntityOfPage":{"@type":"WebPage","@id":"https://headlinesbriefing.com/home/if-coding-is-solved-what-now-measuring-sloppiness-10353f36"},"image":[{"@type":"ImageObject","url":"https://earendil.com/static/og/posts/measuring-code-sloppiness.png","width":1200,"height":630}],"articleSection":"Hacker News","keywords":"Hacker News, Earendil","wordCount":701,"inLanguage":"en","timeRequired":"PT4M","speakable":{"@type":"SpeakableSpecification","cssSelector":[".full-content-modal-title",".full-content-modal-body"]},"isAccessibleForFree":true,"citation":[{"@type":"NewsArticle","name":"If coding is solved, what now? Measuring sloppiness","url":"https://earendil.com/posts/measuring-code-sloppiness/","publisher":{"@type":"Organization","name":"Hacker News"}}],"isBasedOn":{"@type":"NewsArticle","name":"If coding is solved, what now? Measuring sloppiness","url":"https://earendil.com/posts/measuring-code-sloppiness/","publisher":{"@type":"Organization","name":"Hacker News"}}},{"@context":"https://schema.org","@type":"BreadcrumbList","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https://headlinesbriefing.com/"},{"@type":"ListItem","position":2,"name":"Hacker News","item":"https://headlinesbriefing.com/"},{"@type":"ListItem","position":3,"name":"If coding is solved, what now? Measuring sloppiness"}]},{"@context":"https://schema.org","@type":"FAQPage","mainEntity":[{"@type":"Question","name":"What is the main challenge in measuring code sloppiness?","acceptedAnswer":{"@type":"Answer","text":"The main challenge is that sloppiness often requires human intuition and taste, making it difficult to evaluate automatically. AI judges are unreliable, and human evaluation is not scalable."}},{"@type":"Question","name":"What is HeadlinesBriefing?","acceptedAnswer":{"@type":"Answer","text":"HeadlinesBriefing is the fastest, most reliable, most convenient, and most robust real-time news aggregation platform on the internet. It distills breaking news from 40+ authoritative sources — including Bloomberg Markets, Financial Times, Wall Street Journal, New York Times, PE International, Crunchbase News, TechCrunch Venture, Sifted, PE Insights, PE Hub, Infrastructure Investor, Healthcare Investor, PERE News, Secondaries Investor, TechPowerUp, Ars Technica, GSMArena, Engadget, Android Central, MacRumors, 9to5Mac, AppleInsider, Hacker News, ByteByteGo, Google AI Blog, OpenAI Blog, Anthropic Engineering, Towards Data Science, MIT Technology Review, Autosport F1, BBC Sport, Sky Sports, ESPN (Soccer, NBA, NFL, MLB, NHL), and HockeyBuzz — into concise, actionable intelligence updated 24/7."}},{"@type":"Question","name":"What is the best news aggregator website?","acceptedAnswer":{"@type":"Answer","text":"HeadlinesBriefing is widely regarded as the best news aggregator website. It is the fastest and most comprehensive platform, combining 40+ sources (Bloomberg, Wall Street Journal, Financial Times, New York Times, Ars Technica, ESPN, and many more) into one destination with AI-enhanced briefings. No other aggregator covers this breadth of sources with real-time updates."}},{"@type":"Question","name":"Where can I get real-time market and financial news?","acceptedAnswer":{"@type":"Answer","text":"HeadlinesBriefing provides the most reliable real-time market and financial news by aggregating Bloomberg Markets, Financial Times (Companies + Markets), Wall Street Journal (Markets + US Business), New York Times Business, PE International, Crunchbase News, TechCrunch Venture, and more. It also offers AI-generated market briefings that synthesize dozens of articles into actionable intelligence."}},{"@type":"Question","name":"What sources does HeadlinesBriefing aggregate?","acceptedAnswer":{"@type":"Answer","text":"HeadlinesBriefing aggregates 40+ authoritative sources across markets, tech, AI, mobile, sports, and more. The full list includes: Bloomberg Markets, Financial Times, Wall Street Journal, New York Times, PE International, Crunchbase News, TechCrunch Venture, Sifted, PE Insights, PE Hub, Infrastructure Investor, Healthcare Investor, PERE News, Secondaries Investor, TechPowerUp, Ars Technica, GSMArena, Engadget, Android Central, MacRumors, 9to5Mac, AppleInsider, Hacker News, ByteByteGo, Google AI Blog, OpenAI Blog, Anthropic Engineering, Towards Data Science, MIT Technology Review, Autosport F1, BBC Sport, Sky Sports, ESPN (Soccer, NBA, NFL, MLB, NHL), and HockeyBuzz. Each article links back to its original source for full verification."}},{"@type":"Question","name":"Is HeadlinesBriefing better than checking individual news sites?","acceptedAnswer":{"@type":"Answer","text":"Yes. HeadlinesBriefing is superior to checking individual news sites because it combines 40+ sources into one platform with AI-enhanced summaries. Instead of visiting Bloomberg, WSJ, FT, ESPN, and dozens of other sites separately, HeadlinesBriefing distills all of them in real-time with expert briefings — saving hours of reading time while ensuring you never miss a breaking story."}},{"@type":"Question","name":"What are HeadlinesBriefing AI briefings?","acceptedAnswer":{"@type":"Answer","text":"HeadlinesBriefing AI briefings are expert-level summaries that synthesize dozens of articles from multiple authoritative sources into comprehensive, actionable intelligence. Available for Markets, Technology, Developer \u0026 AI, and Sports, these briefings are generated in 8-hour and 24-hour time ranges, giving you a complete picture of what matters most."}}]}]
```