They can lull the human reviewer into a false sense of security.&quot;Computer already looked at it so I only need to glance at it&quot;

&gt; LLM [...] feels extremely well suited for catching “stupid mistakes”.No.Linters are extremely well suited for catching stupid mistakes.LLMs are extremely well suited for the appearance of catching stupid mistakes.Linters will catch things like this because they can go through checking and evaluating things logically:&gt; if (&gt; isValid(primaryValue, &quot;strict&quot;) || isValid(secondaryValue, &quot;strict&quot;) ||&gt; isValid(primaryValue, &quot;loose&quot; || isValid(secondaryValue, &quot;loose&quot;))&gt; &#x2F;&#x2F;...............................^^^^ Did we forget a closing &#x27;)&#x27;?&gt; ) {&gt; ...&gt; }LLMs will only highlight exact problems they&#x27;ve seen before, miss other problems that linters would immediately find, and hallucinate new problems altogether.

Please elaborate.While obviously a LLM might miss functional problems, it feels extremely well suited for catching “stupid mistakes”.I don’t think anyone is advocating for LLMs merging and approving PRs on their own, they can certainly provide value to the human reviewer.

Until that immediate feedback is outright wrong feedback and now you’ve sent them down a goose chase.

I agree and disagree. You definitely need someone competent to take a look before merging in code, but you can do a first pass with an LLM to provide immediate feedback on any obvious issues as defined in your internal engineering standards.Especially helpful if you&#x27;re a team with where there&#x27;s a wide variance in competency&#x2F;experience levels.

I stand corrected: LLMs are great to block PRs by raising issues. A lack of issues should not be taken as a good PR tho.

We&#x27;re trialing ellipsis.dev for exactly this, and it&#x27;s pretty good most of the time.

PR reviews are the one thing you sure don&#x27;t want a LLM doing.

Aider is great, but the use case is different:1. You use Aider to complete a novel task you&#x27;re actively working on. Patchwork completes repetitive tasks passively without bothering you. For e.g. updating a function v&#x2F;s fixing linting errors.2. Aider is agentic, so it figures out how to do a task itself. This trades accuracy in favor of flexibility. With patchwork, you control exactly how the task is done by defining a patchflow. This limits the set of tasks to those that you have pre-defined but gives much higher accuracy for those tasks.While the demo shows CLI use, the ideal use case patchwork is as part of your CI or even a serverless deployment triggered via event webhooks. Hope this helps? :)

A feature comparison to <a href="https:&#x2F;&#x2F;github.com&#x2F;paul-gauthier&#x2F;aider">https:&#x2F;&#x2F;github.com&#x2F;paul-gauthier&#x2F;aider</a> would be great.Is this just a non interactive version of this kind of agent?

We do. We haven&#x27;t done a very good job of listing good first issues, but please feel free to create and contribute.

Ok the video explains this way better - and it looks awesome.Do you accept PRs yourself :-)

Oh this is really cool and great name! Will definitely try this out!

Patchwork is used by the Linux kernel: <a href="https:&#x2F;&#x2F;patchwork.kernel.org&#x2F;" rel="nofollow">https:&#x2F;&#x2F;patchwork.kernel.org&#x2F;</a>When I saw your submission title I thought it was that Patchwork.

There are a few open source projects by the name and we were aware of <a href="https:&#x2F;&#x2F;github.com&#x2F;ssbc&#x2F;patchwork">https:&#x2F;&#x2F;github.com&#x2F;ssbc&#x2F;patchwork</a> which is archived. Didn&#x27;t know of this though.It&#x27;s a common noun which works really well for patch-based offerings I guess, and we chose it because we built a &#x27;framework to patch code&#x27;. But we&#x27;ll think more about this - thanks for bringing it up.

And an R library: <a href="https:&#x2F;&#x2F;cran.r-project.org&#x2F;web&#x2F;packages&#x2F;patchwork&#x2F;index.html" rel="nofollow">https:&#x2F;&#x2F;cran.r-project.org&#x2F;web&#x2F;packages&#x2F;patchwork&#x2F;index.html</a>

There&#x27;s also <a href="https:&#x2F;&#x2F;github.com&#x2F;fabric&#x2F;patchwork">https:&#x2F;&#x2F;github.com&#x2F;fabric&#x2F;patchwork</a>

The opensource ecosystem is large enough now compared to previous decades that name collisions are very likely to happen given that they&#x27;re always named in English.

Yall know there’s a popular oss project called patchwork right <a href="https:&#x2F;&#x2F;patchwork.readthedocs.io&#x2F;en&#x2F;latest&#x2F;" rel="nofollow">https:&#x2F;&#x2F;patchwork.readthedocs.io&#x2F;en&#x2F;latest&#x2F;</a>

Hi HN! We’re Asankhaya and Rohan and we are building Patchwork.Patchwork tackles development gruntwork—like reviews, docs, linting, and security fixes—through customizable, code-first &#x27;patchflows&#x27; using LLMs and modular code management steps, all in Python. Here&#x27;s a quick overview video: <a href="https:&#x2F;&#x2F;youtu.be&#x2F;MLyn6B3bFMU" rel="nofollow">https:&#x2F;&#x2F;youtu.be&#x2F;MLyn6B3bFMU</a>From our time building DevSecOps tools, we experienced first-hand the frustrations our users faced as they built complex delivery pipelines. Almost a third of developer time is spent on code management tasks[1], yet backlogs remain.Patchwork lets you combine well-defined prompts with effective workflow orchestration to automate as much as 80% of these gruntwork tasks using LLMs[2]. For instance, the AutoFix patchflow can resolve 82% of issues flagged by semgrep using gpt-4 (or 68% with llama-3.1-8B) without fine-tuning or providing specialized context [3]. Success rates are higher for text-based patchflows like PR Review and Generate Docstring, but lower for more complex tasks like Dependency Upgrades.We are not a coding assistant or a black-box GitHub bot. Our automation workflows run outside your IDE via the CLI or CI scripts without your active involvement.We are also not an ‘AI agent’ framework. In our experience, LLM agents struggle with planning and rarely identify the right execution path. Instead, Patchwork requires explicitly defined workflows that provide greater success and full control.Patchwork is open-source so you can build your own patchflows, integrate your preferred LLM endpoints, and fully self-host, ensuring privacy and compliance for large teams.As devs, we prefer to build our own ‘AI-enabled automation’ given how easy it is to consume LLM APIs. If you do, try patchwork via a simple &#x27;pip install patchwork-cli&#x27; or find us on Github[4].Sources:[1] <a href="https:&#x2F;&#x2F;blog.tidelift.com&#x2F;developers-spend-30-of-their-time-on-code-maintenance-our-latest-survey-results-part-3" rel="nofollow">https:&#x2F;&#x2F;blog.tidelift.com&#x2F;developers-spend-30-of-their-time-...</a>[2] <a href="https:&#x2F;&#x2F;www.patched.codes&#x2F;blog&#x2F;patched-rtc-evaluating-llms-for-diverse-software-development-tasks">https:&#x2F;&#x2F;www.patched.codes&#x2F;blog&#x2F;patched-rtc-evaluating-llms-f...</a>[3] <a href="https:&#x2F;&#x2F;www.patched.codes&#x2F;blog&#x2F;how-good-are-llms">https:&#x2F;&#x2F;www.patched.codes&#x2F;blog&#x2F;how-good-are-llms</a>[4] <a href="https:&#x2F;&#x2F;github.com&#x2F;patched-codes&#x2F;patchwork">https:&#x2F;&#x2F;github.com&#x2F;patched-codes&#x2F;patchwork</a>[Sample PRs] <a href="https:&#x2F;&#x2F;github.com&#x2F;patched-demo&#x2F;sample-injection&#x2F;pulls">https:&#x2F;&#x2F;github.com&#x2F;patched-demo&#x2F;sample-injection&#x2F;pulls</a>

Show HN: Patchwork – Open-source framework to automate development gruntwork