Show HN: A minimal TS library that generates prompt injection attacks

yaoke259 | 33 points

Was the whole lib and website vibe coded? I can't find any instructions on how to use it, the repo is for the website itself and the readme is AI blurb that doesn't make me any wiser.

  // Test your AI system
  const results = await injector.runTests(yourAISystem);
???

Even the "prompt-injector" NPM package is something completely different. Does this project even exist?

sippeangelo | 3 days ago

The website copy is obviously generated, and has not been reviewed for correctness.

The website trumpets "25+ curated prompt injection patterns from leading security research". The README of the linked Github promises: "100+ curated injection patterns from JailbreakBench".

None of the research sources are actually linked for us to review.

The README lists "integrations" with various security-oriented entities, but no such integration is apparent in the code.

The project doesn't earn the credibility it claims for itself. Because the author trusts bad LLM output enough to publish it as their own work, we have to assume that they don't have the knowledge or experience to recognize it as bad output.

Sorry for the bluntness, but there are few classes of HN submission that rankle as much as these polished bits of fluff. My advice: do not use AI to publicly imply abilities or knowledge you don't have; it will never serve you well.

mpalmer | 3 days ago

The meat seems to be in https://github.com/BlueprintLabIO/prompt-injector/tree/main/..., the generation could be done without any UI but then it probably would not look so flashy.

mkesper | 3 days ago

Your feedback is valuable and correct, I'll extract the library into /core in the repo and also manually verify all the citations. I'll read into the prompt injection literature more deeply and turn this from a shower thought project into something more mature

yaoke259 | 2 days ago

What are some good prevention mechanisms for this? A sort of firewall for prompts? I've seen people recommend LLMs, but that seems like it wouldn't work well. What is the industry standard? Or what looks promising at least?

mosselman | 3 days ago

I have significantly improved both the library and the demo page, hope this is more useful now!

yaoke259 | a day ago

[dead]

doka_smoka | 3 days ago

Why did you use something as heavy as SvelteKit for a website with a single page? This doesn't inspire confidence.

HKayn | 3 days ago