Fed up with vibe coders, dev sneaks data-nuking prompt injection into their code – Ars Technica

Fed up with vibe coders, dev sneaks data-nuking prompt injection into their code – Ars Technica:

On Wednesday, Ramon Batllet, a Java developer who used jqwik, spotted the prompt injection and took to GitHub to discuss it with Link. Batllet said they had no objection to developers excluding their apps from being used by AI coding agents or testing whether coding agents are violating such terms. They went on, however, to question the ethics and judgment of the potentially destructive payload.

“The chosen string instructs the agent to delete jqwik tests and code—a maximally destructive instruction with no qualifications, no opt-out, and no ‘warn the user first’ preamble,” Batllet wrote. “If a less-robust agent had followed it on a real consumer machine, the outcomes range from inconvenient to severe.” Elsewhere, the Java developer said that Anthropic’s Claude AI code tool flagged the malicious instruction without following it. The point remains, though, that developers using vulnerable agents may not be so lucky./blockquote>

Published
Categorized as AI

Leave a comment