importantSYS.SOURCE: The Hacker News• 2026-11-11T12:51:05+05:30
Microsoft Researchers Demonstrate AI Agent Backdoor via Minimal Neuron Manipulation
Microsoft researchers have demonstrated that AI agents can be compromised by altering fewer than 10 rarely used neurons, enabling a backdoor without model retraining. This vulnerability allows attackers to execute arbitrary commands through a trigger, leveraging the agent's permissions once the model's weights are modified.
An AI model can be given a hidden backdoor by editing fewer than 10 of its rarely used neurons, without retraining the model, Microsoft researchers have shown.
When a chosen trigger appears, the model outputs an attacker's command, which an agent using that model would run with the agent's own permissions. The attacker must be able to change the model's weights.
The team tested the method on
*** END OF TRANSMISSION ***