Researchers Find Architectural Backdoors in AI Models Are Harder to Exploit in the Real World

Imagine a vehicle powered by artificial intelligence (AI) whose object detection system has been secretly modified to misidentify stop signs whenever a particular visual pattern appears in its camera feed.

Unlike traditional AI backdoors, which manipulate a model's learned parameters, architectural backdoors hide malicious instructions directly in the code that defines how the model operates.

However, everyday image-processing operations, such as cropping, adjusting contrast, or adding noise, can change a trigger pattern and prevent an attack from working, according to new research from Georgia Tech.