Detecting model weight tampering in GPU memory (Rome attacks)
This article introduces Rank-One Model Editing (ROME) attacks, where a malicious Python module rewrites a model's weights in GPU memory to corrupt its answers, and explains why CPU-focused security tooling misses this class of attack. We then run a ROME attack in our lab and show how Stealthium detects model tampering via our runtime sensor, which ties every CUDA kernel launch back to the Python code that issued it, and new on-going research that detects the weight changes together with the call stack that caused it.
Summary
Researchers reveal a new threat in AI security with Rank-One Model Editing (ROME) attacks, which manipulate model weights in GPU memory to alter outputs. The article details how traditional CPU security measures fall short and presents a novel detection method using Stealthium’s runtime sensor to track CUDA kernel launches back to their originating Python code.
Comments (1 of ) ⌛