42What are multi-turn jailbreaks like crescendo, and why do single-turn filters miss them?▼hardAnthropicOpenAIMicrosoft1 replies◆ premiumA request that would be refused in one message often succeeds when spread across ten. The signal is understanding that conversational state is part of the attack surface, and that turn-by-turn classifiers see only fragments.Open full answer →
43How do attackers smuggle prompt injections past filters using encoding and obfuscation?▼hardAnthropicOpenAIMicrosoft1 replies◆ premiumbase64, leetspeak, invisible Unicode, and foreign scripts all let a payload read as gibberish to your filter but as a clear instruction to the model. The signal is knowing why the model decodes what the classifier cannot.Open full answer →
44Give a taxonomy of LLM jailbreaks and the layered defenses that actually hold up.▼hardAnthropicOpenAIGoogle1 replies◆ premiumRoleplay, obfuscation, optimization-based suffixes, and multi-turn escalation are different attack classes that need different defenses. The signal is organizing the space and pairing each class with a control instead of hoping one filter covers all.Open full answer →
45What are backdoor (trojan) attacks on ML models, and how do you detect a poisoned model?▼hardGoogleMicrosoftAnthropic1 replies◆ premiumA backdoored model behaves perfectly until it sees a secret trigger, then flips. The signal is explaining why clean test accuracy never reveals it, and what detection actually buys you when the trigger is unknown.Open full answer →
46How do optimization-based adversarial attacks (GCG suffixes) work against LLMs, and how do you defend?▼expertAnthropicOpenAIGoogle DeepMind1 replies◆ premiumGibberish-looking token strings appended to a prompt can reliably break refusals, and they transfer between models. The signal is explaining the gradient search that finds them and why output checks beat input pattern matching.Open full answer →
47How do tool-result and memory poisoning attacks compromise an AI agent, and how do you defend?▼hardAnthropicOpenAIMicrosoft1 replies◆ premiumAn agent that trusts its tools and its own memory can be steered by a single poisoned record that resurfaces turns or sessions later. The signal is seeing persistent state as an attack surface, not just the live prompt.Open full answer →
48What are the data-exfiltration channels in an AI agent, and how do you close them?▼hardAnthropicOpenAIMicrosoft2 replies◆ premiumA hijacked agent does not need a 'send email' tool to leak secrets. A rendered markdown image, a URL parameter, or a DNS lookup is enough. The signal is enumerating the covert channels and locking down egress, not just tools.Open full answer →
49Why is 'the model is not a trust boundary' the core principle of secure RAG, and how do you build on it?▼hardAnthropicMicrosoftGoogle2 replies◆ premiumAsking the model to keep secrets or enforce permissions is asking the wrong component. The signal is enforcing access control before retrieval, in code you trust, and treating the LLM as untrusted compute over already-authorized data.Open full answer →