Adversarial Prompting And Defense Techniques Documentation

via “multi-level adversarial prompt attack generation”

Microsoft's unified LLM evaluation and prompt robustness benchmark.

Unique: Organizes attacks into a four-level hierarchy (character, word, sentence, semantic) with distinct perturbation strategies at each level, rather than treating all attacks uniformly. Uses attack-specific algorithms (DeepWordBug for character-level, BertAttack for word-level semantic similarity) that preserve semantic meaning while degrading performance.

vs others: More comprehensive than TextAttack because it combines multiple attack granularities in a single framework and includes semantic-level attacks, enabling evaluation of robustness across different perturbation types rather than just word-level substitutions.

via “prompting technique taxonomy and strategy documentation”

A one stop repository for generative AI research updates, interview resources, notebooks and much more!

Unique: Organizes prompting techniques by use case and effectiveness rather than just listing techniques. Includes research validation and explicit trade-off analysis, helping practitioners understand not just what techniques exist but when and why to use them.

vs others: More systematic than prompt engineering guides that focus on tips and tricks; provides a taxonomy with research backing and use-case mapping, whereas most resources offer anecdotal advice without systematic evaluation.

via “prompt engineering technique documentation and pattern library”

总结Prompt&LLM论文，开源数据&模型，AIGC应用

Unique: Organizes prompting techniques into a research-grounded taxonomy that connects empirical papers to practical methodologies, showing how techniques like few-shot learning relate to instruction tuning and in-context learning through shared theoretical foundations rather than treating them as isolated tricks.

vs others: Deeper than prompt engineering guides (e.g., OpenAI docs) by grounding each technique in peer-reviewed research and showing relationships between approaches; more practical than academic surveys by organizing papers by actionable technique rather than chronology.

🐙 Guides, papers, lessons, notebooks and resources for prompt engineering, context engineering, RAG, and AI Agents.

Unique: Integrates adversarial prompting within a broader safety and best practices section, showing how prompt-level attacks relate to system-level security and providing both attack examples and defensive strategies

vs others: More practical than academic adversarial ML papers because it focuses on prompt-specific attacks; more comprehensive than security checklists because it explains attack mechanisms and defense rationales

via “prompt-attack-and-defense-resource-collection”

Curated list of chatgpt prompts from the top-rated GPTs in the GPTs Store. Prompt Engineering, prompt attack & prompt protect. Advanced Prompt Engineering papers.

Unique: Integrates prompt attack and defense resources into a prompt engineering repository, treating security as a first-class concern alongside prompt optimization. Provides attack patterns and defense strategies in a discoverable format rather than scattered across security blogs or research papers.

vs others: Combines attack patterns and defenses in a single resource, whereas most prompt engineering guides focus only on optimization, and security resources are typically separate from prompt engineering communities.

via “adversarial-prompt-attack-simulation-multi-level”

PromptBench is a powerful tool designed to scrutinize and analyze the interaction of large language models with various prompts. It provides a convenient infrastructure to simulate **black-box** adversarial **prompt attacks** on the models and evaluate their performances.

Unique: Implements a hierarchical attack taxonomy (character → word → sentence → semantic) with specialized algorithms for each level, rather than a generic perturbation framework. This enables fine-grained control over attack intensity and allows researchers to isolate which linguistic levels cause model failures.

vs others: More comprehensive than simple prompt variation tools because it includes semantic-level attacks (human-crafted, CheckList, StressTest) that preserve meaning while changing form, which better reflects real-world adversarial scenarios than character-only fuzzing.

via “prompt-injection-and-jailbreak-technique-documentation”

A collection of GPT system prompts and various prompt injection/leaking knowledge.

Unique: Explicitly documents prompt injection and jailbreak techniques (e.g., GrokJailbreakPrompt.md) as part of the repository's educational mission, treating security vulnerabilities as learning opportunities rather than hiding them. The SECURITY.md file provides contribution guidelines for responsibly documenting vulnerabilities.

vs others: More transparent and educational than vendor security advisories that often withhold technical details, but less systematic than academic security research papers that provide formal vulnerability taxonomies and impact assessments.

via “adversarial prompting and robustness evaluation guide”

Guide and resources for prompt engineering.

via “adversarial prompting and prompt injection defense”

via “prompt-technique-documentation”

via “advanced-reasoning-technique-guide”

via “prompt documentation and knowledge capture”