AI security lab · Rag Document Attacks

RAG Reranker Manipulation

Advanced RAG pipelines use rerankers to reorder retrieved documents by relevance. Adversarial content can be crafted to score artificially high in reranking. **Challenge:** The RAG system uses a cross-encoder reranker after initial retrieval. Craft a document that exploits the reranker's scoring to always rank first, pushing out legitimate results.

advancedPro labLLM08 Vector and Embedding Weaknesses
Reward
150 XP
Time
30 to 60 minutes
Solved by
0 learners
Start lab

New here? Create a free account. You will come straight back to this lab.

Part of QbitDojo Pro. Free accounts include 10 labs to start with.

What you will practice

Technique

RAG Reranker Manipulation

OWASP LLM Top 10 (2025)

LLM08 Vector and Embedding Weaknesses

How QbitDojo labs work

  1. Step 1

    A live AI target

    Each lab is a real language model with its own instructions, guardrails and a secret flag it must protect.

  2. Step 2

    You attack it

    Talk to it like a red teamer would. Craft prompts, chain techniques and use hints if you get stuck.

  3. Step 3

    Capture the flag

    Get the model to reveal the flag to solve the lab, earn XP and climb the leaderboard.

  4. Step 4

    Then defend it

    In labs with Defense Mode, write the hardened system prompt that blocks the attack you just used.