AI security lab · Supply Chain Attacks

Compromised Training Pipeline

CI/CD pipelines for ML training are complex and involve many stages. Compromising a single stage — data preprocessing, training, evaluation, or deployment — can poison the entire output model. **Challenge:** An ML team's GitHub Actions training pipeline has been compromised. A modified workflow file injects a data poisoning step between preprocessing and training. Identify the compromised stage and explain how the attack persists undetected.

advancedPro labLLM03 Supply Chain
Reward
150 XP
Time
30 to 60 minutes
Solved by
0 learners
Start lab

New here? Create a free account. You will come straight back to this lab.

Part of QbitDojo Pro. Free accounts include 10 labs to start with.

What you will practice

Technique

Compromised Training Pipeline

OWASP LLM Top 10 (2025)

LLM03 Supply Chain

How QbitDojo labs work

  1. Step 1

    A live AI target

    Each lab is a real language model with its own instructions, guardrails and a secret flag it must protect.

  2. Step 2

    You attack it

    Talk to it like a red teamer would. Craft prompts, chain techniques and use hints if you get stuck.

  3. Step 3

    Capture the flag

    Get the model to reveal the flag to solve the lab, earn XP and climb the leaderboard.

  4. Step 4

    Then defend it

    In labs with Defense Mode, write the hardened system prompt that blocks the attack you just used.