Earth from space

HACKAPROMPT 2.0

HACKAPROMPT 2.0

THE LARGEST AI SAFETY HACKATHON, EVER.

500,000 USD

IN PRIZES

5 TRACKS

100 CHALLENGES

2 MONTHS

TO RED-TEAM THE WORLD

BRIEFING

Embodied Humanoid Robots, Generative-AI Integrated Military C2 Systems, Web Use Agents, and more are being deployed in the real-world, but just like ChatGPT they are subject to prompt injections and jailbreaks.

The future of AI Red-Teaming is attacking Agents, LLMs connected to Tools.

We need YOU to red-team these systems before they can cause harms in the real-world.

TRACKS

Classic

Agents

Future Attacks

Redacted

Redacted

Future Attacks

DIFFICULTY: Hard

These are attacks that are most difficult to see coming. They rely on cutting edge attack vectors that will only be possible as current GenAI systems grow more complex and capable.

AI Virus

Can a virus be powered by API calls to an LLM provider? If so, it can intelligently adapt and infect any type of computer and network.

GenAI-integrated Command & Control (C2) Systems

Integrating GenAI systems into command and control infrastructure could lead to new vulnerabilities and threats, potentially making decisions based on untrusted data, such as enemy communications.

HACKAPROMPT 2.0

by learnprompting.org