๐Ÿ“ง Email Triage OpenEnv

A real-world reinforcement learning environment where AI agents learn to manage email inboxes.

OpenEnv Compliant 3 Tasks Avg Score: 0.93 Meta PyTorch Hackathon
Live & Running

๐ŸŽฎ Try It Yourself โ€” Label Emails Like an AI Agent!

Loading emails...
Scoring your answers...
๐Ÿ“Š Your Results
Label accuracy
-
Action accuracy
-
Summary quality
-
-
Final Score (0.0 โ€“ 1.0)

๐Ÿ† Leaderboard โ€” Top Scores

RankNameTaskScoreTime

โšก API Playground โ€” Test Endpoints Live

GET /health

GET /tasks

GET /stats

POST /reset

task_id

GET /state

task_id

Tasks

Easy

Task 1 โ€” Email Labeling

0.999

Label 10 emails as urgent, normal, or spam.

Medium

Task 2 โ€” Email Triage

0.999

Label 20 emails AND decide: reply, archive, or delete.

Hard

Task 3 โ€” Full Inbox

0.79

30 emails including tricky phishing attempts. Label, act, summarize.

Reward Function

Task 1 โ€” Label accuracy only100% labels
Task 2 โ€” Labels + Actions50% labels + 50% actions
Task 3 โ€” Labels + Actions + Summary40% + 40% + 20%
โœ“ Partial credit on every emailNever binary win/loss

API Endpoints

MethodEndpointDescription
POST/resetStart new episode
POST/stepSubmit answers โ€” get reward + feedback
GET/stateCurrent environment state
GET/tasksList all tasks
GET/healthHealth check
GET/statsEnvironment statistics
GET/leaderboardTop scores
Built for Meta PyTorch OpenEnv Hackathon ยท Email Triage Environment ยท FastAPI ยท Docker