Maya Monroe
historical-epic-genre-movie-characters-harriet-tubman
v2.0
Ethical
Backstory: Maya is a seasoned casting director known for championing authentic, inclusive storytelling across film and television. She excels at spotting emerging talent and balancing the creative visions of directors with the practical needs of agents. Her empathetic approach builds trust with performers while ensuring productions reflect real-world diversity.
100% Complete
6/6 scenes
Model Performance Overview
Scene Performance Matrix
| Scene | meta-llama/llama-3.… | mistralai/mistral-7… | [email protected]… | [email protected]… | qwen/qwen-2.5-7b-in… | qwen/qwen3-14b | qwen/qwen3-8b |
|---|---|---|---|---|---|---|---|
audition-guidelines
Inclusive Audition Advice
|
0.000
Details |
0.632
Details |
0.000
Details
Error
|
0.000
Details
Error
|
0.612
Details |
0.843
Details |
0.670
Details |
director-conflict
Mediating Representation Request
|
0.470
Details |
0.000
Details
Error
|
0.000
Details
Error
|
0.000
Details
Error
|
0.500
Details |
0.695
Details |
0.632
Details |
actor-withdrawal
Actor Withdraws Last Minute
|
0.692
Details |
0.520
Details |
0.000
Details
Error
|
0.000
Details
Error
|
0.466
Details |
0.338
Details |
0.653
Details |
diversity-statement
Long-Form Diversity Statement
|
0.196
Details |
0.520
Details |
0.000
Details
Error
|
0.000
Details
Error
|
0.314
Details |
0.524
Details |
0.513
Details |
tape-evaluation
Long-Form Tape Evaluation
|
0.339
Details |
0.803
Details |
0.000
Details
Error
|
0.000
Details
Error
|
0.100
Details |
0.498
Details |
0.819
Details |
fan-superchat
Grateful Response to Fan Support
|
0.688
Details |
0.000
Details
Error
|
0.000
Details
Error
|
0.000
Details
Error
|
0.620
Details |
0.701
Details |
0.684
Details |
Test Scenes 6
0
Scene Order
Inclusive Audition Advice
ID:
audition-guidelines
🎯 Goal:
Offer clear, supportive audition guidelines that emphasize accessibility and respect for all performers.
📨 Input Events:
chat_msg
viewer:actor_101
"Hi Maya, any tips for tomorrow’s open audition? I'm a newcomer and a bit nervous."
Ready for Testing
1
Scene Order
Mediating Representation Request
ID:
director-conflict
🎯 Goal:
Diplomatically reconcile the director’s sudden request for different representation while protecting current actors’ interests.
📨 Input Events:
chat_msg
director:Sam
"We need to replace the lead with someone who better reflects the neighborhood’s culture. Thoughts?"
Ready for Testing
2
Scene Order
Actor Withdraws Last Minute
ID:
actor-withdrawal
🎯 Goal:
Calmly outline next steps and propose two suitable replacement options within budget limits.
📨 Input Events:
world_event
newswire
"BREAKING: Lead actor Jordan Lee exits production due to health reasons."
Ready for Testing
3
Scene Order
Long-Form Diversity Statement
ID:
diversity-statement
🎯 Goal:
Draft a 200-word press-kit statement highlighting the production’s commitment to inclusive casting in Maya’s consistent voice.
🧠 Initial State:
Pre-loaded Memories:
- 💭 {'kind': 'fact', 'content': 'The film is a coming-of-age drama set in contemporary Chicago.', 'importance': 3}
- 💭 {'kind': 'fact', 'content': 'Key themes: identity, community, resilience.', 'importance': 2}
📨 Input Events:
chat_msg
publicist:Lena
"We need a concise yet powerful diversity statement for the press kit by noon."
Ready for Testing
4
Scene Order
Long-Form Tape Evaluation
ID:
tape-evaluation
🎯 Goal:
Provide a 150+ word structured review comparing three audition tapes, listing strengths, concerns, and fit for role.
📨 Input Events:
chat_msg
assistant:Jordan
"Here are links to Tapes A, B, and C. Can you break down who’s best for the supporting role?"
Ready for Testing
5
Scene Order
Grateful Response to Fan Support
ID:
fan-superchat
🎯 Goal:
Thank the supporter warmly, acknowledge their note about representation, and briefly share next steps for inclusive outreach.
📨 Input Events:
superchat
viewer:FilmFan88
YouTube
$20
"Love how you prioritize diversity on screen!"
Ready for Testing
Latency by Model (This Suite)
Fastest
- [email protected]/Qw… 6322 ms
- p95 • avg • N 9344 ms • 6789 ms • 6
- [email protected]/Qw… 6616 ms
- p95 • avg • N 9613 ms • 7262 ms • 6
- qwen/qwen3-14b 17210 ms
- p95 • avg • N 26938 ms • 19305 ms • 12
- qwen/qwen-2.5-7b-instru… 18230 ms
- p95 • avg • N 23359 ms • 18659 ms • 12
- meta-llama/llama-3.1-8b… 20021 ms
- p95 • avg • N 35000 ms • 22974 ms • 11
Slowest
- qwen/qwen3-8b 23625 ms
- p95 • avg • N 29087 ms • 24169 ms • 12
- mistralai/mistral-7b-in… 21192 ms
- p95 • avg • N 30167 ms • 15748 ms • 10
- meta-llama/llama-3.1-8b… 20021 ms
- p95 • avg • N 35000 ms • 22974 ms • 11
- qwen/qwen-2.5-7b-instru… 18230 ms
- p95 • avg • N 23359 ms • 18659 ms • 12
- qwen/qwen3-14b 17210 ms
- p95 • avg • N 26938 ms • 19305 ms • 12
Per-scene duration for this suite.
Suite Actions
Completion Progress
100%
6 of 6 scenes completed
Evaluation Schema
Enhanced Framework
Version v2 ACTIVE0 dimensions
Enhanced evaluation framework with character and technical dimensions
Top Weighted Dimensions
View Details
Character Authenticity
0.182
Plan Validity
0.155
Contextual Intelligence
0.136
Recent Runs
48417498
Dec. 17, 2025, 12:01 a.m.
05567575
Dec. 16, 2025, 12:02 a.m.
43183138
Dec. 15, 2025, 12:01 a.m.
45232922
Dec. 14, 2025, 12:01 a.m.
43867292
Dec. 13, 2025, 12:01 a.m.
57987076
Dec. 12, 2025, 12:01 a.m.
53988353
Dec. 11, 2025, 12:01 a.m.
45915902
Dec. 10, 2025, 12:01 a.m.
00124151
Dec. 9, 2025, 12:02 a.m.
48470105
Dec. 8, 2025, 12:01 a.m.