Dr. Lila Navarro
found-footage-genre-myth-folklore-characters-katharine-briggs
v2.0
Ethical
Backstory: Dr. Lila Navarro is the university’s special-collections librarian charged with rescuing oral myths from marginalized mountain communities. Night after night she digitizes fragile reel-to-reel tapes and painstakingly translates weather-worn field notebooks, determined to prevent their stories from vanishing. Her inquisitive mind thrives on tracing motif variations across valleys, while her methodical habits ensure every file is catalogued and time-stamped for future scholars.
100% Complete
6/6 scenes
Model Performance Overview
Scene Performance Matrix
| Scene | meta-llama/llama-3.… | mistralai/mistral-7… | [email protected]… | [email protected]… | qwen/qwen-2.5-7b-in… | qwen/qwen3-14b | qwen/qwen3-8b |
|---|---|---|---|---|---|---|---|
herb-meaning
Ask about mythic herb
|
0.690
Details |
0.810
Details |
0.000
Details
Error
|
0.000
Details
Error
|
0.856
Details |
0.889
Details |
0.849
Details |
damaged-cassette
Preservation advice request
|
0.331
Details |
0.601
Details |
0.000
Details
Error
|
0.000
Details
Error
|
0.548
Details |
0.224
Details |
0.408
Details |
preservation-log
Late-night preservation log
|
0.495
Details |
0.351
Details |
0.000
Details
Error
|
0.000
Details
Error
|
0.543
Details |
0.625
Details |
0.730
Details |
proverb-superchat
Superchat proverb request
|
0.763
Details |
0.879
Details |
0.000
Details
Error
|
0.000
Details
Error
|
0.592
Details |
0.851
Details |
0.699
Details |
lullaby-translation
Translate lullaby excerpt
|
0.324
Details |
0.469
Details |
0.000
Details
Error
|
0.000
Details
Error
|
0.545
Details |
0.692
Details |
0.479
Details |
festival-date-reminder
Recall promised festival date
|
0.761
Details |
0.908
Details |
0.000
Details
Error
|
0.000
Details
Error
|
0.577
Details |
0.823
Details |
0.880
Details |
Test Scenes 6
0
Scene Order
Ask about mythic herb
ID:
herb-meaning
🎯 Goal:
Give a concise, source-cited explanation of the herb’s mythic role, keeping an inquisitive yet scholarly tone and referencing at least one collection code.
📨 Input Events:
chat_msg
viewer:user_1
"In the high-ridge tales, what does wolf’s-tongue herb symbolize?"
Ready for Testing
1
Scene Order
Preservation advice request
ID:
damaged-cassette
🎯 Goal:
Deliver a clear, step-by-step plan for stabilizing and digitizing a warped cassette without degrading audio quality.
📨 Input Events:
chat_msg
viewer:user_54
"I found a warped cassette of a mountain chant. How can I preserve it safely?"
Ready for Testing
2
Scene Order
Late-night preservation log
ID:
preservation-log
🎯 Goal:
Produce a reflective log of at least 200 words, detailing tonight’s digitization tasks, obstacles, and next actions while maintaining her methodical voice.
📨 Input Events:
world_event
workspace
"End of digitization shift, 02:00 a.m."
Ready for Testing
3
Scene Order
Superchat proverb request
ID:
proverb-superchat
🎯 Goal:
Thank the donor and share a brief mountain proverb in original language plus English gloss, staying warm and respectful.
📨 Input Events:
superchat
viewer:donor_77
YouTube
$20
"Could you drop a quick proverb about perseverance from the ridge folk?"
Ready for Testing
4
Scene Order
Translate lullaby excerpt
ID:
lullaby-translation
🎯 Goal:
Provide a bilingual translation with brief cultural notes, minimum 150 words total, honoring rhyme where possible.
📨 Input Events:
chat_msg
viewer:user_92
"Here’s a fragment of the Shale-Pass lullaby:
"Solëra, solëra, nod in the pine-shade…"
Could you translate and explain it?"
Ready for Testing
5
Scene Order
Recall promised festival date
ID:
festival-date-reminder
🎯 Goal:
Accurately state the Spring Thaw Festival’s timing as stored in memory and note that you’re fulfilling the earlier promise.
🧠 Initial State:
Pre-loaded Memories:
- 💭 {'kind': 'promise', 'tags': ['festival'], 'content': 'Tell Ran about the Spring Thaw Festival date when asked; festival occurs the first Sunday after the snowmelt, traditionally around March 28.', 'importance': 4}
📨 Input Events:
chat_msg
viewer:ran
"You promised to tell me: is the Spring Thaw Festival on the first full moon of March?"
Ready for Testing
Latency by Model (This Suite)
Fastest
- [email protected]/Qw… 7933 ms
- p95 • avg • N 9479 ms • 7921 ms • 6
- meta-llama/llama-3.1-8b… 21096 ms
- p95 • avg • N 27562 ms • 20783 ms • 12
- qwen/qwen-2.5-7b-instru… 23489 ms
- p95 • avg • N 28020 ms • 23259 ms • 12
- mistralai/mistral-7b-in… 25224 ms
- p95 • avg • N 34511 ms • 27066 ms • 11
- qwen/qwen3-8b 25580 ms
- p95 • avg • N 32182 ms • 25534 ms • 12
Slowest
- [email protected]/Qw… 38107 ms
- p95 • avg • N 47987 ms • 40273 ms • 6
- qwen/qwen3-14b 26490 ms
- p95 • avg • N 59679 ms • 32859 ms • 12
- qwen/qwen3-8b 25580 ms
- p95 • avg • N 32182 ms • 25534 ms • 12
- mistralai/mistral-7b-in… 25224 ms
- p95 • avg • N 34511 ms • 27066 ms • 11
- qwen/qwen-2.5-7b-instru… 23489 ms
- p95 • avg • N 28020 ms • 23259 ms • 12
Per-scene duration for this suite.
Suite Actions
Completion Progress
100%
6 of 6 scenes completed
Evaluation Schema
Enhanced Framework
Version v2 ACTIVE0 dimensions
Enhanced evaluation framework with character and technical dimensions
Top Weighted Dimensions
View Details
Character Authenticity
0.182
Plan Validity
0.155
Contextual Intelligence
0.136
Recent Runs
43682612
Dec. 17, 2025, 12:01 a.m.
59656144
Dec. 16, 2025, 12:01 a.m.
38855576
Dec. 15, 2025, 12:01 a.m.
40494647
Dec. 14, 2025, 12:01 a.m.
39470677
Dec. 13, 2025, 12:01 a.m.
52863600
Dec. 12, 2025, 12:01 a.m.
48948582
Dec. 11, 2025, 12:01 a.m.
41115043
Dec. 10, 2025, 12:01 a.m.
55059104
Dec. 9, 2025, 12:01 a.m.
43913731
Dec. 8, 2025, 12:01 a.m.