Renee Callahan

musical-genre-movie-characters-ella-fitzgerald v2.0 Ethical
Backstory: Renee Callahan is a seasoned jazz vocalist who spent three decades touring smoky clubs and glittering festival stages from New Orleans to Montreux. After years on the road, she now devotes her time to coaching young singers for film soundtracks, blending strict technique with colorful stories from her touring days. Students praise her for a warm heart, sharp ears, and an endless stash of road-tested wisdom.
100% Complete
6/6 scenes
Model Performance Overview
Scene Performance Matrix
Scene meta-llama/llama-3.… mistralai/mistral-7… [email protected]… [email protected]… qwen/qwen-2.5-7b-in… qwen/qwen3-14b qwen/qwen3-8b
first-lesson-welcome
First Lesson Welcome
 0.756
Details 		0.864
Details 		0.000
Details
Error
0.000
Details
Error
0.665
Details 		0.894
Details 		0.867
Details
scat-exercise-autumn-leaves
Scat Exercise for ‘Autumn Leaves’
 0.617
Details 		0.723
Details 		0.000
Details
Error
0.000
Details
Error
0.416
Details 		0.715
Details 		0.702
Details
tour-bus-anecdote
Tour Bus Anecdote (Long-form)
 0.684
Details 		0.521
Details 		0.000
Details
Error
0.000
Details
Error
0.337
Details 		0.716
Details 		0.678
Details
gratitude-superchat
Gratitude for Superchat
 0.895
Details 		0.715
Details 		0.000
Details
Error
0.000
Details
Error
0.720
Details 		0.913
Details 		0.864
Details
breathier-take
Breathier Take Quick Fix
 0.395
Details 		0.867
Details 		0.000
Details
Error
0.000
Details
Error
0.589
Details 		0.615
Details 		0.394
Details
vibrato-masterclass
Vibrato Masterclass (Long-form)
 0.485
Details 		0.523
Details 		0.000
Details
Error
0.000
Details
Error
0.310
Details 		0.690
Details 		0.563
Details
Test Scenes 6
0
Scene Order
First Lesson Welcome
ID: first-lesson-welcome
🎯 Goal:
Offer a warm, encouraging greeting, share a brief road anecdote, and outline a clear first-lesson plan.
📨 Input Events:
chat_msg student:newcomer
"Hi Renee, I’m kinda nervous for my first lesson."
Ready for Testing
1
Scene Order
Scat Exercise for ‘Autumn Leaves’
ID: scat-exercise-autumn-leaves
🎯 Goal:
Provide a concise technical drill plus a short scat example tailored to ‘Autumn Leaves’; keep the tone encouraging.
📨 Input Events:
chat_msg student:sam
"Could you give me a scatting exercise for the tune ‘Autumn Leaves’?"
Ready for Testing
2
Scene Order
Tour Bus Anecdote (Long-form)
ID: tour-bus-anecdote
🎯 Goal:
Deliver a vivid 3+ paragraph story about a late-night jam on the tour bus, ending with a lesson on vocal phrasing; at least 200 words.
📨 Input Events:
chat_msg viewer:livestream_fan
"Renee, tell us about the most memorable jam session you ever had on the road!"
Ready for Testing
3
Scene Order
Gratitude for Superchat
ID: gratitude-superchat
🎯 Goal:
Thank the supporter warmly and give one quick, actionable vocal tip; keep response under 80 words.
📨 Input Events:
superchat viewer:jazz_fan_88 YouTube $20
"Thanks for the last tip—my high notes feel way better!"
Ready for Testing
4
Scene Order
Breathier Take Quick Fix
ID: breathier-take
🎯 Goal:
Suggest one immediate technique (max 3 steps) to achieve a breathier tone for tonight’s recording, delivered in an encouraging voice.
📨 Input Events:
chat_msg student:director_request
"The film director wants a breathier take tonight—any quick fix?"
Ready for Testing
5
Scene Order
Vibrato Masterclass (Long-form)
ID: vibrato-masterclass
🎯 Goal:
Provide a structured masterclass (≈250–300 words) explaining what vibrato is, when to use it in jazz ballads, and two drills to practice.
📨 Input Events:
chat_msg viewer:podcast_listener
"Could you give us a 3-minute masterclass on using vibrato in jazz ballads?"
Ready for Testing
Latency by Model (This Suite)
Fastest
  • [email protected]/Qw… 5180 ms
  • p95 • avg • N 6439 ms • 5343 ms • 6
  • [email protected]/Qw… 7127 ms
  • p95 • avg • N 9180 ms • 7185 ms • 6
  • qwen/qwen-2.5-7b-instru… 20972 ms
  • p95 • avg • N 65569 ms • 28527 ms • 13
  • meta-llama/llama-3.1-8b… 24074 ms
  • p95 • avg • N 33707 ms • 24483 ms • 18
  • qwen/qwen3-8b 26471 ms
  • p95 • avg • N 32266 ms • 26654 ms • 18
Slowest
  • mistralai/mistral-7b-in… 27885 ms
  • p95 • avg • N 43303 ms • 29965 ms • 18
  • qwen/qwen3-14b 26673 ms
  • p95 • avg • N 47950 ms • 30952 ms • 15
  • qwen/qwen3-8b 26471 ms
  • p95 • avg • N 32266 ms • 26654 ms • 18
  • meta-llama/llama-3.1-8b… 24074 ms
  • p95 • avg • N 33707 ms • 24483 ms • 18
  • qwen/qwen-2.5-7b-instru… 20972 ms
  • p95 • avg • N 65569 ms • 28527 ms • 13
Per-scene duration for this suite.
Suite Actions
Completion Progress 100%
6 of 6 scenes completed
New Suite Import
Edit Suite Duplicate
Export With Results
Evaluation Schema
Enhanced Framework
Version v2 ACTIVE
0 dimensions

Enhanced evaluation framework with character and technical dimensions

Top Weighted Dimensions View Details
Character Authenticity
0.182
Plan Validity
0.155
Contextual Intelligence
0.136
Recent Runs
08838374
Dec. 17, 2025, 12:02 a.m.
30111344
Dec. 16, 2025, 12:02 a.m.
00871572
Dec. 15, 2025, 12:02 a.m.
04382781
Dec. 14, 2025, 12:02 a.m.
02480063
Dec. 13, 2025, 12:02 a.m.
20968159
Dec. 12, 2025, 12:02 a.m.
15546730
Dec. 11, 2025, 12:02 a.m.
05014992
Dec. 10, 2025, 12:02 a.m.
21711469
Dec. 9, 2025, 12:02 a.m.
08381116
Dec. 8, 2025, 12:02 a.m.
Latency Overview (This Suite)