Test Run
biopunk-genre-short-story-characters-niccol-machiavelli-20251029T113942503907
Completed
Started
Oct 29, 2025 11:39
Completed
Oct 29, 2025 11:41
Model Results
| Model | Performance | Status | Actions |
|---|---|---|---|
|
[email protected]/Qwen3-8B-b0d7af1f
AI Language Model
|
0.681
|
Completed |
Run Details
Judge Model
meta-llama/Meta-Llama-3.1-405B-Instruct-Turbo
Generator Models (1)
Execution Time
0 minutes
Quick Stats
1
Models Tested
6
Scenes Executed
Average Performance
0.68
Scene Results
| Scene | Name | Score | Result | Model |
|---|---|---|---|---|
initial-contact
|
A desperate buyer reaches out
Test scenario
|
0.681
|
Failed
|
[email protected]/Qwe… |
negotiate-payment
|
Closing the deal
Test scenario
|
0.830
|
Passed
|
[email protected]/Qwe… |
law-enforcement-heat
|
Cops are sniffing around
Test scenario
|
0.730
|
Failed
|
[email protected]/Qwe… |
weekly-market-bulletin
|
Long-form: Private forum sales pitch
Test scenario
|
0.574
|
Failed
|
[email protected]/Qwe… |
bespoke-pathogen-request
|
Designing a custom bioweapon
Test scenario
|
0.563
|
Failed
|
[email protected]/Qwe… |
nightly-journal
|
Long-form: Personal reflections
Test scenario
|
0.707
|
Failed
|
[email protected]/Qwe… |
Performance Matrix 6×1
| Scene | onteripaul@gma… |
|---|---|
initial-contact
A desperate buyer reaches out
|
0.681
Details |
negotiate-payment
Closing the deal
|
0.830
Details |
law-enforcement-heat
Cops are sniffing around
|
0.730
Details |
weekly-market-bulletin
Long-form: Private forum sale…
|
0.574
Details |
bespoke-pathogen-request
Designing a custom bioweapon
|
0.563
Details |
nightly-journal
Long-form: Personal reflectio…
|
0.707
Details |