LIVE
Total Voters
0
Total Ratings
0
Top Model
—
Avg Gen Cost
$0.0000
Analyzing data trends...

Quality vs. Cost ROI

Average score vs. generation cost (log scale) with Pareto Frontier

Skills vs. Vanilla Prompting

Average score comparison across all models

Framework Performance

Python Shiny vs. R Shiny average scores

Design Quality Drivers

Average score deviation from overall baseline when tag is present

Human Preference Beeswarm

Distribution of individual user ratings (S to D Tier) across categories. Hover over dots to read comments.

Thought-Provoking Insights

  • Do Guidelines Eliminate Bad Output? Switch to Approach. Check if the "Skills" guidelines completely shield models from D-tier ratings, or if it just compresses the spread compared to "Vanilla".
  • The Cost-Quality Paradox: Look at the ratings for expensive models (Claude Opus) versus extremely cheap ones (DeepSeek Flash). Does paying 100x more per generation lead to human S-tier preferences?

Questions to Ponder

  • Are certain models highly polarized (having lots of S and D ratings with few B's) while others are safely mediocre?
  • Does Python Shiny or R Shiny have a tighter distribution of positive reviews? Switch to Framework to investigate.

Performance Leaderboard

Rank Model Approach Framework Avg Rating Votes Time Cost
Loading leaderboard...

Live Feed

0
Awaiting submissions...