Evaluation

How Cue compares with Claude alone

We asked both the same questions. Claude alone answers from what it remembers. Cue answers from Qloo's taste data, scores matches in code and only shows names that exist in Qloo. Both use the same Claude model, so Qloo is the difference.

1 · Smaller US artists: who should they pitch to?

12 lesser-known US artists that Qloo knows, such as Major Murphy, Annie DiRusso and Babehoven. These are the artists Cue is built for. There is no single right answer for them, so we measure how specific and how reachable each system's suggestions are.

Suggestions repeated for other artists

Same title suggested to 3 or more different artists. Lower means answers fit the artist, not a generic list.

Claude alone66%
Cue37%
Lower is better

How big the suggestions are

Median popularity in Qloo of what was suggested. Lower means smaller, more realistic placements for an indie artist.

Claude alone0.96
Cue0.83
Lower is better

Names not found in Qloo

Suggestions Qloo has no exact match for. Not always invented, but not checkable.

Claude alone0%
Cue0%
Lower is better

Side by side

Three of the twelve artists, first six suggestions each. Both systems have weak spots: Cue also suggested Cyberpunk 2077 to Annie DiRusso, and repeats a few favourites such as Sandra.

Major Murphy · Claude alone

Shrinking · High Fidelity · Licorice Pizza · Life Is Strange · Somebody Somewhere · Dave

Major Murphy · Cue

Aftersun · Past Lives · Sandra · Joe Pera Talks with You · PEN15 · Saint Frances

Babehoven · Claude alone

Normal People · Station Eleven · Life Is Strange · Never Have I Ever · Aftersun · The Bear

Babehoven · Cue

Return to Seoul · Tár · Undertale · A Love Song · Ali & Ava · TOEM

Wild Pink · Claude alone

Friday Night Lights · The Bear · Life Is Strange · Firewatch · Patagonia · Normal People

Wild Pink · Cue

Sandra · Untitled Goose Game · Homecoming · Rough Trade · DTR - The Official Tinder Podcast · TOEM

2 · Supervisors asking for lesser-known artists

Both were told to suggest lesser-known, still-active artists for a show, film or game. We checked every suggestion's popularity in Qloo.

Suggestions that really are under the radar

At or under popularity 80 in Qloo.

Claude alone4%
Cue98%
Higher is better

Names not found in Qloo

Across all known-placement rows.

Claude alone2%
Cue1%
Lower is better

3 · Famous placements, as a sanity check

27 well-documented placements, such as Kate Bush in Stranger Things. Claude alone finds 96% of them and Cue 4%. That is expected: these placements are famous, so Claude can recall them from training, while Cue matches on audience taste and doesn't know placement history. Famous artists aren't who Cue is for.

What to keep in mind· Known placements are famous, so Claude alone may recall them from training rather than reason about taste.· Qloo's taste data can reflect a placement after it happened, which may help Cue on old placements.· Two systems only: Claude alone and Cue. Claude with web search was not run.· 9 supervisor rows weren't scored for hits, for either system, because the known answer is above Cue's popularity cap.
Typical time per run3.19 s vs 25.84 sClaude alone vs Cue. Cue makes about 20 live Qloo calls.
Claude cost, small-artist set$0.0755 vs $0.0323Claude alone vs Cue, whole set
Errors0 vs 0Across 53 rows

Scores come from python -m cue.eval in the repo. Only scores are published; raw Qloo responses never are.