Evaluation program

Evaluator Guide

Work through this checklist in order, use the prepared Week 8 examples, and tell us where the product earns or loses your trust.

Before you start

Test the current in-season experience

Plan on 60-90 minutes for the 11 core sections. Season 2025, Week 8 is an intentional evaluator snapshot with stable sample data. There is no drafting workflow in this build. Your private sample roster is editable, and a real league connection is optional. Keep rough notes as you go — the final debrief asks for them.

Use the sample first

It makes every evaluator's first run comparable.

Open feature links

They launch in a new tab so this checklist keeps your place.

Use your own examples

The prepared checks are a baseline, not a script you must stay inside.

Report through The Desk

Bugs, confusion, missing states, and feature ideas are all useful.

Saved progress

0/17

Loading your saved checklist…

Reporting is part of the evaluation

Found a bug or idea? Put it in The Desk.

Do not email, text, or DM feedback. Keeping every actionable item in The Desk preserves the page context, screenshots, status, and private fix review in one place. Send one focused report for each bug or feature idea.

1Stay on the page you are testing and select LOG ISSUE.
2Choose Report a bug when something is wrong, or Request a feature when something useful is missing.
3Describe what you expected, what happened, and the shortest steps that reproduce it.
4Attach a screenshot when it helps, but never include passwords, provider cookies, API keys, or verification codes.
5Select Send, then use Your reports to follow progress and review a private candidate fix.

Read the complete Desk workflow

The Desk request form showing Report a bug and Request a feature choices, a message box, file attachment control, and Send button. — The Desk keeps bug reports, feature requests, attachments, and review status together.

0/17 complete

01core5 min0/5 steps

Get oriented

Before the checklist tells you anything, see how much the product explains on its own.

Mark complete

1Open Dashboard.
2Before clicking anything, say out loud what you think FantasyOmatic helps you decide.
3Open Why FantasyOmatic. Does the story about the model and its evidence feel credible?
4Open Season Passes. Can you tell what separates Free, All-Pro, and Hall of Famer?
5Note the first feature you would try and anything that made you hesitate. The final debrief asks for these notes.

Open Dashboard Open Why FantasyOmatic Open Season Passes

02core8 min0/6 steps

Explore Rankings

Learn the four rating horizons and find useful players without help.

Mark complete

1Open Rankings and choose the QB position.
2Select This Week and confirm the week selector shows Week 8.
3Search for Drake Maye and open his row.
4Compare his four ratings: Player Rating, This Week, Rest of Season, and Playoffs. Can you say what each one is for?
5Switch to K and search for Harrison Butker. Look at his row of weekly tiles, the four-week outlook, and the BYE badge on Week 10.
6Switch to DST and search for IND D/ST. Do the labels still make sense for a defense?

Primary searchDrake Maye

Kicker checkHarrison Butker

Defense checkIND D/ST

Try your own

Search for a player you actually care about. Which rating would you use for your next decision?

Open Rankings

03core7 min0/5 steps

Read a player page

Follow the evidence from the headline rating down to the factors behind it.

Mark complete

1Open Drake Maye's player page and read the Rating view first.
2Switch to the Signal Dial.
3Move through WEEK, SEASON, and PLAYOFFS.
4Tap one matchup factor — Defense, Efficiency, Home/Road, or Injury. Does the explanation match the way the number moved?
5Scan the projection breakdown, the weekly trend, and the similar players.

Direct playerDrake Maye

Try your own

Go back to Rankings and open a different player. Does the same reading pattern still work?

Open Drake Maye

04core6 min0/5 steps

Work a weekly matchup

Use the defense matchup context without counting it twice.

Mark complete

1Open Matchups, choose QB, and confirm Week 8 is selected.
2Scan from easiest to hardest. Pick one favorable defense and one difficult one.
3Open a defense's affected-player panel, then open one of those players.
4Compare the opponent story with that player's This Week rating.
5Explain the recommendation in your own words. The matchup effect is already inside the rating — do not add it on top.

Open Matchups

05core10 min0/6 steps

Edit the private sample roster

See how lineup changes flow through the personalized tools — without touching a real league.

Mark complete

Only edit while the SAMPLE ROSTER banner is visible. If you connected a real league, skip the edits and just read the roster.

1Open My Team and confirm the SAMPLE ROSTER banner is visible before you change anything.
2Move Jordan Love to starters. When asked who to replace, pick Drake Maye. Both spots should swap together.
3Open Dashboard and confirm Jordan Love now shows as the starting QB.
4Go back to My Team and undo the swap: move Drake Maye to starters and replace Jordan Love.
5Open Edit Roster and search for Harrison Butker.
6Add him to the bench, then remove him again.

Temporary starterJordan Love

Restore starterDrake Maye

Add and removeHarrison Butker

Open My Team Check Dashboard

06core8 min0/4 steps

Use the personalized Dashboard

Decide whether the dashboard puts the most important in-season action first.

Mark complete

1Open Dashboard and check the lineup matches what you left in My Team.
2Find Jake Bates. How does the page treat his bye or streaming risk?
3Find Cowboys DST. Is the defense alert something you could act on?
4Expand one Week swing or alert explanation. Is the next action obvious?

Bye/status exampleJake Bates

Defense exampleCowboys DST

Open Dashboard

07core8 min0/5 steps

Compare a lineup choice and a trade

Keep this week's lineup call separate from longer-term roster value.

Mark complete

1Open the prepared weekly comparison: Drake Maye vs Jordan Love.
2Decide who you would start in Week 8 and note the evidence that decided it.
3Open the prepared trade: give De'Von Achane, get Puka Nacua and Rico Dowdle.
4Pick Isaiah Likely as the suggested drop.
5Check that the result explains roster impact, Rest of Season value, and Playoffs value — not just a winner.

Weekly choiceDrake Maye vs Jordan Love

GiveDe'Von Achane

GetPuka Nacua, Rico Dowdle

Suggested dropIsaiah Likely

Try your own

Swap in a real start/sit or trade question from your own league.

Open weekly comparison Open trade package

08core7 min0/4 steps

Fix a bye-week conflict

Find a safe bye-week replacement without mistaking a suggestion for a confirmed pickup.

Mark complete

Without a connected league, only bench options are guaranteed to be yours. Players from outside your roster are only confirmed available after a league sync.

1Open Fix Byes and select Week 8.
2Find Jake Bates and Zach Charbonnet in the bye conflicts.
3Compare the three groups: On Bench, Available Now, and Trade Targets.
4Pick the replacement you would look into first and note why.

Starter conflictJake Bates

Bench conflictZach Charbonnet

Open Fix Byes

09core6 min0/4 steps

Read the Newsstand

Check whether the articles lead back to useful product decisions.

Mark complete

1Open Newsstand and expand the weekly Dope Sheet.
2Open the sample article '5 Waiver Targets That Will Win You a Championship.'
3Follow one player or tool link back into FantasyOmatic.
4Can you tell this is sample content from a past week? If it reads as current, report it.

Open Newsstand Open sample article

10core6 min0/4 steps

Pressure-test the User Guide

Confirm the User Guide answers questions in plain language.

Mark complete

1Open the User Guide and search for 'Week Context.'
2Search for 'sample roster Week 8' and confirm the guide says the snapshot is intentional.
3Search for 'feature suggestion' and confirm it points you to The Desk.
4Ask the guide one question in your own words. Is the answer honest about what the product cannot do yet?

Search 1Week Context

Search 2sample roster Week 8

Search 3feature suggestion

Try your own

Search for the first term you did not understand during this evaluation.

Open User Guide

11core8 min now; follow-up later0/7 steps

Send feedback through The Desk

Complete the same feedback loop evaluators will use after this journey.

Mark complete

Never put passwords, cookies, API keys, or verification codes in a report. Name the provider and the visible error instead.

1Stay on the page where you noticed a bug, confusion, missing state, or feature idea.
2Select LOG ISSUE and choose Bug or Feature suggestion.
3Send one focused report: what you expected, what happened, and the shortest steps to repeat it.
4Add a screenshot only if it helps.
5Open My reported issues to follow progress.
6Later, when The Desk emails you that a fix is ready to check, open the private link and follow its steps.
7Choose Fixed or Still not right. If it is still wrong, say what remains in the same report.

Feature idea if nothing breaksLet me save a Compare result and share it with a league mate.

Open a product page

12optional8 min0/4 steps

Challenge AI Coach

Test whether a chat answer stays grounded in your visible roster and ratings.

Mark complete

1Open AI Coach and confirm the evaluator preview notice is visible.
2Ask the prepared Week 8 question exactly as written below.
3Check the answer against your sample roster and the linked evidence.
4Ask one follow-up that pushes back on the recommendation.

AskShould I start Drake Maye or Jordan Love in Week 8? Use only my current roster and FantasyOmatic ratings evidence.

Try your own

Ask one real roster question, then verify every player, injury, opponent, and rating the answer cites.

Open AI Coach

13optional7 min0/4 steps

Explore Matchup Matrix

Compare raw schedule difficulty with the full player outlook.

Mark complete

If the Matrix says ratings are being prepared, note what you saw and keep going — that state is itself useful feedback.

1Open Matchup Matrix and select RB.
2Choose Matchups Only and sort by Schedule Edge.
3Turn on Apply Player Ratings and watch how the order changes.
4Check one remaining-week column: bye weeks should sort last, not act like zero-point games.

Open Matchup Matrix

14optional10-20 min0/5 steps

Generate a private podcast

Evaluate generation, playback, transcript, and follow-up end to end.

Mark complete

1Open My Podcast and choose Weekly Preview or Custom Topic.
2For Custom Topic, paste the prepared prompt below and start generating.
3While you wait, judge the status the page gives you.
4Test playback, speed, the transcript, and chapter seeking.
5If Call In is available, ask one follow-up and check the new segment stays grounded.

Custom topicWhich starter is most vulnerable in Week 8, and why?

Open My Podcast

15optional6 min0/4 steps

Inspect My Season

See whether saved decisions and outcomes add up to a useful season story.

Mark complete

1Open My Season and scan the decisions, outcomes, and progress states.
2Open one saved item. Would you understand it a month from now?
3Generate an edition if your account shows that control.
4Would the result help you learn from past roster calls? Note why or why not.

Open My Season

16optional15 min0/4 steps

Try the browser extension

Test the ratings overlay on the fantasy sites you already use.

Mark complete

This program covers in-season features only — you do not need to test a draft.

1Open Extension Setup and install the unpacked extension in Chrome, Edge, Brave, Opera, or Arc.
2Visit a roster, waiver, or matchup page on ESPN, NFL, CBS, Sleeper, or Yahoo.
3Confirm ratings appear next to recognizable player names without covering the site.
4Refresh and navigate around the site. Does the overlay stay stable?

Open Extension Setup

17optional10-20 min0/4 steps

Volunteer for real league import

Optionally test a real league sync — it is not required.

Mark complete

Yahoo import is currently unavailable. Never paste passwords, cookies, tokens, or verification codes into The Desk.

1Prefer Sleeper: connecting a public Sleeper league needs no password or cookie.
2Use ESPN or CBS only if you are comfortable with their connection steps.
3After syncing, compare starters, bench, league size, and scoring against the provider's own site.
4Disconnect when done if you do not want the league retained.

Open league connections

Final debrief

Tell us what the checklist cannot measure

What would bring you back every week during the season?

What would you confidently share with a league mate?

Which number, recommendation, or state did you distrust most?

Which tier feels right for you, and where does the value stop being clear?

What are the three improvements you would make first?

What did you look for that FantasyOmatic does not currently offer?

Put each actionable bug or feature idea into its own Desk report. Broader impressions can go in your evaluator reply or closing survey.

Finish the core journey first

Complete sections 01-11 before treating the evaluation as finished. Optional sections broaden coverage but are not required.