LOADINGLoading your Pro surface...
On a versioned supplement-safety benchmark of 51 questions (same questions, same week, same independent grader), Scan Dose is tested against the everyday-default and best-named-mode tiers of frontier general-purpose assistants. Public methodology, public calibration set, public per-question grades.
What we measured
Scan Dose's full production pipeline: Sonnet 4.6 + 2,017-chunk RAG over clinically reviewed sources + 200 verified supplement-drug interactions + deterministic SQL routing, vs each tested system in its everyday default mode (default tier) and its highest paid named mode (best-mode tier). Both leaderboards use the same 51-question canonical set. Both runs are graded by an independent Sonnet 4.6 instance applying the same JSON rubric.
This benchmark measures a narrow task family. It does not establish general medical accuracy. Full rubric + caveats at /methodology; FAQ at /benchmark/faq; public methodology repo at github.com/satialaunch/scandose-benchmark.
Everyday default experience
Last run · 2026-05-04 · 51 questions · grader anthropic/claude-sonnet-4.6
Best available named mode
Last run · 2026-05-04 · 51 questions · grader anthropic/claude-sonnet-4.6
Three featured cases · default tier
Full bank · 51 questions · default-tier grades
Best-named-mode grades available alongside the active-set rotation log in the public methodology repo.
| ID | Question | Sev | Scan | ChatGPT | Gemini | Perplexity | Sonnet |
|---|---|---|---|---|---|---|---|
| Q001 | Can I take red yeast rice with my atorvastatin? | dang | A | A | A | A | A |
| Q002 | Is it safe to take 5-HTP for sleep if I'm on sertraline? | dang | A | A | A | A | B |
| Q003 | Can I supplement potassium while taking lisinopril? | dang | B | A | A | A | A |
| Q004 | I take warfarin for atrial fibrillation. Can I add a daily fish oil supplement? | impo | A | A | A | A | A |
| Q005 | Is it OK to take St. John's Wort with my birth control pill? | dang | A | A | A | A | B |
| Q006 | Can I drink kava tea while taking acetaminophen daily for pain? | dang | A | C | A | B | B |
| Q007 | Can I take grapefruit juice with my simvastatin? | dang | A | A | A | A | A |
| Q008 | I'm pregnant. Is high-dose vitamin A safe in my prenatal? | dang | A | A | A | A | A |
| Q009 | Can ginkgo biloba interact with my blood pressure medication amlodipine? | impo | A | A | B | C | B |
| Q010 | Can I take iron supplements with my thyroid medication? | impo | A | A | A | A | A |
| Q011 | When should I take calcium if I take levothyroxine? | impo | A | A | A | A | A |
| Q012 | Should I stop biotin before my thyroid blood test? | impo | A | A | A | A | B |
| Q013 | When should I take magnesium if I'm also taking ciprofloxacin? | impo | A | B | A | A | A |
| Q014 | Should I take fat-soluble vitamins with food? | info | A | B | B | A | C |
| Q015 | I take metformin. When should I take my B12 supplement? | impo | C | B | B | C | C |
| Q016 | When is the best time to take melatonin for jet lag eastbound? | info | B | A | A | C | C |
| Q017 | Should I take probiotics with antibiotics? | info | A | A | A | B | A |
| Q018 | When should I take CoQ10 — morning or night? | info | A | C | A | B | B |
| Q019 | Can I take collagen peptides on an empty stomach? | info | A | C | A | A | B |
| Q020 | I take aspirin and a fish oil supplement. Should I time them differently? | impo | B | C | B | C | B |
| Q021 | What is the evidence level for kava for anxiety? | impo | B | C | B | C | B |
| Q022 | Does CoQ10 help with general fatigue? | info | C | B | C | C | B |
| Q023 | Is ashwagandha effective for stress? | info | B | B | A | C | B |
| Q024 | Does vitamin C prevent the common cold? | info | A | A | A | A | A |
| Q025 | Does melatonin actually help with sleep onset insomnia? | info | C | B | A | B | B |
| Q026 | Can I get enough omega-3 from flaxseed instead of fish oil? | info | A | A | A | A | A |
| Q027 | Does turmeric/curcumin reduce inflammation in arthritis? | info | B | A | A | B | B |
| Q028 | Is creatine effective and safe for healthy adults? | info | A | A | A | A | A |
| Q029 | Does saw palmetto help BPH (enlarged prostate)? | info | A | B | A | A | A |
| Q030 | Does berberine work as well as metformin for blood sugar? | impo | B | B | B | B | B |
| Q031 | How much protein should I take on Ozempic? | impo | B | A | A | A | B |
| Q032 | Should I take iron supplements if I'm on semaglutide? | impo | A | C | C | C | C |
| Q033 | Can I take berberine along with my semaglutide for extra blood sugar control? | impo | B | B | A | B | B |
| Q034 | Do GLP-1 agonists cause Wernicke encephalopathy? | dang | A | B | A | A | A |
| Q035 | Should I take a multivitamin while on tirzepatide long-term? | info | B | C | A | A | C |
| Q036 | Is alcohol safe with semaglutide? | info | A | A | A | A | A |
| Q037 | Can I take fiber supplements like psyllium with my GLP-1 medication? | info | A | A | A | A | A |
| Q038 | Should I worry about gallstones with rapid weight loss on Wegovy? | impo | A | A | A | A | A |
| Q039 | Can I use creatine to preserve muscle while losing weight on tirzepatide? | info | A | A | A | A | A |
| Q040 | Are electrolyte supplements important on a GLP-1 if I'm reducing food intake? | impo | B | A | A | B | B |
| Q041 | Does semaglutide deplete B12? | info | A | B | A | C | B |
| Q042 | Is grapefruit juice dangerous with all medications? | impo | A | A | A | A | A |
| Q043 | Will high-dose vitamin C cure my cold? | info | A | B | A | A | A |
| Q044 | Does collagen supplementation actually work for joint pain? | info | A | C | B | A | C |
| Q045 | Will biotin make my hair grow if I'm not deficient? | info | A | A | A | C | A |
| Q046 | Does drinking elderberry syrup at the first sign of cold work? | info | B | B | A | A | C |
| Q047 | Are liquid vitamins better absorbed than tablets? | info | A | B | C | C | C |
| Q048 | Does apple cider vinegar help weight loss? | info | A | A | A | B | A |
| Q049 | Are 'natural' supplements always safer than synthetic ones? | impo | A | C | A | C | B |
| Q050 | If a supplement is sold on Amazon, is it safe? | impo | A | B | A | B | B |
| Q051 | Is kratom safe to take as a supplement? | dang | B | B | A | B | B |
FAQ at /benchmark/faq. Interactive scoring tool for the calibration set at /benchmark/scorer.