One of fourteen models named Amplitude first on the direct prompt; one named Looker. Amplitude was named by thirteen of the fourteen models and Looker by eight and Amplitude carries 27 labels and Looker 11, so the shares are not directly comparable.
Named in one category this edition.
Named in two categories this edition.
Share is the count of first choices across the direct, paraphrase, budget and scale prompts over all fourteen models, for a mid-market B2B company; rank is within the category; every quote names the model and the prompt it came from. Both figures come from the saas metrics and analytics page.
Across every category in the October 2026 Edition, Amplitude and Looker were named in the same answer twenty-six times, of the 81 answers naming Amplitude and the 98 naming Looker. In those answers Looker took the first choice one time and Amplitude two.
| Model | Direct | Paraphrase | Comparative | Budget-constrained | Scale-constrained | Negative |
|---|---|---|---|---|---|---|
| Claude Haiku 4.5 | ||||||
| GPT-5.4 mini | ||||||
| Gemini 3.5 Flash | ||||||
| Perplexity Sonar | ||||||
| Grok 4.1 Fast | ||||||
| Mistral Small | ||||||
| DeepSeek V4 Flash | ||||||
| Llama 4 Maverick | ||||||
| Qwen 3.7 Flash | ||||||
| Kimi K2 | ||||||
| GLM 4.7 FlashX | ||||||
| MiniMax M2.5 | ||||||
| GPT-6 Luna | ||||||
| Muse Glimmer 30B |
Bold names in an answer are the products the judge labeled a first choice; a model naming several gives each of them that label. The full answer text for every row is in the record.
Every negative label with a quote, up to three, then the highest-weighted positives, up to three. Six of eight in this category shown.
“Amplitude is terrible at calculating Net Revenue Retention (NRR), churn reasons, LTV:CAC ratios, or forecasting cash flow accurately” Llama 4 Maverick · negative prompt · hard negative
“it's not recommended for CFO-level financial reporting or accurate calculation of key SaaS metrics” Mistral Small · negative prompt · hard negative
“Avoid using these as your primary SaaS revenue metrics tool.” DeepSeek V4 Flash · negative prompt · hard negative
“Amplitude is best for mid-market to enterprise SaaS with dedicated data teams... very strong for B2B SaaS companies, and its cohort analysis is the best.” Claude Haiku 4.5 · direct prompt · first choice
“If you want to know what users do in the app: start with Amplitude or Mixpanel.” GPT-5.4 mini · comparative prompt · first choice
“Need deep product behavior insights with AI? → Amplitude” Kimi K2 · comparative prompt · first choice
Every negative label with a quote, up to three, then the highest-weighted positives, up to three. Four of five in this category shown.
“too heavy and expensive for early-stage SaaS companies” Mistral Small · negative prompt · hard negative
“you might not yet have the massive data engineering resources required to build custom BI dashboards (like Looker or Tableau)” Gemini 3.5 Flash · direct prompt · soft negative
“Modern BI Tools (e.g., Looker, PowerBI, Tableau): Better if you have a dedicated data team... requires technical resources.” Qwen 3.7 Flash · scale prompt · soft negative
“If you want one default recommendation, I'd usually pick Looker for a mid-market B2B company” GPT-5.4 mini · direct prompt · first choice
Comparisons are drawn for the top eight products in each category, each against each. The output is the models' output; nothing here is a recommendation by the index.