Three of fourteen models named Coupa first on the direct prompt; three named Payhawk. Coupa was named by fourteen of the fourteen models and Payhawk by eight and Coupa carries 45 labels and Payhawk 11, so the shares are not directly comparable.
Named in nine categories this edition.
Named in seven categories this edition.
Share is the count of first choices across the direct, paraphrase, budget and scale prompts over all fourteen models, for a mid-market B2B company; rank is within the category; every quote names the model and the prompt it came from. Both figures come from the supplier management page.
| Model | Direct | Paraphrase | Comparative | Budget-constrained | Scale-constrained | Negative |
|---|---|---|---|---|---|---|
| Claude Haiku 4.5 | ||||||
| GPT-5.4 mini | ||||||
| Gemini 3.5 Flash | ||||||
| Perplexity Sonar | ||||||
| Grok 4.1 Fast | ||||||
| Mistral Small | ||||||
| DeepSeek V4 Flash | ||||||
| Llama 4 Maverick | ||||||
| Qwen 3.7 Flash | ||||||
| Kimi K2 | ||||||
| GLM 4.7 FlashX | ||||||
| MiniMax M2.5 | ||||||
| GPT-6 Luna | ||||||
| Muse Glimmer 30B |
Bold names in an answer are the products the judge labeled a first choice; a model naming several gives each of them that label. The full answer text for every row is in the record.
Every negative label with a quote, up to three, then the highest-weighted positives, up to three. Three of three in this category shown.
“### 2. Coupa ⚠️ Common complaints: - Clunky, poorly designed UI - described as "unworkable"” Kimi K2 · negative prompt · hard negative
“the biggest mistake is choosing a heavyweight enterprise platform (like SAP Ariba, Coupa, or Jaggaer)” Gemini 3.5 Flash · paraphrase prompt · hard negative
“"Best for centralized spend and supplier management: Coupa, if you want procurement and finance standardized in one place."” Muse Glimmer 30B · comparative prompt · first choice
Every negative label with a quote, up to three, then the highest-weighted positives, up to three. Two of two in this category shown.
“framed as finance-led supplier and spend workflows for mid-market finance” Muse Glimmer 30B · direct prompt · first choice
“the strongest all-around choice from the results is Payhawk” Perplexity Sonar · direct prompt · first choice
Comparisons are drawn for the top eight products in each category, each against each. The output is the models' output; nothing here is a recommendation by the index.