ChatGPT gives a different list almost every time
By Highpoint Labs, LLC · From ChatGPT answers recorded October 26, 2026
If a buyer asks ChatGPT for software twice, worded a little differently, they often get two different shortlists. Being named once is not the same as being named reliably.
What we found
- 57% of the products named in a category (151 of 264) appeared in only one of its 5 answers.
- Only 9 products, across all 20 categories, were named in every answer for their category.
- In 16 of 20 categories, no product made every answer.
- The steadiest category was uptime monitoring tools (8 different products across 5 answers). The least steady was e-signature software (18).
What it means for you
A single screenshot of an AI answer tells you little. To know whether AI recommends your product, ask several realistic buyer questions and look at how often you come up, not whether you came up once.
By category
| Category | Different products named | Named in only one answer | Named in every answer |
|---|---|---|---|
| uptime monitoring tools | 8 | 2 | 2 |
| product analytics | 9 | 2 | 3 |
| accounting software for small businesses | 10 | 5 | 0 |
| password managers for teams | 10 | 5 | 3 |
| AI note takers | 11 | 7 | 0 |
| social media management tools | 11 | 4 | 1 |
| AI writing assistants | 13 | 8 | 0 |
| help desk software | 13 | 8 | 0 |
| live chat software | 13 | 7 | 0 |
| project management software | 13 | 10 | 0 |
| SEO tools | 13 | 5 | 0 |
| CRM for startups | 14 | 9 | 0 |
| invoicing software for freelancers | 14 | 9 | 0 |
| scheduling software | 14 | 8 | 0 |
| online form builders | 15 | 7 | 0 |
| email marketing software | 16 | 11 | 0 |
| knowledge base software | 16 | 9 | 0 |
| screen recording software | 16 | 10 | 0 |
| HR software for small businesses | 17 | 13 | 0 |
| e-signature software | 18 | 12 | 0 |
How we got these numbers
One ChatGPT run (with web search) on October 26, 2026: 5 buyer questions in each of 20 categories, 100 answers in total. Name variants of the same product are counted once. This covers ChatGPT only, and a single run is a small sample. See how question wording changes the answers.
The free check asks ChatGPT 5 buyer questions for your category, after you confirm your email.