AI Software Index: ChatGPT vs. Gemini
ChatGPT and Gemini disagree on the best software in a third of categories, according to a study of 9,978 answers from GetIntel’s AI Software Index. The review sites have been largely skipped over, with buyers relying instead on the live consumer apps of these AI assistants.
Key Findings:
- Coin Toss Result: In one out of every three software categories, ChatGPT and Gemini recommend different top products.
- Most Cited Domains: techradar.com (1,114 citations), Reddit (807), Zapier (418). G2, Capterra, and TrustRadius together account for 5% of all citations.
- Reddit’s Role: Reddit is a significant source of recommendations, but it’s also cracking down on fake opinions seeded by brands.
Behavior Differences:
- ChatGPT: Recommends products’ own websites (53% of the time).
- Gemini: Relies more on third-party pages, often blog posts written by other software companies.
Customer and Geography Influences:
- Identity: Being a freelancer or an enterprise changes the recommendation in some categories.
- Geography: AI assistants provide different answers based on whether the buyer is US- or UK-phrased.
Leaderboard Uncertainty:
- HubSpot: Appears on 19 leaderboards and wins 3.
- Salesforce: Appears on 13 leaderboards but doesn’t win any.
- QuickBooks: Appears on 7 leaderboards and wins 5.
Some categories are already settled, with GitHub leading in CI/CD (91%) and code review (72%), Shopify dominating e-commerce (84%), and Miro in whiteboarding (83%).