Why does ChatGPT give a different answer when you ask the same shopping question twice?

Each new chat can search again and pick up different sources. In our test, 11 of 20 products got a different store or price when asked a second time the same day.

Updated

Each new chat can run a fresh search and draw on different sources, so the same question can return a different store or price a few hours later. In Core dna's October 2026 test, 11 of 20 products got a different answer on the second ask. For the Ninja air fryer, ChatGPT first recommended Amazon Australia at $199, the correct price, then JB Hi-Fi at $127, a price JB Hi-Fi wasn't charging.

Getting the same answer twice doesn't make it right either. Nine products got the same answer both times, and six of those were wrong both times. Track how often you are named and recommended across several asks of the same question, and at what price. How do you measure AI visibility? covers what to record.

← Back to Help Center