What you can do about wrong AI answers
AI models sometimes give wrong prices, old addresses or offers that no longer exist, or speak badly of a brand. You can't change that inside the model, but you can in the sources it takes its information from.
How it works
A language model repeats what it learned in training or found through a web search. If a source is wrong, out of date or missing altogether, the answer is wrong. Where information is missing, models sometimes fill the gap with something made up that sounds plausible.
bytereport checks this in two ways, each with a judge model that reads the answers:
- Accuracy: you add a fact sheet to the project with the details that must be right (depending on your plan). The judge compares the answers about the brand with it and reports each contradiction with an example.
- Sentiment: the judge reads the answers to questions about the brand and to comparisons, and counts how many speak negatively about the brand.
What matters
- A precise fact sheet. Write short, verifiable details: name, legal form, location, year founded, offering, prices, what you don't offer. The more precise the sheet, the more precise the comparison.
- Find the source. An error almost always comes from somewhere. The most cited sources in the report and the links in the answers show where.
- Your own pages first. Whatever is outdated on your website gets passed on. Keep prices, addresses and offers current there; see freshness.
- Take negative answers seriously. If a model speaks badly of you, there are usually reviews or articles saying so. That is where the real work lies.
- Patience with training. What a model knows from training only changes with a new model version. Answers with web search pick up corrections more quickly.
How to correct it
- Check your website. Correct wrong or outdated details on your own pages and in your Organization data.
- Wikipedia and Wikidata. You can edit Wikidata yourself, with references. On Wikipedia you should not edit articles about your own company yourself; propose the correction on the article's talk page and cite a source.
- Directories and profiles. Update your Google Business Profile, business directories, comparison sites and social media profiles.
- Feedback in the assistant. Most apps let you rate each answer, such as with a thumbs down; this reports wrong answers directly.
A new run then shows whether the answers are right. For answers without a web search, that may take until the next model version.