Back to the Archive

LibraryFoundational AI: Do's and Don'ts8 min read

Honest Marketing Metrics in the AI Era

Connect inquiries to qualified conversations and business outcomes without pretending attribution is complete. A worked example for smaller marketing teams.

Frantic spinning gauges surround steady water-filling jars and a worn footpath, undisturbed by a swarm of insects and paper scraps.

A marketing lead can replace a weekly deck of traffic totals with a short report showing which inquiries became qualified conversations, which became opportunities, and what the team still cannot attribute. That saves the hours spent defending a rising chart while sales asks where the useful leads went. AI makes the measurement question more urgent, but the repair starts with definitions your business controls.

The temptation is to declare an old metric dead and crown a new one. Pageviews are out, branded search is in, or perhaps mentions in AI answers will finally tell the whole story. I don't trust any single number with that job. Each observes one part of a buying process, with gaps that don't disappear because the dashboard looks clean.

_Revised September 10, 2026. The original publication date is retained._

Some of the visibility changed, and some was always incomplete

Search experiences now include answers assembled with AI. Google's documentation for AI features and websites says appearances in AI Overviews and AI Mode are included in overall Search Console reporting under the Web search type. That means a familiar search report can contain activity from different experiences. It doesn't give a business a complete account of how every prospect discovered or evaluated it.

Traffic quality also needs careful language. Google Analytics automatically excludes known bots and spiders, and Google says users cannot see how much known bot traffic was excluded. So a claim that every crawler visit lands in your analytics as a person is wrong. The word known still matters: that documented filter isn't a guarantee that every remaining event represents a potential customer.

Neither fact proves that your marketing stopped working. A decline in clicks may accompany a change in search behavior, a weaker ranking, a seasonal shift, a technical problem, or a less useful article. A rise in visits may reflect relevant demand or irrelevant attention. The job is to investigate the explanation instead of choosing the one that makes the slide easiest to present.

The same caution applies to attribution. Google's attribution documentation describes how models assign credit among touchpoints on a path to a key event. Assigned credit is useful for reporting, but it isn't a controlled experiment establishing what would have happened without the channel. A model can organize observed activity without observing every influence on a buyer.

My inference from those limits is that small teams need several connected views. Use the website data to understand observed behavior, the CRM to understand the business process, and customer answers to learn about influences the tracking missed. Keep the boundaries visible. Combining sources should make the picture more informative, not create a false claim that it is complete.

Start with a qualified conversation

Agree what qualifies before counting. For a hypothetical B2B service business, a qualified conversation might require a relevant organization, a real problem the business can address, an identifiable participant, and a substantive exchange. A spam submission, job applicant, vendor pitch, or duplicate inquiry doesn't qualify. The exact rule should match the business rather than a vendor's default lifecycle stage.

Keep disqualification reasons. If marketing creates fifty inquiries and only five qualify, the other forty-five contain information. Are they outside the service area? Looking for a product you don't sell? Students researching a topic? Duplicates from the same account? Each explanation suggests a different change, and none is helped by calling the whole group low quality without evidence.

Then define the next meaningful step. A qualified conversation becomes an opportunity when there is an agreed reason to pursue work, not simply because someone moved a CRM card. The sales team should be able to explain why the opportunity exists and what happens next. Otherwise the pipeline number is as easy to inflate as the pageview total it replaced.

Use stable identifiers to connect records. One person can submit twice, attend a webinar, and reply to a newsletter. One account can include several people. Decide whether the weekly report counts people, accounts, inquiries, or opportunities, and label the number accordingly. Counting all four as if they were interchangeable is a reliable way to invent growth.

Show the denominator alongside the rate. Eight qualified conversations from twenty inquiries is forty percent. Eight from two hundred is four percent. The same numerator can describe a focused campaign or a noisy one. The denominator also helps the team spot changes in tracking, form behavior, or the definition of an inquiry.

Put acquisition cohorts beside current activity when the sales cycle spans months. Opportunities created this week may come from inquiries received much earlier. Comparing them directly with this week's campaign spending implies a relationship the calendar hasn't established. A cohort view follows inquiries from a defined period through later outcomes, even if that means some results are still incomplete.

Build a small report with an honest worked example

Imagine a month with one hundred recorded inquiries. Twenty are duplicates or spam, leaving eighty eligible inquiries. Twenty-four become qualified conversations, ten become opportunities, and three eventually close. These are invented numbers for illustration, but the sequence shows the information a useful report carries. The qualification rate is thirty percent of eligible inquiries, not twenty-four percent of all submissions.

Suppose the relevant campaign spending was $6,000. The observed spend per qualified conversation is $250. That is a defined calculation, not automatically a customer acquisition cost. It excludes costs you haven't included, and the conversations have not all become customers. Name the measure precisely so nobody mistakes a convenient intermediate number for the final economics.

If those three eventual customers came from the same cohort, the campaign spend divided by customers would be $2,000. Whether that is acceptable depends on contribution, retention, sales effort, and other acquisition costs. The report should connect to those business questions without pretending that one division answers them all. A small team can make sound decisions with incomplete data if the incompleteness is explicit.

Add the source evidence in separate fields. Keep the tracked acquisition source, the customer's answer to how they heard about you, and any specific content they mention. A person may arrive through branded search after a colleague sends an article. The tracked source and the self-reported influence can both be true. Forcing one to overwrite the other destroys useful information.

Leave unknown values visible. If thirty percent of qualified conversations have no credible source information, report that share. Don't distribute them across known channels just to make the chart add up neatly. An unknown segment is an instruction to improve collection or accept a limit. It isn't an empty space the analyst must fill with confidence.

Keep a short note beside each material change. A new form went live halfway through the period. Sales changed the qualification definition. A campaign targeted a different geography. Those facts may explain movement more directly than a clever interpretation of the chart. A useful report remembers the conditions under which the numbers were produced.

Branded search and engagement still need context

Branded search can indicate awareness, but it isn't pure new demand. Existing customers search for login pages. Job candidates research employers. A company name may overlap with another term. Segment what you can and avoid calling the entire total purchase intent. The signal becomes more useful when qualified inquiries and customer comments move in a consistent direction alongside it.

Substantive replies, shares, and return visits can add evidence too. A prospect mentioning a specific article during a sales conversation is worth recording. It tells you that the piece reached at least one relevant person and mattered enough to remember. It doesn't establish that the article caused the deal, and it doesn't need to make that claim to be useful.

Be careful with small samples. Three customers mentioning the same guide is an interesting lead for investigation. It isn't enough to declare a precise conversion lift. Read the guide, ask sales what questions it answered, and see whether the same problem appears in other conversations. Qualitative evidence can direct the next experiment without pretending to be a large study.

If you use AI to classify customer comments, keep the original text and check a sample of the classifications. An assistant can help sort mentions into themes, but a neat category can hide ambiguity. Separate an explicit mention of a channel from an inference the model made. Otherwise the system can manufacture attribution while appearing to tidy it.

When spending decisions are large enough to justify it, test a change deliberately. Define the audience, outcome, time window, and comparison before launching. A holdout or controlled experiment can answer a narrower causal question than a dashboard, provided the design and sample support the claim. If the business is too small for a useful test, say that and use converging evidence with appropriate restraint.

For weekly operations, the report can stay short. Show eligible inquiries, qualified conversations, opportunities, mature cohort outcomes, spending with its definition, and the unknown-source share. Add the few observations that explain movement and the decision they support. Keep detailed traffic reports available for diagnosis without making every available metric a headline.

The hardest part is holding definitions steady when the results disappoint. Changing what counts as qualified halfway through a weak month may make a target easier to hit while making the history unusable. If a definition genuinely needs to change, record when and why, and compare periods on a consistent basis where possible. Reporting should survive a difficult meeting.

There is no obligation to produce a victorious story every week. Sometimes the honest finding is that interest increased but suitable inquiries did not. Sometimes a smaller audience produced better conversations. Sometimes the evidence is too thin to choose between explanations. Each can support a useful next action if the report says what is known and what would resolve the uncertainty.

The strongest marketing report is the one you can still explain after someone asks to see the records behind it.

Sources

Every claim above traces back to one of these. Go read them yourself.

  1. 01
    AI features and your website

    Google / developers.google.com / retrieved Sep 10, 2026

  2. 02
    Known bot-traffic exclusion

    Google / support.google.com / retrieved Sep 10, 2026

  3. 03
    Get started with attribution

    Google / support.google.com / retrieved Sep 10, 2026