{"id":12309,"date":"2026-07-24T04:34:51","date_gmt":"2026-07-23T20:34:51","guid":{"rendered":"http:\/\/longzhuplatform.com\/?p=12309"},"modified":"2026-07-24T04:34:51","modified_gmt":"2026-07-23T20:34:51","slug":"ai-search-is-working-how-to-prove-it-with-real-tests-via-sejournal-hethr_campbell","status":"publish","type":"post","link":"http:\/\/longzhuplatform.com\/?p=12309","title":{"rendered":"AI Search is Working. How to Prove It With Real Tests. via @sejournal, @hethr_campbell"},"content":{"rendered":"<p><\/p> <div id=\"narrow-cont\"> <p dir=\"ltr\" data-sourcepos=\"19:1-19:236;968-1203\">Adding FAQ sections to a set of test pages lifted AI citations. Removing them dropped citations back down.<\/p> <p dir=\"ltr\" data-sourcepos=\"19:1-19:236;968-1203\">That reversion is the difference between correlation and causation, and almost no team measuring AI search today can produce it.<\/p> <p dir=\"ltr\" data-sourcepos=\"21:1-21:365;1205-1569\">That standard of proof anchored the latest SEJ webinar with seoClarity\u2019s Mark Traphagen, VP of Product Marketing &amp; Training, Mihir Naik, Senior Product Manager, AI, and Suraj Lalchandani, Sr. IT Project Manager. Their core argument: \u201cVisibility scores tell you if you showed up. Page-level performance and split testing tell you if what you did actually mattered.\u201d<\/p> <p dir=\"ltr\" data-sourcepos=\"23:1-23:364;1571-1934\">The session walked through the split testing methodology seoClarity\u2019s enterprise clients run across ChatGPT, Claude, Perplexity, Gemini, and Google\u2019s AI surfaces: how to build a funnel-spanning golden set of prompts, how to construct a control group when LLMs will not let you A\/B test, and where Google\u2019s new first-party Search Console AI data fits.<\/p> <p dir=\"ltr\" data-sourcepos=\"25:1-25:160;1936-2095\">They also shared results from three real client tests, including the one change that moved citations and two results nobody in the room predicted.<\/p> <p dir=\"ltr\" data-sourcepos=\"27:1-27:87;2097-2183\">Watch the full webinar on demand to get the complete testing methodology.<\/p> <h2 dir=\"ltr\" data-sourcepos=\"29:1-29:70;2185-2254\">Can You Finally See AI Search Visibility In Google Search Console?<\/h2> <p dir=\"ltr\" data-sourcepos=\"31:1-31:202;2256-2457\">For a subset of sites, yes. On June 3, Google launched dedicated Search Console reports for AI Overviews and AI Mode, showing page by page how often each URL appears inside Google\u2019s AI search features.<\/p> <p dir=\"ltr\" data-sourcepos=\"33:1-33:233;2459-2691\">Lalchandani called it the biggest measurement upgrade AI search testing has received. \u201cThis has been the hardest thing to measure in AI search. Everyone was sampling. Everyone was inferring. But now Google is just giving it to you.\u201d<\/p> <p dir=\"ltr\" data-sourcepos=\"35:1-35:310;2693-3002\">First-party data straight from the source carries a different level of trust than any third-party tool. But the team was direct about the limitations: the new reports cover only part of what an AI search testing program needs, and ChatGPT, Claude, and Perplexity still require structured third-party tracking.<\/p> <p dir=\"ltr\" data-sourcepos=\"37:1-37:193;3004-3196\">In the session, the team maps exactly which gaps the new reports close, which they leave open, and the platform-by-platform reference for what each AI engine can crawl and render.<\/p> <p dir=\"ltr\" data-sourcepos=\"39:1-39:161;3198-3358\">Action item: Check Search Console for the new AI reports, then see where first-party data fits your testing program before you build around it.<\/p> <h2 dir=\"ltr\" data-sourcepos=\"41:1-41:53;3360-3412\">Which Prompts Should You Test First In AI Search?<\/h2> <p dir=\"ltr\" data-sourcepos=\"43:1-43:271;3414-3684\">The ones where you are almost winning. The team builds a golden set of prompts spanning the full AI search funnel, awareness through retention, with every prompt tagged by stage, then sorts each prompt into tiers by where the brand currently stands in the AI\u2019s response.<\/p> <p dir=\"ltr\" data-sourcepos=\"45:1-45:130;3686-3815\">Tier 1 prompts are the easy wins. As Lalchandani put it, \u201cYou\u2019re relevant, but AI just hasn\u2019t been given a URL worth linking to.\u201d<\/p> <p dir=\"ltr\" data-sourcepos=\"47:1-47:128;3817-3944\">Tier 2 is the heavier lift, and one bucket of prompts gets dropped from testing entirely, a move that surprised many attendees.<\/p> <p dir=\"ltr\" data-sourcepos=\"49:1-49:278;3946-4223\">The sequencing is deliberate: early wins buy the political capital to run harder tests later. The session covers how to build and tag the golden prompt set, how the tiers are defined, and the tracking unit that pairs each prompt with the exact page you want cited.<\/p> <h2 dir=\"ltr\" data-sourcepos=\"51:1-51:42;4225-4266\">How Do You Run A Split Test On An LLM?<\/h2> <p dir=\"ltr\" data-sourcepos=\"53:1-53:178;4268-4445\">You cannot split live traffic 50-50, so you build a control group instead: a set of correlated pages that acts as your noise filter against model updates and algorithmic shifts.<\/p> <p dir=\"ltr\" data-sourcepos=\"55:1-55:141;4447-4587\">\u201cWithout a control group, every result would be guesswork,\u201d Lalchandani said. \u201cWith one, you can tell a real win from the background noise.\u201d<\/p> <p dir=\"ltr\" data-sourcepos=\"57:1-57:316;4589-4904\">Timing is the discipline most teams skip. The methodology sets a specific baseline period before any change goes live and a minimum test window after, because AI search does not respond overnight the way traditional SEO sometimes does. Cut the window short and, in Lalchandani\u2019s words, \u201cyou could be reading noise.\u201d<\/p> <p dir=\"ltr\" data-sourcepos=\"59:1-59:263;4906-5168\">Every test lands in one of three outcomes, and each one tells you something about your hypothesis. The full session walks through how to construct the correlated control group, the exact baseline and test windows, and how to read all three outcomes.<\/p> <p dir=\"ltr\" data-sourcepos=\"61:1-61:78;5170-5247\">Watch the full webinar on demand to get the complete test setup.<\/p> <h2 dir=\"ltr\" data-sourcepos=\"63:1-63:66;5249-5314\">The FAQ Test That Proved Causation, And Two Tests That Did Not<\/h2> <p dir=\"ltr\" data-sourcepos=\"65:1-65:121;5316-5436\">seoClarity ran the same methodology for three clients and got three very different outcomes, which is exactly the point.<\/p> <p dir=\"ltr\" data-sourcepos=\"67:1-67:445;5438-5882\">The FAQ test was the clear win. With roughly 1,000 prompts under measurement, adding FAQ sections to test pages pushed citations up versus control, and they stayed elevated as long as the change was live. Then the team reverted the change. \u201cThe citations fell back down. That\u2019s the second half of proof. Not that citations just went up when we added FAQs, but that they went back down when we took them away. That\u2019s causation, not correlation.\u201d<\/p> <p dir=\"ltr\" data-sourcepos=\"69:1-69:244;5884-6127\">The other two tests, one on meta descriptions and one on listicle formatting, ended very differently, and the reasons why hold lessons for anyone about to invest in either tactic. See how both tests played out in the full session.<\/p> <p dir=\"ltr\" data-sourcepos=\"71:1-71:139;6129-6267\">Naik\u2019s framing: every result is a win, because you have evidence instead of guesses. That is more than most teams in AI search have today.<\/p> <p dir=\"ltr\" data-sourcepos=\"73:1-73:233;6269-6501\">The session also lays out the schema and markdown test blueprints, two of the most argued questions in AEO right now, plus a set of fast structural tests for high-value templates you can run in a few weeks.<\/p> <h2 dir=\"ltr\" data-sourcepos=\"75:1-75:48;6503-6550\">Q&amp;A: Most Helpful Questions from the Webinar<\/h2> <h3 dir=\"ltr\" data-sourcepos=\"77:1-77:80;6552-6631\">Q: How do you measure AI authority when there is no clean authority metric?<\/h3> <p dir=\"ltr\" data-sourcepos=\"79:1-79:247;6633-6879\">\u201cAI authority is basically how much the model trusts you as a source for this topic. I don\u2019t think there\u2019s a clean number for it or a single number for it, but there\u2019s a couple of signals that you can stack to give you kind of a working picture.\u201d<\/p> <p dir=\"ltr\" data-sourcepos=\"81:1-81:331;6881-7211\">Lalchandani named four stackable signals, starting with citation share on your top prompts and cross-engine consistency, because \u201cconsistency across engines just means that you become the authoritative source in your category for specific kinds of questions.\u201d He walks through all four, and how to track them, in the full session.<\/p> <h3 dir=\"ltr\" data-sourcepos=\"83:1-83:71;7213-7283\">Q: Can AI bots read FAQ answers hidden behind collapsible toggles?<\/h3> <p dir=\"ltr\" data-sourcepos=\"85:1-85:86;7285-7370\">\u201cCollapsible can mean many different things. It\u2019s how you are having it collapsible.\u201d<\/p> <p dir=\"ltr\" data-sourcepos=\"87:1-87:423;7372-7794\">It depends entirely on implementation: one common setup keeps collapsed FAQs fully readable to AI search engines and Google, and another makes the content invisible to both, because \u201ceven Google will not click around on your site.\u201d Lalchandani explains which is which in the recording, with his standing advice attached: \u201cIf you\u2019re unsure of something, just test it out. It takes effort, but it\u2019ll give you a sure answer.\u201d<\/p> <h3 dir=\"ltr\" data-sourcepos=\"89:1-89:79;7796-7874\">Q: What is the ROI of an AI citation that does not drive referral traffic?<\/h3> <p dir=\"ltr\" data-sourcepos=\"91:1-91:103;7876-7978\">\u201cYou want to be cited because you are controlling the answer that is actually going to be showing up.\u201d<\/p> <p dir=\"ltr\" data-sourcepos=\"93:1-93:502;7980-8481\">Even without a click, Naik explained, your cited page shapes the narrative inside the answer, especially in comparison queries where citations do the heavy work of positioning both brands. The question shifts from traffic to representation: are your USPs highlighted correctly, is the comparison set right, are inaccuracies surfacing. Lalchandani added a cautionary example from a real restaurant client that shows exactly what happens when AI cannot reach your content, told in full in the recording.<\/p> <h3 dir=\"ltr\" data-sourcepos=\"95:1-95:78;8483-8560\">Q: Is traditional SEO still a factor in moving the AI findability needle?<\/h3> <p dir=\"ltr\" data-sourcepos=\"97:1-97:56;8562-8617\">\u201cAbsolutely. It is foundational. It is the foundation.\u201d<\/p> <p dir=\"ltr\" data-sourcepos=\"99:1-99:376;8619-8994\">Traphagan noted that seoClarity\u2019s longest-standing clients, the ones with well-optimized content and technically healthy sites, are also performing best in AI search, with AI optimization as the extra layer on top. Lalchandani added: \u201cWhen we run tests with our clients, we\u2019ve rarely, if ever, found a situation where something works for SEO and does not work for AI search.\u201d<\/p> <h2 dir=\"ltr\" data-sourcepos=\"101:1-101:26;8996-9021\">Watch the Full Webinar<\/h2> <p dir=\"ltr\" data-sourcepos=\"103:1-103:377;9023-9399\">The on-demand recording contains everything the recap holds back: the golden prompt set build, the tier definitions, the control group construction with exact baseline and test windows, the platform-by-platform crawler reference, the meta description and listicle results, and the schema and markdown test blueprints. Register to watch the full session on demand.<\/p> <p><iframe width=\"510\" height=\"420\" style=\"border: var(--border-1) solid #CCC; border-width: 1px; margin-bottom: 5px; max-width: 100%;\" src=\"https:\/\/www.slideshare.net\/slideshow\/embed_code\/key\/rJezOU8OvMsdkg\" frameborder=\"0\" marginwidth=\"0\" marginheight=\"0\" scrolling=\"no\" allowfullscreen=\"allowfullscreen\" title=\"AI Search is Working. How to Prove It With Real Tests.\" loading=\"lazy\"><\/iframe><\/p> <\/div> <p>Generative AI,SEO Strategy#Search #Working #Prove #Real #Tests #sejournal #hethr_campbell1784838891<\/p> ","protected":false},"excerpt":{"rendered":"<p>Adding FAQ sections to a set of test pages lifted AI citations. Removing them dropped citations back down. That reversion is the difference between correlation and causation, and almost no team measuring AI search today can produce it. That standard of proof anchored the latest SEJ webinar with seoClarity\u2019s Mark Traphagen, VP of Product Marketing [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":12310,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[16],"tags":[81,17403,454,95,80,1706,4842],"class_list":["post-12309","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-accessibility","tag-hethr_campbell","tag-prove","tag-real","tag-search","tag-sejournal","tag-tests","tag-working"],"acf":[],"_links":{"self":[{"href":"http:\/\/longzhuplatform.com\/index.php?rest_route=\/wp\/v2\/posts\/12309","targetHints":{"allow":["GET"]}}],"collection":[{"href":"http:\/\/longzhuplatform.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/longzhuplatform.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/longzhuplatform.com\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"http:\/\/longzhuplatform.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=12309"}],"version-history":[{"count":0,"href":"http:\/\/longzhuplatform.com\/index.php?rest_route=\/wp\/v2\/posts\/12309\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"http:\/\/longzhuplatform.com\/index.php?rest_route=\/wp\/v2\/media\/12310"}],"wp:attachment":[{"href":"http:\/\/longzhuplatform.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=12309"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/longzhuplatform.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=12309"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/longzhuplatform.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=12309"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}