{"id":6148,"date":"2026-04-09T12:45:28","date_gmt":"2026-04-09T04:45:28","guid":{"rendered":"http:\/\/longzhuplatform.com\/?p=6148"},"modified":"2026-04-09T12:45:28","modified_gmt":"2026-04-09T04:45:28","slug":"openai-meta-bytedance-lead-ai-bot-traffic-in-publishing-via-sejournal-mattgsouthern","status":"publish","type":"post","link":"http:\/\/longzhuplatform.com\/?p=6148","title":{"rendered":"OpenAI, Meta, ByteDance Lead AI Bot Traffic In Publishing via @sejournal, @MattGSouthern"},"content":{"rendered":"<p><\/p> <div id=\"narrow-cont\"> <p>Akamai analyzed AI bot activity by examining application-layer traffic from its bot management tools.<\/p> <p>Commerce drew the most AI bot traffic at <strong>48%<\/strong>. Media, which includes publishing, video, social media, and broadcasting, came second at <strong>13%<\/strong>.<\/p> <p>Publishing companies accounted for <strong>40%<\/strong> of all AI bot activity in media, ahead of broadcast and OTT at <strong>29%<\/strong>.<\/p> <p>OpenAI generated the most AI bot traffic hitting media companies, with 40% of its media requests going to publishing companies. That\u2019s partly because OpenAI runs multiple bots. GPTBot handles training, OAI-SearchBot powers AI search, and ChatGPT-User retrieves content in real time.<\/p> <p>Meta and ByteDance were the second- and third-largest operators. Anthropic and Perplexity rounded out the top five at lower volumes.<\/p> <h2>Why Akamai Says Fetcher Bots Are The Bigger Concern<\/h2> <p>The report groups AI bots into four types based on behavior.<\/p> <p>Training crawlers and fetchers account for most of the AI bot activity Akamai saw in media, which includes publishing. Training crawlers collect content to build language models. They made up <strong>63%<\/strong> of AI bot activity targeting media in H2 2025.<\/p> <p>Fetcher bots grab specific pages in real time when someone asks an AI chatbot a question. They made up <strong>24%<\/strong>, and publishing accounted for <strong>43%<\/strong> of that fetcher activity.<\/p> <p>Akamai argues that fetcher bots are the more immediate revenue concern, even though training crawlers generate more total traffic. When a fetcher bot pulls an article to answer a chatbot query, the user gets the information without visiting the publisher\u2019s site.<\/p> <h2>How Publishers Are Responding<\/h2> <p>It\u2019s worth noting that Akamai sells bot management tools, and the report\u2019s recommendations point toward its own products and partners.<\/p> <p>The most common responses among Akamai\u2019s customers are deny (blocking requests outright), tarpit (holding connections open to waste bot resources), and delay (adding a pause before responding). One unnamed publisher chose tarpitting over blocking, controlled 97% of AI bot requests, and kept the door open to potential licensing deals.<\/p> <p>The report argues against blanket blocking, saying some AI companies are willing to pay for content access and that blocking all bots removes that option.<\/p> <h2>Looking Ahead<\/h2> <p>The report\u2019s top takeaway is the distinction between training crawlers and fetcher bots. Blocking a training crawler can influence how your content helps build future AI models. Blocking a fetcher bot affects whether your content appears in AI responses right now.<\/p> <hr\/> <p><em>Featured Image: <span class=\"MuiBox-root mui-16qd35q-centeredContent-avatarContainer\"><span class=\"MuiTypography-root MuiTypography-body1 mui-1w8ttpd-contributorLabel-linkAvatarLabel\">la pico de gallo<\/span><\/span>\/Shutterstock<\/em><\/p> <\/div> <p>Generative AI,News#OpenAI #Meta #ByteDance #Lead #Bot #Traffic #Publishing #sejournal #MattGSouthern1775709928<\/p> ","protected":false},"excerpt":{"rendered":"<p>Akamai analyzed AI bot activity by examining application-layer traffic from its bot management tools. Commerce drew the most AI bot traffic at 48%. Media, which includes publishing, video, social media, and broadcasting, came second at 13%. Publishing companies accounted for 40% of all AI bot activity in media, ahead of broadcast and OTT at 29%. [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":6149,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[16],"tags":[19190,22959,9012,90,166,216,12591,80,441],"class_list":["post-6148","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-accessibility","tag-bot","tag-bytedance","tag-lead","tag-mattgsouthern","tag-meta","tag-openai","tag-publishing","tag-sejournal","tag-traffic"],"acf":[],"_links":{"self":[{"href":"http:\/\/longzhuplatform.com\/index.php?rest_route=\/wp\/v2\/posts\/6148","targetHints":{"allow":["GET"]}}],"collection":[{"href":"http:\/\/longzhuplatform.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/longzhuplatform.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/longzhuplatform.com\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"http:\/\/longzhuplatform.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=6148"}],"version-history":[{"count":0,"href":"http:\/\/longzhuplatform.com\/index.php?rest_route=\/wp\/v2\/posts\/6148\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"http:\/\/longzhuplatform.com\/index.php?rest_route=\/wp\/v2\/media\/6149"}],"wp:attachment":[{"href":"http:\/\/longzhuplatform.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=6148"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/longzhuplatform.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=6148"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/longzhuplatform.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=6148"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}