{"id":2732,"date":"2026-02-03T22:28:30","date_gmt":"2026-02-03T14:28:30","guid":{"rendered":"http:\/\/longzhuplatform.com\/?p=2732"},"modified":"2026-02-03T22:28:30","modified_gmt":"2026-02-03T14:28:30","slug":"googles-biggest-crawling-challenges-are-faceted-navigation-action-parameters-and-more","status":"publish","type":"post","link":"http:\/\/longzhuplatform.com\/?p=2732","title":{"rendered":"Google\u2019s biggest crawling challenges are faceted navigation, action parameters and more"},"content":{"rendered":"<p><\/p> <div id=\"articleContent\" itemprop=\"articlebody\"> <div class=\"bialty-container\"> <p>Google spoke about its year-end report on the crawling challenges Google faced in 2025 when crawling and indexing the web for Google Search. The biggest challenges include faceted navigation and action parameters, which make up about 75% of those challenges, Gary Illyes from Google said. This was on its latest Search Off the Record podcast, published this morning.<\/p> <p><strong>What is the issue. <\/strong>Crawling issues can cause your site to lag and slow, it can overload your server, and make your website unusable and inaccessible. If a robot goes off on your site and gets into some infinite loop of crawling, it can take some time for the site to recover.<\/p> <p>\u201cOnce it discovers a set of URLs, it cannot make a decision about whether that URL space is good or not unless it crawled a large chunk of that URL space,\u201d Gary said. By then it is too late and your site has slowed to a halt. <\/p> <p><strong>The biggest crawling challenges. <\/strong>Here are the biggest crawling challenges based on the report:<\/p> <ul class=\"wp-block-list\"> <li>50% are related to <strong>faceted navigation<\/strong>. This is a common issue for e-commerce sites where you can have infinite ways to filter products by size, colors, price, and so on.<\/li> <li>25% are related to <strong>action parameters<\/strong>. This is when URL parameters that trigger a specific action rather than changing the page content significantly.<\/li> <li>10% are related to <strong>irrelevant parameters<\/strong>. These are things like session IDs, UTMs or other parameters in the URL.<\/li> <li>5% are related to <strong>plugins or widgets<\/strong>. Some plugins or widgets can cause URL issues and confuse crawlers.<\/li> <li>2% are related to other \u201c<strong>weird stuff.\u201d <\/strong>This is like a catch all of URL issues including issues like double-encoding URLs.<\/li> <\/ul> <p><strong>Why we care<\/strong>. Ensuring you have a good URL structure, without many of these URL traps for bots is essential for (1) making sure your server is healthy, (2) your pages load quickly and (3) search engines don\u2019t get confused on what are your canonical URLs.<\/p> <p><strong>The recording. <\/strong>Here is an embed of the podcast recording:<\/p> <p><iframe loading=\"lazy\" title=\"Libsyn Player\" style=\"border: none\" src=\"https:\/\/searchengineland.com\/about:blank\" height=\"90\" width=\"100%\" scrolling=\"no\" allowfullscreen=\"\" webkitallowfullscreen=\"\" mozallowfullscreen=\"\" oallowfullscreen=\"\" msallowfullscreen=\"\" data-rocket-lazyload=\"fitvidscompatible\" data-lazy-src=\"https:\/\/html5-player.libsyn.com\/embed\/episode\/id\/39977255\/height\/90\/theme\/custom\/thumbnail\/yes\/direction\/forward\/render-playlist\/no\/custom-color\/ececec\/\"><\/iframe><noscript><iframe loading=\"lazy\" title=\"Libsyn Player\" style=\"border: none\" src=\"https:\/\/html5-player.libsyn.com\/embed\/episode\/id\/39977255\/height\/90\/theme\/custom\/thumbnail\/yes\/direction\/forward\/render-playlist\/no\/custom-color\/ececec\/\" height=\"90\" width=\"100%\" scrolling=\"no\" allowfullscreen=\"\" webkitallowfullscreen=\"\" mozallowfullscreen=\"\" oallowfullscreen=\"\" msallowfullscreen=\"\"><\/iframe><\/noscript> <\/div> <hr\/> <p class=\"article-disclosure\"> <em>Search Engine Land is owned by Semrush. We remain committed to providing high-quality coverage of marketing topics. Unless otherwise noted, this page\u2019s content was written by either an employee or a paid contractor of Semrush Inc.<\/em> <\/p> <hr\/> <div class=\"author-about py-4\"> <div class=\"card bg-light\"> <div class=\"row gx-0\"> <div class=\"col-12 col-lg-auto\"> <div class=\"authorImage p-2\"> <img loading=\"lazy\" decoding=\"async\" class=\"img-fluid rounded avatar-border\" alt=\"Barry Schwartz\" width=\"140\" height=\"140\" src=\"https:\/\/searchengineland.com\/wp-content\/seloads\/2025\/05\/1630496745425.jpeg\" title=\"Google\u2019s biggest crawling challenges are faceted navigation, action parameters and more\u63d2\u56fe\" \/><img loading=\"lazy\" decoding=\"async\" class=\"img-fluid rounded avatar-border\" src=\"https:\/\/searchengineland.com\/wp-content\/seloads\/2025\/05\/1630496745425.jpeg\" alt=\"Barry Schwartz\" width=\"140\" height=\"140\" title=\"Google\u2019s biggest crawling challenges are faceted navigation, action parameters and more\u63d2\u56fe1\" \/> <\/div> <\/p><\/div> <div class=\"col-12 col-lg\"> <div class=\"card-body author-body p-2\"> <div id=\"authorBio-251\" class=\"author-desc\"> <p>Barry Schwartz is a technologist and a Contributing Editor to Search Engine Land and a member of the programming team for SMX events. He owns RustyBrick, a NY based web consulting firm. He also runs Search Engine Roundtable, a popular search blog on very advanced SEM topics.<\/p> <p>In 2019, Barry was awarded the Outstanding Community Services Award from Search Engine Land, in 2018 he was awarded the US Search Awards the &#8220;US Search Personality Of The Year,&#8221; you can learn more over here and in 2023 he was listed as a top 50 most influential PPCer by Marketing O&#8217;Clock.<\/p> <p>Barry can be followed\u00a0<a href=\"https:\/\/twitter.com\/rustybrick\/\">on X here<\/a>\u00a0and you can learn more about\u00a0Barry Schwartz over here or on his personal site.<\/p> <\/p><\/div> <\/p><\/div> <\/p><\/div> <\/p><\/div> <\/p><\/div> <\/div> <p> <!-- START SIDEBAR LOWER SPACE --><\/p> <p><!-- END SIDEBAR LOWER SPACE --><\/p><\/div> <p><script async src=\"\/\/platform.twitter.com\/widgets.js\" charset=\"utf-8\"><\/script>News#Googles #biggest #crawling #challenges #faceted #navigation #action #parameters1770128910<\/p> ","protected":false},"excerpt":{"rendered":"<p>Google spoke about its year-end report on the crawling challenges Google faced in 2025 when crawling and indexing the web for Google Search. The biggest challenges include faceted navigation and action parameters, which make up about 75% of those challenges, Gary Illyes from Google said. This was on its latest Search Off the Record podcast, [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":2733,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[18],"tags":[209,2377,1979,4675,8462,179,382,83,8463],"class_list":["post-2732","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-careers","tag-action","tag-biggest","tag-challenges","tag-crawling","tag-faceted","tag-googles","tag-navigation","tag-news","tag-parameters"],"acf":[],"_links":{"self":[{"href":"http:\/\/longzhuplatform.com\/index.php?rest_route=\/wp\/v2\/posts\/2732","targetHints":{"allow":["GET"]}}],"collection":[{"href":"http:\/\/longzhuplatform.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/longzhuplatform.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/longzhuplatform.com\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"http:\/\/longzhuplatform.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=2732"}],"version-history":[{"count":0,"href":"http:\/\/longzhuplatform.com\/index.php?rest_route=\/wp\/v2\/posts\/2732\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"http:\/\/longzhuplatform.com\/index.php?rest_route=\/wp\/v2\/media\/2733"}],"wp:attachment":[{"href":"http:\/\/longzhuplatform.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=2732"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/longzhuplatform.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=2732"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/longzhuplatform.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=2732"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}