{"id":207096,"date":"2022-07-12T15:46:18","date_gmt":"2022-07-12T07:46:18","guid":{"rendered":"https:\/\/seo-hacker.com\/?p=207096"},"modified":"2022-12-14T22:59:08","modified_gmt":"2022-12-14T14:59:08","slug":"googlebot-crawl-limit","status":"publish","type":"post","link":"https:\/\/seo-hacker.com\/googlebot-crawl-limit\/","title":{"rendered":"15MB Only for Googlebot Today"},"content":{"rendered":"

\"googlebot<\/a><\/p>\n

When Google decided to update its official documents in June 2022, SEO practitioners and specialists started worrying about a particular piece of content that\u2019s been added to the Googlebot crawl limit. Stated within Googlebot\u2019s official Google documentation is the following statement:<\/p>\n

\u201cGooglebot can crawl the first 15MB of an HTML or support text-based file. Any resources referenced in the HTML such as images, videos, CSS, and JavaScript are fetched separately. After the first 15MB of the file, Googlebot stops crawling and only considers the first 15MB of the file for indexing. The file size limit is applied to the uncompressed data\u2026<\/em>\u201d<\/p>\n

Source: Googlebot<\/a><\/p>\n

<\/p>\n

What is Googlebot?<\/h2>\n

Googlebot is the official generic name for Google\u2019s website crawler. It’s currently responsible for gathering information from your website for SEO assessment. It provides essential information to Google on whether to index a web page or not.<\/p>\n

Googlebot is separated into two types- Googlebot Desktop and Googlebot Smartphone. As the name suggests, these two work hand-in-hand in determining whether Google should index a website under Desktop and Mobile platforms.<\/p>\n

So how does the 15MB Googlebot crawl limit factor into all these?<\/p>\n

Boundaries of the 15MB Crawl Limit<\/h2>\n

The 15MB crawl limit is the standard limit set for both Googlebot Desktop and Smartphone. Being applied only to the text encoded within the HTML file or the supported text-based file of the web page.<\/p>\n

This translates to the Googlebot crawl limit setting its boundaries within the text in your HTML file. The same texts can be found whenever one inspects the page source of a web page.<\/p>\n

\"Sample<\/p>\n

But what does this mean for the images, videos, CSS, and JavaScript resources being utilized within the HTML file? Consider the quoted text below,<\/p>\n

\u201c\u2026resources referenced in HTML such as images, videos, CSS, and JavaScript are fetched separately<\/strong>\u2026<\/em>\u201d<\/p>\n

This statement simply means that the 15MB crawl limit for Googlebot doesn\u2019t take into account the file sizes of resources being referenced in an HTML file. For example, when an image is apparent on a web page, it is usually defined by a line of code.<\/p>\n

\"Sample<\/p>\n

Whenever an image is defined through a URL- this DOES NOT account for the 15MB crawl limit. This is because the image is “referenced” from a different URL rather than being “encoded” within the HTML file itself.<\/p>\n

The difference between Referencing and Encoding<\/h2>\n

Referencing a media or resource within an HTML file means it is only called or accessed from a different URL outside of your web page. Like a person placing an object in his\/her bag instead of carrying it. This way, it\u2019s easier to store and access the object while retaining free movement. When something is \u201cencoded\u201d, this translates to placing a file purely onto another. A person that prefers to carry an object around that limits his\/her movement in the process.
\nThere are currently no means of encoding a media file like an image or a video into your HTML file. But on the other hand, it\u2019s possible to encode CSS and JavaScript codes into an HTML file.<\/p>\n

What does this imply?<\/p>\n

Including these codes into your HTML file contributes to additional lines of code. And extra lines of code allow your HTML file to reach the 15MB Googlebot crawl limit.<\/p>\n

The Truth About the 15MB Googlebot Crawl Limit<\/h2>\n

It is a fact that a web page builder will almost always NEVER reach the 15MB Googlebot crawl limit that is set for indexing an HTML file. In a tweet by John Mueller, a search advocate at Google; Reaching the 15MB in your HTML file is equivalent to roughly 16 novels of which the manuscript is transferred to an HTML file.<\/p>\n

\"Sample<\/p>\n

Source: Twitter<\/a><\/p>\n

From a developer\u2019s perspective, it\u2019s considered an absurd amount of lines of code to place in your HTML. There will always be efficient means of building a web page, especially with site speed being considered a huge factor in website ranking. If one is curious about testing how big an HTML file is for a web page, consider using the tool DebugBear\u2019s HTML Size Analyzer<\/a>.<\/p>\n

Googlebot\u2019s 15MB crawl limit and Site speed
\nBeing unable to reach the 15MB Googlebot crawl limit shouldn’t be an excuse to ignore site speed optimizations for a website. Google considers user experience as one of the biggest factors affecting website rank. This involves how fast can a web browser load a web page\u2019s resources and elements.<\/p>\n

The crawl limit is meant to serve as a guide for indexing and does not guarantee rank. The media and resources file not being factored into the crawl limit is not an excuse to ignore the resources a web browser loads.<\/p>\n

Site speed should always be considered when referencing media or resources on your website.<\/p>\n

Learn more about Site Speed Optimization here<\/a>.<\/p>\n

Key Takeaway<\/h2>\n

The newly included statement in Googlebot\u2019s official documentation about the Googlebot 15MB crawl limit should not intimidate SEO practitioners and specialists. It should instead serve as a reminder to keep in mind how an SEO-friendly web page should be built.<\/p>\n

Even with the recent Google Algorithms rewarding a content-based SEO strategy, it\u2019s almost impossible to reach the 15MB crawl limit for a single web page. User experience, site speed, and continuous publication of unique content are still the priority in creating a well-optimized website.<\/p>\n

If you want to learn more about creating a well-optimized and SEO-friendly website, check out Learn SEO: The Complete Guide for Beginners<\/a>!<\/p>\n","protected":false},"excerpt":{"rendered":"","protected":false},"author":3,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"wl_entities_gutenberg":"","footnotes":""},"categories":[100005,100008],"tags":[200260,103289,200259,102193,101463],"wl_entity_type":[102583],"class_list":["post-207096","post","type-post","status-publish","format-standard","hentry","category-google-and-other-search-engine-news","category-seo","tag-google-website-crawler","tag-googlebot","tag-googlebot-crawl-limit","tag-seo-advice","tag-seo-news","wl_entity_type-article"],"acf":[],"yoast_head":"\nHow 15 MB Google Crawl Limit Affects SEO<\/title>\n<meta name=\"description\" content=\"Need answers about the Googlebot crawl limit? Here is all you need to know about Googlebot and how the 15MB indexing limit affects SEO.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/seo-hacker.com\/googlebot-crawl-limit\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"How 15 MB Google Crawl Limit Affects SEO\" \/>\n<meta property=\"og:description\" content=\"Need answers about the Googlebot crawl limit? Here is all you need to know about Googlebot and how the 15MB indexing limit affects SEO.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/seo-hacker.com\/googlebot-crawl-limit\/\" \/>\n<meta property=\"og:site_name\" content=\"SEO Services Agency in Manila, Philippines\" \/>\n<meta property=\"article:published_time\" content=\"2022-07-12T07:46:18+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2022-12-14T14:59:08+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/seo-hacker.com\/wp-content\/uploads\/2022\/07\/Googlebots-15MB-Crawl-Limit_cover-photo.jpg\" \/>\n<meta name=\"author\" content=\"Sean Si\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/seo-hacker.com\\\/googlebot-crawl-limit\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/seo-hacker.com\\\/googlebot-crawl-limit\\\/\"},\"author\":{\"name\":\"Sean Si\",\"@id\":\"https:\\\/\\\/seo-hacker.com\\\/#\\\/schema\\\/person\\\/5565b7823135bb49dd1618bbcaec2dbf\"},\"headline\":\"15MB Only for Googlebot Today\",\"datePublished\":\"2022-07-12T07:46:18+00:00\",\"dateModified\":\"2022-12-14T14:59:08+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/seo-hacker.com\\\/googlebot-crawl-limit\\\/\"},\"wordCount\":921,\"commentCount\":0,\"image\":{\"@id\":\"https:\\\/\\\/seo-hacker.com\\\/googlebot-crawl-limit\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/seo-hacker.com\\\/wp-content\\\/uploads\\\/2022\\\/07\\\/Googlebots-15MB-Crawl-Limit_cover-photo.jpg\",\"keywords\":[\"Google Website Crawler\",\"GoogleBot\",\"Googlebot Crawl Limit\",\"SEO Advice\",\"seo news\"],\"articleSection\":[\"Google and other Search engine News\",\"SEO\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\\\/\\\/seo-hacker.com\\\/googlebot-crawl-limit\\\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/seo-hacker.com\\\/googlebot-crawl-limit\\\/\",\"url\":\"https:\\\/\\\/seo-hacker.com\\\/googlebot-crawl-limit\\\/\",\"name\":\"How 15 MB Google Crawl Limit Affects SEO\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/seo-hacker.com\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/seo-hacker.com\\\/googlebot-crawl-limit\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/seo-hacker.com\\\/googlebot-crawl-limit\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/seo-hacker.com\\\/wp-content\\\/uploads\\\/2022\\\/07\\\/Googlebots-15MB-Crawl-Limit_cover-photo.jpg\",\"datePublished\":\"2022-07-12T07:46:18+00:00\",\"dateModified\":\"2022-12-14T14:59:08+00:00\",\"author\":{\"@id\":\"https:\\\/\\\/seo-hacker.com\\\/#\\\/schema\\\/person\\\/5565b7823135bb49dd1618bbcaec2dbf\"},\"description\":\"Need answers about the Googlebot crawl limit? Here is all you need to know about Googlebot and how the 15MB indexing limit affects SEO.\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/seo-hacker.com\\\/googlebot-crawl-limit\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/seo-hacker.com\\\/googlebot-crawl-limit\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/seo-hacker.com\\\/googlebot-crawl-limit\\\/#primaryimage\",\"url\":\"https:\\\/\\\/seo-hacker.com\\\/wp-content\\\/uploads\\\/2022\\\/07\\\/Googlebots-15MB-Crawl-Limit_cover-photo.jpg\",\"contentUrl\":\"https:\\\/\\\/seo-hacker.com\\\/wp-content\\\/uploads\\\/2022\\\/07\\\/Googlebots-15MB-Crawl-Limit_cover-photo.jpg\",\"width\":1024,\"height\":768,\"caption\":\"googlebot crawl limit\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/seo-hacker.com\\\/googlebot-crawl-limit\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/seo-hacker.com\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"15MB Only for Googlebot Today\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/seo-hacker.com\\\/#website\",\"url\":\"https:\\\/\\\/seo-hacker.com\\\/\",\"name\":\"SEO Services Agency in Manila, Philippines\",\"description\":\"SEO Hacker is an SEO Agency and SEO Blog in the Philippines. Let us take your website to the top of the search results with our holistic white-hat strategies. Inquire today!\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/seo-hacker.com\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/seo-hacker.com\\\/#\\\/schema\\\/person\\\/5565b7823135bb49dd1618bbcaec2dbf\",\"name\":\"Sean Si\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/3225fbc3fa29eafa997934ff429b9b1949121b469f7a110079f055ad4eeffd25?s=96&d=mm&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/3225fbc3fa29eafa997934ff429b9b1949121b469f7a110079f055ad4eeffd25?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/3225fbc3fa29eafa997934ff429b9b1949121b469f7a110079f055ad4eeffd25?s=96&d=mm&r=g\",\"caption\":\"Sean Si\"},\"description\":\"Sean Si is a Filipino motivational speaker and a Leadership Speaker in the Philippines. He is the head honcho and editor-in-chief of SEO Hacker. He does SEO Services for companies in the Philippines and Abroad. Connect with him at Facebook, LinkedIn or Twitter. Check out his new project...\",\"sameAs\":[\"https:\\\/\\\/sean.si\"]}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"How 15 MB Google Crawl Limit Affects SEO","description":"Need answers about the Googlebot crawl limit? Here is all you need to know about Googlebot and how the 15MB indexing limit affects SEO.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/seo-hacker.com\/googlebot-crawl-limit\/","og_locale":"en_US","og_type":"article","og_title":"How 15 MB Google Crawl Limit Affects SEO","og_description":"Need answers about the Googlebot crawl limit? Here is all you need to know about Googlebot and how the 15MB indexing limit affects SEO.","og_url":"https:\/\/seo-hacker.com\/googlebot-crawl-limit\/","og_site_name":"SEO Services Agency in Manila, Philippines","article_published_time":"2022-07-12T07:46:18+00:00","article_modified_time":"2022-12-14T14:59:08+00:00","og_image":[{"url":"https:\/\/seo-hacker.com\/wp-content\/uploads\/2022\/07\/Googlebots-15MB-Crawl-Limit_cover-photo.jpg","type":"","width":"","height":""}],"author":"Sean Si","schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/seo-hacker.com\/googlebot-crawl-limit\/#article","isPartOf":{"@id":"https:\/\/seo-hacker.com\/googlebot-crawl-limit\/"},"author":{"name":"Sean Si","@id":"https:\/\/seo-hacker.com\/#\/schema\/person\/5565b7823135bb49dd1618bbcaec2dbf"},"headline":"15MB Only for Googlebot Today","datePublished":"2022-07-12T07:46:18+00:00","dateModified":"2022-12-14T14:59:08+00:00","mainEntityOfPage":{"@id":"https:\/\/seo-hacker.com\/googlebot-crawl-limit\/"},"wordCount":921,"commentCount":0,"image":{"@id":"https:\/\/seo-hacker.com\/googlebot-crawl-limit\/#primaryimage"},"thumbnailUrl":"https:\/\/seo-hacker.com\/wp-content\/uploads\/2022\/07\/Googlebots-15MB-Crawl-Limit_cover-photo.jpg","keywords":["Google Website Crawler","GoogleBot","Googlebot Crawl Limit","SEO Advice","seo news"],"articleSection":["Google and other Search engine News","SEO"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/seo-hacker.com\/googlebot-crawl-limit\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/seo-hacker.com\/googlebot-crawl-limit\/","url":"https:\/\/seo-hacker.com\/googlebot-crawl-limit\/","name":"How 15 MB Google Crawl Limit Affects SEO","isPartOf":{"@id":"https:\/\/seo-hacker.com\/#website"},"primaryImageOfPage":{"@id":"https:\/\/seo-hacker.com\/googlebot-crawl-limit\/#primaryimage"},"image":{"@id":"https:\/\/seo-hacker.com\/googlebot-crawl-limit\/#primaryimage"},"thumbnailUrl":"https:\/\/seo-hacker.com\/wp-content\/uploads\/2022\/07\/Googlebots-15MB-Crawl-Limit_cover-photo.jpg","datePublished":"2022-07-12T07:46:18+00:00","dateModified":"2022-12-14T14:59:08+00:00","author":{"@id":"https:\/\/seo-hacker.com\/#\/schema\/person\/5565b7823135bb49dd1618bbcaec2dbf"},"description":"Need answers about the Googlebot crawl limit? Here is all you need to know about Googlebot and how the 15MB indexing limit affects SEO.","breadcrumb":{"@id":"https:\/\/seo-hacker.com\/googlebot-crawl-limit\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/seo-hacker.com\/googlebot-crawl-limit\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/seo-hacker.com\/googlebot-crawl-limit\/#primaryimage","url":"https:\/\/seo-hacker.com\/wp-content\/uploads\/2022\/07\/Googlebots-15MB-Crawl-Limit_cover-photo.jpg","contentUrl":"https:\/\/seo-hacker.com\/wp-content\/uploads\/2022\/07\/Googlebots-15MB-Crawl-Limit_cover-photo.jpg","width":1024,"height":768,"caption":"googlebot crawl limit"},{"@type":"BreadcrumbList","@id":"https:\/\/seo-hacker.com\/googlebot-crawl-limit\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/seo-hacker.com\/"},{"@type":"ListItem","position":2,"name":"15MB Only for Googlebot Today"}]},{"@type":"WebSite","@id":"https:\/\/seo-hacker.com\/#website","url":"https:\/\/seo-hacker.com\/","name":"SEO Services Agency in Manila, Philippines","description":"SEO Hacker is an SEO Agency and SEO Blog in the Philippines. Let us take your website to the top of the search results with our holistic white-hat strategies. Inquire today!","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/seo-hacker.com\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/seo-hacker.com\/#\/schema\/person\/5565b7823135bb49dd1618bbcaec2dbf","name":"Sean Si","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/3225fbc3fa29eafa997934ff429b9b1949121b469f7a110079f055ad4eeffd25?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/3225fbc3fa29eafa997934ff429b9b1949121b469f7a110079f055ad4eeffd25?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/3225fbc3fa29eafa997934ff429b9b1949121b469f7a110079f055ad4eeffd25?s=96&d=mm&r=g","caption":"Sean Si"},"description":"Sean Si is a Filipino motivational speaker and a Leadership Speaker in the Philippines. He is the head honcho and editor-in-chief of SEO Hacker. He does SEO Services for companies in the Philippines and Abroad. Connect with him at Facebook, LinkedIn or Twitter. Check out his new project...","sameAs":["https:\/\/sean.si"]}]}},"_wl_alt_label":[],"jetpack_featured_media_url":"","wl:entity_url":"http:\/\/data.wordlift.io\/wl0320\/post\/15mb-only-for-googlebot-today-207096","_links":{"self":[{"href":"https:\/\/seo-hacker.com\/wp-json\/wp\/v2\/posts\/207096","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/seo-hacker.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/seo-hacker.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/seo-hacker.com\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/seo-hacker.com\/wp-json\/wp\/v2\/comments?post=207096"}],"version-history":[{"count":0,"href":"https:\/\/seo-hacker.com\/wp-json\/wp\/v2\/posts\/207096\/revisions"}],"wp:attachment":[{"href":"https:\/\/seo-hacker.com\/wp-json\/wp\/v2\/media?parent=207096"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/seo-hacker.com\/wp-json\/wp\/v2\/categories?post=207096"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/seo-hacker.com\/wp-json\/wp\/v2\/tags?post=207096"},{"taxonomy":"wl_entity_type","embeddable":true,"href":"https:\/\/seo-hacker.com\/wp-json\/wp\/v2\/wl_entity_type?post=207096"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}