{"id":10608,"date":"2013-08-12T18:49:48","date_gmt":"2013-08-12T13:19:48","guid":{"rendered":"https:\/\/2thenew.xyz\/blog\/?p=10608"},"modified":"2013-08-12T18:52:00","modified_gmt":"2013-08-12T13:22:00","slug":"how-to-use-crawlme","status":"publish","type":"post","link":"https:\/\/2thenew.xyz\/blog\/how-to-use-crawlme\/","title":{"rendered":"How to Use CRAWLME"},"content":{"rendered":"<p><strong>How to implement <a href=\"https:\/\/2thenew.xyz\/blog\/make-your-ajax-web-application-indexable-using-crawlme\/\">CRAWLME<\/a>?<\/strong><\/p>\n<ol>\n<li>Make you ajax app use the hashbang #! instead of just hash # in urls which allows Google to crawl and index those ajax supported urls.<\/li>\n<li>Insert the CRAWLME\u00a0middleware before your server in the chain of Connect\/Express middlewares.<\/li>\n<li>Crawlme takes care of rest.<\/li>\n<\/ol>\n<p><strong>Example:<\/strong><\/p>\n<pre>var <code>connect <\/code>=<code> <\/code>require('connect');\r\n<code>var http <\/code>=<code> <\/code>require('http');\r\n<code><span><span style=\"line-height: 19px\">var<\/span><\/span> crawlme <\/code><span style=\"font-family: 'Courier 10 Pitch', Courier, monospace;font-size: 13px;font-style: normal;line-height: 1.5\">=<\/span><code> <\/code><span style=\"font-family: 'Courier 10 Pitch', Courier, monospace;font-size: 13px;font-style: normal;line-height: 1.5\">require('crawlme');<\/span><code> <\/code>\r\nvar<code> app <\/code>=<code> <\/code>connect()<code> \u00a0 <\/code>\r\n.use(crawlme())<code> \u00a0 <\/code>\r\n.use(<code>connect<\/code>.static(<code>__dirname <\/code>+<code> <\/code>'\/webroot'));\r\n<code>http<\/code>.createServer(<code>app<\/code>).listen(3000);<\/pre>\n<p><strong>How to install CRAWLME?<\/strong><\/p>\n<pre><code>npm install crawlme<\/code><\/pre>\n<p><strong>How crawlme help pages index AJAX files?<\/strong><\/p>\n<p>When Google bot detects that your url of your page, \u00a0<em>your.server.com\/page.html#!key=value<\/em>\u00a0contains hashbang #!, it tries to get url:\u00a0<em>your.server.com\/page.html?escaped_fragment=key=value<\/em><em>\u00a0<\/em>where it finds the HTML snapshot of webpage. The method continues for all original ajax pages to generate HTML snapshot.<\/p>\n<p>Google\u0092s\u00a0<a href=\"https:\/\/support.google.com\/webmasters\/answer\/158587?hl=en\">Fetch as Googlebot<\/a>\u00a0can also be used which lets you see Google page as Google sees it.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>How to implement CRAWLME? Make you ajax app use the hashbang #! instead of just hash # in urls which allows Google to crawl and index those ajax supported urls. Insert the CRAWLME\u00a0middleware before your server in the chain of Connect\/Express middlewares. Crawlme takes care of rest. Example: var connect = require(&#8216;connect&#8217;); var http = [&hellip;]<\/p>\n","protected":false},"author":64,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"iawp_total_views":5,"footnotes":""},"categories":[1],"tags":[96,1179,33,55],"class_list":["post-10608","post","type-post","status-publish","format-standard","hentry","category-technology","tag-ajax","tag-crawlme","tag-intelligrape","tag-javascript"],"aioseo_notices":[],"aioseo_head":"\n\t\t<!-- All in One SEO 5.0.0.1 - aioseo.com -->\n\t<meta name=\"description\" content=\"How to implement CRAWLME? Make you ajax app use the hashbang #! instead of just hash # in urls which allows Google to crawl and index those ajax supported urls. Insert the CRAWLME middleware before your server in the chain of Connect\/Express middlewares. Crawlme takes care of rest. Example: var connect = require(&#039;connect&#039;); var http =\" \/>\n\t<meta name=\"robots\" content=\"max-image-preview:large\" \/>\n\t<meta name=\"author\" content=\"Shreyance Jain\"\/>\n\t<link rel=\"canonical\" href=\"https:\/\/2thenew.xyz\/blog\/how-to-use-crawlme\/\" \/>\n\t<meta name=\"generator\" content=\"All in One SEO (AIOSEO) 5.0.0.1\" \/>\n\t\t<meta property=\"og:locale\" content=\"en_US\" \/>\n\t\t<meta property=\"og:site_name\" content=\"TO THE NEW BLOG\" \/>\n\t\t<meta property=\"og:type\" content=\"blog\" \/>\n\t\t<meta property=\"og:title\" content=\"How to Use CRAWLME | TO THE NEW Blog\" \/>\n\t\t<meta property=\"og:description\" content=\"How to implement CRAWLME? Make you ajax app use the hashbang #! instead of just hash # in urls which allows Google to crawl and index those ajax supported urls. Insert the CRAWLME middleware before your server in the chain of Connect\/Express middlewares. Crawlme takes care of rest. Example: var connect = require(&#039;connect&#039;); var http =\" \/>\n\t\t<meta property=\"og:url\" content=\"https:\/\/2thenew.xyz\/blog\/how-to-use-crawlme\/\" \/>\n\t\t<meta property=\"og:image\" content=\"https:\/\/2thenew.xyz\/blog\/wp-content\/themes\/ttn\/images\/social-logo.png\" \/>\n\t\t<meta property=\"og:image:secure_url\" content=\"https:\/\/2thenew.xyz\/blog\/wp-content\/themes\/ttn\/images\/social-logo.png\" \/>\n\t\t<meta name=\"twitter:card\" content=\"summary\" \/>\n\t\t<meta name=\"twitter:site\" content=\"@tothenew\" \/>\n\t\t<meta name=\"twitter:title\" content=\"How to Use CRAWLME | TO THE NEW Blog\" \/>\n\t\t<meta name=\"twitter:description\" content=\"How to implement CRAWLME? Make you ajax app use the hashbang #! instead of just hash # in urls which allows Google to crawl and index those ajax supported urls. Insert the CRAWLME middleware before your server in the chain of Connect\/Express middlewares. Crawlme takes care of rest. Example: var connect = require(&#039;connect&#039;); var http =\" \/>\n\t\t<meta name=\"twitter:image\" content=\"https:\/\/2thenew.xyz\/blog\/wp-content\/themes\/ttn\/images\/social-logo.png\" \/>\n\t\t<script type=\"application\/ld+json\" class=\"aioseo-schema\">\n\t\t\t{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/www.tothenew.com\\\/blog\\\/how-to-use-crawlme\\\/#article\",\"name\":\"How to Use CRAWLME | TO THE NEW Blog\",\"headline\":\"How to Use CRAWLME\",\"author\":{\"@id\":\"https:\\\/\\\/www.tothenew.com\\\/blog\\\/author\\\/shreyance\\\/#author\"},\"publisher\":{\"@id\":\"https:\\\/\\\/www.tothenew.com\\\/blog\\\/#organization\"},\"datePublished\":\"2013-08-12T18:49:48+05:30\",\"dateModified\":\"2013-08-12T18:52:00+05:30\",\"inLanguage\":\"en-US\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/www.tothenew.com\\\/blog\\\/how-to-use-crawlme\\\/#webpage\"},\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.tothenew.com\\\/blog\\\/how-to-use-crawlme\\\/#webpage\"},\"articleSection\":\"Technology, Ajax, CRAWLME, Intelligrape, javascript\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/www.tothenew.com\\\/blog\\\/how-to-use-crawlme\\\/#breadcrumblist\",\"itemListElement\":[{\"@type\":\"ListItem\",\"@id\":\"https:\\\/\\\/www.tothenew.com\\\/blog#listItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/www.tothenew.com\\\/blog\",\"nextItem\":{\"@type\":\"ListItem\",\"@id\":\"https:\\\/\\\/www.tothenew.com\\\/blog\\\/category\\\/technology\\\/#listItem\",\"name\":\"Technology\"}},{\"@type\":\"ListItem\",\"@id\":\"https:\\\/\\\/www.tothenew.com\\\/blog\\\/category\\\/technology\\\/#listItem\",\"position\":2,\"name\":\"Technology\",\"item\":\"https:\\\/\\\/www.tothenew.com\\\/blog\\\/category\\\/technology\\\/\",\"nextItem\":{\"@type\":\"ListItem\",\"@id\":\"https:\\\/\\\/www.tothenew.com\\\/blog\\\/how-to-use-crawlme\\\/#listItem\",\"name\":\"How to Use CRAWLME\"},\"previousItem\":{\"@type\":\"ListItem\",\"@id\":\"https:\\\/\\\/www.tothenew.com\\\/blog#listItem\",\"name\":\"Home\"}},{\"@type\":\"ListItem\",\"@id\":\"https:\\\/\\\/www.tothenew.com\\\/blog\\\/how-to-use-crawlme\\\/#listItem\",\"position\":3,\"name\":\"How to Use CRAWLME\",\"previousItem\":{\"@type\":\"ListItem\",\"@id\":\"https:\\\/\\\/www.tothenew.com\\\/blog\\\/category\\\/technology\\\/#listItem\",\"name\":\"Technology\"}}]},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/www.tothenew.com\\\/blog\\\/#organization\",\"name\":\"TO THE NEW Blog\",\"url\":\"https:\\\/\\\/www.tothenew.com\\\/blog\\\/\"},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/www.tothenew.com\\\/blog\\\/author\\\/shreyance\\\/#author\",\"url\":\"https:\\\/\\\/www.tothenew.com\\\/blog\\\/author\\\/shreyance\\\/\",\"name\":\"Shreyance Jain\",\"image\":{\"@type\":\"ImageObject\",\"@id\":\"https:\\\/\\\/www.tothenew.com\\\/blog\\\/how-to-use-crawlme\\\/#authorImage\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/2df2db27caa4ff869f6e062b0feb0907a696f8dfa956a752248725188e4cc5bd?s=96&d=mm&r=g\",\"width\":96,\"height\":96,\"caption\":\"Shreyance Jain\"}},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/www.tothenew.com\\\/blog\\\/how-to-use-crawlme\\\/#webpage\",\"url\":\"https:\\\/\\\/www.tothenew.com\\\/blog\\\/how-to-use-crawlme\\\/\",\"name\":\"How to Use CRAWLME | TO THE NEW Blog\",\"description\":\"How to implement CRAWLME? Make you ajax app use the hashbang #! instead of just hash # in urls which allows Google to crawl and index those ajax supported urls. Insert the CRAWLME middleware before your server in the chain of Connect\\\/Express middlewares. Crawlme takes care of rest. Example: var connect = require('connect'); var http =\",\"inLanguage\":\"en-US\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.tothenew.com\\\/blog\\\/#website\"},\"breadcrumb\":{\"@id\":\"https:\\\/\\\/www.tothenew.com\\\/blog\\\/how-to-use-crawlme\\\/#breadcrumblist\"},\"author\":{\"@id\":\"https:\\\/\\\/www.tothenew.com\\\/blog\\\/author\\\/shreyance\\\/#author\"},\"creator\":{\"@id\":\"https:\\\/\\\/www.tothenew.com\\\/blog\\\/author\\\/shreyance\\\/#author\"},\"datePublished\":\"2013-08-12T18:49:48+05:30\",\"dateModified\":\"2013-08-12T18:52:00+05:30\"},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/www.tothenew.com\\\/blog\\\/#website\",\"url\":\"https:\\\/\\\/www.tothenew.com\\\/blog\\\/\",\"name\":\"TO THE NEW Blog\",\"inLanguage\":\"en-US\",\"publisher\":{\"@id\":\"https:\\\/\\\/www.tothenew.com\\\/blog\\\/#organization\"}}]}\n\t\t<\/script>\n\t\t<!-- All in One SEO -->\n\n","aioseo_head_json":{"title":"How to Use CRAWLME | TO THE NEW Blog","description":"How to implement CRAWLME? Make you ajax app use the hashbang #! instead of just hash # in urls which allows Google to crawl and index those ajax supported urls. Insert the CRAWLME middleware before your server in the chain of Connect\/Express middlewares. Crawlme takes care of rest. Example: var connect = require('connect'); var http =","canonical_url":"https:\/\/2thenew.xyz\/blog\/how-to-use-crawlme\/","robots":"max-image-preview:large","keywords":"","webmasterTools":{"miscellaneous":""},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/2thenew.xyz\/blog\/how-to-use-crawlme\/#article","name":"How to Use CRAWLME | TO THE NEW Blog","headline":"How to Use CRAWLME","author":{"@id":"https:\/\/2thenew.xyz\/blog\/author\/shreyance\/#author"},"publisher":{"@id":"https:\/\/2thenew.xyz\/blog\/#organization"},"datePublished":"2013-08-12T18:49:48+05:30","dateModified":"2013-08-12T18:52:00+05:30","inLanguage":"en-US","mainEntityOfPage":{"@id":"https:\/\/2thenew.xyz\/blog\/how-to-use-crawlme\/#webpage"},"isPartOf":{"@id":"https:\/\/2thenew.xyz\/blog\/how-to-use-crawlme\/#webpage"},"articleSection":"Technology, Ajax, CRAWLME, Intelligrape, javascript"},{"@type":"BreadcrumbList","@id":"https:\/\/2thenew.xyz\/blog\/how-to-use-crawlme\/#breadcrumblist","itemListElement":[{"@type":"ListItem","@id":"https:\/\/2thenew.xyz\/blog#listItem","position":1,"name":"Home","item":"https:\/\/2thenew.xyz\/blog","nextItem":{"@type":"ListItem","@id":"https:\/\/2thenew.xyz\/blog\/category\/technology\/#listItem","name":"Technology"}},{"@type":"ListItem","@id":"https:\/\/2thenew.xyz\/blog\/category\/technology\/#listItem","position":2,"name":"Technology","item":"https:\/\/2thenew.xyz\/blog\/category\/technology\/","nextItem":{"@type":"ListItem","@id":"https:\/\/2thenew.xyz\/blog\/how-to-use-crawlme\/#listItem","name":"How to Use CRAWLME"},"previousItem":{"@type":"ListItem","@id":"https:\/\/2thenew.xyz\/blog#listItem","name":"Home"}},{"@type":"ListItem","@id":"https:\/\/2thenew.xyz\/blog\/how-to-use-crawlme\/#listItem","position":3,"name":"How to Use CRAWLME","previousItem":{"@type":"ListItem","@id":"https:\/\/2thenew.xyz\/blog\/category\/technology\/#listItem","name":"Technology"}}]},{"@type":"Organization","@id":"https:\/\/2thenew.xyz\/blog\/#organization","name":"TO THE NEW Blog","url":"https:\/\/2thenew.xyz\/blog\/"},{"@type":"Person","@id":"https:\/\/2thenew.xyz\/blog\/author\/shreyance\/#author","url":"https:\/\/2thenew.xyz\/blog\/author\/shreyance\/","name":"Shreyance Jain","image":{"@type":"ImageObject","@id":"https:\/\/2thenew.xyz\/blog\/how-to-use-crawlme\/#authorImage","url":"https:\/\/secure.gravatar.com\/avatar\/2df2db27caa4ff869f6e062b0feb0907a696f8dfa956a752248725188e4cc5bd?s=96&d=mm&r=g","width":96,"height":96,"caption":"Shreyance Jain"}},{"@type":"WebPage","@id":"https:\/\/2thenew.xyz\/blog\/how-to-use-crawlme\/#webpage","url":"https:\/\/2thenew.xyz\/blog\/how-to-use-crawlme\/","name":"How to Use CRAWLME | TO THE NEW Blog","description":"How to implement CRAWLME? Make you ajax app use the hashbang #! instead of just hash # in urls which allows Google to crawl and index those ajax supported urls. Insert the CRAWLME middleware before your server in the chain of Connect\/Express middlewares. Crawlme takes care of rest. Example: var connect = require('connect'); var http =","inLanguage":"en-US","isPartOf":{"@id":"https:\/\/2thenew.xyz\/blog\/#website"},"breadcrumb":{"@id":"https:\/\/2thenew.xyz\/blog\/how-to-use-crawlme\/#breadcrumblist"},"author":{"@id":"https:\/\/2thenew.xyz\/blog\/author\/shreyance\/#author"},"creator":{"@id":"https:\/\/2thenew.xyz\/blog\/author\/shreyance\/#author"},"datePublished":"2013-08-12T18:49:48+05:30","dateModified":"2013-08-12T18:52:00+05:30"},{"@type":"WebSite","@id":"https:\/\/2thenew.xyz\/blog\/#website","url":"https:\/\/2thenew.xyz\/blog\/","name":"TO THE NEW Blog","inLanguage":"en-US","publisher":{"@id":"https:\/\/2thenew.xyz\/blog\/#organization"}}]},"og:locale":"en_US","og:site_name":"TO THE NEW BLOG","og:type":"blog","og:title":"How to Use CRAWLME | TO THE NEW Blog","og:description":"How to implement CRAWLME? Make you ajax app use the hashbang #! instead of just hash # in urls which allows Google to crawl and index those ajax supported urls. Insert the CRAWLME middleware before your server in the chain of Connect\/Express middlewares. Crawlme takes care of rest. Example: var connect = require('connect'); var http =","og:url":"https:\/\/2thenew.xyz\/blog\/how-to-use-crawlme\/","og:image":"https:\/\/2thenew.xyz\/blog\/wp-content\/themes\/ttn\/images\/social-logo.png","og:image:secure_url":"https:\/\/2thenew.xyz\/blog\/wp-content\/themes\/ttn\/images\/social-logo.png","twitter:card":"summary","twitter:site":"@tothenew","twitter:title":"How to Use CRAWLME | TO THE NEW Blog","twitter:description":"How to implement CRAWLME? Make you ajax app use the hashbang #! instead of just hash # in urls which allows Google to crawl and index those ajax supported urls. Insert the CRAWLME middleware before your server in the chain of Connect\/Express middlewares. Crawlme takes care of rest. Example: var connect = require('connect'); var http =","twitter:image":"https:\/\/2thenew.xyz\/blog\/wp-content\/themes\/ttn\/images\/social-logo.png"},"aioseo_meta_data":{"post_id":"10608","title":null,"description":null,"keywords":null,"keyphrases":null,"primary_term":null,"canonical_url":null,"og_title":null,"og_description":null,"og_object_type":"default","og_image_type":"default","og_image_url":null,"og_image_width":null,"og_image_height":null,"og_image_custom_url":null,"og_image_custom_fields":null,"og_video":null,"og_custom_url":null,"og_article_section":null,"og_article_tags":null,"twitter_use_og":false,"twitter_card":"default","twitter_image_type":"default","twitter_image_url":null,"twitter_image_custom_url":null,"twitter_image_custom_fields":null,"twitter_title":null,"twitter_description":null,"schema":{"blockGraphs":[],"customGraphs":[],"default":{"data":{"Article":[],"Course":[],"Dataset":[],"FAQPage":[],"Movie":[],"Person":[],"Product":[],"ProductReview":[],"Car":[],"Recipe":[],"Service":[],"SoftwareApplication":[],"WebPage":[]},"graphName":"Article","isEnabled":true},"graphs":[]},"schema_type":null,"schema_type_options":null,"pillar_content":false,"robots_default":true,"robots_noindex":false,"robots_noarchive":false,"robots_nosnippet":false,"robots_nofollow":false,"robots_noimageindex":false,"robots_noodp":false,"robots_notranslate":false,"robots_max_snippet":null,"robots_max_videopreview":null,"robots_max_imagepreview":"large","priority":null,"frequency":null,"local_seo":null,"limit_modified_date":false,"created":"2021-04-30 08:08:02","updated":"2024-02-29 10:52:24","focus_keyword":null,"additional_keywords":null,"truseo_locale":null,"ai":null,"breadcrumb_settings":null,"seo_analyzer_scan_date":null},"aioseo_breadcrumb":"<div class=\"aioseo-breadcrumbs\"><span class=\"aioseo-breadcrumb\">\n\t\t\t<a href=\"https:\/\/2thenew.xyz\/blog\" title=\"Home\">Home<\/a>\n\t\t<\/span><span class=\"aioseo-breadcrumb-separator\">&raquo;<\/span><span class=\"aioseo-breadcrumb\">\n\t\t\t<a href=\"https:\/\/2thenew.xyz\/blog\/category\/technology\/\" title=\"Technology\">Technology<\/a>\n\t\t<\/span><span class=\"aioseo-breadcrumb-separator\">&raquo;<\/span><span class=\"aioseo-breadcrumb\">\n\t\t\tHow to Use CRAWLME\n\t\t<\/span><\/div>","aioseo_breadcrumb_json":[{"label":"Home","link":"https:\/\/2thenew.xyz\/blog"},{"label":"Technology","link":"https:\/\/2thenew.xyz\/blog\/category\/technology\/"},{"label":"How to Use CRAWLME","link":"https:\/\/2thenew.xyz\/blog\/how-to-use-crawlme\/"}],"_links":{"self":[{"href":"https:\/\/2thenew.xyz\/blog\/wp-json\/wp\/v2\/posts\/10608","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/2thenew.xyz\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/2thenew.xyz\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/2thenew.xyz\/blog\/wp-json\/wp\/v2\/users\/64"}],"replies":[{"embeddable":true,"href":"https:\/\/2thenew.xyz\/blog\/wp-json\/wp\/v2\/comments?post=10608"}],"version-history":[{"count":0,"href":"https:\/\/2thenew.xyz\/blog\/wp-json\/wp\/v2\/posts\/10608\/revisions"}],"wp:attachment":[{"href":"https:\/\/2thenew.xyz\/blog\/wp-json\/wp\/v2\/media?parent=10608"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/2thenew.xyz\/blog\/wp-json\/wp\/v2\/categories?post=10608"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/2thenew.xyz\/blog\/wp-json\/wp\/v2\/tags?post=10608"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}