Comments on: Build a Niche Store Empire in 12 Weeks – Inbound Links Bring Spiders! http://www.thenichestorebuilder.com/build-a-niche-store-empire-in-12-weeks-inbound-links-bring-spiders.htm Learn How to Build and Market Niche Websites Tue, 18 Oct 2011 17:32:11 +0000 hourly 1 http://wordpress.org/?v=3.2.1 By: Jason Michalek http://www.thenichestorebuilder.com/build-a-niche-store-empire-in-12-weeks-inbound-links-bring-spiders.htm#comment-4070 Jason Michalek Wed, 26 Mar 2008 21:47:29 +0000 http://www.thenichestorebuilder.com/build-a-niche-store-empire-in-12-weeks-inbound-links-bring-spiders.htm#comment-4070 Does' rochelle's autoupdating sitemap apply to v3.0? I see that there is already a sitemap.php file in the directory. Should I make the changes to added this or not? Jason<div class="comment-remix-meta"><a href="#" class="replyto" onclick="replyto('4070','Jason Michalek'); return false;">Reply</a> - <a href="#" class="quote" onclick="quote('4070','Jason Michalek','Does\' rochelle\'s autoupdating sitemap apply to v3.0? I see that there is already a sitemap.php file in the directory.\r\n\r\nShould I make the changes to added this or not?\r\n\r\nJason'); return false;">Quote</a></div> Does’ rochelle’s autoupdating sitemap apply to v3.0? I see that there is already a sitemap.php file in the directory.

Should I make the changes to added this or not?

Jason

Reply – Quote
]]> By: Adding a Link Cloud Directory to your Build a Niche Store | The Niche Store Builder - Succeed with Build a Niche Store http://www.thenichestorebuilder.com/build-a-niche-store-empire-in-12-weeks-inbound-links-bring-spiders.htm#comment-4047 Adding a Link Cloud Directory to your Build a Niche Store | The Niche Store Builder - Succeed with Build a Niche Store Wed, 26 Mar 2008 17:23:44 +0000 http://www.thenichestorebuilder.com/build-a-niche-store-empire-in-12-weeks-inbound-links-bring-spiders.htm#comment-4047 [...] line: disallow: /niche-sites/buy/ If you don’t already have a robots.txt file, read the robots file for build a niche store post [...]<div class="comment-remix-meta"><a href="#" class="replyto" onclick="replyto('4047','Adding a Link Cloud Directory to your Build a Niche Store | The Niche Store Builder - Succeed with Build a Niche Store'); return false;">Reply</a> - <a href="#" class="quote" onclick="quote('4047','Adding a Link Cloud Directory to your Build a Niche Store | The Niche Store Builder - Succeed with Build a Niche Store','[...] line: disallow: \/niche-sites\/buy\/ If you don’t already have a robots.txt file, read the robots file for build a niche store post [...]'); return false;">Quote</a></div> [...] line: disallow: /niche-sites/buy/ If you don’t already have a robots.txt file, read the robots file for build a niche store post [...]
Reply – Quote
]]> By: Marilla http://www.thenichestorebuilder.com/build-a-niche-store-empire-in-12-weeks-inbound-links-bring-spiders.htm#comment-2595 Marilla Sun, 02 Mar 2008 19:03:39 +0000 http://www.thenichestorebuilder.com/build-a-niche-store-empire-in-12-weeks-inbound-links-bring-spiders.htm#comment-2595 Okay - I've read this through a couple of times and I still don't get what I'm supposed to do. Could you please add a step-by-step explanation so those of us who are newbies/having a senior moment can do this part? Thanks!<div class="comment-remix-meta"><a href="#" class="replyto" onclick="replyto('2595','Marilla'); return false;">Reply</a> - <a href="#" class="quote" onclick="quote('2595','Marilla','Okay - I\'ve read this through a couple of times and I still don\'t get what I\'m supposed to do. Could you please add a step-by-step explanation so those of us who are newbies\/having a senior moment can do this part?\r\n\r\nThanks!'); return false;">Quote</a></div> Okay – I’ve read this through a couple of times and I still don’t get what I’m supposed to do. Could you please add a step-by-step explanation so those of us who are newbies/having a senior moment can do this part?

Thanks!

Reply – Quote
]]> By: Josh http://www.thenichestorebuilder.com/build-a-niche-store-empire-in-12-weeks-inbound-links-bring-spiders.htm#comment-2566 Josh Sun, 02 Mar 2008 02:30:24 +0000 http://www.thenichestorebuilder.com/build-a-niche-store-empire-in-12-weeks-inbound-links-bring-spiders.htm#comment-2566 Thanks Mark. I asked as a knee-jerk reaction, then realize I could've easily found out for myself. I did a quick google search and found the answer, just as you describe it. Thanks for the quick response!<div class="comment-remix-meta"><a href="#" class="replyto" onclick="replyto('2566','Josh'); return false;">Reply</a> - <a href="#" class="quote" onclick="quote('2566','Josh','Thanks Mark. I asked as a knee-jerk reaction, then realize I could\'ve easily found out for myself. I did a quick google search and found the answer, just as you describe it. Thanks for the quick response!'); return false;">Quote</a></div> Thanks Mark. I asked as a knee-jerk reaction, then realize I could’ve easily found out for myself. I did a quick google search and found the answer, just as you describe it. Thanks for the quick response!
Reply – Quote
]]> By: Mark http://www.thenichestorebuilder.com/build-a-niche-store-empire-in-12-weeks-inbound-links-bring-spiders.htm#comment-2564 Mark Sun, 02 Mar 2008 01:37:19 +0000 http://www.thenichestorebuilder.com/build-a-niche-store-empire-in-12-weeks-inbound-links-bring-spiders.htm#comment-2564 @ Josh - Exactly! Forward and trailing slash... If it is just a filename, you can just list the filename after the leading slash. Always go to the link in the post and test your robots file after each change. Mark<div class="comment-remix-meta"><a href="#" class="replyto" onclick="replyto('2564','Mark'); return false;">Reply</a> - <a href="#" class="quote" onclick="quote('2564','Mark','@ Josh -\r\n\r\nExactly! Forward and trailing slash...\r\n\r\nIf it is just a filename, you can just list the filename after the leading slash.\r\n\r\nAlways go to the link in the post and test your robots file after each change.\r\n\r\nMark'); return false;">Quote</a></div> @ Josh -

Exactly! Forward and trailing slash…

If it is just a filename, you can just list the filename after the leading slash.

Always go to the link in the post and test your robots file after each change.

Mark

Reply – Quote
]]> By: Josh http://www.thenichestorebuilder.com/build-a-niche-store-empire-in-12-weeks-inbound-links-bring-spiders.htm#comment-2563 Josh Sun, 02 Mar 2008 01:32:33 +0000 http://www.thenichestorebuilder.com/build-a-niche-store-empire-in-12-weeks-inbound-links-bring-spiders.htm#comment-2563 Dumb question. Let's say I want to disallow a page full of template legalese, since I'll use the same content over and over and don't want to have the duplicate content on the site. If its at http://www.example.com/legal Then would I put a Disallow: /legal/ line in robots.txt to tell them to not index it?<div class="comment-remix-meta"><a href="#" class="replyto" onclick="replyto('2563','Josh'); return false;">Reply</a> - <a href="#" class="quote" onclick="quote('2563','Josh','Dumb question. Let\'s say I want to disallow a page full of template legalese, since I\'ll use the same content over and over and don\'t want to have the duplicate content on the site.\r\n\r\nIf its at http:\/\/www.example.com\/legal\r\n\r\nThen would I put a\r\n\r\nDisallow: \/legal\/\r\n\r\nline in robots.txt to tell them to not index it?'); return false;">Quote</a></div> Dumb question. Let’s say I want to disallow a page full of template legalese, since I’ll use the same content over and over and don’t want to have the duplicate content on the site.

If its at http://www.example.com/legal

Then would I put a

Disallow: /legal/

line in robots.txt to tell them to not index it?

Reply – Quote
]]> By: Mark http://www.thenichestorebuilder.com/build-a-niche-store-empire-in-12-weeks-inbound-links-bring-spiders.htm#comment-2312 Mark Sun, 24 Feb 2008 23:35:11 +0000 http://www.thenichestorebuilder.com/build-a-niche-store-empire-in-12-weeks-inbound-links-bring-spiders.htm#comment-2312 Rod... Nothing wrong with it! It is fine and disallows the directories you specified. Mark<div class="comment-remix-meta"><a href="#" class="replyto" onclick="replyto('2312','Mark'); return false;">Reply</a> - <a href="#" class="quote" onclick="quote('2312','Mark','Rod...\r\n\r\nNothing wrong with it!\r\n\r\nIt is fine and disallows the directories you specified.\r\n\r\nMark'); return false;">Quote</a></div> Rod…

Nothing wrong with it!

It is fine and disallows the directories you specified.

Mark

Reply – Quote
]]> By: rod http://www.thenichestorebuilder.com/build-a-niche-store-empire-in-12-weeks-inbound-links-bring-spiders.htm#comment-2310 rod Sun, 24 Feb 2008 23:27:41 +0000 http://www.thenichestorebuilder.com/build-a-niche-store-empire-in-12-weeks-inbound-links-bring-spiders.htm#comment-2310 I followed the instruction for putting in a robots.txt but the following appeared. How do I alter things so that it is exccepted? Rod The following block of code DISALLOWS the crawling of the following files and directories: /cgi-bin/ /admin/ /cont/ /themes/ /scripts/ to all spiders/robots. Line 1 User-agent: * Line 2 Disallow: /cgi-bin/ Line 3 Disallow: /admin/ Line 4 Disallow: /cont/ Line 5 Disallow: /themes/ Line 6 Disallow: /scripts/<div class="comment-remix-meta"><a href="#" class="replyto" onclick="replyto('2310','rod'); return false;">Reply</a> - <a href="#" class="quote" onclick="quote('2310','rod','I followed the instruction for putting in a robots.txt but the following appeared. How do I alter things so that it is exccepted?\r\n\r\nRod\r\n\r\n\r\nThe following block of code DISALLOWS the crawling of the following files and directories: \/cgi-bin\/ \/admin\/ \/cont\/ \/themes\/ \/scripts\/ to all spiders\/robots.\r\nLine 1 User-agent: *\r\nLine 2 Disallow: \/cgi-bin\/\r\nLine 3 Disallow: \/admin\/\r\nLine 4 Disallow: \/cont\/\r\nLine 5 Disallow: \/themes\/\r\nLine 6 Disallow: \/scripts\/'); return false;">Quote</a></div> I followed the instruction for putting in a robots.txt but the following appeared. How do I alter things so that it is exccepted?

Rod

The following block of code DISALLOWS the crawling of the following files and directories: /cgi-bin/ /admin/ /cont/ /themes/ /scripts/ to all spiders/robots.
Line 1 User-agent: *
Line 2 Disallow: /cgi-bin/
Line 3 Disallow: /admin/
Line 4 Disallow: /cont/
Line 5 Disallow: /themes/
Line 6 Disallow: /scripts/

Reply – Quote
]]> By: Mark http://www.thenichestorebuilder.com/build-a-niche-store-empire-in-12-weeks-inbound-links-bring-spiders.htm#comment-2302 Mark Sun, 24 Feb 2008 21:24:31 +0000 http://www.thenichestorebuilder.com/build-a-niche-store-empire-in-12-weeks-inbound-links-bring-spiders.htm#comment-2302 @ Rochelle - The image is just an xml-sitemap (Web 2.0) style image. It links direct to the sitemap page... The main reason it is there versus anywhere else at this point, is simply due to the lack of a template for the site. Once I put together a custom template for the site, I will likely put it in a different place. In addition, XML sitemaps serve no purpose for humans. They are strictly for either a feed or a search engine spider. The main link in the navigation menu is a public, or human sitemap. Mark<div class="comment-remix-meta"><a href="#" class="replyto" onclick="replyto('2302','Mark'); return false;">Reply</a> - <a href="#" class="quote" onclick="quote('2302','Mark','@ Rochelle -\r\n\r\nThe image is just an xml-sitemap (Web 2.0) style image. It links direct to the sitemap page...\r\n\r\nThe main reason it is there versus anywhere else at this point, is simply due to the lack of a template for the site. Once I put together a custom template for the site, I will likely put it in a different place.\r\n\r\nIn addition, XML sitemaps serve no purpose for humans. They are strictly for either a feed or a search engine spider. The main link in the navigation menu is a public, or human sitemap. \r\n\r\nMark'); return false;">Quote</a></div> @ Rochelle -

The image is just an xml-sitemap (Web 2.0) style image. It links direct to the sitemap page…

The main reason it is there versus anywhere else at this point, is simply due to the lack of a template for the site. Once I put together a custom template for the site, I will likely put it in a different place.

In addition, XML sitemaps serve no purpose for humans. They are strictly for either a feed or a search engine spider. The main link in the navigation menu is a public, or human sitemap.

Mark

Reply – Quote
]]> By: Mark http://www.thenichestorebuilder.com/build-a-niche-store-empire-in-12-weeks-inbound-links-bring-spiders.htm#comment-2299 Mark Sun, 24 Feb 2008 21:19:44 +0000 http://www.thenichestorebuilder.com/build-a-niche-store-empire-in-12-weeks-inbound-links-bring-spiders.htm#comment-2299 @ Eric - Exactly right Eric! You can actually see the Hybrid Club sitemap and copy it by going to: <a href="http://www.hybrid-golf-club.com/robots.txt" rel="nofollow">Hybrid Gold Robots file</a> Change the text to your specific site... Mark<div class="comment-remix-meta"><a href="#" class="replyto" onclick="replyto('2299','Mark'); return false;">Reply</a> - <a href="#" class="quote" onclick="quote('2299','Mark','@ Eric -\r\n\r\nExactly right Eric! You can actually see the Hybrid Club sitemap and copy it by going to: <a href=\"http:\/\/www.hybrid-golf-club.com\/robots.txt\" rel=\"nofollow\">Hybrid Gold Robots file<\/a>\r\n\r\nChange the text to your specific site...\r\n\r\nMark'); return false;">Quote</a></div> @ Eric -

Exactly right Eric! You can actually see the Hybrid Club sitemap and copy it by going to: Hybrid Gold Robots file

Change the text to your specific site…

Mark

Reply – Quote
]]>