Comments on: Redesigning my robots.txt file. Have you done yours? http://www.cravingtech.com/redesigning-my-robotstxt-file-have-you-done-yours.html Tech news, reviews, and a geek's ramblings Tue, 09 Feb 2010 00:35:11 +1100 http://wordpress.org/?v=2.9.1 hourly 1 By: iPod http://www.cravingtech.com/redesigning-my-robotstxt-file-have-you-done-yours.html/comment-page-1#comment-10020 iPod Wed, 11 Feb 2009 17:30:08 +0000 http://www.cravingtech.com/blog/?p=615#comment-10020 Good piece. Good piece.

]]> By: Michael Aulia http://www.cravingtech.com/redesigning-my-robotstxt-file-have-you-done-yours.html/comment-page-1#comment-3069 Michael Aulia Mon, 21 Jul 2008 14:01:06 +0000 http://www.cravingtech.com/blog/?p=615#comment-3069 I've just updated this post with my latest robots.txt after following the web checker posted by Squeaky earlier I think it's a very good tool to analyze your robots.txt file. I'll probably post something about it soon @Arnold: You can copy paste my robots.txt and change the paths to match your blog :D I’ve just updated this post with my latest robots.txt after following the web checker posted by Squeaky earlier

I think it’s a very good tool to analyze your robots.txt file. I’ll probably post something about it soon

@Arnold: You can copy paste my robots.txt and change the paths to match your blog :D

]]> By: Arnold Aranez http://www.cravingtech.com/redesigning-my-robotstxt-file-have-you-done-yours.html/comment-page-1#comment-3065 Arnold Aranez Mon, 21 Jul 2008 13:23:42 +0000 http://www.cravingtech.com/blog/?p=615#comment-3065 Michael, help me write mine robot.txt files :) Michael, help me write mine robot.txt files :)

]]> By: Yan@Blog for Beginners http://www.cravingtech.com/redesigning-my-robotstxt-file-have-you-done-yours.html/comment-page-1#comment-2409 Yan@Blog for Beginners Mon, 09 Jun 2008 15:51:36 +0000 http://www.cravingtech.com/blog/?p=615#comment-2409 Thanks for the advise. If you do find any useful tool online to analyze robots.txt, do let us know. Thanks for the advise. If you do find any useful tool online to analyze robots.txt, do let us know.

]]> By: Michael Aulia http://www.cravingtech.com/redesigning-my-robotstxt-file-have-you-done-yours.html/comment-page-1#comment-2407 Michael Aulia Mon, 09 Jun 2008 14:58:20 +0000 http://www.cravingtech.com/blog/?p=615#comment-2407 @Yan: Yeah, but honestly the Webmaster Tool doesn't really analyze your robots.txt file in detail. It's probably worth researching again if you got errors, and see what other SEO experts say about the error, though. @Yan: Yeah, but honestly the Webmaster Tool doesn’t really analyze your robots.txt file in detail.

It’s probably worth researching again if you got errors, and see what other SEO experts say about the error, though.

]]>