Robot txt is a text folder where we put it our sites and tell search engine robots, some page we don't like to visit. Robots txt generally Crawling websites, help to place your site by search engine results. This is also called search engine intelligence. So this is very important for any website or blogs.
Anyone can easily add robots txt
0 comments:
Post a Comment