Results 1 to 7 of 7


  1. #1

    Default Where robots.txt file uploaded to hosting directory?

    Hello friends,
    Where robots.txt file uploaded to hosting directory?

  2. #2

    Default

    Format and location rules for the robots.txt file:


  3. #3

    Default

    Quote Originally Posted by Preeju M S View Post
    Format and location rules for the robots.txt file:

    That's great, this concludes almost everything the OP wants to know about robots.txt

  4. #4

    Default

    Put it in the root folder. But don't expect every crawler to respect it. There is good chance that some bot ignore your robots.txt, no matter what's put on it.

  5. #5

    Default

    Quote Originally Posted by dilipcybex View Post
    Put it in the root folder. But don't expect every crawler to respect it. There is good chance that some bot ignore your robots.txt, no matter what's put on it.
    Can you clarify this further: "don't expect every crawler to respect it"

  6. #6

    Default

    Quote Originally Posted by Preeju M S View Post
    Format and location rules for the robots.txt file:

    Agree With This...

  7. #7

    Default

    Upload it in root directory. In many hosting it is uploaded on public_html folder


Similar Threads

  1. Is it necessary to use Robots.txt file?
    By jaysh4922 in forum Internet Marketing, SEO, PPC, Web Development Forums
    Replies: 7
    Last Post: 05-08-2018, 03:09 AM
  2. Why we use Robots.txt File?
    By riprook7 in forum Internet Marketing, SEO, PPC, Web Development Forums
    Replies: 12
    Last Post: 02-24-2017, 06:52 AM
  3. Replies: 0
    Last Post: 08-28-2015, 07:11 AM
  4. What is a robots.txt file?
    By Patelsharp in forum SEO Forum
    Replies: 1
    Last Post: 02-13-2014, 07:06 AM
  5. Don’t exceed maximum file size for robots.txt file
    By ClaudiaSchayffer7 in forum Internet Marketing, SEO, PPC, Web Development Forums
    Replies: 0
    Last Post: 03-26-2012, 11:07 AM

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
| UKC | VPS Germany | Webmaster Marketplace | Web Hosting Forum | Domain Name Forum | VPS Forum | Webmaster Forum | Website Design Forum | Sites For Sale |