You need to block the subdomain using the robots.txt file, which is located at the same directory level
I have one problem
I have a domain name, for example www.testing.com
and new.testing.com
so I don't want to show new.testing.com on any search engine. I added one robots.txt file to new.testing.com. And both sites have the same parent directory
--httpdoc
----testing.com
----new.testing.com
So, I want to know that I can handle both sites using the same robots.txt from test.com, is this possible.
Please suggest me a solution if possible.
+3
source to share
2 answers
The best you can do is add separate robots.txt files. Place one in each directory. You must have
- test.com/robots.txt and
- new.testing.com/robots.txt
After adding the robots.txt file to new.testing.com, you must add the following code to keep search engines out.
User-agent: *
Disallow: /
+7
source to share