I have done my best to double check and it seems to be perfectly fine.
Also, with that same setup, Bing has been able to crawl and index - for a while at least.
Check the "security & privacy" link in Bing webmaster. Bing removes the whole website from index if there is copyright complain.
Google just removes pages in question.
@pkr said:
Check the "security & privacy" link in Bing webmaster. Bing removes the whole website from index if there is copyright complain.
Google just removes pages in question.
Comments
Bing seems to have gone broken, again - lol.
Detailed info about providers whose services I've used:
BikeGremlin web-hosting reviews
@bikegremlin I'd remove robots.txt if i were you.
https://www.bikegremlin.com/robots.txt
Why?
Do you think there's a problem with that setup?
I have done my best to double check and it seems to be perfectly fine.
Also, with that same setup, Bing has been able to crawl and index - for a while at least.
Finally, Google has zero complaints.
Detailed info about providers whose services I've used:
BikeGremlin web-hosting reviews
In my case, Bing removed all pages from the index, but a week ago new pages appeared in the results.
Check the "security & privacy" link in Bing webmaster. Bing removes the whole website from index if there is copyright complain.
Google just removes pages in question.
Good thinking.
(checked - all clear on my end )
Detailed info about providers whose services I've used:
BikeGremlin web-hosting reviews