Tweet
Ahrefs bot crawling issue
Hello,
Received an email from Ahrefs that it has identified pretty much every webpage of our website with status 500. From the logs we can see with certainty that we didn't have any website downtime recently.
Never had issues before with Ahrefs, Semrush, Majestic, Google, Bing, etc. So far we had been seeing this situation happening with Yandex and Imunify360 team even posted a notice to verify that. Yandex had been emailing us for about a year now that once every week their bot was getting into a 500 error on our website.
Now it's Ahrefs turn. Most likely its the same issue that's prevent both bots.
Just wanted to report that.
Received an email from Ahrefs that it has identified pretty much every webpage of our website with status 500. From the logs we can see with certainty that we didn't have any website downtime recently.
Never had issues before with Ahrefs, Semrush, Majestic, Google, Bing, etc. So far we had been seeing this situation happening with Yandex and Imunify360 team even posted a notice to verify that. Yandex had been emailing us for about a year now that once every week their bot was getting into a 500 error on our website.
Now it's Ahrefs turn. Most likely its the same issue that's prevent both bots.
Just wanted to report that.
Comment