Magento 2.2.4: SEO issue - Homepage Search Results in “No information is available for this page.”

Question

I have recently replatformed from a custom PHP build to Magento 2.2.4, during the go-live process we changed from www to non-www versions of the site. I've updated Search Console to make the preference to the non-www version of the site.

Now I'm getting the following notice:

Magento is using a stock version of the robots.txt file as seen here current robots.txt

Everything within Google says the root domain is able to be indexed:

The default domain is also not www it's the non-www version.

I also verified that the site has Index,Follow enabled.

Does anyone have any thoughts as to why this maybe occurring?

Answer 1

It's something in the robots.txt

You could just delete it as it will not hurt anything to have it or not have it.

People think the robots.txt makes a difference in SEO - only if you have robotted out pages you want indexed. Otherwise it makes no difference on 99.9% of sites. So delete it and fetch in SC - that should go away.