Magento: Googlebot trying to access invalid URLs due to the addition of a trailing slash

StackOverflow https://stackoverflow.com/questions/12081201

  •  27-06-2021
  •  | 
  •  

Question

For some reason when googlebot spiders my Magento store it regularly generates debug reports due to a mistakenly added trailing slash to URLs containing arguments, such as:

http://www.sinfulthrills.co.uk/lingerie-clothing-1/sexy-lingerie?filter_brand=14054&filter_size=13258/.

Here’s the first few lines of the latest store debug report:

URL: http://www.sinfulthrills.co.uk/lingerie-clothing-1/sexy-lingerie?filter_brand=14054&filter_size=13258/
IP Address: 66.249.72.177
Time: 2012-08-22 12:39:58 GMT
Error:
SQLSTATE[42000]: Syntax error or access violation: 1064 You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')  INNER JOIN `catalog_product_index_eav` AS `filter_brand_idx` ON filter_brand_' at line 4

Now I’m certain that there is not a single link on my site that contains the trailing slash so how could it be possible that Google is mistakenly adding one? I’m worried that these invalid URLs will be negatively affecting my index positioning :(

I should add that it’s not always the same filtering arguments or argument values that are being used when this happens, nor is it the same product category. There is no pattern that I’ve been able to spot.

Was it helpful?

Solution 2

Google appears to have finally settled down and is now taking notice of the filters I had set - I haven't had an error in quite a few weeks now. I'd give Utility the points for answering this question if he'd actually answered it haha...

OTHER TIPS

Maybe you've submitted this URL in your sitemap?

Also if this is a 404 link you can probably back track it with Google Webmaster Tools (in Crawl Error list it will provide the linking page)

GL

Licensed under: CC-BY-SA with attribution
Not affiliated with StackOverflow
scroll top