Still have the same problem somehow For some bizarre reason amazonbot is no longer on my main forum which had been working.
All the other bots are visiting both forums as normal.
Amazon bot is still being logged about once a second in the nginx access.log. So it's like the spiders/bots rule never matched amazonbot..
Other bots are very active also, so I can't see it being anything server related, at least what I can think of.
semrush bot seems fine for example..
All the other bots are visiting both forums as normal.
Amazon bot is still being logged about once a second in the nginx access.log. So it's like the spiders/bots rule never matched amazonbot..
Code:
34.236.135.14 - - [01/Oct/2024:16:51:21 +0100] "GET /AMN/index.php?sid=ff0e528f3ef1bc4ea05192a819cab20a HTTP/1.1" 301 5 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_1) AppleWebKit/600.2.5 (KHTML, like Gecko) Version/8.0.2 Safari/600.2.5 (Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot)"
semrush bot seems fine for example..
Code:
85.208.96.212 - - [01/Oct/2024:17:58:21 +0100] "GET /forum/viewtopic.php?t=6193 HTTP/1.1" 200 9841 "-" "Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html)"
Statistics: Posted by exxos — Tue Oct 01, 2024 4:59 pm