Arkadaşlar merhaba bir konuda danışmak istiyorum.

Bir web sayfam var ve log taramasında google-test adıyla gelen google cloud ip adresleri mevcut firewall dan engelledim ama en az 5k ip oldu bu nasıl olabilir ve sadece ana sayfaya get ediliyor.

google user agent listesinde yok

https://support.google.com/webmasters/answer/1061943?hl=en



66.249.83.30 - - [29/Dec/2018:08:01:18 -0700] "GET / HTTP/1.1" 301 236 "-" "Google-Test"
66.249.84.68 - - [29/Dec/2018:08:01:18 -0700] "GET / HTTP/1.1" 301 236 "-" "Google-Test"
107.178.198.97 - - [29/Dec/2018:08:01:18 -0700] "GET / HTTP/1.1" 301 236 "-" "Google-Test"
107.178.198.100 - - [29/Dec/2018:08:01:19 -0700] "GET / HTTP/1.1" 301 236 "-" "Google-Test"
64.233.173.144 - - [29/Dec/2018:08:01:19 -0700] "GET / HTTP/1.1" 301 236 "-" "Google-Test"
35.187.142.9 - - [29/Dec/2018:08:01:19 -0700] "GET / HTTP/1.1" 301 236 "-" "Google-Test"
35.187.129.139 - - [29/Dec/2018:08:01:20 -0700] "GET / HTTP/1.1" 301 236 "-" "Google-Test"
66.249.93.18 - - [29/Dec/2018:08:01:21 -0700] "GET / HTTP/1.1" 301 236 "-" "Google-Test"
66.249.82.190 - - [29/Dec/2018:08:01:21 -0700] "GET / HTTP/1.1" 301 236 "-" "Google-Test"
64.233.173.146 - - [29/Dec/2018:08:01:21 -0700] "GET / HTTP/1.1" 301 236 "-" "Google-Test"