What is the name of the domain?
What is the error number?
403
What is the error message?
http/2 403
What is the issue you’re encountering
Googlebot is being blocked
What steps have you taken to resolve the issue?
- disabled bots blocking
- added waf rule to allow asn of google
What are the steps to reproduce the issue?
i checked in ssh with commnad
curl -I -A “Googlebot” https://www.erosweb.com
This gave the results below
HTTP/2 403
date: Thu, 28 Nov 2024 11:19:25 GMT
content-type: text/html; charset=UTF-8
accept-ch: Sec-CH-UA-Bitness, Sec-CH-UA-Arch, Sec-CH-UA-Full-Version, Sec-CH-UA- Mobile, Sec-CH-UA-Model, Sec-CH-UA-Platform-Version, Sec-CH-UA-Full-Version-List , Sec-CH-UA-Platform, Sec-CH-UA, UA-Bitness, UA-Arch, UA-Full-Version, UA-Mobile , UA-Model, UA-Platform-Version, UA-Platform, UA
critical-ch: Sec-CH-UA-Bitness, Sec-CH-UA-Arch, Sec-CH-UA-Full-Version, Sec-CH-U A-Mobile, Sec-CH-UA-Model, Sec-CH-UA-Platform-Version, Sec-CH-UA-Full-Version-Li st, Sec-CH-UA-Platform, Sec-CH-UA, UA-Bitness, UA-Arch, UA-Full-Version, UA-Mobi le, UA-Model, UA-Platform-Version, UA-Platform, UA
cross-origin-embedder-policy: require-corp
cross-origin-opener-policy: same-origin
cross-origin-resource-policy: same-origin
origin-agent-cluster: ?1
permissions-policy: accelerometer=(),autoplay=(),browsing-topics=(),camera=(),cl ipboard-read=(),clipboard-write=(),geolocation=(),gyroscope=(),hid=(),interest-c ohort=(),magnetometer=(),microphone=(),payment=(),publickey-credentials-get=(),s creen-wake-lock=(),serial=(),sync-xhr=(),usb=()
referrer-policy: same-origin
x-content-options: nosniff
x-frame-options: SAMEORIGIN
cf-mitigated: challenge
cf-chl-out: rC3REUJZkrw+WUezFXdOGPBHJM4EPpbYhfU0OeqTjGRxEqfBZM/4PxkXH/BKntwEU4Vy L/hcsEcoIPMP3kGd/lfTQ+7jQ8bsFYjshOJdcFW8IBIAJLJK+uZ2emCvNXLOb45iHXueIAXVgePMGFbP AQ==$bccvS/JEel533Sm2LiPMxg==
cache-control: private, max-age=0, no-store, no-cache, must-revalidate, post-che ck=0, pre-check=0
expires: Thu, 01 Jan 1970 00:00:01 GMT
report-to: {“endpoints”:[{“url”:“https://a.nel.cloudflare.com/report/v4?s=vx MXCwbE1dNIhfYZXUPx1RJlKFh7UwmD%2FnrvLebJLEf0fX9UBECueUnJ4B0yxaLvdPH9tkGCtEbZqQ80 dOcNwQso7qSgaWxM%2FslUxtFTvtV0n749TpDk13FWCBy4aZmXQQ%3D%3D”}],“group”:“cf-nel”," max_age":604800}
nel: {“success_fraction”:0,“report_to”:“cf-nel”,“max_age”:604800}
server: cloudflare
cf-ray: 8e99f67e5ae1b8af-AMS
server-timing: cfL4;desc=“?proto=TCP&rtt=2259&min_rtt=2219&rtt_var=649&sent=6&re cv=9&lost=0&retrans=0&sent_bytes=3387&recv_bytes=824&delivery_rate=1276895&cwnd= 252&unsent_bytes=0&cid=e7a5fc04bd5d9cf6&ts=21&x=0”