If Blocking Entire United states Country, Will it Crawl or Indexes site on Google?

Website, Application, Performance Security
1

Hi guys,

Site being hit by United States IPs (BOT). We’ve Captcha challenge them via the Firewall Rules.

However, will this stop Google US bot from crawling our site?

Daily request 60k from only United States

If i used Captcha challenge for United States Country then my post is not crawling or indexes on google

If i remove the Captcha Challenge then Bots is hugging the server resources

Also When I went to share on My business Facebook page I got a URL returned bad HTTP response code.

PREVIEW on FACEBOOK “ACTION REQUIRED | CLOUDFLARE”

Thank you very much!

2

Yes, it will. You’ll need to exclude “known bots” in your rule.

3

Thanks,
just add one more rule with AND Condition or OR condition

Then it will stop unwanted request or not

it will crawl /indexes automatically, Right

what about server resources?

Thanks

4

Depends on your overall setup, but most likely with an AND. No OR.

(ip.geoip.country eq "US" and not cf.client.bot)
5

image
image1066×568 13.2 KB

I used only OR condition

Please check the screenshot

6

I posted an example.

7

Thanks, i did as according to your example

image
image1063×644 17 KB

This will not hugging the server resources

all my post will crawl/indexes on google, right

Is it anything else need to do

8

That will do exactly what you originally described.

9

This way CPU USAGE, RAM (server resources) will not hugging

all my post will crawl/indexes on google, right

Is it anything else need to do

10

Well, let’s go through this rule. What does it do?

11

Okay, i will let you know after sometime

about server resources, preview on FB , Indexes post on google search

Thanks

12

Do you know

how to create rule threat score ?
when it will use and benefits ?

13

It all is covered at About Cloudflare Firewall Rules · Cloudflare Firewall Rules docs

14

Hello Sandro

Yes i reviewed

Fb preview issue is resolved
indexes is almost resolved

But sometimes resources used very high

CPU usages touches 100%
Load server is also increase
Ram is also increase

After changed in cloudflare Firewal rule

What should i do for this

Thanks

15

You need to check that on your server.

16

Thanks, from server end it was good

No problem, i will ask again

Can i add threat score rule for united states that will work

Thanks

17

Aforementioned link has all these details.

18

This topic was automatically closed after 30 days. New replies are no longer allowed.