How long does it take to apply a page rule?


#1

I just applied a page rule to exclude caching but CF is still crawling. I am not sure if I did it correct or there is a delay…

Thank you!


#2

Crawling?


#3

I guess he meant caching.

Page rules take effect almost immediately. But cached items remain there until they expire.
Try to purge the cache, wait a few minutes and check again. @bprakkmr


#4

Thank you Sandro and Mark!

Actually Both… (may be I am not understaing few things) Sorry new to CF

I see on my log

172.68.10.77 - - [14/Sep/2018:16:24:21 -0400] “GET /forsale?make=Lincoln&model=&category=&condition=all&trans=&extcolor=&mpg=&min_year=&max_year=&min_miles=&max_miles=&near=&withinmiles=&min_price=70001&max_price=&page=4 HTTP/1.1” 200 10752 “-” “Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/67.0.3396.99 Safari/537.36”

172.68.10.77 points to CF and thought CF crawls to cache pages ? Am I wrong ?

How can I block this? It is taking too much of the resource…

Thanks a lot!


#5

Cloudflare doesn’t crawl your site.

If you set the DNS records to :orange: every single request (legit or not) will be done through CF and their IPs appear in your logs.


#6

Not exactly, Cloudflare does not crawl your page but caches it when users visit it. This was a user visit. The Cloudflare IP shows up because it was proxied through their servers, which also means you should probably install something like mod_cloudflare to get the real IP addresses to show up in the log file.


#7

Thank you , you are the best… Got it now!!


#8

Thank you , you are the best… Got it now!!


#9

But be careful:

Cloudflare will no longer update and support mod_cloudflare , starting with versions Debian 9 and Ubuntu 18.04 LTS of the Linux operating system. Customers who are interested in building the mod_cloudflare package can download the codebase from GitHub.

I am not sure how long this will work.


#10

Would you have a source for this? I run it on Debian 9 without any hiccups :confused:


#11

Sure:

Not saying it won’t work. But if there is no further development on GitHub…


#12

Thanks.

Yeah, I noticed there basically hasnt been any maintenance for quite some while. Not sure why, but apparently its going to be mod_remoteip at some point :man_shrugging:


#13

I don’t have to right ?? I am ok with this ip, not a big deal for me but thank you for sharing!


#14

You dont, if you dont care.