How long does it take to apply a page rule?

I just applied a page rule to exclude caching but CF is still crawling. I am not sure if I did it correct or there is a delay…

Thank you!

Crawling?

1 Like

I guess he meant caching.

Page rules take effect almost immediately. But cached items remain there until they expire.
Try to purge the cache, wait a few minutes and check again. @bprakkmr

1 Like

Thank you Sandro and Mark!

Actually Both… (may be I am not understaing few things) Sorry new to CF

I see on my log

172.68.10.77 - - [14/Sep/2018:16:24:21 -0400] “GET /forsale?make=Lincoln&model=&category=&condition=all&trans=&extcolor=&mpg=&min_year=&max_year=&min_miles=&max_miles=&near=&withinmiles=&min_price=70001&max_price=&page=4 HTTP/1.1” 200 10752 “-” “Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/67.0.3396.99 Safari/537.36”

172.68.10.77 points to CF and thought CF crawls to cache pages ? Am I wrong ?

How can I block this? It is taking too much of the resource…

Thanks a lot!

Cloudflare doesn’t crawl your site.

If you set the DNS records to :orange: every single request (legit or not) will be done through CF and their IPs appear in your logs.

https://support.cloudflare.com/hc/en-us/articles/200170786-Why-do-my-server-logs-show-Cloudflare-s-IPs-using-Cloudflare-

2 Likes

Not exactly, Cloudflare does not crawl your page but caches it when users visit it. This was a user visit. The Cloudflare IP shows up because it was proxied through their servers, which also means you should probably install something like mod_Cloudflare to get the real IP addresses to show up in the log file.

2 Likes

Thank you , you are the best… Got it now!!

Thank you , you are the best… Got it now!!

But be careful:

Cloudflare will no longer update and support mod_Cloudflare , starting with versions Debian 9 and Ubuntu 18.04 LTS of the Linux operating system. Customers who are interested in building the mod_Cloudflare package can download the codebase from GitHub.

I am not sure how long this will work.

2 Likes

Would you have a source for this? I run it on Debian 9 without any hiccups :confused:

Sure:

https://support.cloudflare.com/hc/en-us/articles/200170896-Using-mod-Cloudflare-Packages

Not saying it won’t work. But if there is no further development on GitHub…

1 Like

Thanks.

Yeah, I noticed there basically hasnt been any maintenance for quite some while. Not sure why, but apparently its going to be mod_remoteip at some point :man_shrugging:

1 Like

I don’t have to right ?? I am ok with this ip, not a big deal for me but thank you for sharing!

You dont, if you dont care.

1 Like

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.