I just applied a page rule to exclude caching but CF is still crawling. I am not sure if I did it correct or there is a delay…
Thank you!
I just applied a page rule to exclude caching but CF is still crawling. I am not sure if I did it correct or there is a delay…
Thank you!
Crawling?
I guess he meant caching.
Page rules take effect almost immediately. But cached items remain there until they expire.
Try to purge the cache, wait a few minutes and check again. @bprakkmr
Thank you Sandro and Mark!
Actually Both… (may be I am not understaing few things) Sorry new to CF
I see on my log
172.68.10.77 - - [14/Sep/2018:16:24:21 -0400] “GET /forsale?make=Lincoln&model=&category=&condition=all&trans=&extcolor=&mpg=&min_year=&max_year=&min_miles=&max_miles=&near=&withinmiles=&min_price=70001&max_price=&page=4 HTTP/1.1” 200 10752 “-” “Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/67.0.3396.99 Safari/537.36”
172.68.10.77 points to CF and thought CF crawls to cache pages ? Am I wrong ?
How can I block this? It is taking too much of the resource…
Thanks a lot!
Cloudflare doesn’t crawl your site.
If you set the DNS records to every single request (legit or not) will be done through CF and their IPs appear in your logs.
Not exactly, Cloudflare does not crawl your page but caches it when users visit it. This was a user visit. The Cloudflare IP shows up because it was proxied through their servers, which also means you should probably install something like mod_Cloudflare to get the real IP addresses to show up in the log file.
Thank you , you are the best… Got it now!!
Thank you , you are the best… Got it now!!
But be careful:
Cloudflare will no longer update and support mod_Cloudflare , starting with versions Debian 9 and Ubuntu 18.04 LTS of the Linux operating system. Customers who are interested in building the mod_Cloudflare package can download the codebase from GitHub.
I am not sure how long this will work.
Would you have a source for this? I run it on Debian 9 without any hiccups
Sure:
https://support.cloudflare.com/hc/en-us/articles/200170896-Using-mod-Cloudflare-Packages
Not saying it won’t work. But if there is no further development on GitHub…
Thanks.
Yeah, I noticed there basically hasnt been any maintenance for quite some while. Not sure why, but apparently its going to be mod_remoteip at some point
I don’t have to right ?? I am ok with this ip, not a big deal for me but thank you for sharing!
You dont, if you dont care.
This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.