Always online - aggressive crawling?

jorn.ove.stokka · January 30, 2019, 1:40pm

Hi

The Cloudflare-Alwaysonline crawler seems to excessively hit our frontpage from time to time, creating sort of a mini DDOS attack against the backend server. (400+ request within a minute)
access_log

Is anyone else experiencing this?

Judge · January 30, 2019, 2:16pm

Can you confirm the IP address in your log is one of the CF IPs? The user agent might be spoofed.

jorn.ove.stokka · February 1, 2019, 8:37am

We didn’t expose the X-Forwarded-for in our log so I only see the ip-adress of the amazon loadbalancer.
We’ve changed the log-format so we can check the IP-adress next time it happens. We have, however, decided to turn off the “Always online” feature as a preemptive step.

system · February 13, 2019, 1:43pm

This topic was automatically closed after 14 days. New replies are no longer allowed.