I appreciate the response…
Yes, we have access to your logs as we need to write to that table and other things, but we plan on offering paid plans here soon with generous limits. Like 13 million events/month for $20 a month. And we charge you just to shuffle the data to BigQuery, you pay the underlying backend cost (which with BQ is pretty negligible as long as you keep your queries in line). Absolutely refuse to sell your data to 3rd parties.
Yes, definitely plans for themes / customizing the log stream view.
With the Cloudflare app you can choose from like 15 fields and pick the order, but then we give you everything about every request (except the body) in the metadata payload. So, request/response headers, cf data, status code, and origin_time.
No real usage limits right now until we have the paid plans in place. I have a rate limit of 3000 requests per minute per source to keep the service from going down but I can increase that for you if you need.
Yes, that line is in there for our paid plans (coming soon).
Setting up BG and GCP I’ve found is way more user friendly than AWS so it’s pretty straight forward, plus we do all of the table setup for you once you have BigQuery enabled.
But yeah I totally get the need to stay only on AWS. Ultimately you will be able to “bring your own backend” so we can talk about that if you like. I think Athena is really the AWS answer to BigQuery but you also get Data Studio with BigQuery which is super straight forward (I’ve never played with AWS BI tool though).
Oh and workers are free for both of us since it’s a Cloudflare app that initiates them