"Build comments on pull requests" not working

The option “Automatically add build comments on open pull requests” is enabled on my page’s build configuration but I don’t see any comment added to my PR’s. The Cloudflare GitHub App is installed in an Organization account, in case that matters. I don’t see much about this feature in help docs.

Any ideas?