Allowing PayPay IPN (Instant payment Notifications) through the firewall

I am trying to white flag Instant payment Notifications sent by Paypal to a processing script by adding a firewall rule allowing all connections from PayPal to be allowed. This is however not working. Is there something different I should do? Thanks for any help