Significant delays in IPNs

[paulatthehug]

It's been a long time since we've seen this but on Thursday 28/09 and again today we are seeing IPNs being significantly delayed.

This is intermittent - some are getting through - but most aren't and https://www.paypal.com/merchantnotification/ipn/history now shows lots of IPNs still retrying.

We have checked that we are not blocking any of PayPal's IP address ranges https://www.paypal.com/us/selfhelp/article/what-are-the-ip-addresses-for-live-paypal-servers-ts1056 so it's not that.

All the IPNs we are seeing are coming from [removed], which has been the pattern for a long time, and when we look at the IPN history it's showing that those that did succeed often only did so after retries.

Anyone else seeing this? Any thoughts?

TIA

Paul

[Eric-Le]

Got an email from them admitting that there is a problem on their side but no ETA for the fix, at all.

[MTS_Chiranjeevi]

Good day @paulatthehug,

Thank you for posting to the PayPal community.

The PayPal Product Developers are currently looking into this issue and will be working on resolving it. Once they have coded a fix for this issue, we will reach out.

Sincerely,

Chiranjeevi

PayPal/Braintree MTS

If this post or any other was helpful, please enrich the community by giving kudos or accepting it as a solution.

[paulatthehug]

It now seems to be working again, although there's a lot still to come so the queue is clearly still clearing itself out.

I would like to log at this point my unhappiness about the whole way this incident has been resolved as this is not the first time and there is a common pattern:

1. IPNs stop arriving
2. PayPal's status page says all is well
3. We raise a ticket
4. PayPal's status page says all is well
5. PayPal claim it's our fault and ask us to check we're not blocking IP addresses
6. We check. We're not. We tell you that
7. PayPal's status page says all is well
8. We post on the developer forum and find a significant number of people experiencing similar issues
9. PayPal's status page says all is well
10. Finally PayPal begrudgingly admits that there may be a problem
11. The problem is resolved

So in summary it's clear that you have no watchdog process monitoring IPNs, that the status page lies, and that you assume we're at fault even when we have never been over multiple instances.

[MTS_Chiranjeevi]

Good day @paulatthehug /All,

Yes, our internal team have fixed the issue.

IPNs processing successfully. You shouldn't be facing this issue.

Sincerely,

Chiranjeevi

PayPal/Braintree MTS

If this post or any other was helpful, please enrich the community by giving kudos or accepting it as a solution.