PayPal IPN keeps on delaying [AGAIN]

[Eric-Le]

Dear all,

About 2-3 days ago, we did experience a significant IPN delay, which affected us so badly. Fortunately, the issue was resolved after around 8 hours. Today, again, the IPN delay issue started happening again, which is very frustrating. Does anyone know why this issue is keep happening and any solution to fix it?

Thank you so much.

[statk192]

We have been having this issue as well since October 1st and seems getting worse today. Most of transactions went alright, some aren't with no HTTP response code (seems like the issue comes in a cluster).

[Eric-Le]

@statk192 at least you got most of your transactions went alright, which is far much better than what we have. I haven't received any IPN message since last 24 hours (almost). Does anyone know or able to tag the admin of the community to this post?

[statk192]

Before today all the troublesome IPNs went through within 8 hours. However, there is one failing IPN right now that hasn't been through for almost 18 hours:

[Eric-Le]

According to their maintenance schedule: https://www.paypal-status.com/maintenance/production

They will be doing some maintenance works on 6th of October, starting from 3:00 till 12:30 UTC. I guess they will fix this issue on that day (I hope), which means we will have to fight with orders manually at least till that time.

[Arma76]

I don't think this maintenance is related to the problem we have

[Eric-Le]

Some of our IPN messages retries now have HTTP Status code 500 eventhough our IPN Listener is fully operational. Code 500 means they tried to call a thing that is not exist. This is a strong indication that their internet route configuration is faulty, and it possibly happen with only a group of servers or a range of IPs, in certain timeframe. Fixing internet route configuration is for a large scale service such as PayPal is not an easy task, unless they have a large group of dedicated engineers. For this reason, I believe this would not be fixed soon!

[Arma76]

Guys! Something just changed, received the first few IPN since yesterday!

[Eric-Le]

Yep, we are start receiving the IPN messages. I think they fixed it? Just don't be happy too soon. They fixed it a few days ago then it happened again. Let's keep updating here together.

@motointegrator @ultramoo @statk192 @pvanthony  how about you guys? Started receiving IPN messages?

[hmoorefd]

Yes. Working....just sent out 100. But we've still got thousands in retry, and since the retry period is exponentially longer, it might take a while for the queue to empty...

Fingers crossed.

In any case, don't expect apology, explanation or acknowledgment from PayPal.  

[pvanthony]

Some of the IPN status is sent.

Looks like working.

Keeping my fingers crossed.