Does this happen instantly or after a while?

This could simply be caused by the fact that the transfer is taking some time and you might need to up your TTL or connection timeout somehow.

//...