I want to pin a large number of objects (say 100k). I am sending a bunch of request to the HTTP API at the same time. As far as I can tell, if one of the objects cannot be found, I never get an error, it just keeps waiting. So I just stop waiting after a minute, and send another request for another file.
What is going on inside? Does IPFS itself give up at some point? Is there a limit of parallel pinning requests it will entertain? In other words, what is the right number of concurrent requests to send, and at what point will my script timeout simply because they are waiting inside IPFS internal queue, not because they are truly not accessible in the network?