From @gerrickw on Wed Mar 30 2016 21:07:31 GMT+0000 (UTC)
Attempting to see if my usecase is possible, methods to make it possible, or if this would be a bad solution. This question will be multiple, but towards the same goal.
Usecase: I would have 80 servers attempting to download a 100gb file as quickly as possible in an intranet environment.
- While downloading is it possible to force sequential writes for spinning disks with a 1gb memory limit (so not a large amount of room for disk cache)? As the disks are not ssds, sequential downloads will help IO on the disks.
- Is a 80 server swarm possible where each server is pulling from any of the 80 servers if they have already downloaded that chuck of data from a single seed? So all 80 servers start downloading at once, I would hope they would spread out their download load between servers.
- Is it possible for the 80 servers to start the download from a seed that does not have ipfs installed? Such as if it is hosted on http, https, or a hadoop connection? Or if some metadata files such as checksums, blocks, etc can be generated beforehand.
- If number 3 is not possible, can a host add a file to ipfs and before it is finished adding can others start fetching?
Thanks for any help people can supply – even answering a single questions will be helpful – Thanks
Copied from original issue: https://github.com/ipfs/faq/issues/105