I have a process that’s producing a new file every minute, and I’d like to make all of these files available over IPFS. In particular, I’d like the entire set of files to be easily accessible to anyone.
When these files are produced, I organize them into a tree structure of Year-Month-Day-Hour hierarchical directories with 60 minute files in the Hour directory. Over the course of a year, I’ll produce a few hundred thousand files that are organized in this way.
To make all of this available over IPFS, I assume that I can simply use IPNS on the top node (e.g. the Year directory). If I update this every time I add a new file (every minute), everything should be available and always up to date.
So my question is: Is this the right way to do this? It seems to me that to hash the topmost node, hashes for a few hundred thousand files will need to be calculated which doesn’t seem so efficient. Is there a better way to do this?