I am trying to recover the data in an instance in which we don’t know what happened. The data is not super critical but we would like to be able to get it back. The last operation done was to increase the GC Watermark from 100GB to 150GB and when we restarted the server, it didn’t come online. After many trials, it always just hangs up, doesn’t boot properly, and doesn’t shut down with a single interrupt.
Currently when I boot up the IPFS daemon,
Initializing daemon... go-ipfs version: 0.10.0 Repo version: 11 System version: amd64/linux Golang version: go1.16.8
These are the only logs that are printed and I cannot connect to API or any other endpoint.
We had roughly ~100GB of data, I’ve created another instance, moved everything there, and started it to see if the issue is “host-related”. But the new server is stuck at this booting state for more than 3 days which I killed at this point.
If I try to run a simple command like
ipfs add ipfs_test.txt command when the server is running(but it doesn’t boot up properly as I said), it shows me
Error: lock /root/.ipfs/repo.lock: someone else has the lock, and I remember seeing “Merkle dag not found” error when the daemon is not running.
Trying to do a curl on 5001 results in “Connection refused”.
We have the data duplicated in a few locations right after the incident, but I don’t have any clue how to recover from such an error.
We also have a list of IPFS hashes that we used to pin in this instance if it can help with anything.
Thank you for your time!