Post
Share your knowledge.
Kubo FS Error: Can I Adjust Storage Block Size for Lower File Count?
Encountering file system issues with Kubo while attempting to pin around 300TB. Is there an option to increase the storage block size locally to reduce metadata/file count without affecting consumed IPFS storage? Using badger datastore for large collections is suggested, but also, if adding new data, can the chunk size be adjusted to alleviate file count concerns?
- Kubo
Answers
1Consider using badger datastore for large collections. If adding new data, adjust the chunk size with ipfs add chunker=size-1048576. For 300TB, managing a fleet of nodes with ipfs-cluster might be worth exploring, as it could surpass the limit for a single node.
Do you know the answer?
Please log in and share it.
The InterPlanetary File System (IPFS) is a protocol, hypermedia and file sharing peer-to-peer network for storing and sharing data in a distributed file system.
