IPFS.

Post

Share your knowledge.

IPFS moderator.
Dec 01, 2023
Expert Q&A

Kubo FS Error: Can I Adjust Storage Block Size for Lower File Count?

Encountering file system issues with Kubo while attempting to pin around 300TB. Is there an option to increase the storage block size locally to reduce metadata/file count without affecting consumed IPFS storage? Using badger datastore for large collections is suggested, but also, if adding new data, can the chunk size be adjusted to alleviate file count concerns?

  • Kubo
0
1
Share
Comments
.

Answers

1
IPFS moderator.
Dec 1 2023, 13:24

Consider using badger datastore for large collections. If adding new data, adjust the chunk size with ipfs add chunker=size-1048576. For 300TB, managing a fleet of nodes with ipfs-cluster might be worth exploring, as it could surpass the limit for a single node.

0
Official Answer
Comments
.

Do you know the answer?

Please log in and share it.

The InterPlanetary File System (IPFS) is a protocol, hypermedia and file sharing peer-to-peer network for storing and sharing data in a distributed file system.

95Posts95Answers
Sui.X.Peera.

Earn Your Share of 1000 Sui

Gain Reputation Points & Get Rewards for Helping the Sui Community Grow.