IPFS.

Post

Share your knowledge.

IPFS moderator.
Mar 20, 2024
Expert Q&A

Hosting 600Gb of Files on IPFS: Potential Risks

I have a large amount of files, totaling 600Gb, that I would like to host on IPFS. To ensure I have realistic expectations, I would appreciate any insights on possible mistakes I may be making. My plan is to use IPFS-cluster to pin these files and hope that community members will join the cluster. However, I am concerned that adding the files to IPFS may consume even more storage than the original files.

  • IPFS
  • IPFS Node
0
1
Share
Comments
.

Answers

1
IPFS moderator.
Mar 20 2024, 10:22

Hey there! I'd like to share my thoughts on a few points regarding your question.

Regarding the concern about the storage requirements when adding files to IPFS, it is important to note that this refers to the storage on your local computer. If you are running your own IPFS instance, there are a few things you can consider:

  1. Pinning files locally: By pinning files locally, you can ensure faster access to them. One way to achieve this is by mounting data from IPFS locally. You can find more information on how to do this in the IPFS Kubo documentation. However, it's worth mentioning that this approach is still experimental, and its performance may vary. Additionally, if you require advanced file processing actions or transformations, you might need to develop an application on top of IPFS to meet your specific needs.

  2. Data store selection: The default flatfs data store in IPFS is suitable for storing up to 10GB of data. If you need to store more than that, you should consider using the badgerds data store instead. You can find more information on this in the IPFS documentation.

  3. IPFS Cluster and pinning services: If you are using IPFS Cluster, the availability of files will depend on whether people have a full or partial mirror of your primary instance. Alternatively, you can opt for a paid pinning service that can store the data for you. It's worth noting that public gateways may not have these pinning services as default peers for fast lookups. However, you have the option to create your own application using libp2p to communicate with IPFS and automatically pre-seed your paid pinning service or IPFS cluster addresses.

Please keep in mind that I am still learning myself, so if there are any inaccuracies in my response, please feel free to correct me. If you have any further questions, I'll be happy to help!

Links:

0
Official Answer
Comments
.

Do you know the answer?

Please log in and share it.

The InterPlanetary File System (IPFS) is a protocol, hypermedia and file sharing peer-to-peer network for storing and sharing data in a distributed file system.

95Posts95Answers
Sui.X.Peera.

Earn Your Share of 1000 Sui

Gain Reputation Points & Get Rewards for Helping the Sui Community Grow.

We use cookies to ensure you get the best experience on our website.
More info