Enabling file streaming option while adding large file

jaknap · February 12, 2021, 11:22am

Hi ,
Is it possible to allow files streaming while adding file to ipfs with go-ipfs , similar to what we have for js.ipfs [add.ALL], where it take fileStream as input parameter?
js-ipfs/FILES.md at master · ipfs/js-ipfs · GitHub

wclayf · February 12, 2021, 6:20pm

Here is my go-ipfs code that saves to IPFS from a stream:

github.com

Clay-Ferguson/quantizr/blob/master/src/main/java/org/subnode/service/IPFSService.java

package org.subnode.service;

import java.io.BufferedInputStream;
import java.io.FileInputStream;
import java.io.InputStream;
import java.net.URI;
import java.net.URL;
import java.util.HashSet;
import java.util.LinkedHashMap;
import java.util.Map;
import com.fasterxml.jackson.core.type.TypeReference;
import com.fasterxml.jackson.databind.ObjectMapper;
import org.apache.commons.io.IOUtils;
import org.apache.commons.lang3.StringUtils;
import org.apache.http.HttpResponse;
import org.apache.http.client.HttpClient;
import org.apache.http.client.config.RequestConfig;
import org.apache.http.client.methods.HttpGet;
import org.apache.http.impl.client.HttpClientBuilder;
import org.slf4j.Logger;

This file has been truncated. show original

see “writeFromStream” function

That’s Java code but it’s using the HTTP API on a GO-IPFS docker instance. Hope it helps.

jaknap · February 12, 2021, 7:09pm

Thanks a lot wclayf . It is very helpful.

Topic		Replies	Views
Does the IPFS JavaScript client support stream uploads?	0	236	June 5, 2022
Uploading large files to IPFS through the web IPFS js-ipfs , go-ipfs , ipfs-cluster , files	0	357	March 29, 2022
Was the --to-files option added to js-ipfs? js-ipfs	3	203	November 14, 2022
Reading streams in Javascript js-ipfs js-ipfs	6	2134	August 13, 2018
Can i upload a file by p2p protocol Help go-ipfs	5	493	March 5, 2019

Enabling file streaming option while adding large file

Related Topics