Streaming files from HTTP/FTP

[kiwitech]

Hi guys,

Is it still the case that I need to chunk larger files to download them from http/ftp or is it possible to somehow use a HTTP stream or similar to facilitate large file download?

Many thanks

[hugo]

You can stream, but that’s for a service that is returning chunks (eg see the twitter streaming implementation in the twitter library)

If you’re trying to pull down a large file in chunks via HTTP, you can add a range header to your fetch, like this:

http.get(source, {"Range":format("bytes=%d-%d", start, end)})

…due to HTTP session reuse, most likely the range fetches will be issued on the same connection.

[kiwitech]

@hugo

http.get(source, {“Range”:format(“bytes=%d-%d”, start, end)})

Thanks Hugo, we’ll give it a try.