{
"$type": "site.standard.document",
"bskyPostRef": {
"cid": "bafyreiec2r2alzaahpbymhyxcfhkhn7ensdfcqfu4nvwxpr2qqk6qynniy",
"uri": "at://did:plc:pgryn3ephfd2xgft23qokfzt/app.bsky.feed.post/3mj2b6pap62u2"
},
"path": "/t/download-speed-way-too-slow/169824#post_12",
"publishedAt": "2026-04-09T05:49:52.000Z",
"site": "https://discuss.huggingface.co",
"textContent": "The problem might be that you aren’t using parquet format. I just downloaded a dataset with with 10k items (3GB) and it took 2 hours and was averaging 30mbps in 1 gbit internet.\n\nDownloading in parquet fixed it and I got full download throughput. Most datasets have an auto parquet converter, so you can use that ref to get the fast downloads.\n\nWorks much faster for access and uploading too! parquet rocks",
"title": "Download speed way too slow"
}