Download speed way too slow

The problem might be that you aren’t using parquet format. I just downloaded a dataset with with 10k items (3GB) and it took 2 hours and was averaging 30mbps in 1 gbit internet. Downloading in parquet fixed it and I got full download throughput. Most datasets have an auto parquet converter, so you can use that ref to get the fast downloads. Works much faster for access and uploading too! parquet rocks