Download times

[ajwimmers]

The time required on the "zenodo_get" command, below, is killing us:

print('installing dependancies')
!pip -q install zenodo-get
!pip -q install zarr
!pip -q install xmovie
print('grabbing sub-sevir')
!zenodo_get 7011372
print('unpacking sub-sevir')
!tar -xf sub-sevir.tar.gz
!tar -xf sub-sevir/sub-sevir-train.tar.gz -C sub-sevir/
!tar -xf sub-sevir/sub-sevir-val.tar.gz -C sub-sevir/
!tar -xf sub-sevir/sub-sevir-test.tar.gz -C sub-sevir/
print('grabbing the Github repo')

What we need is a better way to get the sub-sevir.tar.gz file. We can brainstorm on our call on Tuesday. Otherwise, don't waste your time on it. I'll finish it when you're away.

[ajwimmers]

Good news: This takes 44 seconds:
!wget ftp://ftp.ssec.wisc.edu/pub/ssec/sub-sevir.tar.gz