Currently I’m trying to load some images for training purpose, here is what i’m currently doing
sats = [np.array(Image.open(cdir + "/x/" + name).convert('RGB'),dtype="float32") for name in names] masks = [np.array(Image.open(cdir + "/y/" + name),dtype="float32") for name in names]
But this takes almost all space in colab, when running on the full dataset. So my question is can I use a better api, which will partially load data, so I don’t run out of memory ?
Thanks.
submitted by /u/maifee
[visit reddit] [comments]