Couple .rec questions:
- When forming batches from one .rec file with an
mx.ioiterator or a gluon DataLoader, are the batches randomly sampling from any location in the .rec? If yes how is this done efficiently, eg if the .rec is several dozens GB?
- When forming batches from several .rec files with an io iterator or a gluon DataLoader, are the batches randomly sampling from any location in any files? Or will the first batches be sampled from the first file, then other batches sampled from the next file etc?