o MeI@sdZddlmZddlZddlZddlZddlmm Z ddl Z ddl Z ddl m ZgZdZedZdZedZd Zdd d Ze d ddddddZe d ddddddZe d dddddddZe d dddddddZe d ddddddZdS)a, CIFAR dataset. This module will download dataset from https://dataset.bj.bcebos.com/cifar/cifar-10-python.tar.gz and https://dataset.bj.bcebos.com/cifar/cifar-100-python.tar.gz, parse train/test set into paddle reader creators. The CIFAR-10 dataset consists of 60000 32x32 color images in 10 classes, with 6000 images per class. There are 50000 training images and 10000 test images. The CIFAR-100 dataset is just like the CIFAR-10, except it has 100 classes containing 600 images each. There are 500 training images and 100 testing images per class. )print_functionN)cPicklez$https://dataset.bj.bcebos.com/cifar/zcifar-10-python.tar.gzZ c58f30108f718f92721af3b95e74349azcifar-100-python.tar.gzZ eb9058c3a382ffc7106e4002c42a8d85Fcsddfdd}|S)Ncssr|td}|td|tdd}|dusJtj||D]\}}|dtjt|fVq%dS)NdatalabelsZ fine_labelsgo@) sixbgetmoveszipZastypenumpyZfloat32int)batchrrsamplelabelrDD:\Projects\ConvertPro\env\Lib\site-packages\paddle/dataset/cifar.py read_batch3s z"reader_creator..read_batchc3s tjdd*}fdd|D}|D]}tj||dd}|D]}|Vq%qWdn1s6wYs?dSq)NTr)modec3s |] }|jvr|jVqdS)N)name).0Z each_item)sub_namerr >s  z1reader_creator..reader..bytes)encoding)tarfileopenpickleload extractfile)fnamesrr itemcyclefilenamerrrrreader;s  zreader_creator..readerr)r%rr$r&rr#rreader_creator1sr'z2.0.0zpaddle.vision.datasets.Cifar100z>Please use new dataset API which supports paddle.io.DataLoader)ZsinceZ update_tolevelreasoncCttjjtdtdS)z CIFAR-100 training set creator. It returns a reader creator, each sample in the reader is image pixels in [0, 1] and label in [0, 99]. :return: Training reader creator :rtype: callable cifartrainr'paddledatasetcommondownload CIFAR100_URL CIFAR100_MD5rrrrtrain100Lr5cCr+)z CIFAR-100 test set creator. It returns a reader creator, each sample in the reader is image pixels in [0, 1] and label in [0, 99]. :return: Test reader creator. :rtype: callable r,testr.rrrrtest100`r6r8zpaddle.vision.datasets.Cifar10cCttjjtdtd|dS)a CIFAR-10 training set creator. It returns a reader creator, each sample in the reader is image pixels in [0, 1] and label in [0, 9]. :param cycle: whether to cycle through the dataset :type cycle: bool :return: Training reader creator :rtype: callable r,Z data_batchr$r'r/r0r1r2 CIFAR10_URL CIFAR10_MD5r:rrrtrain10t r>cCr9)a CIFAR-10 test set creator. It returns a reader creator, each sample in the reader is image pixels in [0, 1] and label in [0, 9]. :param cycle: whether to cycle through the dataset :type cycle: bool :return: Test reader creator. :rtype: callable r,Z test_batchr:r;r:rrrtest10r?r@cCs(tjjtdttjjtdtdS)Nr,)r/r0r1r2r<r=r3r4rrrrfetchsrA)F)__doc__ __future__r itertoolsr Zpaddle.dataset.commonr/Zpaddle.utils.deprecatedutils deprecatedrrZ six.movesrr__all__Z URL_PREFIXr<r=r3r4r'r5r8r>r@rArrrrsf