o Me,@sdZddlmZddlZddlmmZddlZddl Z ddl Z ddl m Z gZ dZedZdZedZd Zed Zd Zed Zd ZddZedddddddZedddddddZedddddddZdS)z MNIST dataset. This module will download dataset from http://yann.lecun.com/exdb/mnist/ and parse training set and test set into paddle reader creators. )print_functionN)rangez$https://dataset.bj.bcebos.com/mnist/zt10k-images-idx3-ubyte.gzZ 9fb629c4189551a2d022fa330f9573f3zt10k-labels-idx1-ubyte.gzZ ec29112dd5afa0611ce80d1b7f02629cztrain-images-idx3-ubyte.gzZ f68b3c2dcbeaaa9fbdd348bbdeb94873ztrain-labels-idx1-ubyte.gzZ d53e105ee54ea40749a09fcbcd1e9432csfdd}|S)Nc 3std}|}td}|}d}d}d}t|||\}}} } |t|7}d} d} t| || \} }| t| 7} ||krInddtd}t||| }| t|7} |7}dt| | d}t|||}t|| | f d}|t|7}|d }|d }|d }t D]}||ddft ||fVqqDWdn1swYWddSWddS1swYdS) Nrbrz>IIIIz>IIT>BZfloat32go@g@g?) gzipGzipFilereadstruct unpack_fromcalcsizestrnumpyZreshapeZastyperint)Z image_fileZimg_bufZ label_fileZlab_bufZ step_labelZ offset_imgZmagic_byte_imgZ magic_imgZ image_numrowscolsZ offset_labZmagic_byte_labZ magic_labZ label_numZ fmt_labellabelsZ fmt_imagesZ images_tempZimagesi buffer_sizeimage_filenamelabel_filenameDD:\Projects\ConvertPro\env\Lib\site-packages\paddle/dataset/mnist.pyreader-s^    "zreader_creator..readerr)rrrrrrrreader_creator+s/rz2.0.0zpaddle.vision.datasets.MNISTz>Please use new dataset API which supports paddle.io.DataLoader)ZsinceZ update_tolevelreasoncC(ttjjtdttjjtdtdS)z MNIST training set creator. It returns a reader creator, each sample in the reader is image pixels in [-1, 1] and label in [0, 9]. :return: Training reader creator :rtype: callable mnistd) rpaddledatasetcommondownloadTRAIN_IMAGE_URLTRAIN_IMAGE_MD5TRAIN_LABEL_URLTRAIN_LABEL_MD5rrrrtrain_s  r*cCr)z MNIST test set creator. It returns a reader creator, each sample in the reader is image pixels in [-1, 1] and label in [0, 9]. :return: Test reader creator. :rtype: callable r r!) rr"r#r$r%TEST_IMAGE_URLTEST_IMAGE_MD5TEST_LABEL_URLTEST_LABEL_MD5rrrrtestus r/cCsLtjjtdttjjtdttjjtdt tjjt dt dS)Nr ) r"r#r$r%r&r'r(r)r+r,r-r.rrrrfetchsr0)__doc__ __future__rZpaddle.dataset.commonr"Zpaddle.utils.deprecatedutils deprecatedrrr Z six.movesr__all__Z URL_PREFIXr+r,r-r.r&r'r(r)rr*r/r0rrrrsP  4