o Ne@svddlZddlZddlZddlmZddlmZmZz ddl m Z m Z Wn ddl m Z m Z YddZ dd ZdS) N)_non_static_mode)corelayers)SequenceMappingcsd}t|tjrtjddSt|tjtjjfr$tjddSt|t j r1t St|t t fr:St|trHfdd|DSt|trkt|tfddtDsbtddd tDStd t|) ad Default batch collating function for :code:`paddle.io.DataLoader`, get input data as a list of sample datas, each element in list if the data of a sample, and sample data should composed of list, dictionary, string, number, numpy array and paddle.Tensor, this function will parse input data recursively and stack number, numpy array and paddle.Tensor datas as batch datas. e.g. for following input data: [{'image': np.array(shape=[3, 224, 224]), 'label': 1}, {'image': np.array(shape=[3, 224, 224]), 'label': 3}, {'image': np.array(shape=[3, 224, 224]), 'label': 4}, {'image': np.array(shape=[3, 224, 224]), 'label': 5},] This default collate function zipped each number and numpy array field together and stack each field as the batch field as follows: {'image': np.array(shape=[4, 3, 224, 224]), 'label': np.array([1, 3, 4, 5])} Args: batch(list of sample data): batch should be a list of sample data. Returns: Batched data: batched each number, numpy array and paddle.Tensor in input data. r)Zaxiscs$i|]tfddDqS)csg|]}|qSr.0dkeyrOD:\Projects\ConvertPro\env\Lib\site-packages\paddle/fluid/dataloader/collate.py Ez1default_collate_fn...default_collate_fn)r batchr r Dsz&default_collate_fn..c3s|] }t|kVqdS)N)len)r sample)sample_fields_numrr Jsz%default_collate_fn..z/fileds number not same among samples in a batchcSg|]}t|qSrr)r fieldsrrrrMrz&default_collate_fn..zSbatch data con only contains: tensor, numpy.ndarray, dict, list, number, but got {}) isinstancenpndarraystackpaddleTensorreagerrnumbersNumberarraystrbytesrrralliter RuntimeErrorzip TypeErrorformattype)rrr)rrrrs2       rcsfttjtjtjjfrStttfrStt r%fddDStt r1ddDSS)a Default batch converting function for :code:`paddle.io.DataLoader`. get input data as a list of sample datas, each element in list if the data of a sample, and sample data should composed of list, dictionary, string, number, numpy array and paddle.Tensor. .. note:: This function is default :attr:`collate_fn` in **Distable automatic batching** mode, for **Distable automatic batching** mode, please ses :attr:`paddle.io.DataLoader` Args: batch(list of sample data): batch should be a list of sample data. Returns: Batched data: batched each number, numpy array and paddle.Tensor in input data. csi|] }|t|qSrdefault_convert_fn)r r rrrrksz&default_convert_fn..cSrrr/r rrrrmrz&default_convert_fn..) rr r!rrrr"r&r'rrrrrrr0Ss  r0)r r#numpyrZ frameworkrrrcollections.abcrr collectionsrr0rrrrs  8