o e@svdZddlmZmZmZddlZddlZddlZddlZddl Z ddl Z ddl Z ddl Z ddlZddlmZddlm ZddlmZmZejddkr_ddlZddlmZmZddlZej Z!nejddkrrddlZddl"mZmZdZ#dd Z$d d Z%d d Z&ddZ'ddZ(Gddde)Z*ddZ+ddZ,ddZ-ddZ.ddZ/d$ddZ0Gd d!d!e)Z1Gd"d#d#e)Z2dS)%zFClasses and functions dealing with augmentation on multiple CPU cores.)print_functiondivisionabsolute_importN)BatchUnnormalizedBatch)EmptyFullcCsXtj}|ddkp|ddko|ddk}d}dtvr&d}|r&td|r*dS|S) Nrrr ZNixOSZspawnzDetected usage of imgaug.multicore in python <=3.4 and NixOS. This is known to sometimes cause endlessly hanging programs when also making use of multicore augmentation (aka background augmentation). Use python 3.5 or later to prevent this.F)sys version_infoplatformversioniawarn)ZvinfoZget_context_unsupportedmethodr@D:\Projects\ConvertPro\env\Lib\site-packages\imgaug/multicore.py_get_context_method!s   rcCs |durtnt|td<dS)NF_CONTEXT)multiprocessingZ get_contextglobals)rrrr _set_contextBs  rcCsdtd<dS)Nr)rrrrr_reset_contextKrcCsttdSN)rrrrrr_autoset_contextPrrcCstdurttSr)rrrrrr _get_contextUsrc@seZdZdZdZdZ  d$ddZeddZd%ddZ  d$d d Z e d d Z d&ddZ d&ddZe ddZddZddZddZddZddZddZd d!Ze d"d#ZdS)'Poolax Wrapper around ``multiprocessing.Pool`` for multicore augmentation. Parameters ---------- augseq : imgaug.augmenters.meta.Augmenter The augmentation sequence to apply to batches. processes : None or int, optional The number of background workers, similar to the same parameter in multiprocessing.Pool. If ``None``, the number of the machine's CPU cores will be used (this counts hyperthreads as CPU cores). If this is set to a negative value ``p``, then ``P - abs(p)`` will be used, where ``P`` is the number of CPU cores. E.g. ``-1`` would use all cores except one (this is useful to e.g. reserve one core to feed batches to the GPU). maxtasksperchild : None or int, optional The number of tasks done per worker process before the process is killed and restarted, similar to the same parameter in multiprocessing.Pool. If ``None``, worker processes will not be automatically restarted. seed : None or int, optional The seed to use for child processes. If ``None``, a random seed will be used. NcCstjdus Jd|dus|dksJdt|t|f||_||_||_|durGtj|kr6tj ksGnJdtjtj t|t|f||_ d|_ d|_ dS)Nzm_WORKER_AUGSEQ was already set when calling Pool.__init__(). Did you try to instantiate a Pool within a Pool?rzExpected `processes` to be `None` ("use as many cores as available") or a negative integer ("use as many as available MINUS this number") or an integer>1 ("use exactly that many processes"). Got type %s, value %s instead.z`Expected `seed` to be either `None` or a value between %d and %d. Got type %s, value %s instead.) r_WORKER_AUGSEQtypestraugseq processesmaxtasksperchildiarandomSEED_MIN_VALUESEED_MAX_VALUEseed_pool _batch_idx)selfr#r$r%r)rrr__init__s2    z Pool.__init__c Cs|jdurC|j}|dur3|dkr3ztt|}t|d}Wnttfy2t dd}Ynwtj |t |j |j f|jd|_|jS)aReturn or create the ``multiprocessing.Pool`` instance. This creates a new instance upon the first call and afterwards returns that instance (until the property ``_pool`` is set to ``None`` again). Returns ------- multiprocessing.Pool The ``multiprocessing.Pool`` used internally by this ``imgaug.multicore.Pool``. Nrr zCould not find method multiprocessing.cpu_count(). This will likely lead to more CPU cores being used for the background augmentation than originally intended.)Z initializerZinitargsr%)r*r$r cpu_countabsmax ImportErrorNotImplementedErrorrrr_Pool_initialize_workerr#r)r%)r,r$rrrpools&   z Pool.poolcCs"|||jjt|||dS)a Augment a list of batches. Parameters ---------- batches : list of imgaug.augmentables.batches.Batch The batches to augment. chunksize : None or int, optional Rough indicator of how many tasks should be sent to each worker. Increasing this number can improve performance. Returns ------- list of imgaug.augmentables.batches.Batch Augmented batches.  chunksize)_assert_batches_is_listr4map_Pool_starworker_handle_batch_ids)r,batchesr6rrr map_batchess zPool.map_batchescCs&|||jjt|||||dS)a Augment batches asynchonously. Parameters ---------- batches : list of imgaug.augmentables.batches.Batch The batches to augment. chunksize : None or int, optional Rough indicator of how many tasks should be sent to each worker. Increasing this number can improve performance. callback : None or callable, optional Function to call upon finish. See ``multiprocessing.Pool``. error_callback : None or callable, optional Function to call upon errors. See ``multiprocessing.Pool``. Returns ------- multiprocessing.MapResult Asynchonous result. See ``multiprocessing.Pool``. )r6callbackerror_callback)r7r4Z map_asyncr9r:)r,r;r6r=r>rrrmap_batches_asyncs zPool.map_batches_asynccCs t|tsJdt|fdS)NzXExpected `batches` to be a list, got type %s. Call imap_batches() if you use generators.) isinstancelistr!clsr;rrrr7  zPool._assert_batches_is_listr ccX||t|}|jjt|||||d}|D] }|V|dur)|qdS)aQ Augment batches from a generator. Pattern for output buffer constraint is from https://stackoverflow.com/a/47058399. Parameters ---------- batches : generator of imgaug.augmentables.batches.Batch The batches to augment, provided as a generator. Each call to the generator should yield exactly one batch. chunksize : None or int, optional Rough indicator of how many tasks should be sent to each worker. Increasing this number can improve performance. output_buffer_size : None or int, optional Max number of batches to handle *at the same time* in the *whole* pipeline (including already augmented batches that are waiting to be requested). If the buffer size is reached, no new batches will be loaded from `batches` until a produced (i.e. augmented) batch is consumed (i.e. requested from this method). The buffer is unlimited if this is set to ``None``. For large datasets, this should be set to an integer value to avoid filling the whole RAM if loading+augmentation happens faster than training. *New in version 0.3.0.* Yields ------ imgaug.augmentables.batches.Batch Augmented batch. r5N)_assert_batches_is_generator_create_output_buffer_leftr4imapr9_ibuffer_batch_loading_handle_batch_ids_genreleaser,r;r6output_buffer_sizeoutput_buffer_leftgenbatchrrr imap_batchess" #zPool.imap_batchesccrE)ahAugment batches from a generator (without preservation of order). Pattern for output buffer constraint is from https://stackoverflow.com/a/47058399. Parameters ---------- batches : generator of imgaug.augmentables.batches.Batch The batches to augment, provided as a generator. Each call to the generator should yield exactly one batch. chunksize : None or int, optional Rough indicator of how many tasks should be sent to each worker. Increasing this number can improve performance. output_buffer_size : None or int, optional Max number of batches to handle *at the same time* in the *whole* pipeline (including already augmented batches that are waiting to be requested). If the buffer size is reached, no new batches will be loaded from `batches` until a produced (i.e. augmented) batch is consumed (i.e. requested from this method). The buffer is unlimited if this is set to ``None``. For large datasets, this should be set to an integer value to avoid filling the whole RAM if loading+augmentation happens faster than training. *New in version 0.3.0.* Yields ------ imgaug.augmentables.batches.Batch Augmented batch. r5N)rFrGr4Zimap_unorderedr9rIrJrKrLrrrimap_batches_unorderedSs" # zPool.imap_batches_unorderedcCs t|sJdt|fdS)NzUExpected `batches` to be generator, got type %s. Call map_batches() if you use lists.)r is_generatorr!rBrrrrFrDz!Pool._assert_batches_is_generatorcCs|jdus Jd|j}|S)Nzhsz3BatchLoader.count_workers_alive..)sumrr^rrrcount_workers_alivegszBatchLoader.count_workers_alivecCs |dkS)z Determine whether the workers have finished the loading process. Returns ------- out : bool True if all workers have finished. Else False. r)rr^rrr all_finishedjs zBatchLoader.all_finishedc Cs |}|dkrK|jsKz|jjdd}|dkr|d8}n|j|Wnty3t dYn t t fy=Ynw|}|dkrK|jr z|jjdd}|dkr^|j|WntyhYn t t fyrYnwqL|jt j dd d t ddS) Nr皙?timeoutr {Gz?T{Gzt?protocol)rris_setrgetrput QueueEmptyrssleepEOFErrorBrokenPipeErrorpickledumps)r,Zworkers_running batch_strrrrrvs:      zBatchLoader._main_workerc Cs|durt|tj|t|z\zGt|s|n|}|D]8}t|ts2Jdt|ft j |dd}| sTz |j |ddWn t yOYnw| r=| rZnq"Wn tyitYnwW| dn| dwtddS)NzOExpected batch returned by load_batch_func to be of class imgaug.Batch, got %s.rrrrrr)randomr)rar&rrSr@rr!rrrr QueueFull Exception traceback print_excrsr)rCrZqueue_internalrseedvalrOrPZ batch_pickledrrrrsF       zBatchLoader._load_batchescCs8|js |jtd|jr|j|jr+|j D] }|r)|qn|j D]}|r<| |q.| sJtd| rA|j rT|j |j tjdddtd z |jjddWn tywYnwqe|jjs|j|j js|j |j|j td dS) zStop all workers.rMbP?NrrTrrg?)rrsetrsrrrr]rrr`rrfullrrrrrr_closedrVZ join_threadr,rrrrr`sJ                zBatchLoader.terminatecCs|js |jdSdSr)rrrr^rrr__del__s zBatchLoader.__del__N)rr T)rgrhrirjr deprecatedr-rrrrmrr`rrrrrr$s  & ! " 0rc@sReZdZdZejdddddZdd Zd d Ze d d Z ddZ ddZ dS)BackgroundAugmentera **Deprecated**. Augment batches in the background processes. Deprecated. Use ``imgaug.multicore.Pool`` instead. This is a wrapper around the multiprocessing module. Parameters ---------- batch_loader : BatchLoader or multiprocessing.Queue BatchLoader object that loads the data fed into the BackgroundAugmenter, or alternatively a Queue. If a Queue, then it must be made sure that a final ``None`` in the Queue signals that the loading is finished and no more batches will follow. Otherwise the BackgroundAugmenter will wait forever for the next batch. augseq : Augmenter An augmenter to apply to all loaded images. This may be e.g. a Sequential to apply multiple augmenters. queue_size : int Size of the queue that is used to temporarily save the augmentation results. Larger values offer the background processes more room to save results when the main process doesn't load much, i.e. they can lead to smoother and faster training. For large images, high values can block a lot of RAM though. nb_workers : 'auto' or int Number of background workers to spawn. If ``auto``, it will be set to ``C-1``, where ``C`` is the number of CPU cores. rrrautoc Cs|dks Jd|f||_t|tjjr|n|j|_t||_|dkrAzt}Wn t t fy8d}Ynwt d|d}n |dksLJd|f||_ g|_ d|_t|}t|D]}tj|j||j|j||fd}d|_||j |q`dS)Nrz/Expected 'queue_size' to be at least 1, got %d.rr zAExpected 'nb_workers' to be "auto" or at least 1, got %d instead.rT)r#r@rqueuesrr queue_source queue_resultr.r1r2r0rrnb_workers_finishedr&rrrr_augment_images_workerrrr)r,Z batch_loaderr#rrrrrrrrr-sD      zBackgroundAugmenter.__init__cCs |j|jkSr)rrr^rrrr8r[z BackgroundAugmenter.all_finishedcCsx|rdS|j}t|}|dur|S|jd7_|j|jkr8z |jjddWdSty7YdSw| S)aK Returns a batch from the queue of augmented batches. If workers are still running and there are no batches in the queue, it will automatically wait for the next batch. Returns ------- out : None or imgaug.Batch One batch or None if all workers have finished. Nr rr) rrrrloadsrrrr get_batch)r,rrPrrrr;s      zBackgroundAugmenter.get_batchc Cstj|t|||t|d}|sYz/|jdd}t|}|dur6d}|tj dddn| |}tj |dd}||Wnt yVt dYnw|r|tj dddt ddS) z Augment endlessly images in the source queue. This is a worker function for that endlessly queries the source queue (input batches), augments batches in it and sends the result to the output queue. FrrNTrrr)rarr)r|r&rrrrrrxrrsr) rCr#rrrZloader_finishedrrPZ batch_augrrrrZs,        z*BackgroundAugmenter._augment_images_workercCsH|jD] }|r |qt|j|_|jjs|jt ddS)zk Terminates all background processes immediately. This will also free their RAM. rN) rrr`rbrrrrVrsrrrrrr`s   zBackgroundAugmenter.terminatecCstd|dS)Nr)rsrr`r^rrrrs  zBackgroundAugmenter.__del__N)rr) rgrhrirjrrr-rrrmrr`rrrrrrs " % ' r)r)3rj __future__rrrr rrrrsrrnumpyrarpZ imgaug.imgaugZimgaugrZ imgaug.randomr&Zimgaug.augmentables.batchesrrr cPicklerrrrr rsocketerrorrrrrrrrrobjectrrGr3rzr9rwr{rrrrrrsP  ! o   L