o Qe9@sddlZddlZddlmZGdddeZGdddeZGdddeZGd d d eZGd d d eZ Gd ddeZ e Z ddZ dS)N) OrderedDictc@8eZdZdZddZddZddZdd Zd d Zd S) Stackz The stack in a Last-In/First-Out (LIFO) manner. New element is added at the end and an element is removed from that end. cCs g|_dSN)itemsselfr ED:\Projects\ConvertPro\env\Lib\site-packages\paddle/profiler/timer.py__init__ zStack.__init__cCs|j|dSr)rappend)ritemr r r pushsz Stack.pushcC |jSr)rpoprr r r r r z Stack.popcCst|jdkSNr)lenrrr r r is_empty#szStack.is_emptycCs |s|jt|jdSdSN)rrrrr r r peek&sz Stack.peekN) __name__ __module__ __qualname____doc__r rrrrr r r r rs rc@sZeZdZdZddZddZddZdd d Zd d Zd dZ ddZ ddZ ddZ dS)Eventzt A Event is used to record the cost of every step and the cost of the total steps except skipped steps. cCsxt|_t|_d|_d|_d|_tdtddd|_tdtddd|_ tdtdd|_ d|_ d|_ d|_ d|_dS)Nr inf)maxmintotal)rr T samples/s) TimeAveragerreader_cost_averagerbatch_cost_averager total_samples total_iters skip_iterdictfloatreader_records batch_records speed_recordsreader need_record speed_mode speed_unitrr r r r 3s zEvent.__init__cCs|j|jdSr)r$resetr%rr r r r2E z Event.resetcCs.|j||j|jkr|||jdSdSr)r$recordr'r(_update_recordsr+)rusetimer r r record_readerIs  zEvent.record_readerNcCs|dur d|_d|_|j|||jd7_|j|jkrE|||j|jdkr8t||}|j |7_ nd|}|||j dSdS)Nsteps/srr"g?) r0r1r%r4r'r(r5r,r*r&r-)rr6 num_samplesZ current_speedr r r record_batchNs   zEvent.record_batchcCsN||dkr ||d<n ||dkr||d<d|vr%|d|7<dSdS)Nrr r!)keys)rZcurrent_recordrecordsr r r r5^s    zEvent._update_recordscCrr)r$ get_averagerr r r reader_averagefr zEvent.reader_averagecCrr)r%r=rr r r batch_averageir zEvent.batch_averagecCs|jdkr |jS|jS)Nr")r0r%get_ips_averageget_step_averagerr r r speed_averagels   zEvent.speed_averagec Cs|j|jkriSd}d}d}|j|j8_|jdt|j}|jdt|j}|jdkr:t|j|jd}n t|j|jd}t|jd|jd|d}t|jd|jd|d}t|jd|jd|d}||d}t||||d}|S) Nrr!r"rr )rr avgd)reader_summary batch_summary ips_summary reader_ratio) r'r(r+r*r,r0r&r)r-) rZ reader_avgZ batch_avgZ speed_avgrErFrGrHsummaryr r r get_summaryrs<      zEvent.get_summaryr) rrrrr r2r7r:r5r>r?rBrJr r r r r-s  rc@r) HookzG As the base class. All types of hooks should inherit from it. cCdSrr r benchmarkr r r beginz Hook.begincCrLrr rMr r r endrPzHook.endcCrLrr rMr r r before_readerrPzHook.before_readercCrLrr rMr r r after_readerrPzHook.after_readercCrLrr rMr r r after_steprPzHook.after_stepN) rrrrrOrQrRrSrTr r r r rKs rKc@sPeZdZdZddZddZddZdd Zd d Zd d Z ddZ ddZ dS) TimerHookze A hook for recording real-time performance and the summary performance of total steps. cCst|_t|_dSr)timeit default_timer start_time start_readerrr r r r r3zTimerHook.__init__cCs(|jt|j|_t|_dS)z Create the event for timing and initialize the start time of a step. This function will be called in `Profiler.start()`. N)eventsrrr current_eventrVrWrXrMr r r rOs zTimerHook.begincCst|_dS)z Initialize the start time of the dataloader. This function will be called at the beginning of `next` method in `_DataLoaderIterMultiProcess` or `_DataLoaderIterSingleProcess`. N)rVrWrYrMr r r rRszTimerHook.before_readercCs<t|j}|jdus|jjr|dkrdS|j|dS)aX Record the cost of dataloader for the current step. Since the skipped steps are 10, it will update the maximum, minimum and the total time from the step 11 to the current step. This function will be called at the end of `next` method in `_DataLoaderIterMultiProcess` or `_DataLoaderIterSingleProcess`. Nr)rVrWrYr[r/r7)rrN reader_costr r r rSs zTimerHook.after_readercCsB|jdus |jjs dSt|j}|j||jt|_dS)a Record the cost for the current step. It will contain the cost of the loading data if there is a dataloader. Similar to `after_reader`, it will also update the maximum, minimum and the total time from the step 11 to the current step as well as the maximum and minimum speed of the model. This function will be called in `Profiler.step()`. N)r[r/rVrWrXr:r9)rrN batch_costr r r rTs zTimerHook.after_stepcCs<|jrdS|||j|j|_t|_dS)a& Print the performance summary of the model and pop the current event from the events stack. Since there may be nested timing events, such as evaluation in the training process, the current event needs to be update to the event at the top of the stack. N) rZr_print_summaryrrr[rVrWrXrMr r r rQs    z TimerHook.endc Cs|j}|s dStddd|ddkr#tdd|ddtd |jjtd d d d d d d dd d dd d |dd dkrS|d|d|d|d|d|ddS)Nz Perf SummaryrD=rHrzReader Ratio: z%.3f%zTime Unit: s, IPS Unit: %s|rCrr rEr\r]rFipsrG)r[rJprintcenterr1 _print_stats)rrNrIr r r r^s    zTimerHook._print_summaryc CsXd|d}d|d}d|d}td|dd|dd|dd|dd dS)Nz%.5frCrr rarc)rerf)rrZ message_dictZavg_strZmax_strZmin_strr r r rgs   zTimerHook._print_statsN) rrrrr rOrRrSrTrQr^rgr r r r rUs   rUc@sBeZdZdZddZddZdddZd d Zd d Zd dZ dS)r#z> Record the cost of every step and count the average. cCs |dSr)r2rr r r r s zTimeAverager.__init__cCsd|_d|_d|_dSr _total_iters _total_time_total_samplesrr r r r2s zTimeAverager.resetNcCs6|jd7_|j|7_|r|j|7_dSdSrrh)rr6r9r r r r4s zTimeAverager.recordcCs|jdkrdS|jt|jS)zA Get the average cost of loading data or a step. r)rirjr*rr r r r=# zTimeAverager.get_averagecCs$|jr|jdkr dSt|j|jS)zL Get the average throughput when speed mode is "samples/s". r)rkrir*rjrr r r r@,szTimeAverager.get_ips_averagecCs|jdkrdSt|j|jS)zD Get the average speed when speed mode is "step/s". r)rir*rjrr r r rA5rlzTimeAverager.get_step_averager) rrrrr r2r4r=r@rAr r r r r#s  r#c@sZeZdZdZddZdddZddZd d Zd d Zd dZ ddZ ddZ ddZ dS) Benchmarka A tool for the statistics of model performance. The `before_reader` and `after_reader` are called in the DataLoader to count the cost of loading the data. The `begin`, `step` and `end` are called to count the cost of a step or total steps. cCs&d|_ttd|_d|_t|_dS)N) timer_hook)r9rrUhooksr[rrZrr r r r Gs zBenchmark.__init__NcCs||_|dS)zl Record the statistic for the current step. It will be called in `Profiler.step()`. N)r9rT)rr9r r r stepMs zBenchmark.stepcCsd}|j}|j}|r|d|7}|r/|jjdkr!d|j_n|d|j_|dd|f7}|j}|r@|d||jjf7}|j|S)z It returns the statistic of the current step as a string. It contains "reader_cost", "batch_cost" and "ips". rbz reader_cost: %.5f sr8z/sz %s: %.5f sr]z ips: %.3f %s)r[r>r?r0r1rBr2)runitmessager>r?rBr r r step_infoVs"        zBenchmark.step_infocC|jD]}||qdSr)rovaluesrOrhookr r r rOn zBenchmark.begincCrtr)rorurRrvr r r rRrrxzBenchmark.before_readercCrtr)rorurSrvr r r rSvrxzBenchmark.after_readercCrtr)rorurTrvr r r rTzrxzBenchmark.after_stepcCrtr)rorurQrvr r r rQ~rxz Benchmark.endcCs|jdurdS|jjr+|jjdur||j_dS|jjjd|jdkr)d|j_dSdS|jjjd|jdkrEd|j_t|jd_dSdS)NZ_datasetFTrn)r[r/r.__dict__rVrWrorX)rr.r r r check_if_need_records(     zBenchmark.check_if_need_recordr) rrrrr rprsrOrRrSrTrQrzr r r r rm?s   rmcCstSr) _benchmark_r r r r rNrPrN) rVlogging collectionsrobjectrrrKrUr#rmr{rNr r r r s gg/Y