o e)1@sdZddlmZddlZddlZddlZddlZddlZddlm Z ddl m Z ddl m Z ddlmZddlZddlZddlmZdd lmZdd lmZmZmZmZdd lmZmZmZdd lm Z dd l!m"Z"dZ#e$e%Z&dFddZ'dGddZ(dHddZ)dHddZ*dHddZ+dId"d#Z,dHd$d%Z-dHd&d'Z.dHd(d)Z/dHd*d+Z0dHd,d-Z1dJd0d1Z2dJd2d3Z3dKd7d8Z4dHd9d:Z5  ; Dsz*check_options_languages..z@ Note: most languages are identified by a 3-digit ISO 639-2 Code) languagesDEFAULT_LANGUAGElocale getlocale startswithrdebugjoinr )rrZ system_langZmissing_languagesmsgrrrcheck_options_languages6s   r/cCs|jt}|jdr|std|jdkr)|jt j dfvr)t d|jdd}t |j |j|j|jfs9d}||_|jsF|jrHt d dSdS) NZhocrzThe 'hocr' PDF renderer is known to cause problems with one or more of the languages in your document. Use `--pdf-renderer auto` (the default) to avoid this issue.none-z:Since you specified `--output-type none`, the output file zI cannot be produced. Set the output file to `-` to suppress this message.FTz\--redo-ocr is not currently compatible with --deskew, --clean-final, and --remove-background)r'issubsetrZ pdf_rendererr+rwarning output_type output_filerdevnullr anydeskew clean_final force_ocrremove_backgroundlossless_reconstructionredo_ocr)rZis_latinr<rrrcheck_options_outputIs4  r>cCs`|jdkr|jdkrtd|jtjkrtd|jd|_|j|jks*|j|jkr.tddS)Nr1z@--sidecar filename must be specified when output file is stdout.zJ--sidecar filename must be specified when output file is /dev/null or NUL.z.txtz@--sidecar file must be different from the input and output files)Zsidecarr5r rr6 input_filerrrrcheck_options_sidecarms    rBc Cs|jrd|_|jr|jstd|jrCtddtjdddz|jr+t|j|_WdSWdStyB}z tdt ||d}~wwdS)NTz&--clean is required for --unpaper-argsrz6.1z--clean, --clean-final)programpackageZversion_checkerZ need_versionZ required_forz--unpaper-args: ) r9cleanZ unpaper_argsr rrversionZvalidate_custom_args Exceptionstr)rerrrcheck_options_preprocessing~s.  rJrangesrHset[int]c Csg}|ddd}|D]S}|sq z |d\}}Wnty-|t|dYq wz"ttt|dt|}|sJtd|d|dd||Wq ty`td|ddw|sktd|d t |stt d t d d |Drtd t d|t|S)N ,r1zinvalid page subrange ''zThe string of page ranges 'z/' did not contain any recognizable page ranges.zQList of pages to process contains duplicate pages, or pages that are out of ordercss|]}|dkVqdS)rNr)r$pagerrrr&z%_pages_from_ranges..z)pages refers to a page number less than 1zOCRing only these pages: %s)replacesplit ValueErrorappendintlistranger extendrrr3r7r,set)rKpagesZ page_groupsgroupstartendZ new_pagesrrr_pages_from_rangessD    racCsHtdd|j|j|jfD}|dkrtd|jr"t|j|_dSdS)Ncss|] }|rdndVqdS)rPrNr)r$optrrrr&s  z-check_options_ocr_behavior..z8Choose only one of --force-ocr, --skip-text, --redo-ocr.)sumr:Z skip_textr=r r]ra)rZexclusive_optionsrrrcheck_options_ocr_behaviorsrecCs,|jdkr|jdstddSdSdS)Nautopdfazi--pdfa-image-compression argument only applies when --output-type is one of 'pdfa', 'pdfa-1', or 'pdfa-2')Zpdfa_image_compressionr4r+rr3rArrrcheck_options_advancedsrhcCs~|j|j|j|jg}dd|DD]+}|D]&}t|dks$t|dkr;tt|dd}t d|d|dqqdS) Ncss|]}|r|VqdSr#r)r$mrrrr&rSz)check_options_metadata..CoirczGOne of the metadata strings contains an unsupported Unicode character: z (U+)) titleauthorkeywordssubject unicodedatacategoryordhexupperrV)rZdocinfoscharZhexcharrrrcheck_options_metadatasrwcCs.t|jdtj_tjjdkrdtj_dSdS)Ni@Br)rXZmax_image_mpixelsPILZImageZMAX_IMAGE_PIXELSrArrrcheck_options_pillows  rycCsBtt|t|t|t|t|t|t|dSr#)rrwr>rBrJrerhryrArrr_check_plugin_invariant_optionss rzplugin_managerrcCs,|jj|d|j|}t||dS)NrA)hook check_optionsZget_ocr_enginer'r/)rr{rrrr_check_plugin_optionssr~cCst|t||dSr#)rzr~)rr{rrrr}sr} work_folderrtuple[Path, str]c Cs@|jdkr1td|d}t|d}ttjj|Wd|dfS1s(wY|dfSt|jdrk|j s@t dtd|d}t|d}t|j|Wd|dfS1sbwY|dfSz|d }t |j||t |jfWSty}zd |j}td r|d 7}t ||d}~ww) Nr1z reading file from standard inputstdinwbreadablez!Input file stream is not readablezreading file from input streamstreamoriginzFile not found - z /.dockerenvz Docker cannot your working directory unless you explicitly share it with the Docker container and set uppermissions correctly. You may find it easier to use stdin/stdout: docker run -i --rm jbarlow83/ocrmypdf - - output.pdf )r@rinfoopenrrrbufferhasattrrr rrfspathFileNotFoundErrorrexists)rrtargetZ stream_bufferrIr.rrrcreate_input_filesB             rcCsb|jdkrtjrtddSt|jdr!|jstddSt|js/td|jddS)Nr1ztOutput was set to stdout '-' but it looks like stdout is connected to a terminal. Please redirect stdout to a file.writablezOutput stream is not writablezOutput file location (z) is not a writable file.) r5rstdoutisattyr rrr r rArrrcheck_requested_output_files      r r@r5optimize_messagesSequence[str] | None file_overheadrX page_overheadcCsJ|durg}zt|j}t|j}Wn ty YdSwt|}||t|j} Wdn1s:wY||} ||| } | dksQ|dkrSdSg} hd} | D]}t||drp| d| dddq[| ||j d r| d |jr| d | rd d | d }nd}td| dd|dS)Ng?ia>Z oversampler:r9r;r8FzThe argument --_r1z! was issued, causing transcoding.rgz8PDF/A conversion was enabled. (Try `--output-type pdf`.)zPlugins were used.z#Possible reasons for this include: r"z@No reason for this increase is known. Please report this issue.zThe output file size is z.2fu× larger than the input file. )rstatst_sizerpikepdfrlenr]getattrrWrTr[r4r+pluginsr-rr3)rr@r5rrrZ output_sizeZ input_sizepZreasonable_overheadratioZreasonable_ratioreasonsZ image_preprocargZ explanationrrrreport_output_file_size-sH         r)rr)rrrr rr)rrrr)rKrHrrL)rrr{rrr)rrrrrr)Nrr)rrr@rr5rrrrrXrrXrr)7__doc__ __future__rr)loggingrrrpargparserpathlibrshutilrtypingrrrxZpluggyrZocrmypdf._execrZocrmypdf.exceptionsr r r r Zocrmypdf.helpersr rrZocrmypdf.hocrtransformrZocrmypdf.subprocessrr( getLogger__name__rrr/r>rBrJrarerhrwryrzr~r}rrrrrrrsP             $   '    #