o e4@sRdZddlZddlZddlmZddlmZddlmZm Z m Z GdddZ dS) aExtract images from PDF. Both raster images and vector graphics are considered: * Normal images like jpeg or png could be extracted with method ``page.get_text('rawdict')`` and ``Page.get_images()``. Note the process for png images with alpha channel. * Vector graphics are actually composed of a group of paths, represented by operators like ``re``, ``m``, ``l`` and ``c``. They're detected by finding the contours with ``opencv``. N) Collection) BlockType)recursive_xy_cutinner_contoursxy_project_profilec@seZdZdejddfddZd%dejdefd d Zd%dejd efd d Z d&d efddZ dedededefddZ e dej dejfddZe dej defddZe dejfddZe dejd efd!d"Ze dej fd#d$ZdS)'ImagesExtractorpagereturnNcCs ||_dS)zwExtract images from PDF page. Args: page (fitz.Page): pdf page to extract images. N)_page)selfr r ND:\Projects\ConvertPro\env\Lib\site-packages\pdf2docx/image/ImagesExtractor.py__init__s zImagesExtractor.__init__@bboxzoomcCs`||j|dur|jj}n |jjr||jj}n|}||jj@}t||}|jj||dS)aClip page pixmap (without text) according to ``bbox``. Args: bbox (fitz.Rect, optional): Target area to clip. Defaults to None, i.e. entire page. Note that ``bbox`` depends on un-rotated page CS, while cliping page is based on the final page. zoom (float, optional): Improve resolution by this rate. Defaults to 3.0. Returns: fitz.Pixmap: The extracted pixmap. N)Zclipmatrix)_hide_page_textr rectrotationZrotation_matrixfitzZMatrixZ get_pixmap)r rr clip_bboxrr r rclip_page_to_pixmaps    z#ImagesExtractor.clip_page_to_pixmapclip_image_res_ratiocCs|j||d}|||S)arClip page pixmap (without text) according to ``bbox`` and convert to source image. Args: bbox (fitz.Rect, optional): Target area to clip. Defaults to None, i.e. entire page. clip_image_res_ratio (float, optional): Resolution ratio of clipped bitmap. Defaults to 3.0. Returns: list: A list of image raw dict. )rr)r _to_raw_dict)r rrpixr r rclip_page_to_dictAs z!ImagesExtractor.clip_page_to_dictcCs:|jj}|jj}t}|jjddD]-}t|}d|d<|j|}|jj}|D]}|dkr1q(| |s7q(| ||fq(qdd} | | } g} | D]M} t | dkrkt } | D]\}}| |O} q[|| |}n*| d\}}|||}|j }|r|||}n|||}|r||| |d <| |qM| S) aExtract normal images with ``Page.get_images()``. Args: clip_image_res_ratio (float, optional): Resolution ratio of clipped bitmap. Defaults to 3.0. Returns: list: A list of extracted and recovered image raw dict. .. note:: ``Page.get_images()`` contains each image only once, which may less than the real count of images in a page. T)fullrcSs|d|dS)Nr) intersects)abr r rysz0ImagesExtractor.extract_images..image)r parentrrZ get_imageslistZget_image_rectsZcropboxZget_arear!appendgrouplenrRectr_recover_pixmap colorspacer _rotate_image)r rdocrZicitemZrectsZunrotated_page_bboxrZfungroupsZimagesr*rZraw_dictrZ alpha_onlyr r rextract_imagesOs>         zImagesExtractor.extract_imagesmin_svg_gap_dxmin_svg_gap_dymin_wmin_hc sRddl}|jdd}||}|||j}||dd|j\} t||d} fdd | D} tt | | } d } | rt | D])\}\}}}}t |||||ddf||||f}| d ||qB| D]-\}}|\}}}}| |||f||fd d |D]\}}}}| |||f||fdd qqn| d||d| S)aFind contour of potential vector graphics. Args: min_svg_gap_dx (float): Merge svg if the horizontal gap is less than this value. min_svg_gap_dy (float): Merge svg if the vertical gap is less than this value. min_w (float): Ignore contours if the bbox width is less than this value. min_h (float): Ignore contours if the bbox height is less than this value. Returns: list: A list of potential svg region: (external_bbox, inner_bboxes:list). rN?)r)Zmin_dxZmin_dycsg|] }t|qSr )r).0rbinaryr7r6r r sz7ImagesExtractor.detect_svg_contours..Fz sub-image-)r:rrr%)rrr:img)cv2r_pixmap_to_cv_imageZcvtColorZCOLOR_BGR2GRAY thresholdZTHRESH_BINARY_INVrr(zip enumeraterZimshowZ rectangleZwaitKey)r r4r5r6r7cvpixmapsrcgray_Zexternal_bboxesZgrouped_inner_bboxesr2debugix0y0x1y1ZarrrZ inner_bboxesZu0Zv0u1v1r r<rdetect_svg_contourss,  0    z#ImagesExtractor.detect_svg_contoursr&cCs tjjt||j|j|dS)zStore Pixmap ``image`` to raw dict. Args: image (fitz.Pixmap): Pixmap to store. bbox (fitz.Rect): Boundary box the pixmap. Returns: dict: Raw dict of the pixmap. )typerwidthheightr&)rZIMAGEvaluetuplerTrUtobytes)r&rr r rrs  zImagesExtractor._to_raw_dictrFrcCsddl}ddl}t|}|jdd\}}|d|d}}d} |||f|| } || d} || d} t|| || } t|| || }| d| d|7<| d|d|7<||| | |f}| d |\}}| S) zRotate image represented by image bytes. Args: pixmap (fitz.Pixmap): Image to rotate. rotation (int): Rotation angle. Return: image bytes. rNrr8)rr)rr%)rr)r%rz.png) r@numpyrrAshapeZgetRotationMatrix2DabsintZ warpAffineZimencoderX)rFrrEnpr?hwrLrMscalercossinWHZ rotated_imgrIZim_pngr r rr/s   zImagesExtractor._rotate_imagecCsbdd|D}|||j}|D]}||dddddd}|||qd S) z$Hide page text before clipping page.cSsg|]\}}}}|qSr r )r;xrefnameZinvokerrr r rr>sz3ImagesExtractor._hide_page_text..sBTsBT 3 TrsTmsTm 3 TrsTdsTd 3 TrN)Z get_xobjectsextendZ get_contentsr'Z xref_streamreplaceZ update_stream)r Z xref_listr0restreamr r rrszImagesExtractor._hide_page_textr0r1cCs|d}|d}t||}|dkr>t||}|jr%t|d}d}|}|j|jkr8|j|jkr8t||}ntd||jrT|jjtj jtj jfvrTttj |}|S)a&Restore pixmap with soft mask considered. References: * https://pymupdf.readthedocs.io/en/latest/document.html#Document.getPageImageList * https://pymupdf.readthedocs.io/en/latest/faq.html#how-to-handle-stencil-masks * https://github.com/pymupdf/PyMuPDF/issues/670 Args: doc (fitz.Document): pdf document. item (list): image instance of ``page.get_images()``. Returns: fitz.Pixmap: Recovered pixmap with soft mask considered. rr%NzCIgnore image due to inconsistent size of color and mask pixmaps: %s) rPixmapalpharTrUloggingwarningr.rfZcsGRAYZcsRGB)r0r1xsrmasktempr r rr-+s    zImagesExtractor._recover_pixmapcCs0ddl}ddl}|}||||j|jS)znConvert fitz Pixmap to opencv image. Args: pixmap (fitz.Pixmap): PyMuPDF Pixmap. rN)r@rYrXZimdecodeZ frombufferZuint8Z IMREAD_COLOR)rFrEr]Zimg_byter r rrA[sz#ImagesExtractor._pixmap_to_cv_image)Nr)r)__name__ __module__ __qualname__rZPagerr,floatrrr3rR staticmethodrjrr\r/rZDocumentr(r-rAr r r rrs  #N7-/r) __doc__rlrZcommon.CollectionrZ common.sharerZcommon.algorithmrrrrr r r rs