--- myst: substitutions: im0: |- ```{image} /images/congress_im0.jpg :width: 2in ``` --- # Working with images PDFs embed images as binary stream objects within the PDF's data stream. The stream object's dictionary describes properties of the image such as its dimensions and color space. The same image may be drawn multiple times on multiple pages, at different scales and positions. In some cases such as JPEG2000, the standard file format of the image is used verbatim, even when the file format contains headers and information that is repeated in the stream dictionary. In other cases such as for PNG-style encoding, the image file format is not used directly. pikepdf currently has no facility to embed new images into PDFs. We recommend img2pdf instead, because it does the job so well. pikepdf instead allows for image inspection and lossless/transcode free (where possible) "pdf2img". pikepdf also cannot extract vector images, that is images produced through a combination of PDF drawing commands. These are produced by a content stream, or sometimes a Form XObject. Unfortunately there may not be anything in the PDF that indicates a particular sequence of operations produces an image, and that sequence is not necessarily all in the same place. To extract a vector image, use a PDF viewer/editor to crop to that image. ## Finding the images on a page Use {meth}`pikepdf.Page.get_images` to enumerate the images a page draws. It returns a mapping of resource name to image object: ```python >>> page = pdf.pages[0] >>> images = page.get_images() # {'/Im0': , ...} ``` By default `get_images()` **recurses into form XObjects**. A form XObject is a reusable bundle of PDF drawing operations -- not to be confused with an interactive form -- and a page very commonly draws its entire visible content through one or more of them. An image nested two or three form XObjects deep is still, visually, an image on the page, so `get_images()` finds it. Pass `recursive=False` to report only images referenced directly by the page's own resources. :::{warning} The older {attr}`pikepdf.Page.images` property is **deprecated** as of pikepdf 10.9. It reports only images referenced *directly* by the page and silently omits any image drawn through a form XObject. Because it is not visually obvious when a page's content is wrapped in a form XObject, `page.images` could make a page that clearly displays images appear to "have no images" at all. Use `page.get_images()` instead (or `page.get_images(recursive=False)` for the old, non-recursive behavior). ::: If two images in different XObject scopes happen to share the same resource name (for example both are called `/Im0` in their own scope), only one of them appears in the merged mapping that `get_images()` returns. This is a consequence of returning a single name-keyed mapping; the underlying objects are still distinct. ## Playing with images pikepdf provides a helper class {class}`~pikepdf.PdfImage` for manipulating images in a PDF. The helper class helps manage the complexity of the image dictionaries. ```{eval-rst} .. doctest:: >>> from pikepdf import Pdf, PdfImage, Name >>> example = Pdf.open('../tests/resources/congress.pdf') >>> page1 = example.pages[0] >>> list(page1.get_images().keys()) ['/Im0'] >>> rawimage = page1.get_images()['/Im0'] # The raw object/dictionary >>> pdfimage = PdfImage(rawimage) >>> type(pdfimage) ``` In Jupyter (or IPython with a suitable backend) the image will be displayed. {{ im0 }} You can also inspect the properties of the image. The parameters are similar to Pillow's. ```{eval-rst} .. doctest:: >>> pdfimage.colorspace '/DeviceRGB' >>> pdfimage.width, pdfimage.height (1000, 1520) ``` :::{note} `.width` and `.height` are the resolution of the image in pixels, not the size of the image in page coordinates. The size of the image in page coordinates is determined by the content stream. ::: (extract-image)= ## Extracting images Extracting images is straightforward. {meth}`~pikepdf.PdfImage.extract_to` will extract images to a specified file prefix. The extension is determined while extracting and appended to the filename. Where possible, `extract_to` writes compressed data directly to the stream without transcoding. (Transcoding lossy formats like JPEG can reduce their quality.) ```python >>> pdfimage.extract_to(fileprefix='image') 'image.jpg' ``` It also possible to extract to a writable Python stream using `` .extract_to(stream=...`) ``. You can also retrieve the image as a Pillow image (this will transcode): ```{eval-rst} .. doctest:: >>> type(pdfimage.as_pil_image()) ``` Another way to view the image is using Pillow's `Image.show()` method. Not all image types can be extracted. Also, some PDFs describe an image with a mask, with transparency effects. pikepdf can only extract the images themselves, not rasterize them exactly as they would appear in a PDF viewer. In the vast majority of cases, however, the image can be extracted as it appears. ## Stored bytes are not the presentation image The raw bytes stored in an image stream are not, on their own, the picture a viewer displays. The stream dictionary carries extra parameters that tell a viewer how to *interpret* those bytes -- the color space, bit depth, and in particular the `/Decode` array. Two images with byte-for-byte identical sample data can present as entirely different pictures depending on these parameters. The `/Decode` array remaps each stored sample value to a value in the color space before rendering. The most familiar case is `[1, 0]` on a grayscale image, which inverts it: stored `0` presents as white and stored `255` as black. A viewer applies `/Decode`; so, by default, does pikepdf when you extract an image. {meth}`pikepdf.PdfImage.as_pil_image` and {meth}`pikepdf.PdfImage.extract_to` apply `/Decode` as a linear per-channel mapping for grayscale, RGB and CMYK raster images, so the extracted image matches what a viewer renders. If you instead want the **raw stored sample values** with the least processing -- for forensic inspection of the underlying data, say -- pass `apply_decode_array=False`: ```python >>> raw = pdfimage.as_pil_image(apply_decode_array=False) # stored samples, /Decode ignored >>> shown = pdfimage.as_pil_image() # default: matches a PDF viewer ``` A couple of image types are intentionally unaffected by this parameter, because applying `/Decode` ourselves would be wrong: - **Indexed (palette) color spaces**, where `/Decode` remaps *palette indices* rather than colors. pikepdf does not reinterpret these and emits a warning if a non-identity `/Decode` is present. - **DCT (JPEG) and JPX (JPEG 2000)** images, whose codecs carry their own color semantics -- such as the Adobe `APP14` marker that signals inverted CMYK -- which Pillow already honors. Re-applying `/Decode` would double-invert them. The takeaway: an extracted image's bytes reflect a *choice* about how much interpretation to apply. The default reproduces the presentation; pass `apply_decode_array=False` only when you specifically want the stored data. ## What looks like one image may be many It is tempting to assume that one thing you see on a page corresponds to one image object you can pull out and edit. PDF offers no such guarantee. Accessing "the image" on a page is like an HTML parser scanning for the first `` tag it finds -- a lot more could be happening. A page that *looks* like it shows a single picture may in fact be composited from many pieces: - **Multiple image objects tiled or layered together** -- a scanner might split one physical page into several stripes, or a designer might stack a photo, a logo, and a background as separate images. - **Image masks, soft masks (`/SMask`), and transparency groups** that combine a base image with one or more masks to produce the final appearance. The colors you see are the *result* of compositing, not the contents of any single stream. - **Vector drawing** -- lines, fills, and shadings produced by content-stream operators rather than stored as a raster image at all (see the note on vector images above). - **Form XObjects** that group images and drawing operations into a reusable unit drawn as a whole, possibly several times. So when you set out to "extract the image" from a page, be prepared to discover that the reality is more complex than a single JPEG. pikepdf can hand you the individual image streams; it does not rasterize or composite them into the single picture a viewer renders. For that you need a renderer such as those listed on the {doc}`home page `. ### One image, many appearances The reverse situation is just as common: a single image object can be **drawn multiple times** -- on the same page at different positions and scales, or across many pages of the document. Each *placement* is just a reference; the pixel data lives in one stream. This has a direct consequence for editing. Because the content stream controls where and at what size an image is drawn, replacing one image stream changes **every** place that stream is drawn. Conversely, if a document has several visually identical images that are actually separate objects (common when a file was assembled from multiple sources), editing one will not touch the others. If you need to change exactly one occurrence, you must first determine whether the occurrences share an object or not -- two placements of the same object cannot be edited independently without first duplicating the object. (replace-image)= ## Replacing an image In this example we extract an image and replace it with a grayscale equivalent. ```{eval-rst} .. doctest:: >>> import zlib >>> rawimage = pdfimage.obj >>> pillowimage = pdfimage.as_pil_image() >>> grayscale = pillowimage.convert('L') >>> grayscale = grayscale.resize((32, 32)) >>> rawimage.write(zlib.compress(grayscale.tobytes()), filter=Name("/FlateDecode")) >>> rawimage.ColorSpace = Name("/DeviceGray") >>> rawimage.Width, rawimage.Height = 32, 32 ``` Notes on this example: - It is generally possible to use `zlib.compress()` to generate compressed image data, although this is not as efficient as using a program that knows it is preparing a PDF. This works only when the filter is set to FlateDecode. You cannot use most other compression algorithms, since in general they are not supported in PDF. - In general we can resize an image to any scale. The PDF content stream specifies where to draw an image and at what scale. - This example would replace all occurrences of the image if it were used multiple times in a PDF. ## Removing an image The easy way to remove an image is to replace it with a 1x1 pixel transparent image. A transparent image can be created by setting the `/ImageMask` to true. Note that, if an image is referenced on multiple pages, this procedure only updates the occurrence on one page. If all references to the image are deleted, it should not be included in the output file. ```{eval-rst} .. doctest:: >>> pdf = pikepdf.open('../tests/resources/sandwich.pdf') >>> page = pdf.pages[0] >>> image_name, image = next(iter(page.get_images().items())) >>> new_image = pdf.make_stream(b'\xff') >>> new_image.Width, new_image.Height = 1, 1 >>> new_image.BitsPerComponent = 1 >>> new_image.ImageMask = True >>> new_image.Decode = [0, 1] >>> page.Resources.XObject[image_name] = new_image ```