ImageMagick Static Binaries for AWS Lambda

imagemagick.bash

#!/usr/bin/env bash

# Must be run on an Amazon Linux AMI that matches AWS Lambda's runtime which can be found at:
# https://docs.aws.amazon.com/lambda/latest/dg/current-supported-versions.html
#
# As of May 21, 2019, this is:
# Amazon Linux AMI 2018.03.0 (ami-0756fbca465a59a30)
#
# You need to prepend PATH with the folder containing these binaries in your Lambda function 
# to ensure these newer binaries are used.
#
# In a NodeJS runtime, you would add something like the following to the top of
# your Lambda function file:
# process.env['PATH'] = process.env['LAMBDA_TASK_ROOT'] + '/imagemagick/bin:' + process.env['PATH']
#
# This works with both ImageMagick v6.x and v7.x
# version=6.9.10-23
version=7.0.8-45

sudo yum -y install libpng-devel libjpeg-devel libtiff-devel gcc
curl -O https://imagemagick.org/download/ImageMagick-$version.tar.gz 
tar zxvf ImageMagick-$version.tar.gz
cd ImageMagick-$version 
./configure --prefix=/var/task/imagemagick --enable-shared=no --enable-static=yes
make
sudo make install
tar zcvf ~/imagemagick.tgz /var/task/imagemagick/

Where to Place this Code ?

16. Update environment variables in your lambda function.

import os
os.environ["PATH"] = f"/opt/bin:{os.environ['PATH']}"
os.environ["LD_LIBRARY_PATH"] = f"/opt/lib:{os.environ['LD_LIBRARY_PATH']}"
os.environ["MAGICK_HOME"] = "/opt/"
os.environ["WAND_MAGICK_LIBRARY_SUFFIX"] = "-6.Q8"
os.environ["MAGICK_CONFIGURE_PATH"] = "/opt/etc/ImageMagick-6/"
os.environ["MAGICK_CODER_MODULE_PATH"] = "/opt/lib/ImageMagick-6.9.11/modules-Q8/coders/"

@R-Harishkumar You may place the code at the top of the Python file.

@samkit-jain

I created the layer with your ZIP file and added it to my lambda, along with the code from step 16,
but when I try to do: from wand.image import Image
I get this error: Unable to import module 'lambda_function': No module named 'wand'

And if I try to package wand myself and add it then I get the error where wand doesn't find the shared library for ImageMagick.

Is there any other step you took to get Wand working in AWS Lambda?

Hi @ClickheadZ Adding the ZIP file as a layer would give you the required libraries that you want at the OS level to communicate with imagemagick, gs, ... You still need the pip package files in your lambda archive. Did you add Wand as a dependency in your lambda function archive? Example here.

@samkit-jain Thanks for the response! I had not added it properly, I repackaged and deployed a zip now and I'm getting a different error, not sure what I did wrong.

Here are the steps I took to package Wand:

• Connect to an EC2 instance
• pip install --target=package wand, pip install --target=package magickwand
• scp the package to my computer, and zip the package along with my lambda function as per AWS zip deployment instructions

In lambda console, my lambda structure now looks like this:

myLambdaFunction
      - magickwand
      - magickwand-0.2.dist-info
      - wand
      - Wand-0.6.7.dist-info
      lambda_function.py

And when i try from wand.image import Image I now get the error message : Unable to import module 'lambda_function': MagickWand shared library not found.\nYou probably had not installed ImageMagick library despite the fact that I have deployed the imagemagick/ghostscript zip as a layer for this lambda and added it. Did I do something wrong in the Wand packaging or is the problem my lambda layer?

@ClickheadZ Facing same issue, were you able to find a fix?

Thanks~ It's work for me !!! But I found a small problem while using it：
curl download url: curl -O https://imagemagick.org/download/ImageMagick-$version.tar.gz , it will return 404 http status...
the ture url is: https://download.imagemagick.org/archive/ImageMagick-$version.tar.xz

@samkit-jain please can you help here , the layer you build is partially working for me as it doent have webp support , i need webp support so I followed the same steps but in docker container on linux , the difference is imagemagick is now updated to version 7 , there is no coders file at the same place as in 6 so i am also not sure what env vars to set in lmabda as well-

I am getting error on lambda ->

{
  "errorMessage": "Unable to import module 'lambda_function': MagickWand shared library not found.\nYou probably had not installed ImageMagick library.\nTry to install:\n  [https://docs.wand-py.org/en/latest/guide/install.html"](https://docs.wand-py.org/en/latest/guide/install.html%22),
  "errorType": "Runtime.ImportModuleError",
  "requestId": "",
  "stackTrace": []
}

this is my docker file ->

FROM amazonlinux:2 as builder
 
# Install development tools and libraries

RUN yum update -y && \

    yum install -y \

        gcc \

        gcc-c++ \

        make \

        autoconf \

        automake \

        libtool \

        git \

        wget \

        tar \

        gzip \

        zip \

        unzip \

        python3 \

        python3-devel \

        python3-pip \

        yum-utils
 
# Create directory structure for the Lambda layer

RUN mkdir -p /opt/python
 
# Install libwebp

WORKDIR /tmp

RUN wget https://storage.googleapis.com/downloads.webmproject.org/releases/webp/libwebp-1.3.0.tar.gz && \

    tar xzf libwebp-1.3.0.tar.gz && \

    cd libwebp-1.3.0 && \

    ./configure --prefix=/opt && \

    make && \

    make install
 
# Install ImageMagick with WebP support

WORKDIR /tmp

RUN wget https://imagemagick.org/archive/ImageMagick.tar.gz && \

    tar xzf ImageMagick.tar.gz && \

    cd ImageMagick-* && \

    ./configure --prefix=/opt \

                --with-webp \

                --disable-static \

                --enable-shared \

                --without-perl \

                --without-x \

                --without-xml \

                --without-pango && \

    make && \

    make install
 
# Install Wand (Python binding for ImageMagick)

RUN pip3 install --target=/opt/python wand
 
# Create the layer structure as expected by Lambda

FROM amazonlinux:2
 
# Install zip in the second stage

RUN yum update -y && \

    yum install -y zip
 
# Copy built libraries and python packages from the builder

COPY --from=builder /opt /opt
 
# Set up a directory for the final zip

RUN mkdir -p /layer
 
# Create layer.zip with the right structure

RUN cd /opt && zip -r9 /layer/layer.zip .
 
WORKDIR /layer

CMD ["/bin/bash"]

 

My lambda is running on python3.10 , i also tried the above with FROM public.ecr.aws/lambda/python:3.10 as builder image but same error.

please can someone help here , Thanks in Advance

您好，您的邮件我已收到，我会尽快与您联系，谢谢来信

@siddhant-grover I have not worked on this project for a long time so can't help with full debugging. However, it looks like the coders file for imagemagick-7 might be somewhere at ImageMagick-7.1.1/modules-Q16/coders or similar.

Also, AWS Lambda now has support for Docker images so you might be better off building a Docker and using that instead of adding a layer.