Compile on MacOS from Source Code¶

1. Enter the terminal of the Mac¶

2. Please select the path where you want to store PaddlePaddle, and then use the following command to clone PaddlePaddle’s source code from github to a folder named Paddle in the local current directory:¶

git clone https://github.com/PaddlePaddle/Paddle.git

3. Go to the Paddle directory:¶

cd Paddle

4. Pull PaddlePaddle image¶

For domestic users, when downloading docker is slow due to network problems, you can use the mirror provided by Baidu:

• CPU version of PaddlePaddle：

docker pull registry.baidubce.com/paddlepaddle/paddle:latest-dev

If your machine is not in mainland China, you can pull the image directly from DockerHub:

• CPU version of PaddlePaddle：

docker pull paddlepaddle/paddle:latest-dev

You can see DockerHub to get the image that matches your machine.

5. Create and enter a Docker container that meets the compilation environment:¶

docker run --name paddle-test -v $PWD:/paddle --network=host -it registry.baidubce.com/paddlepaddle/paddle:latest-dev /bin/bash

• --name paddle-test: name the Docker container you created as paddle-test,

• -v $PWD:/paddle: mount the current directory to the /paddle directory in the Docker container (the PWD variable in Linux will expand to the current path’s Absolute path),

• -it: keeps interacting with the host;

• registry.baidubce.com/paddlepaddle/paddle:latest-dev: creates a Docker container with a mirror named registry.baidubce.com/paddlepaddle/paddle:latest-dev, /bin /bash starts the /bin/bash command after entering the container.

Note: Please make sure to allocate at least 4g of memory for docker, otherwise the compilation process may fail due to insufficient memory. You can set a container’s memory allocation cap in “Preferences-Resources” in the docker UI.

6. After entering Docker, go to the paddle directory:¶

cd /paddle

7. Switch to a more stable version to compile:¶

git checkout [name of the branch]

For example：

git checkout release/2.3

Note: python3.6、python3.7 version started supporting from release/1.2 branch, python3.8 version started supporting from release/1.8 branch, python3.9 version started supporting from release/2.1 branch, python3.10 version started supporting from release/2.3 branch

8. Create and enter the /paddle/build path:¶

mkdir -p /paddle/build && cd /paddle/build

9. Use the following command to install the dependencies:¶

Install protobuf 3.1.0.

pip3.7 install protobuf==3.1.0

Note: We used Python3.7 command as an example above, if the version of your Python is 3.6/3.8/3.9/3.10, please change pip3.7 in the commands to pip3.6/pip3.8/pip3.9/pip3.10

Installing patchelf, PatchELF is a small and useful program for modifying the dynamic linker and RPATH of ELF executables.

apt install patchelf

10. Execute cmake:¶

• For users who need to compile the CPU version PaddlePaddle (We currently do not support the compilation of the GPU version PaddlePaddle under MacOS):

  cmake .. -DPY_VERSION=3.7 -DWITH_GPU=OFF -DWITH_TESTING=OFF -DWITH_AVX=OFF -DCMAKE_BUILD_TYPE=Release
  

For details on the compilation options, see the compilation options table.

Please attention to modify parameters -DPY_VERSION for the version of Python you want to compile with, for example -DPY_VERSION=3.7 means the version of python is 3.7

11. Execute compilation:¶

Use multicore compilation

make -j$(nproc)

Note: During the compilation process, you need to download dependencies from github. Please make sure that your compilation environment can download the code from github normally.

12. After compiling successfully, go to the /paddle/build/python/dist directory and find the generated .whl package:¶

cd /paddle/build/python/dist

13. Install the compiled .whl package on the current machine or target machine: (For Python3: Please select the pip corresponding to the python version you wish to use, such as pip3.6)¶

For Python3:

pip3.7 install -U [whl package name]

Note: We used Python3.7 command as an example above, if the version of your Python is 3.6/3.8/3.9/3.10, please change pip3.7 in the commands to pip3.6/pip3.8/pip3.9/pip3.10.

Congratulations, now that you have successfully installed PaddlePaddle using Docker, you only need to run PaddlePaddle after entering the Docker container. For more Docker usage, please refer to the official Docker documentation.¶

1. Check that your computer and operating system meet our supported compilation standards: uname -m and view the system version about this Mac. And install OpenCV in advance.¶

2. Install python and pip:¶

Please do not use the Python initially given by MacOS, we strongly recommend that you use Homebrew to install python (for Python3 please use python official download python3.6.x, python3.7.x, python3.8, python3.9, python3.10), pip and other dependencies, This will greatly reduce the difficulty of installing and compiling.

Install using Python official website

Please note that when you have multiple pythons installed on your mac, make sure that the python you are using is the python you wish to use.

3. (Only For Python3) Set Python-related environment variables:¶

• a. First use

  find `dirname $(dirname $(which python3))` -name "libpython3.*.dylib"
  

  to find the path to Pythonlib (the first one it prompts is the dylib path for the python you need to use), then (below [python-lib-path] is replaced by finding the file path)

• b. Set PYTHON_LIBRARIES:

  export PYTHON_LIBRARY=[python-lib-path]
  

• c. Secondly use the path to find PythonInclude (usually find the above directory of [python-lib-path] as the include of the same directory, then find the path of python3.x in the directory), then (the [python-include-path] in the following commands should be replaced by the path found here)

• d. Set PYTHON_INCLUDE_DIR:

  export PYTHON_INCLUDE_DIRS=[python-include-path]
  

• e. Set the system environment variable path:

  export PATH=[python-bin-path]:$PATH
  

  (here [python-bin-path] is the result of replacing the last two levels of [python-lib-path] with the path after /bin/)

• f. Set the dynamic library link:

  export LD_LIBRARY_PATH=[python-ld-path]
  

  and

  export DYLD_LIBRARY_PATH=[python-ld-path]
  

  (here [python-ld-path] is the [python-bin-path]’s parent directory )

• g. (Optional) If you are compiling PaddlePaddle on MacOS 10.14, make sure you have the appropriate version of Xcode installed.

4. Before compilation, please confirm that the relevant dependencies mentioned in the compilation dependency table are installed in your environment, otherwise we strongly recommend using Homebrew to install related dependencies.¶

Under MacOS, if you have not modified or installed the dependencies mentioned in the “Compile Dependency Table”, you only need to use pip to install numpy, protobuf, wheel, use homebrew to install wget, swig,then install cmake.

• a. Here is a special description of the installation of CMake:

  We support CMake version 3.15 and above, CMake 3.16 is recommended, please follow the steps below to install:

  1. Download the CMake image from the official CMake website and install it.

  2. Enter

     sudo "/Applications/CMake.app/Contents/bin/cmake-gui" –install
     

     in the console

• b. If you do not want to use the system default blas and want to use your own installed OPENBLAS please read FAQ

5. Put the PaddlePaddle source cloned in the Paddle folder in the current directory and go to the Paddle directory:¶

git clone https://github.com/PaddlePaddle/Paddle.git

cd Paddle

6. Switch to a more stable release branch to compile: (Note that python 3.6, python 3.7 version are supported from the 1.2 branch, python3.8 version started supporting from release/1.8 branch, python3.9 version started supporting from release/2.1 branch, python3.10 version started supporting from release/2.3 branch)¶

git checkout [name of the branch]

For example：

git checkout release/2.3

7. And please create and enter a directory called build:¶

mkdir build && cd build

8. Execute cmake:¶

For details on the compilation options, see the compilation options table.

• If you use Mac M1 machine, and need to compile the Arm architecture, CPU version PaddlePaddle:

  cmake .. -DPY_VERSION=3.8 -DPYTHON_INCLUDE_DIR=${PYTHON_INCLUDE_DIRS} \
  -DPYTHON_LIBRARY=${PYTHON_LIBRARY} -DWITH_GPU=OFF -DWITH_TESTING=OFF \
  -DWITH_AVX=OFF -DWITH_ARM=ON -DCMAKE_BUILD_TYPE=Release
  

• If you don’t use Mac M1 machine, and need to compile the x86_64 architecture, CPU version PaddlePaddle:

  cmake .. -DPY_VERSION=3.8 -DPYTHON_INCLUDE_DIR=${PYTHON_INCLUDE_DIRS} \
  -DPYTHON_LIBRARY=${PYTHON_LIBRARY} -DWITH_FLUID_ONLY=ON -DWITH_GPU=OFF -DWITH_TESTING=OFF -DCMAKE_BUILD_TYPE=Release
  

• -DPY_VERSION=3.8 Please change to the Python version of the installation environment.

• If compiling paddlepaddle for arm architecture, you need cmake version 3.19.2 or above

9. Compile with the following command:¶

• If you use Mac M1 machine, and need to compile the Arm architecture, CPU version PaddlePaddle:

  make TARGET=ARMV8 -j4
  

• If you don’t use Mac M1 machine, and need to compile the x86_64 architecture, CPU version PaddlePaddle:

  make -j4
  

10. After compiling successfully, go to the /paddle/build/python/dist directory and find the generated .whl package:¶

cd /paddle/build/python/dist

11. Install the compiled .whl package on the current machine or target machine:¶

pip install -U (whl package name)

or

pip3 install -U (whl package name)

Congratulations, now you have completed the process of compiling PaddlePaddle using this machine.¶