Need help with cibuildwheel?
Click the β€œchat” button below for chat support from the developer who created it, or find similar developers for support.

About the developer

joerick
554 Stars 68 Forks Other 1.3K Commits 32 Opened issues

Description

🎑 Build Python wheels for all the platforms on CI with minimal configuration.

Services available

!
?

Need anything else?

Contributors list

No Data

cibuildwheel

PyPI Documentation Status Build Status Build status CircleCI Build Status

Documentation

Python wheels are great. Building them across Mac, Linux, Windows, on multiple versions of Python, is not.

cibuildwheel
is here to help.
cibuildwheel
runs on your CI server - currently it supports Azure Pipelines, Travis CI, AppVeyor, GitHub Actions and CircleCI - and it builds and tests your wheels across all of your platforms.

What does it do?

| | macOS x8664 | Windows 64bit | Windows 32bit | manylinux x8664 | manylinux i686 | manylinux aarch64 | manylinux ppc64le | manylinux s390x | |---|---|---|---|---|---|---|---|---| | CPython 2.7 | βœ… | βœ…ΒΉ | βœ…ΒΉ | βœ… | βœ… | | | | | CPython 3.5 | βœ… | βœ… | βœ… | βœ… | βœ… | βœ…Β² | βœ…Β² | βœ…Β³ | | CPython 3.6 | βœ… | βœ… | βœ… | βœ… | βœ… | βœ…Β² | βœ…Β² | βœ…Β³ | | CPython 3.7 | βœ… | βœ… | βœ… | βœ… | βœ… | βœ…Β² | βœ…Β² | βœ…Β³ | | CPython 3.8 | βœ… | βœ… | βœ… | βœ… | βœ… | βœ…Β² | βœ…Β² | βœ…Β³ | | CPython 3.9 | βœ… | βœ… | βœ… | βœ… | βœ… | βœ…Β² | βœ…Β² | βœ…Β³ | | PyPy 2.7 v7.3.3 | βœ… | | βœ… | βœ… | | | | | | PyPy 3.6 v7.3.3 | βœ… | | βœ… | βœ… | | | | | | PyPy 3.7 (beta) v7.3.3 | βœ… | | βœ… | βœ… | | | | |

ΒΉ Not supported on Travis
Β² Only supported on Travis
Β³ Beta support until Travis CI fixes a bug

  • Builds manylinux, macOS and Windows wheels for CPython and PyPy using Azure Pipelines, Travis CI, AppVeyor, and CircleCI
  • Bundles shared library dependencies on Linux and macOS through auditwheel and delocate
  • Runs the library test suite against the wheel-installed version of your library

Usage

cibuildwheel
currently works on Travis CI, Azure Pipelines, AppVeyor, GitHub Actions, CircleCI, and Gitlab CI. Check the table below for supported platforms on each service:

| | Linux | macOS | Windows | Linux ARM | |-----------------|-------|-------|---------|--------------| | Azure Pipelines | βœ… | βœ… | βœ… | ✴️¹ | | Travis CI | βœ… | βœ… | βœ… | βœ… | | AppVeyor | βœ… | βœ… | βœ… | | | GitHub Actions | βœ… | βœ… | βœ… | ✴️¹ | | CircleCI | βœ… | βœ… | | | | Gitlab CI | βœ… | | | |

ΒΉ Requires a "third-party build host"; expected to work with cibuildwheel but not directly tested by our CI.

cibuildwheel
is not intended to run on your development machine. Because it uses system Python from Python.org it will try to install packages globally - not what you expect from a build tool! Instead, isolated CI services like those mentioned above are ideal.

Example setup

To build manylinux, macOS, and Windows wheels on Travis CI and upload them to PyPI whenever you tag a version, you could use this

.travis.yml
:
language: python

jobs: include: # perform a linux build - services: docker # and a mac build - os: osx language: shell # and a windows build - os: windows language: shell before_install: - choco install python --version 3.8.0 - export PATH="/c/Python38:/c/Python38/Scripts:$PATH" # make sure it's on PATH as 'python3' - ln -s /c/Python38/python.exe /c/Python38/python3.exe

env: global: - TWINE_USERNAME=token # Note: TWINE_PASSWORD is set to a PyPI API token in Travis settings

install:

  • python3 -m pip install cibuildwheel==1.7.0

script:

build the wheels, put them into './wheelhouse'

  • python3 -m cibuildwheel --output-dir wheelhouse

after_success:

if the release was tagged, upload them to PyPI

  • | if [[ $TRAVIS_TAG ]]; then python3 -m pip install twine python3 -m twine upload wheelhouse/*.whl fi

For more information, including how to build on GitHub Actions, Appveyor, Azure Pipelines, or CircleCI, check out the documentation and the examples.

Options

| | Option | Description | |---|--------|-------------| | Build selection |

CIBW_PLATFORM
| Override the auto-detected target platform | | |
CIBW_BUILD

CIBW_SKIP
| Choose the Python versions to build | | Build customization |
CIBW_ENVIRONMENT
| Set environment variables needed during the build | | |
CIBW_BEFORE_ALL
| Execute a shell command on the build system before any wheels are built. | | |
CIBW_BEFORE_BUILD
| Execute a shell command preparing each wheel's build | | |
CIBW_REPAIR_WHEEL_COMMAND
| Execute a shell command to repair each (non-pure Python) built wheel | | |
CIBW_MANYLINUX_X86_64_IMAGE

CIBW_MANYLINUX_I686_IMAGE

CIBW_MANYLINUX_PYPY_X86_64_IMAGE

CIBW_MANYLINUX_AARCH64_IMAGE

CIBW_MANYLINUX_PPC64LE_IMAGE

CIBW_MANYLINUX_S390X_IMAGE
| Specify alternative manylinux docker images | | |
CIBW_DEPENDENCY_VERSIONS
| Specify how cibuildwheel controls the versions of the tools it uses | | Testing |
CIBW_TEST_COMMAND
| Execute a shell command to test each built wheel | | |
CIBW_BEFORE_TEST
| Execute a shell command before testing each wheel | | |
CIBW_TEST_REQUIRES
| Install Python dependencies before running the tests | | |
CIBW_TEST_EXTRAS
| Install your wheel for testing using extras_require | | Other |
CIBW_BUILD_VERBOSITY
| Increase/decrease the output of pip wheel |

Working examples

Here are some repos that use cibuildwheel.

  • Matplotlib - The venerable Matplotlib, a Python library with C++ portions, built for Linux, Mac, and Windows on Github Actions.
  • pyinstrument_cext - A simple C extension, without external dependencies, built on Travis CI/Appveyor.
  • websockets
  • Parselmouth - A Python interface to the Praat software package, using pybind11, C++17 and CMake, with the core Praat static library built only once and shared between wheels; all platforms built on Github Actions.
  • python-admesh
  • pybase64
  • KDEpy
  • AutoPy
  • apriltags2-ethz
  • TgCrypto
  • twisted-iocpsupport - A submodule of Twisted that hooks into native C APIs using Cython. Built on Github CI for Windows.
  • gmic-py
  • creme
  • PyAV
  • aiortc
  • aioquic
  • pikepdf
  • fathon
  • etebase-py - Python bindings to a Rust library using
    setuptools-rust
    , and
    sccache
    for improved speed, built on Travis CI.
  • xmlstarlet - Python 3.6+ CFFI bindings with true MSVC build and GitHub Actions.
  • bx-python - A library that includes Cython extensions, built on Travis CI for Mac and Linux.

Add your repo here! Send a PR.

I'd like to include notes here to indicate why an example might be interesting to cibuildwheel users - the styles/technologies/techniques used in each. Please include that in future additions!

Legal note

Since

cibuildwheel
repairs the wheel with
delocate
or
auditwheel
, it might automatically bundle dynamically linked libraries from the build machine.

It helps ensure that the library can run without any dependencies outside of the pip toolchain.

This is similar to static linking, so it might have some licence implications. Check the license for any code you're pulling in to make sure that's allowed.

Changelog

1.7.0

26 November 2020

  • ✨ New logging format, that uses 'fold groups' in CI services that support it. (#458)
  • πŸ›  Update PyPy to 7.3.3 (#460)
  • πŸ› Fix a bug where CIBWBEFOREALL runs with a very old version of Python on Linux. (#464)

1.6.4

31 October 2020

  • πŸ› Fix crash on Appveyor during nuget install due to old system CA certificates. We now use certifi's CA certs to download files. (#455)

1.6.3

12 October 2020

  • πŸ› Fix missing SSL certificates on macOS (#447)
  • πŸ›  Update OpenSSL Python 3.5 patch to 1.1.1h on macOS (#449)

1.6.2

9 October 2020

  • ✨ Python 3.9 updated to the final release version - v3.9.0 (#440)
  • πŸ›  Pypy updated to v7.3.2, adding alpha support for Python 3.7 (#430)

1.6.1

20 September 2020

  • πŸ›  Add PPC64LE manylinux image supporting Python 3.9. (#436)
  • πŸ“š Add project URLs to PyPI listing (#428)

1.6.0

9 September 2020

  • 🌟 Add Python 3.9 support! This initial support uses release candidate builds. You can start publishing wheels for Python 3.9 now, ahead of the official release. (#382)

Minor note - if you're building PPC64LE wheels, the manylinux image pinned by this version is still on Python 3.9b3, not a release candidate. We'd advise holding off on distributing 3.9 ppc64le wheels until a subsequent version of cibuildwheel. - 🌟 Add Gitlab CI support. Gitlab CI can now build Linux wheels, using cibuildwheel. (#419) - πŸ› Fix a bug that causes pyproject.toml dependencies to fail to install on Windows (#420) - πŸ“š Added some information about Windows VC++ runtimes and how they relate to wheels.

1.5.5

22 July 2020

  • πŸ› Fix a bug that would cause command substitutions in CIBW_ENVIRONMENT to produce no output on Linux (#411)
  • πŸ› Fix regression (introduced in 1.5.3) which caused BEFOREBUILD and BEFOREALL to be executed in the wrong directory (#410)

1.5.4

19 June 2020

  • πŸ› Fix a bug that would cause command substitutions in CIBW_ENVIRONMENT variables to not interpret quotes in commands correctly (#406, #408)

1.5.3

19 July 2020

  • πŸ›  Update CPython 3.8 to 3.8.3 (#405)
  • πŸ›  Internal refactoring of Linux build, to move control flow into Python (#386)

1.5.2

8 July 2020

  • πŸ› Fix an issue on Windows where pyproject.toml would cause an error when some requirements formats were used. (#401)
  • πŸ›  Update CPython 3.7 to 3.7.8 (#394)

1.5.1

25 June 2020

  • πŸ› Fix "OSError: [WinError 17] The system cannot move the file to a different disk drive" on Github Actions (#388, #389)

1.5.0

24 June 2020

  • 🌟 Add
    CIBW_BEFORE_ALL
    option, which lets you run a command on the build machine before any wheels are built. This is especially useful when building on Linux, to
    make
    something external to Python, or to
    yum install
    a dependency. (#342)
  • ✨ Added support for projects using pyproject.toml instead of setup.py (#360, #358)
  • ✨ Added workaround to allow Python 3.5 on Windows to pull dependencies from pyproject.toml. (#358)
  • πŸ“š Improved Github Actions examples and docs (#354, #362)
  • πŸ› Ensure pip wheel uses the specified package, and doesn't build a wheel from PyPI (#369)
  • πŸ›  Internal changes: using pathlib.Path, precommit hooks, testing improvements.

1.4.2

25 May 2020

  • πŸ›  Dependency updates, including CPython 3.8.3 & manylinux images.
  • πŸ›  Lots of internal updates - type annotations and checking using mypy, and a new integration testing system.
  • ⚠️ Removed support for running cibuildwheel using Python 3.5. cibuildwheel will continue to build Python 3.5 wheels until EOL.

1.4.1

4 May 2020

  • πŸ› Fix a bug causing programs running inside the i686 manylinux images to think they were running x86_64 and target the wrong architecture. (#336, #338)

1.4.0

2 May 2020

  • 🌟 Deterministic builds. cibuildwheel now locks the versions of the tools it uses. This means that pinning your version of cibuildwheel pins the versions of pip, setuptools, manylinux etc. that are used under the hood. This should make things more reliable. But note that we don't control the entire build environment on macOS and Windows, where the version of Xcode and Visual Studio can still effect things.

This can be controlled using the CIBWDEPENDENCYVERSIONS and manylinux image options - if you always want to use the latest toolchain, you can still do that, or you can specify your own pip constraints file and manylinux image. (#256) - ✨ Added

package_dir
command line option, meaning we now support building a package that lives in a subdirectory and pulls in files from the wider project. See the
package_dir
option help
for more information.

Note that this change makes the working directory (where you call cibuildwheel from) relevant on Linux, as it's considered the 'project' and will be copied into the Docker container. If your builds are slower on this version, that's likely the reason.

cd
to your project and then call
cibuildwheel
from there. (#319, #295) - πŸ›  On macOS, we make
MACOSX_DEPLOYMENT_TARGET
default to
10.9
if it's not set. This should make things more consistent between Python versions. - πŸ›  Dependency updates - CPython 3.7.7, CPython 2.7.18, Pypy 7.3.1.

1.3.0

12 March 2020

  • 🌟 Add support for building on Github Actions! Check out the docs for information on how to set it up. (#194)
  • ✨ Add the
    CIBW_BEFORE_TEST
    option, which lets you run a command to prepare the environment before your tests are run. (#242)

1.2.0

8 March 2020

  • 🌟 Add support for building PyPy wheels, across Manylinux, macOS, and Windows. (#185)
  • 🌟 Added the ability to build ARM64 (aarch64), ppc64le, and s390x wheels, using manylinux2014 and Travis CI. (#273)
  • ✨ You can now build macOS wheels on Appveyor. (#230)
  • πŸ›  Changed default macOS minimum target to 10.9, from 10.6. This allows the use of more modern C++ libraries, among other things. (#156)
  • πŸ›  Stop building universal binaries on macOS. We now only build x86_64 wheels on macOS. (#220)
  • ✨ Allow chaining of commands using
    &&
    and
    ||
    on Windows inside CIBWBEFOREBUILD and CIBWTESTCOMMAND. (#293)
  • πŸ›  Improved error reporting for failed Cython builds due to stale .so files (#263)
  • πŸ›  Update CPython from 3.7.5 to 3.7.6 and from 3.8.0 to 3.8.2 on Mac/Windows
  • πŸ›  Improved error messages when a bad config breaks cibuildwheel's PATH variable. (#264)
  • ⚠️ Removed support for running cibuildwheel on Python 2.7. cibuildwheel will continue to build Python 2.7 wheels for a little while. (#265)

1.1.0

7 December 2019

  • 🌟 Add support for building manylinux2014 wheels. To use, set
    CIBW_MANYLINUX_X86_64_IMAGE
    and CIBWMANYLINUXI686_IMAGE to
    manylinux2014
    .
  • ✨ Add support for Linux on Appveyor (#204, #207)
  • ✨ Add
    CIBW_REPAIR_WHEEL_COMMAND
    env variable, for changing how
    auditwheel
    or
    delocate
    are invoked, or testing an equivalent on Windows. (#211)
  • πŸ“š Added some travis example configs - these are available in /examples. (#228)

1.0.0

10 November 2019

  • 🌟 Add support for building Python 3.8 wheels! (#180)
  • 🌟 Add support for building manylinux2010 wheels. cibuildwheel will now build using the manylinux2010 images by default. If your project is still manylinux1 compatible, you should get both manylinux1 and manylinux2010 wheels - you can upload both to PyPI. If you always require manylinux1 wheels, you can build using the old manylinux1 image using the manylinux image option. (#155)
  • πŸ“š Documentation is now on its own mini-site, rather than on the README (#169)
  • ✨ Add support for building Windows wheels on Travis CI. (#160)
  • πŸ›  If you set
    CIBW_TEST_COMMAND
    , your tests now run in a virtualenv. (#164)
  • πŸ›  Windows now uses Python as installed by nuget, rather than the versions installed by the various CI providers. (#180)
  • πŸ›  Update Python from 2.7.16 to 2.7.17 and 3.7.4 to 3.7.5 on macOS (#171)
  • ⚠️ Removed support for Python 3.4 (#168)

0.12.0

29 September 2019

  • ✨ Add CIBWTESTEXTRAS option, to allow testing using extrarequire options. For example, set `CIBWTESTEXTRAS=test,qt
    to make the wheel
    installed with
    pip install <wheel
    file>[test,qt]`
  • πŸ›  Update Python from 3.7.2 to 3.7.4 on macOS
  • πŸ›  Update OpenSSL patch to 1.0.2t on macOS

0.11.1

28 May 2019

  • πŸ› Fix missing file in the release tarball, that was causing problems with Windows builds (#141)

0.11.0

26 May 2019

  • 🌟 Add support for building on Azure pipelines! This lets you build all Linux, Mac and Windows wheels on one service, so it promises to be the easiest to set up! Check out the quickstart in the docs, or cibuildwheel-azure-example for an example project. (#126, #132)
  • πŸ›  Internal change - the end-to-end test projects format was updated, so we can more precisely assert what should be produced for each one. (#136, #137).

0.10.2

10 March 2019

  • πŸ›  Revert temporary fix in macOS, that was working around a bug in pip 19 (#129)
  • πŸ›  Update Python to 2.7.16 on macOS
  • πŸ›  Update OpenSSL patch to 1.0.2r on macOS

0.10.1

3 February 2019

  • πŸ› Fix build stalling on macOS (that was introduced in pip 19) (#122)
  • πŸ› Fix "AttributeError: 'Popen' object has no attribute 'args'" on Python 2.7 for Linux builds (#108)
  • πŸ›  Update Python from 3.6.7, 3.7.1 to 3.6.8, 3.7.2 on macOS
  • πŸ›  Update openssl patch from 1.0.2p to 1.0.2q on macOS
  • πŸ›  Sorting build options dict items when printing preamble (#114)

0.10.0

23 September 2018

  • 🌟 Add
    CIBW_BUILD
    option, for specifying which specific builds to perform (#101)
  • 🌟 Add support for building Mac and Linux on CircleCI (#91, #97)
  • πŸ›  Improved support for building universal wheels (#95)
  • πŸ›  Ensure log output is unbuffered and therefore in the correct order (#92)
  • πŸ›  Improved error reporting for errors that occur inside a package's setup.py (#88)
  • ⚠️ Removed support for Python 3.3 on Windows.

0.9.4

29 July 2018

  • πŸ›  CIBWTESTCOMMAND now runs in a shell on Mac (as well as Linux) (#81)

0.9.3

10 July 2018

  • πŸ›  Update to Python 3.6.6 on macOS (#82)
  • ✨ Add support for building Python 3.7 wheels on Windows (#76)
  • ⚠️ Deprecated support for Python 3.3 on Windows.

0.9.2

1 July 2018

  • πŸ›  Update Python 3.7.0rc1 to 3.7.0 on macOS (#79)

0.9.1

18 June 2018

  • πŸ›  Removed the need to use
    {python}
    and
    {pip}
    in
    CIBW_BEFORE_BUILD
    statements, by ensuring the correct version is always on the path at
    python
    and
    pip
    instead. (#60)
  • πŸ›  We now patch the _ssl module on Python 3.4 and 3.5 so these versions can still make SSL web requests using TLS 1.2 while building. (#71)

0.9.0

18 June 2018

  • ✨ Add support for Python 3.7 (#73)

0.8.0

4 May 2018

  • ⚠️ Drop support for Python 3.3 on Linux (#67)
  • πŸ› Fix TLS by updating setuptools (#69)

0.7.1

2 April 2017

  • πŸ› macOS: Fix Pip bugs resulting from PyPI TLS 1.2 enforcement
  • πŸ› macOS: Fix brew Python3 version problems in the CI

0.7.0

7 January 2018

  • ✨ You can now specify a custom docker image using the
    CIBW_MANYLINUX1_X86_64_IMAGE
    and
    CIBW_MANYLINUX1_I686_IMAGE
    options. (#46)
  • πŸ› Fixed a bug where cibuildwheel would download and build a package from PyPI(!) instead of building the package on the local machine. (#51)

0.6.0

9 October 2017

  • ✨ On the Linux build, the host filesystem is now accessible via
    /host
    (#36)
  • πŸ› Fixed a bug where setup.py scripts would run the wrong version of Python when running subprocesses on Linux (#35)

0.5.1

10 September 2017

  • πŸ› Fixed a couple of bugs on Python 3.
  • ✨ Added experimental support for Mac builds on Bitrise.io

0.5.0

7 September 2017

  • ✨
    CIBW_ENVIRONMENT
    added. You can now set environment variables for each build, even within the Docker container on Linux. This is a big one! (#21)
  • ✨
    CIBW_BEFORE_BUILD
    now runs in a system shell on all platforms. You can now do things like
    CIBW_BEFORE_BUILD="cmd1 && cmd2"
    . (#32)

0.4.1

14 August 2017

  • πŸ› Fixed a bug on Windows where subprocess' output was hidden (#23)
  • πŸ› Fixed a bug on AppVeyor where logs would appear in the wrong order due to output buffering (#24, thanks @YannickJadoul!)

0.4.0

23 July 2017

  • πŸ› Fixed a bug that was increasing the build time by building the wheel twice. This was a problem for large projects that have a long build time. If you're upgrading and you need the old behaviour, use
    CIBW_BEFORE_BUILD={pip} install .
    , or install exactly the dependencies you need in
    CIBW_BEFORE_BUILD
    . See #18.

0.3.0

27 June 2017

  • ⚠️ Removed Python 2.6 support on Linux (#12)

0.2.1

11 June 2017

  • πŸ›  Changed the build process to install the package before building the wheel - this allows direct dependencies to be installed first (#9, thanks @tgarc!)
  • ✨ Added Python 3 support for the main process, for systems where Python 3 is the default (#8, thanks @tgarc).

0.2.0

13 April 2017

  • ✨ Added
    CIBW_SKIP
    option, letting users explicitly skip a build
  • ✨ Added
    CIBW_BEFORE_BUILD
    option, letting users run a shell command before the build starts

0.1.3

31 March 2017

  • 🌟 First public release!

Contributing

For more info on how to contribute to cibuildwheel, see the docs.

Maintainers

Credits

cibuildwheel
stands on the shoulders of giants.

Massive props also to-

See also

If you'd like to keep wheel building separate from the package itself, check out astrofrog/autowheel. It builds packages using cibuildwheel from source distributions on PyPI.

If

cibuildwheel
is too limited for your needs, consider matthew-brett/multibuild.
multibuild
is a toolbox for building a wheel on various platforms. It can do a lot more than this project - it's used to build SciPy!

We use cookies. If you continue to browse the site, you agree to the use of cookies. For more information on our use of cookies please see our Privacy Policy.