2022-07-25 10:42:56 -04:00
|
|
|
[![SWUbanner]][SWUdocs]
|
|
|
|
|
2019-03-27 15:58:36 -04:00
|
|
|
# PyPI publish GitHub Action
|
2021-02-19 14:00:25 -05:00
|
|
|
|
2020-06-03 11:53:04 -04:00
|
|
|
This action allows you to upload your [Python distribution packages]
|
2019-11-26 16:07:42 -05:00
|
|
|
in the `dist/` directory to PyPI.
|
2019-09-27 07:37:19 -04:00
|
|
|
This text suggests a minimalistic usage overview. For more detailed
|
|
|
|
walkthrough check out the [PyPA guide].
|
2019-03-27 15:58:36 -04:00
|
|
|
|
|
|
|
|
2022-07-25 11:25:08 -04:00
|
|
|
## 🌇 `master` branch sunset ❗
|
|
|
|
|
|
|
|
The `master` branch version has been sunset. Please, change the GitHub
|
|
|
|
Action version you use from `master` to `release/v1` or use an exact
|
|
|
|
tag, or a full Git commit SHA.
|
|
|
|
|
|
|
|
|
2019-03-27 15:58:36 -04:00
|
|
|
## Usage
|
2019-08-20 16:48:52 -04:00
|
|
|
|
2019-09-16 07:01:16 -04:00
|
|
|
To use the action add the following step to your workflow file (e.g.
|
2019-08-20 16:48:52 -04:00
|
|
|
`.github/workflows/main.yml`)
|
|
|
|
|
|
|
|
|
|
|
|
```yml
|
|
|
|
- name: Publish a Python distribution to PyPI
|
2021-02-19 14:05:09 -05:00
|
|
|
uses: pypa/gh-action-pypi-publish@release/v1
|
2019-08-20 16:48:52 -04:00
|
|
|
with:
|
2020-12-12 11:07:19 -05:00
|
|
|
password: ${{ secrets.PYPI_API_TOKEN }}
|
2019-03-27 15:58:36 -04:00
|
|
|
```
|
|
|
|
|
2022-07-25 17:07:43 -04:00
|
|
|
> **Pro tip**: instead of using branch pointers, like `unstable/v1`, pin
|
|
|
|
versions of Actions that you use to tagged versions or sha1 commit identifiers.
|
|
|
|
This will make your workflows more secure and better reproducible, saving you
|
|
|
|
from sudden and unpleasant surprises.
|
2019-09-24 17:03:49 -04:00
|
|
|
|
2019-08-20 16:48:52 -04:00
|
|
|
A common use case is to upload packages only on a tagged commit, to do so add a
|
|
|
|
filter to the step:
|
2019-03-27 15:58:36 -04:00
|
|
|
|
|
|
|
|
2019-08-20 16:48:52 -04:00
|
|
|
```yml
|
2020-06-03 11:49:53 -04:00
|
|
|
if: github.event_name == 'push' && startsWith(github.ref, 'refs/tags')
|
2019-08-20 16:48:52 -04:00
|
|
|
```
|
|
|
|
|
|
|
|
So the full step would look like:
|
|
|
|
|
|
|
|
|
|
|
|
```yml
|
|
|
|
- name: Publish package
|
2020-06-03 11:49:53 -04:00
|
|
|
if: github.event_name == 'push' && startsWith(github.ref, 'refs/tags')
|
2021-02-19 14:05:09 -05:00
|
|
|
uses: pypa/gh-action-pypi-publish@release/v1
|
2019-08-20 16:48:52 -04:00
|
|
|
with:
|
2020-12-12 11:07:19 -05:00
|
|
|
password: ${{ secrets.PYPI_API_TOKEN }}
|
2019-08-20 16:48:52 -04:00
|
|
|
```
|
|
|
|
|
2020-06-03 11:53:04 -04:00
|
|
|
The example above uses the new [API token][PyPI API token] feature of
|
|
|
|
PyPI, which is recommended to restrict the access the action has.
|
2019-08-20 16:48:52 -04:00
|
|
|
|
2020-12-12 11:07:19 -05:00
|
|
|
The secret used in `${{ secrets.PYPI_API_TOKEN }}` needs to be created on the
|
2019-09-24 17:04:57 -04:00
|
|
|
settings page of your project on GitHub. See [Creating & using secrets].
|
2019-03-27 15:58:36 -04:00
|
|
|
|
|
|
|
|
2019-09-12 08:06:55 -04:00
|
|
|
## Non-goals
|
|
|
|
|
|
|
|
This GitHub Action [has nothing to do with _building package
|
|
|
|
distributions_]. Users are responsible for preparing dists for upload
|
|
|
|
by putting them into the `dist/` folder prior to running this Action.
|
|
|
|
|
2021-02-19 14:22:31 -05:00
|
|
|
> **IMPORTANT**: Since this GitHub Action is docker-based, it can only
|
|
|
|
> be used from within GNU/Linux based jobs in GitHub Actions CI/CD
|
|
|
|
> workflows. This is by design and is unlikely to change due to a number
|
|
|
|
> of considerations we rely on.
|
|
|
|
>
|
|
|
|
> This should not stop one from publishing platform-specific
|
|
|
|
> distribution packages, though. It is strongly advised to separate jobs
|
|
|
|
> for building the OS-specific wheels from the publish job. This allows
|
|
|
|
> one to (1) test exactly the same artifacts that are about to be
|
|
|
|
> uploaded to PyPI, (2) prevent parallel unsynchronized jobs from
|
|
|
|
> publishing only part of the dists asynchronously (in case when part of
|
|
|
|
> the jobs fail and others succeed ending up with an incomplete release
|
|
|
|
> on PyPI) and (3) make an atomic upload to PyPI (when part of the dists
|
|
|
|
> appear on PyPI, installers like pip will use that version for the
|
|
|
|
> dependency resolution but this may cause some environments to use
|
2021-02-19 14:28:01 -05:00
|
|
|
> sdists while the wheel for their runtime is not yet available).
|
2021-02-19 14:22:31 -05:00
|
|
|
>
|
|
|
|
> To implement this sort of orchestration, please use
|
|
|
|
> `actions/upload-artifact` and `actions/download-artifact` actions for
|
|
|
|
> sharing the built dists across stages and jobs. Then, use the `needs`
|
|
|
|
> setting to order the build, test and publish stages.
|
|
|
|
|
2019-09-12 08:06:55 -04:00
|
|
|
|
2019-09-15 03:16:54 -04:00
|
|
|
## Advanced release management
|
|
|
|
|
|
|
|
For best results, figure out what kind of workflow fits your
|
|
|
|
project's specific needs.
|
2019-09-16 07:01:16 -04:00
|
|
|
|
2019-09-15 03:16:54 -04:00
|
|
|
For example, you could implement a parallel workflow that
|
2019-09-19 04:04:14 -04:00
|
|
|
pushes every commit to TestPyPI or your own index server,
|
2019-09-15 03:16:54 -04:00
|
|
|
like `devpi`. For this, you'd need to (1) specify a custom
|
|
|
|
`repository_url` value and (2) generate a unique version
|
|
|
|
number for each upload so that they'd not create a conflict.
|
2019-09-16 07:01:16 -04:00
|
|
|
The latter is possible if you use `setuptools_scm` package but
|
2019-09-15 03:16:54 -04:00
|
|
|
you could also invent your own solution based on the distance
|
|
|
|
to the latest tagged commit.
|
|
|
|
|
2019-09-16 07:01:16 -04:00
|
|
|
You'll need to create another token for a separate host and then
|
|
|
|
[save it as a GitHub repo secret][Creating & using secrets].
|
2019-09-15 09:24:35 -04:00
|
|
|
|
2019-09-15 03:16:54 -04:00
|
|
|
The action invocation in this case would look like:
|
|
|
|
```yml
|
2019-09-19 04:04:14 -04:00
|
|
|
- name: Publish package to TestPyPI
|
2021-02-19 14:05:09 -05:00
|
|
|
uses: pypa/gh-action-pypi-publish@release/v1
|
2019-09-15 03:16:54 -04:00
|
|
|
with:
|
2020-12-12 11:07:19 -05:00
|
|
|
password: ${{ secrets.TEST_PYPI_API_TOKEN }}
|
2019-09-15 03:16:54 -04:00
|
|
|
repository_url: https://test.pypi.org/legacy/
|
|
|
|
```
|
|
|
|
|
2019-12-06 07:44:40 -05:00
|
|
|
### Customizing target package dists directory
|
2019-12-05 18:25:02 -05:00
|
|
|
|
|
|
|
You can change the default target directory of `dist/`
|
|
|
|
to any directory of your liking. The action invocation
|
|
|
|
would now look like:
|
|
|
|
|
|
|
|
```yml
|
2019-12-06 07:42:24 -05:00
|
|
|
- name: Publish package to PyPI
|
2021-02-19 14:05:09 -05:00
|
|
|
uses: pypa/gh-action-pypi-publish@release/v1
|
2019-12-05 18:25:02 -05:00
|
|
|
with:
|
2020-12-12 11:07:19 -05:00
|
|
|
password: ${{ secrets.PYPI_API_TOKEN }}
|
2019-12-06 18:09:41 -05:00
|
|
|
packages_dir: custom-dir/
|
2019-12-05 18:25:02 -05:00
|
|
|
```
|
2019-09-15 03:16:54 -04:00
|
|
|
|
2020-06-03 11:04:52 -04:00
|
|
|
### Disabling metadata verification
|
2020-06-02 11:08:43 -04:00
|
|
|
|
2020-06-03 11:04:52 -04:00
|
|
|
It is recommended that you run `twine check` just after producing your files,
|
|
|
|
but this also runs `twine check` before upload. You can also disable the twine
|
|
|
|
check with:
|
2020-06-02 11:08:43 -04:00
|
|
|
|
|
|
|
```yml
|
|
|
|
with:
|
2020-06-03 11:04:52 -04:00
|
|
|
verify_metadata: false
|
2020-06-02 11:08:43 -04:00
|
|
|
```
|
|
|
|
|
2020-06-19 15:30:53 -04:00
|
|
|
### Tolerating release package file duplicates
|
|
|
|
|
|
|
|
Sometimes, when you publish releases from multiple places, your workflow
|
|
|
|
may hit race conditions. For example, when publishing from multiple CIs
|
2020-07-09 03:45:41 -04:00
|
|
|
or even having workflows with the same steps triggered within GitHub
|
2020-06-19 15:30:53 -04:00
|
|
|
Actions CI/CD for different events concerning the same high-level act.
|
|
|
|
|
|
|
|
To facilitate this use-case, you may use `skip_existing` (disabled by
|
|
|
|
default) setting as follows:
|
|
|
|
|
|
|
|
```yml
|
|
|
|
with:
|
|
|
|
skip_existing: true
|
|
|
|
```
|
|
|
|
|
|
|
|
> **Pro tip**: try to avoid enabling this setting where possible. If you
|
|
|
|
have steps for publishing to both PyPI and TestPyPI, consider only using
|
|
|
|
it for the latter, having the former fail loudly on duplicates.
|
|
|
|
|
2020-09-15 00:31:21 -04:00
|
|
|
### For Debugging
|
|
|
|
|
|
|
|
Sometimes, `twine upload` can fail and to debug use the `verbose` setting as follows:
|
|
|
|
|
|
|
|
```yml
|
|
|
|
with:
|
|
|
|
verbose: true
|
|
|
|
```
|
|
|
|
|
2022-01-07 23:41:13 -05:00
|
|
|
### Showing hash values of files to be uploaded
|
|
|
|
|
|
|
|
You may want to verify whether the files on PyPI were automatically uploaded by CI script.
|
|
|
|
It will show SHA256, MD5, BLAKE2-256 values of files to be uploaded.
|
|
|
|
|
|
|
|
```yml
|
|
|
|
with:
|
|
|
|
print_hash: true
|
|
|
|
```
|
|
|
|
|
2022-07-25 17:13:35 -04:00
|
|
|
### Specifying a different username
|
|
|
|
|
|
|
|
The default username value is `__token__`. If you publish to a custom
|
|
|
|
registry that does not provide API tokens, like `devpi`, you may need to
|
|
|
|
specify a custom username and password pair. This is how it's done.
|
|
|
|
|
|
|
|
```yml
|
|
|
|
with:
|
|
|
|
user: guido
|
|
|
|
password: ${{ secrets.DEVPI_PASSWORD }}
|
|
|
|
```
|
|
|
|
|
2019-03-27 15:58:36 -04:00
|
|
|
## License
|
2019-08-20 16:48:52 -04:00
|
|
|
|
2019-03-27 15:58:36 -04:00
|
|
|
The Dockerfile and associated scripts and documentation in this project
|
2019-03-29 18:48:49 -04:00
|
|
|
are released under the [BSD 3-clause license](LICENSE.md).
|
2019-08-20 16:48:52 -04:00
|
|
|
|
|
|
|
|
2019-09-24 17:04:57 -04:00
|
|
|
[Creating & using secrets]:
|
2019-11-23 13:35:12 -05:00
|
|
|
https://help.github.com/en/actions/automating-your-workflow-with-github-actions/creating-and-using-encrypted-secrets
|
2019-09-12 08:06:55 -04:00
|
|
|
[has nothing to do with _building package distributions_]:
|
|
|
|
https://github.com/pypa/gh-action-pypi-publish/issues/11#issuecomment-530480449
|
2019-09-27 07:37:19 -04:00
|
|
|
[PyPA guide]:
|
|
|
|
https://packaging.python.org/guides/publishing-package-distribution-releases-using-github-actions-ci-cd-workflows/
|
2020-06-03 11:53:04 -04:00
|
|
|
[PyPI API token]: https://pypi.org/help/#apitoken
|
|
|
|
[Python distribution packages]:
|
2022-07-25 16:55:14 -04:00
|
|
|
https://packaging.python.org/glossary/#term-Distribution-Package
|
2022-07-25 10:42:56 -04:00
|
|
|
[SWUbanner]:
|
|
|
|
https://raw.githubusercontent.com/vshymanskyy/StandWithUkraine/main/banner-direct-single.svg
|
|
|
|
[SWUdocs]:
|
|
|
|
https://github.com/vshymanskyy/StandWithUkraine/blob/main/docs/README.md
|