Skip to content
This repository was archived by the owner on Jun 12, 2023. It is now read-only.
Draft
Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
34 commits
Select commit Hold shift + click to select a range
5b5f63f
Update release process for Windows hosts
simonjayhawkins Aug 21, 2020
68de0e7
wip - updates during 1.1.2 release
simonjayhawkins Sep 8, 2020
d5521ab
1.1.2 -> 1.1.3
simonjayhawkins Oct 5, 2020
3cac915
Merge remote-tracking branch 'upstream/master' into release-1.1.1
simonjayhawkins Oct 24, 2020
ac09b98
updates to windows.md
simonjayhawkins Oct 26, 2020
ccede2b
wip - add WSL 2 instructions
simonjayhawkins Oct 27, 2020
dfab0cf
wip - add WSL 2 instructions
simonjayhawkins Oct 28, 2020
e3cc626
wip - add WSL 2 instructions
simonjayhawkins Oct 30, 2020
6582d10
[wip] 1.1.5/1.2.0rc0 releases
simonjayhawkins Nov 25, 2020
2486d19
[wip] prep 1.2.0rc0 release
simonjayhawkins Nov 29, 2020
893dcd2
[wip] prep 1.2.0rc0 release
simonjayhawkins Dec 5, 2020
ab38edf
[wip] prep 1.2.0rc0 release
simonjayhawkins Dec 16, 2020
33d26bd
remove windows host instructions (not WSL)
simonjayhawkins Dec 18, 2020
8a8e5b1
[wip] prep 1.2.0 release
simonjayhawkins Dec 21, 2020
851f300
changes for 1.2.0 release
simonjayhawkins Jan 1, 2021
512ca6d
[wip] release 1.2.1
simonjayhawkins Jan 20, 2021
5cbdd73
update for 1.2.2
simonjayhawkins Feb 7, 2021
91a1926
update README.md
simonjayhawkins Feb 13, 2021
8c21c1e
release 1.2.3
simonjayhawkins Mar 2, 2021
e9e5f21
update TAG to v1.2.4
simonjayhawkins Apr 10, 2021
c8b68de
update for v1.3.0rc1
simonjayhawkins Jun 13, 2021
54d0118
updates for conda-forge PR
simonjayhawkins Jun 16, 2021
83c86df
update for 1.3.1
simonjayhawkins Jul 24, 2021
043d799
update for 1.3.3
simonjayhawkins Sep 22, 2021
5e0b063
update for 1.3.4
simonjayhawkins Oct 20, 2021
42f6d16
add conda package cache for doc container build
simonjayhawkins Nov 7, 2021
14f386a
fix doc build deleting sdist
simonjayhawkins Nov 26, 2021
8d3c6a2
v1.4.0rc0 prep
simonjayhawkins Jan 3, 2022
477807d
1.4.0rc release
simonjayhawkins Jan 10, 2022
d28823e
v1.4.0 prep
simonjayhawkins Jan 19, 2022
d2e88cc
update Makefile
simonjayhawkins Jan 22, 2022
fe83a5d
1.4.1 release
simonjayhawkins Apr 2, 2022
3c94d71
v1.4.2 release
simonjayhawkins Apr 6, 2022
1ff3688
v1.4.3 release prep
simonjayhawkins Jun 15, 2022
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
[wip] 1.1.5/1.2.0rc0 releases
  • Loading branch information
simonjayhawkins committed Nov 25, 2020
commit 6582d1079e16c567117b5d9e896cf0f2cd4ef16e
15 changes: 15 additions & 0 deletions Dockerfile
Original file line number Diff line number Diff line change
Expand Up @@ -6,3 +6,18 @@ RUN apt-get update && \
RUN conda update conda -y \
&& conda install -y conda-build conda-verify gcc_linux-64 gxx_linux-64 \
&& conda clean --all

# ARG USER_ID
# ARG GROUP_ID

# RUN addgroup --gid $GROUP_ID user
# RUN adduser --disabled-password --gecos '' --uid $USER_ID --gid $GROUP_ID user

# # https://github.com/ContinuumIO/docker-images/issues/151
# RUN mkdir /opt/conda/envs/user && \
# chgrp user /opt/conda/pkgs && \
# chmod g+w /opt/conda/pkgs && \
# touch /opt/conda/pkgs/urls.txt && \
# chown user /opt/conda/envs/user /opt/conda/pkgs/urls.txt

# USER user
22 changes: 11 additions & 11 deletions Makefile
Original file line number Diff line number Diff line change
@@ -1,7 +1,8 @@
# TO EDIT
TAG ?= v1.1.4

# TAG ?= v1.2.0rc0
TAG ?= v1.1.5
GH_USERNAME ?= simonjayhawkins

PANDAS_VERSION=$(TAG:v%=%)
PANDAS_BASE_VERSION=$(shell echo $(PANDAS_VERSION) | awk -F '.' '{OFS="."} { print $$1, $$2}')
TARGZ=pandas-$(PANDAS_VERSION).tar.gz
Expand All @@ -14,15 +15,12 @@ SHELL := /bin/bash
# -----------------------------------------------------------------------------

init-repos:
git clone https://github.com/pandas-dev/pandas && git -C pandas remote rename origin upstream && git -C pandas remote add origin https://github.com/$(GH_USERNAME)/pandas
git clone https://github.com/conda-forge/pandas-feedstock && git -C pandas-feedstock remote rename origin upstream && git -C pandas-feedstock remote add origin https://github.com/$(GH_USERNAME)/pandas-feedstock
git clone --recursive https://github.com/MacPython/pandas-wheels && git -C pandas-wheels remote rename origin upstream && git -C pandas-wheels remote add origin https://github.com/$(GH_USERNAME)/pandas-wheels
git clone https://github.com/pandas-dev/pandas && git -C pandas remote rename origin upstream && git -C pandas remote add origin https://github.com/$(GH_USERNAME)/pandas
git clone https://github.com/MacPython/pandas-wheels && git -C pandas-wheels remote rename origin upstream && git -C pandas-wheels remote add origin https://github.com/$(GH_USERNAME)/pandas-wheels

update-repos:
git -C pandas checkout master && git -C pandas pull
git -C pandas-wheels checkout master && git -C pandas-wheels pull
git -C pandas-feedstock checkout master && git -C pandas-feedstock pull
pushd pandas-wheels && git submodule update --recursive --remote && popd

# -----------------------------------------------------------------------------
# Git Tag
Expand All @@ -37,10 +35,11 @@ tag:
# Builder Images
# -----------------------------------------------------------------------------

docker-image: pandas
docker-image:
docker build -t pandas-build .


# docker build -t pandas-build \
# --build-arg USER_ID=$(shell id -u) \
# --build-arg GROUP_ID=$(shell id -g) .
docker-doc:
docker build -t pandas-docs -f docker-files/docs/Dockerfile .

Expand All @@ -49,13 +48,14 @@ docker-doc:
# sdist
# -----------------------------------------------------------------------------

pandas/dist/$(TARGZ):
sdist:
docker run -it --rm \
--name=pandas-sdist-build \
-v ${CURDIR}/pandas:/pandas \
-v ${CURDIR}/scripts:/scripts \
pandas-build \
sh /scripts/build_sdist.sh
sudo chown -R $(shell id -u):$(shell id -g) pandas/dist/

# -----------------------------------------------------------------------------
# Tests
Expand Down
46 changes: 22 additions & 24 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -4,6 +4,11 @@ Release automation for pandas.

## Steps to a release

The `environment.yml` contains the local dependencies. You'll
also need docker.

And fork pandas-feedstock and pandas-wheels to your GitHub account.

- [ ] Manually update
- [ ] `TAG` in `Makefile`
- [ ] `GH_USERNAME` in `Makefile`
Expand All @@ -14,11 +19,6 @@ If running for the first time be sure to initialize repos
make init-repos
```

The `environment.yml` contains the local dependencies. You'll
also need docker.

And fork pandas-feedstock and pandas-wheels to your GitHub account.

```
# Update repos
make update-repos
Expand All @@ -30,7 +30,7 @@ make tag
make docker-image docker-doc

# Build the sdist
make pandas/dist/<>.tar.gz
make sdist

# Final Pip and Conda tests. Do these in parallel.
# You can optionally do make doc here as well
Expand All @@ -41,6 +41,22 @@ make conda-test
make push-tag
```

Start the binary build. **For Mac users** you may need to download the GNU version of sed before running this scripts via `brew install gnu-sed`

```
make wheels
```

Open PRs for each of those.

Note that `make wheels` actually pushes a job to MacPython to produce wheels which we will download later.

Docs. You can cheat and re-tag / rebuild these if needed.

```
make doc
```

Now manually create a release https://github.com/pandas-dev/pandas/releases

Make sure to upload the sdist that's in `pandas/dist/` as the "binary".
Expand All @@ -57,24 +73,6 @@ git tag -a v<NEXT_TAG>.dev0 -m 'DEV: Start <NEXT_TAG> cycle'
git push upstream master --follow-tags
```

Start the binary builds. **For Mac users** you may need to download the GNU version of sed before running this scripts via `brew install gnu-sed`

```
# Binaries
make conda-forge
make wheels
```

Open PRs for each of those.

Note that `make wheels` actually pushes a job to MacPython to produce wheels which we will download later.

Docs. You can cheat and re-tag / rebuild these if needed.

```
make doc
```

Once the binaries finish, you'll need to manually upload the wheels to PyPI.

Assuming the job which `make wheels` triggered on MacPython completed successfully (you may want to double check this https://anaconda.org/multibuild-wheels-staging/pandas/files) you can download a copy of the wheels locally.
Expand Down
5 changes: 3 additions & 2 deletions windows-wsl.md
Original file line number Diff line number Diff line change
Expand Up @@ -63,6 +63,7 @@ configure git manually
```
git config --global user.email "<your-email>"
git config --global user.name "<your-name>"
git config --global pull.rebase false
```

or copy the configuration from windows.
Expand Down Expand Up @@ -112,10 +113,10 @@ find /mnt/c/ -name "chrome.exe" 2>/dev/null

then open index.html in the browser
```
"/mnt/c/Program Files/Google/Chrome/Application/chrome.exe" pandas/doc/build/html/index.html
"/mnt/c/Program Files (x86)/Google/Chrome/Application/chrome.exe" pandas/doc/build/html/index.html
```

and the same for the pdf documentation
```
"/mnt/c/Program Files/Google/Chrome/Application/chrome.exe" pandas/doc/build/latex/pandas.pdf
"/mnt/c/Program Files (x86)/Google/Chrome/Application/chrome.exe" pandas/doc/build/latex/pandas.pdf
```