Update dev workflow to use Pixi (#282)

VeckoTheGecko · web-flow · commit 3700f52a92ef · 2026-03-31T16:08:11.000+02:00
* Add pixi.toml configuration for environment management

- Define workspace with VirtualShip name and pixi-build preview
- Configure multiple test environments (py310, py311, py312)
- Set up feature environments for docs, typing, and pre-commit
- Define pixi tasks for tests, docs, linting, and type checking
- Align dependencies with existing pyproject.toml

* Update CI workflows to use Pixi

- Replace mamba-org/setup-micromamba with prefix-dev/setup-pixi
- Update test job to use pixi environments (test-py310, test-py312)
- Update typechecking job to use pixi run typing
- Enable pixi caching for faster CI runs
- Simplify workflow by removing manual dependency installation

* Update contributing guidelines for Pixi

- Replace Conda-based development setup with Pixi
- Add comprehensive Pixi workflows section with examples
- Document testing, docs, and code quality commands
- Include tips for environment management and CI reproduction
- Update dependency management instructions to reference pixi.toml

* Add Pixi badge to README

Add Pixi badge to indicate project uses Pixi for environment management

* Remove environment.yml

Environment management is now handled by pixi.toml. The environment.yml
file is no longer needed as all dependencies are defined in pixi.toml.

* Add virtualship source dependency

* Move pytest args to CI call

* Update RTD config

* Add caching of Pixi lock

* Pixi git files

* Remove license = key in pixi.toml

no longer needed since issue is resolved

* Update pixi-build-python backend version

* Update workflow to external pixi lock action

* Update default environment for Pixi

* Refactor pixi manifest to use run-dependencies

* Move environment definitions to the end of the file
diff --git a/.gitattributes b/.gitattributes
@@ -0,0 +1,2 @@
+# SCM syntax highlighting & preventing 3-way merges
+pixi.lock merge=binary linguist-language=YAML linguist-generated=true -diff
diff --git a/.github/workflows/ci.yml b/.github/workflows/ci.yml
@@ -19,61 +19,78 @@ env:
   # Many color libraries just need this to be set to any value, but at least
   # one distinguishes color depth, where "3" -> "256-bit color".
   FORCE_COLOR: 3
+  PIXI_VERSION: "v0.63.2"
 
 jobs:
+  cache-pixi-lock:
+    runs-on: ubuntu-slim
+    outputs:
+      cache-key: ${{ steps.pixi-lock.outputs.cache-key }}
+      pixi-version: ${{ steps.pixi-lock.outputs.pixi-version }}
+    steps:
+      - uses: actions/checkout@v4
+      - uses: Parcels-code/pixi-lock/create-and-cache@9a2866f8258b87a3c616d5ad7d51c6cd853df78b
+        id: pixi-lock
+        with:
+          pixi-version: ${{env.PIXI_VERSION}}
+      - uses: actions/upload-artifact@v6 # make available as an artifact for local testing
+        with:
+          name: pixi-lock
+          path: pixi.lock
+
   tests:
-    name: tests (${{ matrix.runs-on }} | Python ${{ matrix.python-version }})
+    name: "Unit tests: ${{ matrix.runs-on }} | pixi run -e ${{ matrix.pixi-environment }} tests"
     runs-on: ${{ matrix.runs-on }}
+    needs: cache-pixi-lock
     strategy:
       fail-fast: false
       matrix:
-        python-version: ["3.10", "3.12"]
+        pixi-environment: ["test-py310", "test-py312"]
         runs-on: [ubuntu-latest, windows-latest, macos-14]
-
     steps:
       - uses: actions/checkout@v6
         with:
           fetch-depth: 0
-      - uses: mamba-org/setup-micromamba@v2
+      - uses: Parcels-code/pixi-lock/restore@9a2866f8258b87a3c616d5ad7d51c6cd853df78b
         with:
-          environment-name: ship
-          environment-file: environment.yml
-          create-args: >-
-            python=${{matrix.python-version}}
-
-      - run: pip install . --no-deps
+          cache-key: ${{ needs.cache-pixi-lock.outputs.cache-key }}
+      - uses: prefix-dev/setup-pixi@v0.9.4
+        with:
+          cache: true
+          cache-write: ${{ github.event_name == 'push' && github.ref_name == 'main' }}
+          pixi-version: ${{ needs.cache-pixi-lock.outputs.pixi-version }}
 
       - name: Test package
-        run: >-
-          python -m pytest -ra --cov --cov-report=xml --cov-report=term
+        run:
+          pixi run -e ${{ matrix.pixi-environment }} tests -ra --cov --cov-report=xml --cov-report=term
           --durations=20
 
       - name: Upload coverage report
         uses: codecov/codecov-action@v5.5.2
         with:
           token: ${{ secrets.CODECOV_TOKEN }}
-  # typechecking:
-  #   name: mypy
-  #   runs-on: ubuntu-latest
-  #   steps:
-  #     - uses: actions/checkout@v6
-  #       with:
-  #         fetch-depth: 0
-  #     - uses: mamba-org/setup-micromamba@v2
-  #       with:
-  #         environment-name: ship
-  #         environment-file: environment.yml
-  #         create-args: >-
-  #           python=3.12
-
-  #     - run: pip install . --no-deps
-  #     - run: conda install lxml # dep for report generation
-  #     - name: Typechecking
-  #       run: |
-  #         mypy --install-types --non-interactive src/virtualship --html-report mypy-report
-  #     - name: Upload test results
-  #       if: ${{ always() }} # Upload even on mypy error
-  #       uses: actions/upload-artifact@v4
-  #       with:
-  #         name: Mypy report
-  #         path: mypy-report
+#   typechecking:
+#     name: "TypeChecking: pixi run typing"
+#     runs-on: ubuntu-latest
+#     if: false
+#     needs: cache-pixi-lock
+#     steps:
+#       - uses: actions/checkout@v4
+#         with:
+#           fetch-depth: 0
+#       - uses: Parcels-code/pixi-lock/restore@9a2866f8258b87a3c616d5ad7d51c6cd853df78b
+#         with:
+#           cache-key: ${{ needs.cache-pixi-lock.outputs.cache-key }}
+#       - uses: prefix-dev/setup-pixi@v0.9.4
+#         with:
+#           cache: true
+#           pixi-version: ${{ needs.cache-pixi-lock.outputs.pixi-version }}
+#           cache-write: ${{ github.event_name == 'push' && github.ref_name == 'main' }}
+#       - name: Typechecking
+#         run: pixi run typing --non-interactive --html-report mypy-report
+#       - name: Upload test results
+#         if: ${{ always() }} # Upload even on mypy error
+#         uses: actions/upload-artifact@v4
+#         with:
+#           name: Mypy report
+#           path: mypy-report
diff --git a/.gitignore b/.gitignore
@@ -1,3 +1,8 @@
+# pixi environments
+.pixi/*
+!.pixi/config.toml
+
+
 # Byte-compiled / optimized / DLL files
 __pycache__/
 *.py[cod]
diff --git a/.readthedocs.yaml b/.readthedocs.yaml
@@ -1,18 +1,17 @@
-# Read the Docs configuration file
-# See https://docs.readthedocs.io/en/stable/config-file/v2.html for details
-
 version: 2
-sphinx:
-  configuration: docs/conf.py
 build:
-  os: ubuntu-22.04
+  os: ubuntu-lts-latest
   tools:
-    python: mambaforge-22.9
+    python: "latest" # just so RTD stops complaining
   jobs:
-    pre_build:
-      - pip install .
-      - sphinx-build -b linkcheck docs/ _build/linkcheck
-      - sphinx-apidoc -o docs/api/ --module-first --no-toc --force src/virtualship
-
-conda:
-  environment: environment.yml
+    create_environment:
+      - asdf plugin add pixi
+      - asdf install pixi latest
+      - asdf global pixi latest
+    install:
+      - pixi install -e docs
+    build:
+      html:
+        - pixi run -e docs sphinx-build -T -b html docs $READTHEDOCS_OUTPUT/html
+sphinx:
+  configuration: docs/conf.py
diff --git a/README.md b/README.md
@@ -7,6 +7,7 @@
 
 <!-- Badges -->
 
+[![Pixi Badge](https://img.shields.io/endpoint?url=https://raw.githubusercontent.com/prefix-dev/pixi/main/assets/badge/v0.json)](https://pixi.sh)
 [![Anaconda-release](https://anaconda.org/conda-forge/virtualship/badges/version.svg)](https://anaconda.org/conda-forge/virtualship/)
 ![PyPI - Python Version](https://img.shields.io/pypi/pyversions/virtualship)
 [![DOI](https://zenodo.org/badge/682478059.svg)](https://doi.org/10.5281/zenodo.14013931)
diff --git a/docs/contributing/index.md b/docs/contributing/index.md
@@ -8,36 +8,66 @@ We have a design document providing a conceptual overview of VirtualShip. This d
 
 ### Development installation
 
-We use `conda` to manage our development installation. Make sure you have `conda` installed by following [the instructions here](https://docs.conda.io/projects/conda/en/latest/user-guide/install/index.html) and then run the following commands:
+```{note}
+VirtualShip uses [Pixi](https://pixi.sh) to manage environments and run developer tooling. Pixi is a modern alternative to Conda and also includes other powerful tooling useful for a project like VirtualShip. It is our sole development workflow - we do not offer a Conda development workflow. Give Pixi a try, you won't regret it!
+```
+
+To get started contributing to VirtualShip:
+
+**Step 1:** [Install Pixi](https://pixi.sh/latest/).
+
+**Step 2:** [Fork the repository](https://docs.github.com/en/pull-requests/collaborating-with-pull-requests/working-with-forks/fork-a-repo#forking-a-repository)
+
+**Step 3:** Clone your fork and `cd` into the repository.
+
+**Step 4:** Install the Pixi environment
 
 ```bash
-conda create -n ship python=3.10
-conda activate ship
-conda env update --file environment.yml
-pip install -e . --no-deps --no-build-isolation
+pixi install
 ```
 
-This creates an environment, and installs all the dependencies that you need for development, including:
+Now you have a development installation of VirtualShip, as well as a bunch of developer tooling to run tests, check code quality, and build the documentation! Simple as that.
+
+### Pixi workflows
+
+You can use the following Pixi commands to run common development tasks.
 
-- core dependencies
-- development dependencies (e.g., for testing)
-- documentation dependencies
+**Testing**
 
-then installs the package in editable mode.
+- `pixi run tests` - Run the full test suite using pytest with coverage reporting
+- `pixi run tests-notebooks` - Run notebook tests
 
-### Useful commands
+**Documentation**
 
-The following commands are useful for local development:
+- `pixi run docs` - Build the documentation using Sphinx
+- `pixi run docs-watch` - Build and auto-rebuild documentation when files change (useful for live editing)
 
-- `pytest` to run tests
-- `pre-commit run --all-files` to run pre-commit checks
-- `pre-commit install` (optional) to install pre-commit hooks
-  - this means that every time you commit, pre-commit checks will run on the files you changed
-- `sphinx-autobuild docs docs/_build` to build and serve the documentation
-- `sphinx-apidoc -o docs/api/ --module-first --no-toc --force src/virtualship` (optional) to generate the API documentation
-- `sphinx-build -b linkcheck docs/ _build/linkcheck` to check for broken links in the documentation
+**Code quality**
 
-The running of these commands is useful for local development and quick iteration, but not _vital_ as they will be run automatically in the CI pipeline (`pre-commit` by pre-commit.ci, `pytest` by GitHub Actions, and `sphinx` by ReadTheDocs).
+- `pixi run lint` - Run pre-commit hooks on all files (includes formatting, linting, and other code quality checks)
+- `pixi run typing` - Run mypy type checking on the codebase
+
+**Different environments**
+
+VirtualShip supports testing against different environments (e.g., different Python versions) with different feature sets. In CI we test against these environments, and you can too locally. For example:
+
+- `pixi run -e test-py310 tests` - Run tests using Python 3.10
+- `pixi run -e test-py311 tests` - Run tests using Python 3.11
+- `pixi run -e test-py312 tests` - Run tests using Python 3.12
+
+The name of the workflow on GitHub contains the command you have to run locally to recreate the workflow - making it super easy to reproduce CI failures locally.
+
+**Typical development workflow**
+
+1. Make your code changes
+2. Run `pixi run lint` to ensure code formatting and style compliance
+3. Run `pixi run tests` to verify your changes don't break existing functionality
+4. If you've added new features, run `pixi run typing` to check type annotations
+5. If you've modified documentation, run `pixi run docs` to build and verify the docs
+
+```{tip}
+You can run `pixi info` to see all available environments and `pixi task list` to see all available tasks across environments.
+```
 
 ## For maintainers
 
@@ -52,5 +82,5 @@ The running of these commands is useful for local development and quick iteratio
 
 When adding a dependency, make sure to modify the following files where relevant:
 
-- `environment.yml` for core and development dependencies (important for the development environment, and CI)
+- `pixi.toml` for core and development dependencies (important for the development environment, and CI)
 - `pyproject.toml` for core dependencies (important for the pypi package, this should propagate through automatically to `recipe/meta.yml` in the conda-forge feedstock)
diff --git a/environment.yml b/environment.yml
diff --git a/pixi.toml b/pixi.toml

Original file line number	Diff line number	Diff line change
`@@ -0,0 +1,2 @@`
	`1`	`+# SCM syntax highlighting & preventing 3-way merges`
	`2`	`+pixi.lock merge=binary linguist-language=YAML linguist-generated=true -diff`