Skip to content

Commit 09092b4

Browse files
committed
chore: update to version 1.1.0 with bug fix documentation
1 parent 2856cb7 commit 09092b4

19 files changed

Lines changed: 50 additions & 39 deletions

CHANGELOG.md

Lines changed: 9 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,3 +1,12 @@
1+
### 1.1.0 - 03/20/2025
2+
3+
**Changes**:
4+
5+
- Fixed ligand scoring bug affecting the Astex Diverse, DockGen-E, and PoseBusters Benchmark datasets' primary-ligand results. Thanks a ton, @95028!
6+
- Regenerated results after addressing the scoring bug. The `notebooks` directory has been updated in the process.
7+
- Updated Zenodo links (for `forks` and `notebooks`).
8+
- An updated arXiv manuscript (v7) should be online soon.
9+
110
### 1.0.0 - 11/04/2025
211

312
**Changes**:

README.md

Lines changed: 18 additions & 16 deletions
Original file line numberDiff line numberDiff line change
@@ -3,7 +3,7 @@
33
# PoseBench
44

55
[![Paper](http://img.shields.io/badge/arXiv-2405.14108-B31B1B.svg)](https://rdcu.be/eW5oj)
6-
[![DOI](https://zenodo.org/badge/DOI/10.5281/zenodo.17536252.svg)](https://doi.org/10.5281/zenodo.17536252)
6+
[![DOI](https://zenodo.org/badge/DOI/10.5281/zenodo.19138652.svg)](https://doi.org/10.5281/zenodo.19138652)
77
[![PyPI version](https://badge.fury.io/py/posebench.svg)](https://badge.fury.io/py/posebench)
88
[![Project Status: Active – The project has reached a stable, usable state and is being actively developed.](https://www.repostatus.org/badges/latest/active.svg)](https://www.repostatus.org/#active)
99
[![Docs](https://assets.readthedocs.org/static/projects/badges/passing-flat.svg)](https://bioinfomachinelearning.github.io/PoseBench/)
@@ -22,6 +22,8 @@ Comprehensive benchmarking of protein-ligand structure prediction methods
2222

2323
[Documentation](https://bioinfomachinelearning.github.io/PoseBench/)
2424

25+
> **⚠️ Notice:** We have discovered a bug in version `1.0.0` affecting the ligand scoring results of each primary-ligand dataset (Astex Diverse, DockGen-E, and PoseBusters Benchmark). We have addressed this bug in version `1.1.0`, which reports (~15% on average) reduced performance for each method currently in the benchmark. Please rerun your analyses if you have developed code on top of `PoseBench`. Thank you for your understanding!
26+
2527
## Contents
2628

2729
- [Installation](#installation)
@@ -209,10 +211,10 @@ of how to extend `PoseBench`, as outlined below.
209211

210212
```bash
211213
# fetch, extract, and clean-up preprocessed Astex Diverse, PoseBusters Benchmark, DockGen, and CASP15 data (~3 GB) #
212-
wget https://zenodo.org/records/17536252/files/astex_diverse_set.tar.gz
213-
wget https://zenodo.org/records/17536252/files/posebusters_benchmark_set.tar.gz
214-
wget https://zenodo.org/records/17536252/files/dockgen_set.tar.gz
215-
wget https://zenodo.org/records/17536252/files/casp15_set.tar.gz
214+
wget https://zenodo.org/records/19138652/files/astex_diverse_set.tar.gz
215+
wget https://zenodo.org/records/19138652/files/posebusters_benchmark_set.tar.gz
216+
wget https://zenodo.org/records/19138652/files/dockgen_set.tar.gz
217+
wget https://zenodo.org/records/19138652/files/casp15_set.tar.gz
216218
tar -xzf astex_diverse_set.tar.gz
217219
tar -xzf posebusters_benchmark_set.tar.gz
218220
tar -xzf dockgen_set.tar.gz
@@ -228,39 +230,39 @@ rm casp15_set.tar.gz
228230
```bash
229231
# fetch, extract, and clean-up benchmark method predictions to reproduce paper results (~19 GB) #
230232
# AutoDock Vina predictions and results
231-
wget https://zenodo.org/records/17536252/files/vina_benchmark_method_predictions.tar.gz
233+
wget https://zenodo.org/records/19138652/files/vina_benchmark_method_predictions.tar.gz
232234
tar -xzf vina_benchmark_method_predictions.tar.gz
233235
rm vina_benchmark_method_predictions.tar.gz
234236
# DiffDock predictions and results
235-
wget https://zenodo.org/records/17536252/files/diffdock_benchmark_method_predictions.tar.gz
237+
wget https://zenodo.org/records/19138652/files/diffdock_benchmark_method_predictions.tar.gz
236238
tar -xzf diffdock_benchmark_method_predictions.tar.gz
237239
rm diffdock_benchmark_method_predictions.tar.gz
238240
# DynamicBind predictions and results
239-
wget https://zenodo.org/records/17536252/files/dynamicbind_benchmark_method_predictions.tar.gz
241+
wget https://zenodo.org/records/19138652/files/dynamicbind_benchmark_method_predictions.tar.gz
240242
tar -xzf dynamicbind_benchmark_method_predictions.tar.gz
241243
rm dynamicbind_benchmark_method_predictions.tar.gz
242244
# NeuralPLexer predictions and results
243-
wget https://zenodo.org/records/17536252/files/neuralplexer_benchmark_method_predictions.tar.gz
245+
wget https://zenodo.org/records/19138652/files/neuralplexer_benchmark_method_predictions.tar.gz
244246
tar -xzf neuralplexer_benchmark_method_predictions.tar.gz
245247
rm neuralplexer_benchmark_method_predictions.tar.gz
246248
# RoseTTAFold-All-Atom predictions and results
247-
wget https://zenodo.org/records/17536252/files/rfaa_benchmark_method_predictions.tar.gz
249+
wget https://zenodo.org/records/19138652/files/rfaa_benchmark_method_predictions.tar.gz
248250
tar -xzf rfaa_benchmark_method_predictions.tar.gz
249251
rm rfaa_benchmark_method_predictions.tar.gz
250252
# Chai-1 predictions and results
251-
wget https://zenodo.org/records/17536252/files/chai_benchmark_method_predictions.tar.gz
253+
wget https://zenodo.org/records/19138652/files/chai_benchmark_method_predictions.tar.gz
252254
tar -xzf chai_benchmark_method_predictions.tar.gz
253255
rm chai_benchmark_method_predictions.tar.gz
254256
# Boltz-1 predictions and results
255-
wget https://zenodo.org/records/17536252/files/boltz_benchmark_method_predictions.tar.gz
257+
wget https://zenodo.org/records/19138652/files/boltz_benchmark_method_predictions.tar.gz
256258
tar -xzf boltz_benchmark_method_predictions.tar.gz
257259
rm boltz_benchmark_method_predictions.tar.gz
258260
# AlphaFold 3 predictions and results
259-
wget https://zenodo.org/records/17536252/files/af3_benchmark_method_predictions.tar.gz
261+
wget https://zenodo.org/records/19138652/files/af3_benchmark_method_predictions.tar.gz
260262
tar -xzf af3_benchmark_method_predictions.tar.gz
261263
rm af3_benchmark_method_predictions.tar.gz
262264
# CASP15 predictions and results for all methods
263-
wget https://zenodo.org/records/17536252/files/casp15_benchmark_method_predictions.tar.gz
265+
wget https://zenodo.org/records/19138652/files/casp15_benchmark_method_predictions.tar.gz
264266
tar -xzf casp15_benchmark_method_predictions.tar.gz
265267
rm casp15_benchmark_method_predictions.tar.gz
266268
```
@@ -270,7 +272,7 @@ rm casp15_benchmark_method_predictions.tar.gz
270272
```bash
271273
# fetch, extract, and clean-up benchmark method interactions to reproduce paper results (~12 GB) #
272274
# cached ProLIF interactions for notebook plots
273-
wget https://zenodo.org/records/17536252/files/posebench_notebooks.tar.gz
275+
wget https://zenodo.org/records/19138652/files/posebench_notebooks.tar.gz
274276
tar -xzf posebench_notebooks.tar.gz
275277
rm posebench_notebooks.tar.gz
276278
```
@@ -357,7 +359,7 @@ python3 posebench/data/components/protein_apo_to_holo_alignment.py dataset=casp1
357359
conda deactivate
358360
```
359361

360-
**NOTE:** The preprocessed Astex Diverse, PoseBusters Benchmark, DockGen, and CASP15 data available via [Zenodo](https://doi.org/10.5281/zenodo.17536252) provide pre-holo-aligned protein structures predicted by AlphaFold 3 (and alternatively MIT-licensed ESMFold) for these respective datasets. Accordingly, users must ensure their usage of such predicted protein structures from AlphaFold 3 aligns with AlphaFold 3's [Terms of Use](https://github.com/google-deepmind/alphafold3/blob/main/WEIGHTS_TERMS_OF_USE.md).
362+
**NOTE:** The preprocessed Astex Diverse, PoseBusters Benchmark, DockGen, and CASP15 data available via [Zenodo](https://doi.org/10.5281/zenodo.19138652) provide pre-holo-aligned protein structures predicted by AlphaFold 3 (and alternatively MIT-licensed ESMFold) for these respective datasets. Accordingly, users must ensure their usage of such predicted protein structures from AlphaFold 3 aligns with AlphaFold 3's [Terms of Use](https://github.com/google-deepmind/alphafold3/blob/main/WEIGHTS_TERMS_OF_USE.md).
361363

362364
</details>
363365

docs/source/conf.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -9,7 +9,7 @@
99
# https://www.sphinx-doc.org/en/master/usage/configuration.html#project-information
1010
project = "PoseBench"
1111
author = "Alex Morehead"
12-
release = "1.0.0"
12+
release = "1.1.0"
1313
copyright = f"{datetime.datetime.now().year}, {author}"
1414

1515
# -- General configuration ---------------------------------------------------

docs/source/data_preparation.rst

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -6,4 +6,4 @@ How to prepare `PoseBench` data
66
:end-line: 359
77

88
.. note::
9-
The preprocessed Astex Diverse, PoseBusters Benchmark, DockGen, and CASP15 data (available via Zenodo at https://doi.org/10.5281/zenodo.17536252) provide pre-holo-aligned protein structures predicted by AlphaFold 3 (and alternatively MIT-licensed ESMFold) for these respective datasets. Accordingly, users must ensure their usage of such predicted protein structures from AlphaFold 3 aligns with AlphaFold 3's Terms of Use at https://github.com/google-deepmind/alphafold3/blob/main/WEIGHTS_TERMS_OF_USE.md.
9+
The preprocessed Astex Diverse, PoseBusters Benchmark, DockGen, and CASP15 data (available via Zenodo at https://doi.org/10.5281/zenodo.19138652) provide pre-holo-aligned protein structures predicted by AlphaFold 3 (and alternatively MIT-licensed ESMFold) for these respective datasets. Accordingly, users must ensure their usage of such predicted protein structures from AlphaFold 3 aligns with AlphaFold 3's Terms of Use at https://github.com/google-deepmind/alphafold3/blob/main/WEIGHTS_TERMS_OF_USE.md.

notebooks/astex_method_interaction_analysis_plotting.ipynb

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -104,7 +104,7 @@
104104
")\n",
105105
"assert os.path.exists(\n",
106106
" ad_set_dir\n",
107-
"), \"Please download the Astex Diverse set from `https://zenodo.org/records/17536252` before proceeding.\"\n",
107+
"), \"Please download the Astex Diverse set from `https://zenodo.org/records/19138652` before proceeding.\"\n",
108108
"\n",
109109
"# Mappings\n",
110110
"method_mapping = {\n",

notebooks/astex_method_interaction_analysis_plotting.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -69,7 +69,7 @@
6969
)
7070
assert os.path.exists(
7171
ad_set_dir
72-
), "Please download the Astex Diverse set from `https://zenodo.org/records/17536252` before proceeding."
72+
), "Please download the Astex Diverse set from `https://zenodo.org/records/19138652` before proceeding."
7373

7474
# Mappings
7575
method_mapping = {

notebooks/astex_method_interaction_analysis_plotting_slurm.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -70,7 +70,7 @@
7070
)
7171
assert os.path.exists(
7272
ad_set_dir
73-
), "Please download the Astex Diverse set from `https://zenodo.org/records/17536252` before proceeding."
73+
), "Please download the Astex Diverse set from `https://zenodo.org/records/19138652` before proceeding."
7474

7575
# Mappings
7676
method_mapping = {

notebooks/casp15_method_interaction_analysis_plotting.ipynb

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -101,7 +101,7 @@
101101
")\n",
102102
"assert os.path.exists(\n",
103103
" casp15_set_dir\n",
104-
"), \"Please download the (public) CASP15 set from `https://zenodo.org/records/17536252` before proceeding.\"\n",
104+
"), \"Please download the (public) CASP15 set from `https://zenodo.org/records/19138652` before proceeding.\"\n",
105105
"\n",
106106
"# Mappings\n",
107107
"method_mapping = {\n",

notebooks/casp15_method_interaction_analysis_plotting.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -66,7 +66,7 @@
6666
)
6767
assert os.path.exists(
6868
casp15_set_dir
69-
), "Please download the (public) CASP15 set from `https://zenodo.org/records/17536252` before proceeding."
69+
), "Please download the (public) CASP15 set from `https://zenodo.org/records/19138652` before proceeding."
7070

7171
# Mappings
7272
method_mapping = {

notebooks/casp15_method_interaction_analysis_plotting_slurm.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -67,7 +67,7 @@
6767
)
6868
assert os.path.exists(
6969
casp15_set_dir
70-
), "Please download the (public) CASP15 set from `https://zenodo.org/records/17536252` before proceeding."
70+
), "Please download the (public) CASP15 set from `https://zenodo.org/records/19138652` before proceeding."
7171

7272
# Mappings
7373
method_mapping = {

0 commit comments

Comments
 (0)