Skip to content

Conversation

@LuckyMD
Copy link
Owner

@LuckyMD LuckyMD commented Jul 18, 2022

Submission type

  • This submission adds a new dataset
  • This submission adds a new method
  • This submission adds a new metric
  • This submission adds a new task
  • This submission adds a new Docker image
  • This submission fixes a bug (link to related issue: )
  • This submission adds a new feature not listed above

Testing

  • This submission was written on a forked copy of SingleCellOpenProblems
  • GitHub Actions "Run Benchmark" tests are passing on this base branch of this pull request (include link to passed test: )
  • If this pull request is not ready for review (including passing the "Run Benchmark" tests), I will open this PR as a draft (click on the down arrow next to the "Create Pull Request" button)

Submission guidelines

  • This submission follows the guidelines in our Contributing document
  • I have checked to ensure there aren't other open Pull Requests for the same update/change

PR review checklist

This PR will be evaluated on the basis of the following checks:

  • The task addresses a valid open problem in single-cell analysis
  • The latest version of master is merged and tested
  • The methods/metrics are imported to __init__.py and were tested in the pipeline
  • Method and metric decorators are annotated with paper title, year, author, code version, and date
  • The README gives an outline of the methods, metrics and datasets in the folder
  • The README provides a satisfactory task explanation (for new tasks)
  • The sample test data is appropriate to test implementation of all methods and metrics (for new tasks)

@LuckyMD
Copy link
Owner Author

LuckyMD commented Jul 19, 2022

Notes:

The following error in label encoding:

Traceback (most recent call last):
  File "/tmp/tmpc7ezwktc/test_method.py", line 31, in <module>
    test_method(*('label_projection', 'scarches_scanvi_xgb_all_genes', 'openproblems-python-scvi'), **{})
  File "/tmp/tmpc7ezwktc/test_method.py", line 12, in test_method
    adata = method(adata, test=True)
  File "/__w/SingleCellOpenProblems/SingleCellOpenProblems/openproblems/tools/decorators.py", line 80, in apply_method
    return func(*args, **kwargs)
  File "/__w/SingleCellOpenProblems/SingleCellOpenProblems/openproblems/tasks/label_projection/methods/scvi_tools.py", line 251, in scarches_scanvi_xgb_all_genes
    adata.obs["labels_pred"] = _scanvi_scarches(
  File "/__w/SingleCellOpenProblems/SingleCellOpenProblems/openproblems/tasks/label_projection/methods/scvi_tools.py", line 152, in _scanvi_scarches
    preds = _pred_xgb(adata, adata_train, adata_test, query_model, test=test)
  File "/__w/SingleCellOpenProblems/SingleCellOpenProblems/openproblems/tasks/label_projection/methods/scvi_tools.py", line 193, in _pred_xgb
    xgbc.fit(X_train, y_train)
  File "/usr/local/lib/python3.8/site-packages/xgboost/core.py", line 532, in inner_f
    return f(**kwargs)
  File "/usr/local/lib/python3.8/site-packages/xgboost/sklearn.py", line 1357, in fit
    raise ValueError(
ValueError: Invalid classes inferred from unique values of `y`.  Expected: [0 1 2 3 4], got ['0' '1' '2' '3' '4']

Tested:

  • local install of xgboost 1.5.2 and 1.6.1 with different dataset but same prediction function -> works

Todo:

  • get docker running locally to test the env
  • Test integer label encoding

@LuckyMD LuckyMD changed the base branch from master to main July 19, 2022 13:34
LuckyMD and others added 13 commits July 19, 2022 16:49
* automatically send PRs for R deps

* run as test

* run on push

* fix git diff call

* run git diff

* write changes to disk

* run git diff

* debug

* more debugging

* need to mount

* remove debugging

* skip if nothing changed

* label PR

* remove temp push
* automatically send PRs for R deps

* run as test

* run on push

* fix git diff call

* run git diff

* write changes to disk

* run git diff

* debug

* more debugging

* need to mount

* remove debugging

* skip if nothing changed

* label PR

* remove temp push

* remote endbug add-and-commit

* generalize changes
* Bump peter-evans/create-pull-request from 3 to 4

Bumps [peter-evans/create-pull-request](https://github.com/peter-evans/create-pull-request) from 3 to 4.
- [Release notes](https://github.com/peter-evans/create-pull-request/releases)
- [Commits](peter-evans/create-pull-request@v3...v4)

---
updated-dependencies:
- dependency-name: peter-evans/create-pull-request
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>

* don't use add-and-commit

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Scott Gigante <84813314+scottgigante-immunai@users.noreply.github.com>
* include docker image sha in hash

* bugfixes
Co-authored-by: openproblems-bio <singlecellopenproblems@protonmail.com>
* add markdownlint to pre-commit

* add markdownlint
…s-bio#503)

Updates the requirements on [snakemake](https://github.com/snakemake/snakemake) to permit the latest version.
- [Release notes](https://github.com/snakemake/snakemake/releases)
- [Changelog](https://github.com/snakemake/snakemake/blob/main/CHANGELOG.md)
- [Commits](snakemake/snakemake@v7.8.0...v7.9.0)

---
updated-dependencies:
- dependency-name: snakemake
  dependency-type: direct:development
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* add dataset reference

* add reference to multimodal data

* add DOIs for zebrafish, pancreas, immmune

* refactor and add reference to 10x 1k

* add missing references

* document addition to loader decorator
* init spatial

* spatial decomposition

* init cleanup

* run precommit

* README update

* updated readme

* api update

* pre-commit

* readme update

* api stylefix

* pre-commit

* metrics update

* linting

* pre-commit

* black

* linting fix

* pre-commit

* cleanup

* cleanup

* linting

* linting

* task name change

* Rctd (#6)

Co-authored-by: almaan <almaan@kth.se>

* add stereoscope - nnls - nusvr - vanillanmf - nmfreg (#4)

Co-authored-by: Hirak Sarkar <hiraksarkar.cs@gmail.com>

* Seurat (#8)

Co-authored-by: almaan <almaan@kth.se>

* adding simulation (#7)

Co-authored-by: giovp <giov.pll@gmail.com>
Co-authored-by: almaan <almaan@kth.se>

* reorder requirements

* Update mse.py

* update R2 description

* review comments, populated __init__.py files for import

* update import statements

* fix label dataset

* Specify image

* fix random

* fix labels

* pre-commit

* add test=False

* add synth data from destVI

* remove logger

* return spatial reference in correct format

* specify cell type label

* add destVI simulation to datasets

* fix random

* fix nusvr

* fix stereoscope

* added destvi

* added destvi

* try fix data generation

* fix from previous delete

* add scvitools version

* Synthetic data generation (#9)

* tangram first

* tangram first

* tangram first

* tangram first

* flake8 + isort _destvi_utils

* tangram update; pancreas add string index

* tangram update; pancreas add string index

* tangram update; pancreas add string index; n_obs = 1000 in synth data

* tangram update; pancreas add string index; n_obs = 1000 in synth data

* new synth

* add tangram-sc to docker

* new synth approach

* new synth approach

* new synth approach

* new synth approach

* new synth approach

* new synth approach

* new synth approach

* new synth approach

* pancreas subset integer; comment pancreas dataset [skip actions]

* pancreas subset integer; comment pancreas dataset [skip actions]

* pancreas subset integer; comment pancreas dataset [skip actions]

* pancreas subset integer; comment pancreas dataset [skip actions]

* pancreas subset integer; comment pancreas dataset [skip actions]

* merge and split sc and st data

* merged anndata in methods

* merged anndata in methods

* fix destvi

* add code reference

* shorten

* Update openproblems/tasks/spatial_decomposition/_utils.py

Co-authored-by: Giovanni Palla <giov.pll@gmail.com>

* Update openproblems/tasks/spatial_decomposition/datasets/_sc_to_sp_utils.py [skip actions]

Co-authored-by: Giovanni Palla <giov.pll@gmail.com>

* Update openproblems/tasks/spatial_decomposition/datasets/_sc_to_sp_utils.py [skip actions]

Co-authored-by: Giovanni Palla <giov.pll@gmail.com>

* Update openproblems/tasks/spatial_decomposition/datasets/_sc_to_sp_utils.py  [skip actions]

Co-authored-by: Giovanni Palla <giov.pll@gmail.com>

* comment fix

* comment fix

* fix pancreas dataset

* update readme

* fix destvi genertaion

* fix sparse

* minor fix

* drop csr_matrix; fix double merge of anndata; update seurat v3

* updates

* fix test for sparse arrays

* test=False

* add geos to r-extras

* geos before r install

* add software-properties-common

* add python-software-properties

* add RUN before command

* rm geos from r-base

* fix merging of anndata by pinning higher version

* revert back anndata

* fix obs_names and pin anndata

* try to add swap

* reduce number of spatial spots

* remove swap

* reduce obs

* remove swap

* remove step in CI

* decrease dataset size

* remove sparse

* remove copy

* remove datasets

* remove datasets from init

* address scott comments

* skip all pancreas

* fix import

* remove destiv

* Merge `main` into `synthetic-data-generation` (#10)

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: MalteDLuecken <m.d.luecken@gmail.com>
Co-authored-by: Scott Gigante <84813314+scottgigante-immunai@users.noreply.github.com>
Co-authored-by: SingleCellOpenProblems <singlecellopenproblems@protonmail.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Daniel Strobl <50872326+danielStrobl@users.noreply.github.com>

* change test

* fix from_cache

* pre-commit

* update data generation to remove inf

* change test

* check task

* resolve suggestions from scott

Co-authored-by: almaan <almaan@kth.se>
Co-authored-by: Giovanni Palla <giov.pll@gmail.com>
Co-authored-by: Scott Gigante <84813314+scottgigante-immunai@users.noreply.github.com>
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: MalteDLuecken <m.d.luecken@gmail.com>
Co-authored-by: SingleCellOpenProblems <singlecellopenproblems@protonmail.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Daniel Strobl <50872326+danielStrobl@users.noreply.github.com>

* Remove duplicate line

* Fill in baseline decorator

* Check R version of seurat

* pre-commit

* Remove reference to __from_cache__

* Clean up proportions assert

* pre-commit

* set merge='unique' to retain uns

* fixes from scott comments

* Fix code_version for new API

* Set `max_epochs` on `test`

* pre-commit

* Temporarily remove destvi

* Add dataset metadata fields

* Add task summary

* Temporarily remove steroscope

* pre-commit

* Fix typo

* Copy `uns`

* fix uns_merge to include _from_cache

* convert NaNs in categorical dtypes

* convert string dtypes

* bump tangram-sc

* fix string dtypes

* convert strings to categoricals inside pancreas

* change api label to str

* obsm cannot be pd.DataFrame

* revert anndata change

* fix rctd

* fix R2

* fix lots of things

* fix nmfreg and sample method

* address scott comments

* add metadata attribute decorator

* Update r_requirements.txt

* Handle comments in `r_requirements.txt`

* Rename spacexr

* Move API below metrics

* Rename NNLS

* Fix RCTD code URL

* Set n_pcs in RCTD python call

* Revert 2077c35

* Set n_pca in seuratv3.py

* use `n_pcs` in seuratv3.R

* Split string rather than skipping QA

* Shorten line lengths

* shorten line lengths

* Clean up comment

* Delete pbmc3k_raw.h5ad

* Rename R2.py to r2.py

* Fix reference to r2.py

* pre-commit

* Rename sc_to_sp.py to pancreas.py

* Rename _sc_and_sp_utils.py to utils.py

* rename _utils.py to utils.py

* pre-commit

* import all pancreas datasets

* fix typo

* fix namespace clash

* need to pass test arg

* fix method name (0_1 -> 0_5)

* check tower auth explicitly

* filter genes and cells

* filter_genes_cells is in-place

* remaining todos from scott

* add destvi dataset

* delete scvi models and dataset

* fix shell string

* one more syntactic fix

* Add tangram to readme

* Specify cell types in description

* pre-commit

* Better dataset descriptors

* Clean up

* Split don't skip

* handle random_state

* Fix doi URL

* Move import inside

* Shorten line lengths

* Remove commented imports

* Shorten descriptors

* Fix seuratv3 URL

* Remove unused projection_type arg

* Remove unused toarray

* Remove unused toarray

* Update vanillanmf.py

* Remove unused DataFrame handler

* Remove unused categorical handler

* Remove unused pandas import

* update nmfreg

* fix nmfreg

* fix vanilla

* fix nmf

* fix alpha

* rctd

* pre-commit

* add dataset_reference

* shorten line lengths

* document PYTEST_MAX_RETRIES

* Allow 429 too many requests

Co-authored-by: almaan <almaan@kth.se>
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: Alma Andersson <kangarooblood@gmail.com>
Co-authored-by: Hirak Sarkar <hiraksarkar.cs@gmail.com>
Co-authored-by: Daniel Burkhardt <burkhardt.d.b@gmail.com>
Co-authored-by: Scott Gigante <84813314+scottgigante-immunai@users.noreply.github.com>
Co-authored-by: MalteDLuecken <m.d.luecken@gmail.com>
Co-authored-by: SingleCellOpenProblems <singlecellopenproblems@protonmail.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Daniel Strobl <50872326+danielStrobl@users.noreply.github.com>
Co-authored-by: Scott Gigante <scott.gigante@immunai.com>
dependabot bot and others added 30 commits September 29, 2022 14:16
Updates the requirements on [cmake](https://github.com/scikit-build/cmake-python-distributions) to permit the latest version.
- [Release notes](https://github.com/scikit-build/cmake-python-distributions/releases)
- [Changelog](https://github.com/scikit-build/cmake-python-distributions/blob/master/HISTORY.rst)
- [Commits](scikit-build/cmake-python-distributions@3.22.0...3.24.1.1)

---
updated-dependencies:
- dependency-name: cmake
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Scott Gigante <84813314+scottgigante-immunai@users.noreply.github.com>
…enproblems-bio#601)

Updates the requirements on [scvi-tools](https://github.com/scverse/scvi-tools) to permit the latest version.
- [Release notes](https://github.com/scverse/scvi-tools/releases)
- [Commits](scverse/scvi-tools@0.16.0...0.17.4)

---
updated-dependencies:
- dependency-name: scvi-tools
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Scott Gigante <84813314+scottgigante-immunai@users.noreply.github.com>
…lems-bio#580)

Bumps [annoy](https://github.com/spotify/annoy) from 1.16.3 to 1.17.1.
- [Release notes](https://github.com/spotify/annoy/releases)
- [Changelog](https://github.com/spotify/annoy/blob/master/RELEASE.md)
- [Commits](spotify/annoy@v1.16.3...v1.17.1)

---
updated-dependencies:
- dependency-name: annoy
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Scott Gigante <84813314+scottgigante-immunai@users.noreply.github.com>
openproblems-bio#576)

* use normalized data for batch integration

* pre-commit

* fix name of scran layer in dataloaders

* use log_scran_pooling function

* adapt readme

* pre-commit

* Adapt to discussed setup

* pre-commit

* remove unused import

* review

* change to log_normalized

* update readme

* pre-commit

* adapt embedding subtask

* pre-commit

* clarify pre-integration data

* correct comment in dataloaders

* remove layer X equals counts assertion

* add log_normalized to sample dataloader

* adapt api in embedding task

* pre-commit

* api

* check default layer api adaption

* fix testing

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
…ras (openproblems-bio#583)

Bumps [cmake](https://github.com/scikit-build/cmake-python-distributions) from 3.18.4 to 3.24.1.1.
- [Release notes](https://github.com/scikit-build/cmake-python-distributions/releases)
- [Changelog](https://github.com/scikit-build/cmake-python-distributions/blob/master/HISTORY.rst)
- [Commits](scikit-build/cmake-python-distributions@3.18.4...3.24.1.1)

---
updated-dependencies:
- dependency-name: cmake
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Scott Gigante <84813314+scottgigante-immunai@users.noreply.github.com>
…ems-bio#585)

Updates the requirements on [torch](https://github.com/pytorch/pytorch) to permit the latest version.
- [Release notes](https://github.com/pytorch/pytorch/releases)
- [Changelog](https://github.com/pytorch/pytorch/blob/master/RELEASE.md)
- [Commits](pytorch/pytorch@v1.11.0-rc1...v1.12.1)

---
updated-dependencies:
- dependency-name: torch
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Scott Gigante <84813314+scottgigante-immunai@users.noreply.github.com>
* Revert "temporarily remove cell cell comm"

This reverts commit 1068e5f.

* Revert "remove cell cell comm test"

This reverts commit f9ecd71.

* fix home permissions
Co-authored-by: openproblems-bio <singlecellopenproblems@protonmail.com>
Co-authored-by: Scott Gigante <84813314+scottgigante-immunai@users.noreply.github.com>
…/openproblems" (openproblems-bio#607)

* Revert "Update cmake requirement in /docker/openproblems (openproblems-bio#600)"

This reverts commit 6b7ea6c.

* add pin comment
…penproblems-bio#590)

Bumps [pyyaml](https://github.com/yaml/pyyaml) from 5.4.1 to 6.0.
- [Release notes](https://github.com/yaml/pyyaml/releases)
- [Changelog](https://github.com/yaml/pyyaml/blob/master/CHANGES)
- [Commits](yaml/pyyaml@5.4.1...6.0)

---
updated-dependencies:
- dependency-name: pyyaml
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Scott Gigante <84813314+scottgigante-immunai@users.noreply.github.com>
…s-bio#599)

Updates the requirements on [pytest-cov](https://github.com/pytest-dev/pytest-cov) to permit the latest version.
- [Release notes](https://github.com/pytest-dev/pytest-cov/releases)
- [Changelog](https://github.com/pytest-dev/pytest-cov/blob/master/CHANGELOG.rst)
- [Commits](pytest-dev/pytest-cov@v3.0.0...v4.0.0)

---
updated-dependencies:
- dependency-name: pytest-cov
  dependency-type: direct:development
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Scott Gigante <84813314+scottgigante-immunai@users.noreply.github.com>
Co-authored-by: openproblems-bio <singlecellopenproblems@protonmail.com>
Co-authored-by: Scott Gigante <84813314+scottgigante-immunai@users.noreply.github.com>
* Create knn_smoothing

* Update __init__.py

* pre-commit

* Create knn_smoothing

* Update magic.py

* pre-commit

* Update magic.py

* Rename knn_smoothing to knn_smoothing.py

* pre-commit

* Create knn_smoothing.py

* pre-commit

* Update knn_smoothing.py

* pre-commit

* Update knn_smoothing.py

* Update knn_smoothing.py

* Update README.md

* Update requirements.txt

* Update README.md

* pre-commit

* Update knn_smoothing.py

* Update knn_smoothing.py

* pre-commit

* Update knn_smoothing.py

* Update knn_smoothing.py

* pre-commit

* DOI

* Update knn_smoothing.py

* pre-commit

* Update knn_smoothing.py

* Update knn_smoothing.py

* Update knn_smoothing.py

scanpy anndata objects are n x p, this asks for p x n.

* Update knn_smoothing.py

* pre-commit

* Update knn_smoothing.py

* Update knn_smoothing.py

* Update knn_smoothing.py

* pre-commit

* Update knn_smoothing.py

* pre-commit

* Update knn_smoothing.py

* pre-commit

* Update knn_smoothing.py

* Update knn_smoothing.py

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: Scott Gigante <84813314+scottgigante-immunai@users.noreply.github.com>
* fix wrong desc import

* install biocmanager python37-scgen container

* pre-commit

* fix r docker

* switch to separate r integration container

* pre-commit

* gitignore

* now with correct r extras container

* Revert "now with correct r extras container"

This reverts commit f3f0f10.

* Revert "gitignore"

This reverts commit 80bd50f.

* Revert "pre-commit"

This reverts commit 807c6d0.

* Revert "switch to separate r integration container"

This reverts commit 6180588.

* deactivate desc

* pre-commit

* fastmnn dgcmatrix output

* transpose fastmnn matrix

* flake8 order

* pre-commit

* skip isort for import

* pre-commit

* isort next try

* pre-commit

* clean up

* addressing changes requested

* pre-commit

* remove untested

* remove sudo from r docker

* combine docker RUN statements into one in r-extras

* add metric documentation

* pre-commit

* clean up docker images

* docker r-extras

* hope unicode is fine

* remove subsampling

* remove subsampling pancreas

* adapt new dataloaders

* pre-commit

* remove pancreas data temporarily

* immune batch as sample

* trigger rebuild debian packages

* newer rlang version

* pin older tibble version

* pin igraph 1.2.11

* pin hdf5 version

* Seurat change

* same Seurat fix for liger

* docker images separate PR

* initial commit datasets batch integration

* shorten long line

* pre-commit

* keep raw counts in X

* kill pytest after 2 fails for testing

* increase swap size

* set swap size

* swap

* fix syntax

* change order of tests

* remove duplicate layer

* pre-commit

* immune cell dataloader comments

* doc

* all R requirements in r_requirements.txt

* move github r packages to requirements file

* pre-commit

* pre-commit

* add task dataloaders and subsampling immune

* pre-commit

* add batch integration to init py

* pre-commit

* typo

* generate empty structure for metrics/methods

* init py root

* metrics wrong folder

* fix pancreas dataloader batch

* pancreas batch column

* method stub

* stub metric

* pre-commit

* import error

* one method

* method error

* pre-commit

* remove unused

* pre-commit

* change placeholder method to combat

* pre-commit

* downstream pp

* reduce data correct import

* pre-commit

* addressing comments

* new test var

* remove fastmnn integer conversion

* simpler postprocessing for fastmnn_embed

* pre-commit

* bbknn w/o scib

* pre-commit

* reduced pp for scanvi/scvi

* pre-commit

* remove additional param

* scvi test var

* fastmnn fix

* pre-commit

* line wrapping

* pre-commit

* initial commit

* initial commit

* pre-commit

* remove non-imported functions

* pre-commit

* remove unused code

* activate batch integration feature

* pre-commit

* wrong data import

* wrong import api

* pre-commit

* typo

* don't check for embedding output

* preserve scanorama layers

* pre-commit

* Update README.md

add explanation of "full"

* Add task summary

* Decorate sample dataset

* Don't need log_scran

* imports

* pre-commit

* Delete checks.py

* Expect adata.layers["log_scran_pooling"] to be present

* require log_scran_pooling to be present

* remove checks import

* remove pin

* fix api errors

* use r-base to run log scran pooling

* type hints

* fix decorator usage

* Revert "fix decorator usage"

This reverts commit 0ce324f.

* fix converted function name

* fix layers no matter which layers are present

* line breaks

* normalisation for sample adata

* make unique var names

* try scaling fix

* var names make unique

* save random batch and labels as categorical

* pre-commit

* scale error fixed

* version pins

* pre-commit

* unique var names

* var names make unique

* documentation

* activate fastmnn

* pre-commit

* Un-remove spatial decomposition

* Fix link

* Update summary

* metric description

* pre-commit

* embedding to feature readme change

* adapted task description

* clarify metric API

* clarify HVG cons metric description

* addressing comments

* pre-commit

* don't compute pca for embedding scanorama

* move var_names_make_unique to dataloader

* correct check for same array

* fix api error

* fix api.py var names unique

* pre-commit

* adapt api

* adapt embedding readme

* pre-commit

* api fixes batch integration feature

* pre-commit

* readme and tests

* pre-commit

* Delete batch_integration_graph.py

* Import datasets directly from batch_integration_graph

* change init py embed->feature

* remove unused import

* remove unused file

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: Scott Gigante <84813314+scottgigante-immunai@users.noreply.github.com>
Co-authored-by: MalteDLuecken <m.d.luecken@gmail.com>
Co-authored-by: Scott Gigante <scott.gigante@immunai.com>
Co-authored-by: openproblems-bio <singlecellopenproblems@protonmail.com>
Co-authored-by: Scott Gigante <84813314+scottgigante-immunai@users.noreply.github.com>
* Add Seurat method to label projection, try 1

* pre-commit

* Add Seurat method to label projection, try 2

* Rename R variable according to lint

* Rename R variables according to lint

* pre-commit

* Fix typo in variable name

* Allow setting of kwargs in method call

* pre-commit

* Accept args in R file

* Fix typo

* Fix switched param names in docs

* Convert from Rsparse to Csparse

* Fix typo

* nolint

* run seurat in fork

* pass script_path

* add script path as arg

* k_score can't be NULL

* fix typo

* increase maxsize

* use gc()

* Enforce that is_train is still a bool after method run

* convert is_train back to bool after R computation

* Remove unnecessary partial

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: Scott Gigante <84813314+scottgigante-immunai@users.noreply.github.com>
Co-authored-by: Scott Gigante <scott.gigante@immunai.com>
* add tangram back in

* convert result to numpy

Co-authored-by: Giovanni Palla <25887487+giovp@users.noreply.github.com>
…openproblems-bio#604)

* Bump jaxlib from 0.3.15 to 0.3.20 in /docker/openproblems-python-scvi

Bumps [jaxlib](https://github.com/google/jax) from 0.3.15 to 0.3.20.
- [Release notes](https://github.com/google/jax/releases)
- [Changelog](https://github.com/google/jax/blob/main/CHANGELOG.md)
- [Commits](jax-ml/jax@jaxlib-v0.3.15...jaxlib-v0.3.20)

---
updated-dependencies:
- dependency-name: jaxlib
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

* Update jax too

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Scott Gigante <84813314+scottgigante-immunai@users.noreply.github.com>
…roblems-bio#605)

Updates the requirements on [torch](https://github.com/pytorch/pytorch) to permit the latest version.
- [Release notes](https://github.com/pytorch/pytorch/releases)
- [Changelog](https://github.com/pytorch/pytorch/blob/master/RELEASE.md)
- [Commits](pytorch/pytorch@v1.11.0-rc1...v1.12.1)

---
updated-dependencies:
- dependency-name: torch
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Scott Gigante <84813314+scottgigante-immunai@users.noreply.github.com>
…s-bio#606)

Bumps [styfle/cancel-workflow-action](https://github.com/styfle/cancel-workflow-action) from 0.10.0 to 0.10.1.
- [Release notes](https://github.com/styfle/cancel-workflow-action/releases)
- [Commits](styfle/cancel-workflow-action@0.10.0...0.10.1)

---
updated-dependencies:
- dependency-name: styfle/cancel-workflow-action
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Scott Gigante <84813314+scottgigante-immunai@users.noreply.github.com>
* add destvi dataset

* move import inside function

* add test

* add path

* refactor

* add data_reference

* move torch import inside

* add test and reduce dataset size

* add description of dataset

* add loader

* address comments

* remove newaxis

* fix number of cells at test time

* convert to numpy

* descrease knn cells

* limit genes for test

* set number of genes with test

* n_genes -> test_n_genes

* pre-commit

Co-authored-by: Scott Gigante <scott.gigante@immunai.com>
Co-authored-by: Scott Gigante <84813314+scottgigante-immunai@users.noreply.github.com>
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: openproblems-bio <singlecellopenproblems@protonmail.com>
Co-authored-by: Scott Gigante <84813314+scottgigante-immunai@users.noreply.github.com>
…openproblems-python-extras (openproblems-bio#618)

* Update tensorflow-cpu requirement in /docker/openproblems-python-extras

Updates the requirements on [tensorflow-cpu](https://github.com/tensorflow/tensorflow) to permit the latest version.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](tensorflow/tensorflow@v2.7.0-rc0...v2.10.0)

---
updated-dependencies:
- dependency-name: tensorflow-cpu
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

* Try 2.9

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Scott Gigante <84813314+scottgigante-immunai@users.noreply.github.com>
…o#619)

Updates the requirements on [sagemaker](https://github.com/aws/sagemaker-python-sdk) to permit the latest version.
- [Release notes](https://github.com/aws/sagemaker-python-sdk/releases)
- [Changelog](https://github.com/aws/sagemaker-python-sdk/blob/master/CHANGELOG.md)
- [Commits](aws/sagemaker-python-sdk@v2.110.0...v2.112.0)

---
updated-dependencies:
- dependency-name: sagemaker
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Scott Gigante <84813314+scottgigante-immunai@users.noreply.github.com>
Co-authored-by: openproblems-bio <singlecellopenproblems@protonmail.com>
Co-authored-by: Scott Gigante <84813314+scottgigante-immunai@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.