Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

TASK-5564 - Update data sources for CellBase 6.2 #696

Open
wants to merge 158 commits into
base: develop
Choose a base branch
from
Open

Commits on Jan 21, 2024

  1. download: gwas catalog fixes

    imedina committed Jan 21, 2024
    Configuration menu
    Copy the full SHA
    6346c97 View commit details
    Browse the repository at this point in the history

Commits on Mar 1, 2024

  1. Configuration menu
    Copy the full SHA
    19368e6 View commit details
    Browse the repository at this point in the history
  2. Update configuration.yml

    imedina committed Mar 1, 2024
    Configuration menu
    Copy the full SHA
    89264c2 View commit details
    Browse the repository at this point in the history

Commits on Mar 7, 2024

  1. Configuration menu
    Copy the full SHA
    2be5f21 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    fe05795 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    50f7008 View commit details
    Browse the repository at this point in the history
  4. lib: take into account PubMed version from config file, and fix sonna…

    …r issues, #TASK-5775, #TASK-5564
    jtarraga committed Mar 7, 2024
    Configuration menu
    Copy the full SHA
    a8a9328 View commit details
    Browse the repository at this point in the history
  5. lib: improve clinvar and gwas downloader by removing hardcode filenam…

    …es and taking into account the version from config file, and fix sonnar issues, #TASK-5775, #TASK-5564
    jtarraga committed Mar 7, 2024
    Configuration menu
    Copy the full SHA
    f84734e View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    1a5ba4a View commit details
    Browse the repository at this point in the history

Commits on Mar 8, 2024

  1. lib: improve gene downloader by updating versions from config file, a…

    …dding log messages, removing hardcode filenames, sonnar issues,..., #TASK-5775, #TASK-5564
    jtarraga committed Mar 8, 2024
    Configuration menu
    Copy the full SHA
    4cdd046 View commit details
    Browse the repository at this point in the history
  2. lib: improve repeat downloader by updating versions from config file,…

    … adding log messages, removing hardcode filenames, sonnar issues,..., #TASK-5775, #TASK-5564
    jtarraga committed Mar 8, 2024
    Configuration menu
    Copy the full SHA
    3cea3f3 View commit details
    Browse the repository at this point in the history

Commits on Mar 22, 2024

  1. lib: improve conservation downloader by updating versions from config…

    … file, adding log messages, removing hardcode filenames, sonnar issues,..., #TASK-5775, #TASK-5564
    jtarraga committed Mar 22, 2024
    Configuration menu
    Copy the full SHA
    f308f25 View commit details
    Browse the repository at this point in the history

Commits on Mar 28, 2024

  1. lib: update regulation download manager, and the configuration file, …

    …to take into account the version for miRBase and miRTarBase, #TASK-5775, #TASK-5564
    jtarraga committed Mar 28, 2024
    Configuration menu
    Copy the full SHA
    2e6e895 View commit details
    Browse the repository at this point in the history

Commits on Apr 3, 2024

  1. lib: update configuration file; and create version files for COSMIC a…

    …nd HGMD; and fix some sonnar issues, #TASK-5775, #TASK-5564
    jtarraga committed Apr 3, 2024
    Configuration menu
    Copy the full SHA
    a6688d0 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    c2345d4 View commit details
    Browse the repository at this point in the history

Commits on Apr 4, 2024

  1. Configuration menu
    Copy the full SHA
    df0f1e0 View commit details
    Browse the repository at this point in the history

Commits on Apr 5, 2024

  1. lib: refactor code by changing the DownloadProperties.URLProperties, …

    …#TASK-5775, #TASK-5564
    jtarraga committed Apr 5, 2024
    Configuration menu
    Copy the full SHA
    d4cba15 View commit details
    Browse the repository at this point in the history

Commits on Apr 11, 2024

  1. lib: update CellBase downloaders according to the DownloadProperties.…

    …URLProperties changes, #TASK-5775, #TASK-5564
    jtarraga committed Apr 11, 2024
    Configuration menu
    Copy the full SHA
    a3e9684 View commit details
    Browse the repository at this point in the history
  2. Rename get file name method

    imedina committed Apr 11, 2024
    Configuration menu
    Copy the full SHA
    c7ad55d View commit details
    Browse the repository at this point in the history
  3. lib: update CellBase downloaders according to the DownloadProperties.…

    …URLProperties changes, #TASK-5775, #TASK-5564
    jtarraga committed Apr 11, 2024
    Configuration menu
    Copy the full SHA
    e92b676 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    281fb22 View commit details
    Browse the repository at this point in the history

Commits on Apr 12, 2024

  1. Configuration menu
    Copy the full SHA
    e18506b View commit details
    Browse the repository at this point in the history

Commits on Apr 15, 2024

  1. Configuration menu
    Copy the full SHA
    69a58bf View commit details
    Browse the repository at this point in the history

Commits on Apr 18, 2024

  1. Configuration menu
    Copy the full SHA
    d4e0cd6 View commit details
    Browse the repository at this point in the history
  2. lib: update LRG, HGNC, Cancer HotSpot, DGIDB, Gene Uniprot Xref, Gene…

    … Expression Atlas, Gene Disease Annotation, gnomAD Constraints and GO Annotation downloaders, #TASK-5775, #TASK-5564
    jtarraga committed Apr 18, 2024
    Configuration menu
    Copy the full SHA
    6ee2f78 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    d794ceb View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    1b751de View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    b635333 View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    106b96d View commit details
    Browse the repository at this point in the history

Commits on Apr 19, 2024

  1. lib: update gene downloader (specially for ensembl data), and improve…

    … log messages, #TASK-5564
    jtarraga committed Apr 19, 2024
    Configuration menu
    Copy the full SHA
    55afe6b View commit details
    Browse the repository at this point in the history

Commits on Apr 22, 2024

  1. core: add Ensembl primary fasta URL into the configuration file for t…

    …he genome downloader, #TASK-5564
    jtarraga committed Apr 22, 2024
    Configuration menu
    Copy the full SHA
    88c2b17 View commit details
    Browse the repository at this point in the history
  2. lib: update genome download manager by declaring and using constants …

    …from the class EtlCommand and improve log messages, #TASK-5564
    jtarraga committed Apr 22, 2024
    Configuration menu
    Copy the full SHA
    eee13e3 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    cd367b9 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    ce6f8d5 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    3566e01 View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    cd94452 View commit details
    Browse the repository at this point in the history
  7. lib: update the repeats builder by removing the hardcoded filenames a…

    …nd taking them from the configuration file; update JUnit test and improve log messages, #TASK-5564
    jtarraga committed Apr 22, 2024
    Configuration menu
    Copy the full SHA
    148814f View commit details
    Browse the repository at this point in the history
  8. lib: update conservation builder by removing the hardcoded filenames …

    …and taking them from the version files (i.e., URLs of the DataSource), improve log/exception messages, and fix sonnar issues, #TASK-5564
    jtarraga committed Apr 22, 2024
    Configuration menu
    Copy the full SHA
    30a4c87 View commit details
    Browse the repository at this point in the history

Commits on Apr 23, 2024

  1. Configuration menu
    Copy the full SHA
    85e17db View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    0223cb5 View commit details
    Browse the repository at this point in the history
  3. lib: improve ProteinBuilder by removing hardcoded file names, adding …

    …checks and log messages, #TASK-5564
    jtarraga committed Apr 23, 2024
    Configuration menu
    Copy the full SHA
    833c337 View commit details
    Browse the repository at this point in the history

Commits on Apr 24, 2024

  1. lib: move DataSource reader from ConservationBuilder to the parent Ce…

    …llBaseBuilder to be used by other builders, #TASK-5564
    jtarraga committed Apr 24, 2024
    Configuration menu
    Copy the full SHA
    01deb0c View commit details
    Browse the repository at this point in the history
  2. lib: move the function to split UniProt into chuncks from the protein…

    … downloader to the protein builder, #TASK-5564
    jtarraga committed Apr 24, 2024
    Configuration menu
    Copy the full SHA
    9416894 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    909c0b2 View commit details
    Browse the repository at this point in the history
  4. lib: launch a CellBase exception if executing a command (wget, gunzip…

    …,...) fails; and improve log messages, #TASK-5775, #TASK-5564
    jtarraga committed Apr 24, 2024
    Configuration menu
    Copy the full SHA
    71d8056 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    1544824 View commit details
    Browse the repository at this point in the history
  6. lib: move the function to parse and build PFMs from the regulation do…

    …wnloader to the regulation builder; and improve regulation builder by adding checks, log messages and fixing sonnar issues, #TASK-5776, #TASK-5564
    jtarraga committed Apr 24, 2024
    Configuration menu
    Copy the full SHA
    3e43874 View commit details
    Browse the repository at this point in the history

Commits on Apr 25, 2024

  1. core: update ontology section of the CellBase configuration since ont…

    …ology versions will be taken from the OBO files content, #TASK-5775, #TASK-5564
    jtarraga committed Apr 25, 2024
    Configuration menu
    Copy the full SHA
    959e423 View commit details
    Browse the repository at this point in the history
  2. lib: update ontology download since ontology versions will be taken f…

    …rom the OBO files content; and improve log messages, #TASK-5775, #TASK-5564
    jtarraga committed Apr 25, 2024
    Configuration menu
    Copy the full SHA
    158c259 View commit details
    Browse the repository at this point in the history
  3. app: update the build command executor to check/copy the ontology ver…

    …sion files before creating the ontology builder, #TASK-5576, #TASK-5564
    jtarraga committed Apr 25, 2024
    Configuration menu
    Copy the full SHA
    0b83831 View commit details
    Browse the repository at this point in the history
  4. lib: improve the ontology builder by removing hardcoded filenames, ad…

    …ding log messages and refactoring code, #TASK-5576, #TASK-5564
    jtarraga committed Apr 25, 2024
    Configuration menu
    Copy the full SHA
    39f0f41 View commit details
    Browse the repository at this point in the history
  5. lib: improve the PharmGKB downloader by moving the function to unzip …

    …PharmGKB files from the downloader to the PharmGKB builder and adding log messages, #TASK-5775, #TASK-5564
    jtarraga committed Apr 25, 2024
    Configuration menu
    Copy the full SHA
    5c3dae0 View commit details
    Browse the repository at this point in the history
  6. lib: improve the PharmGKB builder by adding checks and log messages; …

    …and move the function to unzip PharmGKB files from the downloader to the builder, #TASK-5776, #TASK-5564
    jtarraga committed Apr 25, 2024
    Configuration menu
    Copy the full SHA
    971235e View commit details
    Browse the repository at this point in the history
  7. lib: improve the PubMed downloader by adding log messages and fixing …

    …sonnar issues, #TASK-5775, #TASK-5564
    jtarraga committed Apr 25, 2024
    Configuration menu
    Copy the full SHA
    cd444b0 View commit details
    Browse the repository at this point in the history

Commits on Apr 26, 2024

  1. lib: create maps to get the names, categories and version filenames f…

    …rom a given data, #TASK-5775, #TASK-5564
    jtarraga committed Apr 26, 2024
    Configuration menu
    Copy the full SHA
    e19fe73 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    a29afe3 View commit details
    Browse the repository at this point in the history
  3. lib: improve PubMed builder by adding checks, log messages and fixing…

    … sonnar issues, #TAK-5776, #TASK-5564
    jtarraga committed Apr 26, 2024
    Configuration menu
    Copy the full SHA
    377ee9c View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    997c8ec View commit details
    Browse the repository at this point in the history
  5. lib: improve the CADD builder by adding checks, log messages, cleanin…

    …g code and fixing sonnar issues, #TASK-5776, #TASK-5564
    jtarraga committed Apr 26, 2024
    Configuration menu
    Copy the full SHA
    96078b7 View commit details
    Browse the repository at this point in the history
  6. lib: update the REVEL downloader according to the last changes, and a…

    …dd log messages, #TASK-5775, #TASK-5564
    jtarraga committed Apr 26, 2024
    Configuration menu
    Copy the full SHA
    3163a90 View commit details
    Browse the repository at this point in the history

Commits on Apr 29, 2024

  1. Configuration menu
    Copy the full SHA
    bc22fad View commit details
    Browse the repository at this point in the history
  2. lib: improve the Revel builder by fixing sonnar issues and adding che…

    …cks and log messages, #TASK-5776, #TASK-5564
    jtarraga committed Apr 29, 2024
    Configuration menu
    Copy the full SHA
    0c9a299 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    4f9e39a View commit details
    Browse the repository at this point in the history
  4. app: update load command executor according to the EtlCommons changes…

    …, #TASK-6142, #TASK-5564
    jtarraga committed Apr 29, 2024
    Configuration menu
    Copy the full SHA
    1586a77 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    c7c398a View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    754384a View commit details
    Browse the repository at this point in the history

Commits on May 7, 2024

  1. Configuration menu
    Copy the full SHA
    24eb091 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    fc09da4 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    09d33a0 View commit details
    Browse the repository at this point in the history
  4. lib: update Ensembl/RefSeq indexers and builders (include major impro…

    …vements and sonnar fixes), #TASK-5776, #TASK-5564
    jtarraga committed May 7, 2024
    Configuration menu
    Copy the full SHA
    303585d View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    68c47ef View commit details
    Browse the repository at this point in the history

Commits on May 10, 2024

  1. lib: update clinical variant downloader by moving the split ClinVar f…

    …ile to the build step, adding log messages, fixing sonnar issues,... #TASK-5575, #TASK-5564
    jtarraga committed May 10, 2024
    Configuration menu
    Copy the full SHA
    e7c2385 View commit details
    Browse the repository at this point in the history
  2. lib: update clinical variant builder by including the split ClinVar f…

    …ile to the build step, adding checks and log messages, fixing sonnar issues,... #TASK-5576, #TASK-5564
    jtarraga committed May 10, 2024
    Configuration menu
    Copy the full SHA
    f5b7c34 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    a4fca6b View commit details
    Browse the repository at this point in the history

Commits on May 11, 2024

  1. lib: include SpliceAI/MMSplice in the configuration file, and create …

    …the splice score downloader to create the splice score version files, #TASK-5575, #TASK-5564
    jtarraga committed May 11, 2024
    Configuration menu
    Copy the full SHA
    57c6f6f View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    c131459 View commit details
    Browse the repository at this point in the history

Commits on May 16, 2024

  1. lib: improve gene downloader by taking into account the manually down…

    …loaded files and creating the data source version files, #TASK-5575, #TASK-5564
    jtarraga committed May 16, 2024
    Configuration menu
    Copy the full SHA
    a8a047c View commit details
    Browse the repository at this point in the history

Commits on May 17, 2024

  1. lib: update gene builder (Ensembl/RefSeq) according to last changes, …

    …#TASK-5576, #TASK-5564
    jtarraga committed May 17, 2024
    Configuration menu
    Copy the full SHA
    100d6f3 View commit details
    Browse the repository at this point in the history

Commits on May 27, 2024

  1. lib: udate Ensembl/RefSeq gene builder to gunzip FASTA files before b…

    …uilding, #TASK-5576, #TASK-5564
    jtarraga committed May 27, 2024
    Configuration menu
    Copy the full SHA
    0cd4b80 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    e42cd7e View commit details
    Browse the repository at this point in the history

Commits on Jun 22, 2024

  1. Configuration menu
    Copy the full SHA
    4d965d7 View commit details
    Browse the repository at this point in the history

Commits on Jun 23, 2024

  1. Configuration menu
    Copy the full SHA
    fc65d14 View commit details
    Browse the repository at this point in the history

Commits on Jul 2, 2024

  1. Many improvements and fixes:

    * Support multiple species
    * remove sharding code
    * remove 'instal' command
    * launch genome_info.pl in the genome_info
    * update mouse version
    * many other...
    imedina committed Jul 2, 2024
    Configuration menu
    Copy the full SHA
    84ad97b View commit details
    Browse the repository at this point in the history
  2. * Add new ensembl_canonical.pl

    * Split GenomeDownloader in Conservation and Repeats
    imedina committed Jul 2, 2024
    Configuration menu
    Copy the full SHA
    aaec065 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    dad180d View commit details
    Browse the repository at this point in the history
  4. lib: use DockerUtils to execute Perl script from docker image, #TASK-…

    …5775, #TASK-5564
    
    On branch TASK-5564
    Changes to be committed:
    	modified:   cellbase-lib/src/main/java/org/opencb/cellbase/lib/download/GenomeDownloadManager.java
    jtarraga committed Jul 2, 2024
    Configuration menu
    Copy the full SHA
    694b81d View commit details
    Browse the repository at this point in the history

Commits on Jul 3, 2024

  1. test: update JUnit tests, #TASK-5564

    On branch TASK-5564
    Changes to be committed:
    	modified:   cellbase-core/src/test/java/org/opencb/cellbase/core/config/CellBaseConfigurationTest.java
    	modified:   cellbase-core/src/test/resources/configuration.yml
    	modified:   cellbase-lib/src/test/java/org/opencb/cellbase/lib/builders/ConservationBuilderTest.java
    	modified:   cellbase-lib/src/test/java/org/opencb/cellbase/lib/builders/RepeatsBuilderTest.java
    	modified:   cellbase-lib/src/test/resources/configuration.test.yaml
    	new file:   cellbase-lib/src/test/resources/conservation/gerpVersion.json
    	new file:   cellbase-lib/src/test/resources/conservation/phastConsVersion.json
    	new file:   cellbase-lib/src/test/resources/conservation/phyloPVersion.json
    	new file:   cellbase-lib/src/test/resources/regulation/motifFeaturesVersion.json
    	new file:   cellbase-lib/src/test/resources/regulation/regulatoryBuildVersion.json
    	modified:   cellbase-lib/src/test/resources/repeats/repeats.test.json.gz
    	renamed:    cellbase-lib/src/test/resources/repeats/windowMasker.txt.gz -> cellbase-lib/src/test/resources/repeats/windowmaskerSdust.txt.gz
    	modified:   pom.xml
    jtarraga committed Jul 3, 2024
    Configuration menu
    Copy the full SHA
    c8e719a View commit details
    Browse the repository at this point in the history
  2. cicd: update task.yml to deploy cellbase-builder docker, #TASK-5564

    On branch TASK-5564
    Changes to be committed:
    	modified:   .github/workflows/task.yml
    jtarraga committed Jul 3, 2024
    Configuration menu
    Copy the full SHA
    19efdf4 View commit details
    Browse the repository at this point in the history

Commits on Jul 4, 2024

  1. build: create the MiRTarBase parser for .xlsx files, #TASK-5576, #TAS…

    …K-5564
    
      - This parser skips possible errors in the .xlsx file
      - No need to use the script fix-gene-symbol.sh (so it is removed)
      - Update configuration files (by removing comments about the fix-gene-symbol.sh references)
      - Add JUnit test for the MiRTarBase parser
    
    On branch TASK-5564
    Changes to be committed:
    	deleted:    cellbase-app/app/scripts/mirtarbase/fix-gene-symbol.sh
    	modified:   cellbase-core/src/main/resources/configuration.yml
    	modified:   cellbase-core/src/test/resources/configuration.yml
    	modified:   cellbase-lib/src/main/java/org/opencb/cellbase/lib/builders/EnsemblGeneBuilder.java
    	modified:   cellbase-lib/src/main/java/org/opencb/cellbase/lib/builders/GeneBuilderIndexer.java
    	new file:   cellbase-lib/src/main/java/org/opencb/cellbase/lib/builders/MiRTarBaseIndexer.java
    	modified:   cellbase-lib/src/main/java/org/opencb/cellbase/lib/builders/RefSeqGeneBuilder.java
    	new file:   cellbase-lib/src/test/java/org/opencb/cellbase/lib/builders/GeneBuilderIndexerTest.java
    	modified:   cellbase-lib/src/test/resources/configuration.test.yaml
    jtarraga committed Jul 4, 2024
    Configuration menu
    Copy the full SHA
    fcbb680 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    10a579a View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    87d95e8 View commit details
    Browse the repository at this point in the history
  4. Gene downloader fixes

    imedina committed Jul 4, 2024
    Configuration menu
    Copy the full SHA
    c6bcbdd View commit details
    Browse the repository at this point in the history

Commits on Jul 5, 2024

  1. Add VariationDownloader

    imedina committed Jul 5, 2024
    Configuration menu
    Copy the full SHA
    0a6a84f View commit details
    Browse the repository at this point in the history
  2. Add VariationDownloader

    imedina committed Jul 5, 2024
    Configuration menu
    Copy the full SHA
    3dcad47 View commit details
    Browse the repository at this point in the history

Commits on Jul 8, 2024

  1. app: update Dockerfile for cellbase-builder in order to allow the scr…

    …ipt ensembl_canonical.pl to create sub-folders, #TASK-5575, #TASK-5564
    
    On branch TASK-5564
    Changes to be committed:
    	modified:   cellbase-app/app/cloud/docker/cellbase-builder/Dockerfile
    jtarraga committed Jul 8, 2024
    Configuration menu
    Copy the full SHA
    5eb33ae View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    f44dcc5 View commit details
    Browse the repository at this point in the history

Commits on Jul 9, 2024

  1. lib: add variation to the EtlCommons dataVersionFilenamesMap, #TASK-5…

    …575, #TASK-5564
    
    On branch TASK-5564
    Changes to be committed:
    	modified:   cellbase-lib/src/main/java/org/opencb/cellbase/lib/EtlCommons.java
    jtarraga committed Jul 9, 2024
    Configuration menu
    Copy the full SHA
    2b226fe View commit details
    Browse the repository at this point in the history

Commits on Jul 22, 2024

  1. Configuration menu
    Copy the full SHA
    510819c View commit details
    Browse the repository at this point in the history

Commits on Jul 23, 2024

  1. Configuration menu
    Copy the full SHA
    5514177 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    ae9a817 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    20c554b View commit details
    Browse the repository at this point in the history
  4. lib: check if genome data is already downloaded before downloading to…

    … skip, #TASK-5575, #TASK-5564
    jtarraga committed Jul 23, 2024
    Configuration menu
    Copy the full SHA
    9d2d4fe View commit details
    Browse the repository at this point in the history
  5. lib: add the parameter 'assembly' to command line when calling the sc…

    …ript genome_info.pl, #TASK-5575, #TASK-5564
    jtarraga committed Jul 23, 2024
    Configuration menu
    Copy the full SHA
    299003b View commit details
    Browse the repository at this point in the history

Commits on Jul 24, 2024

  1. lib: update GeneDownloadManager to call the script gene_extra_info.pl…

    …, #TASK-5575, #TASK-5564
    jtarraga committed Jul 24, 2024
    Configuration menu
    Copy the full SHA
    1d171d5 View commit details
    Browse the repository at this point in the history
  2. lib: improve genome and conservation downloaders by checking if data …

    …is already downloaded, and fix sonnar issues, #TASK-5575, #TASK-5576
    jtarraga committed Jul 24, 2024
    Configuration menu
    Copy the full SHA
    d10931d View commit details
    Browse the repository at this point in the history
  3. lib: improve repeats downloaders by checking if data is already downl…

    …oaded, #TASK-5575, #TASK-5576
    jtarraga committed Jul 24, 2024
    Configuration menu
    Copy the full SHA
    b422f3a View commit details
    Browse the repository at this point in the history
  4. lib: improve regulation downloader by checking if data is already dow…

    …nloaded, #TASK-5575, #TASK-5576
    jtarraga committed Jul 24, 2024
    Configuration menu
    Copy the full SHA
    d0c0ba3 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    1dc504f View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    4ba788d View commit details
    Browse the repository at this point in the history
  7. lib: improve protein downloader by checking if data is already downlo…

    …aded, #TASK-5575, #TASK-5564
    jtarraga committed Jul 24, 2024
    Configuration menu
    Copy the full SHA
    6fc7129 View commit details
    Browse the repository at this point in the history
  8. lib: improve variation downloader by checking if data is already down…

    …loaded, #TASK-5575, #TASK-5564
    jtarraga committed Jul 24, 2024
    Configuration menu
    Copy the full SHA
    8ed0e0d View commit details
    Browse the repository at this point in the history
  9. Configuration menu
    Copy the full SHA
    1442766 View commit details
    Browse the repository at this point in the history
  10. Configuration menu
    Copy the full SHA
    e48d27d View commit details
    Browse the repository at this point in the history
  11. lib: improve gene downloader, removing DISGENET, fixing sonnar issues…

    …, #TASK-5575, #TASK-5564
    jtarraga committed Jul 24, 2024
    Configuration menu
    Copy the full SHA
    642935a View commit details
    Browse the repository at this point in the history
  12. Configuration menu
    Copy the full SHA
    8030b02 View commit details
    Browse the repository at this point in the history

Commits on Jul 25, 2024

  1. Configuration menu
    Copy the full SHA
    e17e51d View commit details
    Browse the repository at this point in the history
  2. lib: improve genome builder by checking files, and fixing sonnar issu…

    …es, #TASK-5576, #TASK-5564
    jtarraga committed Jul 25, 2024
    Configuration menu
    Copy the full SHA
    733cade View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    ddc1056 View commit details
    Browse the repository at this point in the history

Commits on Jul 26, 2024

  1. lib: improve conservation builder by adding checks, log messages and …

    …fixing sonnar issues, #TASK-5576, #TASK-5564
    jtarraga committed Jul 26, 2024
    Configuration menu
    Copy the full SHA
    8c6dc78 View commit details
    Browse the repository at this point in the history
  2. lib: add support for multi-species, checks and log messages in the re…

    …peats builder, #TASK-5576, #TASK-5564
    jtarraga committed Jul 26, 2024
    Configuration menu
    Copy the full SHA
    847f835 View commit details
    Browse the repository at this point in the history
  3. lib: add support for multi-species, checks and log messages in regula…

    …tion builder, #TASK-5576, #TASK-5564
    jtarraga committed Jul 26, 2024
    Configuration menu
    Copy the full SHA
    b0d1c67 View commit details
    Browse the repository at this point in the history

Commits on Jul 29, 2024

  1. Configuration menu
    Copy the full SHA
    039aa81 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    7f77dec View commit details
    Browse the repository at this point in the history

Commits on Jul 31, 2024

  1. lib: improve gene (Ensembl/RefSeq) builder by supporting multi-specie…

    …s (e.g., mmusculus), #TASK-6426, #TASK-5564
    jtarraga committed Jul 31, 2024
    Configuration menu
    Copy the full SHA
    0eb898e View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    1d47fd9 View commit details
    Browse the repository at this point in the history
  3. lib: add variant and variant_structural_variations in the configurati…

    …on file for species (e.g., mmusculus), and update the variant downloader according to these changes, #TASK-6426, #TASK-5564
    jtarraga committed Jul 31, 2024
    Configuration menu
    Copy the full SHA
    7fbc054 View commit details
    Browse the repository at this point in the history

Commits on Aug 1, 2024

  1. app: improve CellBase loader by creating a new function to be reused …

    …by the different data, e.g., repeats, #TASK-6142, #TASK-5564
    jtarraga committed Aug 1, 2024
    Configuration menu
    Copy the full SHA
    d483dcf View commit details
    Browse the repository at this point in the history
  2. lib: improve genome sequence and info loader, #TASK-6142, #TASK-5564

      - Re-using the fucntion loadJsonFile
      - Adding a mongodb index for the collection genome info
      - Adding log messages
    jtarraga committed Aug 1, 2024
    Configuration menu
    Copy the full SHA
    7f62ce7 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    0602bba View commit details
    Browse the repository at this point in the history
  4. app: update CellBase loader for genes and proteins according to the p…

    …revious changes, #TASK-6142, #TASK-5564
    jtarraga committed Aug 1, 2024
    Configuration menu
    Copy the full SHA
    2b4fbeb View commit details
    Browse the repository at this point in the history
  5. lib: add VariantBuilder to generate the variation JSON files from VCF…

    … files, and rename some constants, #TASK-5776, #TASK-5564
    jtarraga committed Aug 1, 2024
    Configuration menu
    Copy the full SHA
    d693f57 View commit details
    Browse the repository at this point in the history
  6. app: update the CellBase loader for variation data according to the l…

    …atest changes, #TASK-6142, #TASK-5564
    jtarraga committed Aug 1, 2024
    Configuration menu
    Copy the full SHA
    38400c1 View commit details
    Browse the repository at this point in the history

Commits on Aug 2, 2024

  1. Configuration menu
    Copy the full SHA
    3117337 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    9c810e7 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    ec5f21a View commit details
    Browse the repository at this point in the history
  4. lib: extract the FutureSpliceScoreAnnotator in a file to reduce the V…

    …ariantAnnotationCalculator file size, #TASK-6426, #TASK-5564
    jtarraga committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    36c3609 View commit details
    Browse the repository at this point in the history
  5. lib: update the VariantAnnotationCalculator to support multi-species,…

    … #TASK-6426, #TASK-5564
    jtarraga committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    efa4824 View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    4326fa3 View commit details
    Browse the repository at this point in the history

Commits on Aug 5, 2024

  1. Configuration menu
    Copy the full SHA
    2c7ddfb View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    78211d0 View commit details
    Browse the repository at this point in the history
  3. lib: fix VariationBuilder by converting SV values from Ensembl to sta…

    …ndard values, e.g. <deletion> to <DEL>, #TASK-5576, #TASK-5564
    jtarraga committed Aug 5, 2024
    Configuration menu
    Copy the full SHA
    e0c6a13 View commit details
    Browse the repository at this point in the history

Commits on Aug 6, 2024

  1. lib: add new command 'data-list' to display the list of data supporte…

    …d by a given species, and update download options, #TASK-5575, #TASK-5564
    jtarraga committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    81e4cb1 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    280fd67 View commit details
    Browse the repository at this point in the history
  3. app: update CLI option descriptions for loading, exporting, indexing.…

    ….., #TASK-6142, #TASK-5564
    jtarraga committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    2235e5c View commit details
    Browse the repository at this point in the history

Commits on Aug 7, 2024

  1. Configuration menu
    Copy the full SHA
    6a4c16a View commit details
    Browse the repository at this point in the history
  2. lib: improve variation builder by setting xref and annotation, and re…

    …moving study info, #TASK-5576, #TASK-5564
    jtarraga committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    68c9f43 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    914b9c1 View commit details
    Browse the repository at this point in the history
  4. core: add ontology data into configuration file for "mus musculus" an…

    …d update ontology downloader to take it into account, #TASK-5575, #TASK-5564
    jtarraga committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    3538e14 View commit details
    Browse the repository at this point in the history

Commits on Aug 8, 2024

  1. lib: update ontology downloader and take into account multi-species s…

    …upport, #TASK-5575, #TASK-5564
    jtarraga committed Aug 8, 2024
    Configuration menu
    Copy the full SHA
    d0d92a3 View commit details
    Browse the repository at this point in the history
  2. lib: update ontology builder and take into account multi-species supp…

    …ort, #TASK-5576, #TASK-5564
    jtarraga committed Aug 8, 2024
    Configuration menu
    Copy the full SHA
    d51114b View commit details
    Browse the repository at this point in the history
  3. app: update load command executor for ontology data according to the …

    …latest changes, #TASK-6142, #TASK-5564
    jtarraga committed Aug 8, 2024
    Configuration menu
    Copy the full SHA
    24450d3 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    132382d View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    d556c4c View commit details
    Browse the repository at this point in the history

Commits on Aug 9, 2024

  1. lib: fix the function to save status and message of the downloaded fi…

    …les; improve summary log and update downloader managers according to these changes, #TASK-5575, #TASK-5564
    jtarraga committed Aug 9, 2024
    Configuration menu
    Copy the full SHA
    1f3572c View commit details
    Browse the repository at this point in the history

Commits on Aug 10, 2024

  1. Configuration menu
    Copy the full SHA
    6056655 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    a8d6368 View commit details
    Browse the repository at this point in the history

Commits on Aug 13, 2024

  1. add: improve species and assembly parameter descriptions, #TASK-5575,…

    … #TASK-5576, #TASK-5564
    jtarraga committed Aug 13, 2024
    Configuration menu
    Copy the full SHA
    162f34d View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    344e92e View commit details
    Browse the repository at this point in the history