Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Information System - Reproducibility paper #186

Open
8 of 9 tasks
aquemy opened this issue Feb 1, 2022 · 1 comment · Fixed by #188 or #192
Open
8 of 9 tasks

Information System - Reproducibility paper #186

aquemy opened this issue Feb 1, 2022 · 1 comment · Fixed by #188 or #192
Assignees
@aquemy
Milestone
InfoSys

Comments

@aquemy
Copy link
Member

aquemy commented Feb 1, 2022 •
edited
Loading

ECHR-OD project has been invited by Information System for a reproducibility paper.

This epic is about all the different items required to be fully reproducible.

  • Pin the dependency
  • Run a full workflow and establish the list of cases to be kept as reference
  • Ensure the build can be 100% reproduced with the list of case and then mark it as InfoSys special build
  • Tag the master branch with a special release for InfoSys
  • Update the website to provide the InfoSys build to be downloaded
  • Containerize the experiments
  • Adjust the experiment configuration (in particular, the parameter on class weight, add XGBoost and remove RBF SVM - too slow)
  • Ensure on a small dataset that the experiements are reproducible (i.e. all seeds are properly fixed)
  • ...
@aquemy aquemy added this to the InfoSys milestone Feb 1, 2022
@aquemy aquemy self-assigned this Feb 1, 2022
@aquemy aquemy changed the title Information System - Reproduction paper Information System - Reproducibility paper Feb 1, 2022
aquemy added a commit that referenced this issue Feb 2, 2022
@aquemy
Adjust the database preparation for unstructured cases #186
7bcd8bd
aquemy added a commit that referenced this issue Feb 2, 2022
@aquemy
Adjust the database preparation for unstructured cases #186
9f2daee
@aquemy aquemy linked a pull request Feb 2, 2022 that will close this issue
Adjust the database preparation for unstructured cases #186 #188
Merged
aquemy added a commit that referenced this issue Feb 3, 2022
@aquemy
Adjust the deploy action #186
0759b2a
aquemy added a commit that referenced this issue Feb 3, 2022
@aquemy
Adjust the deploy action #186
311667e
aquemy added a commit that referenced this issue Feb 3, 2022
@aquemy
Adjust the deploy action #186
d9fa341
aquemy added a commit that referenced this issue Feb 4, 2022
@aquemy
More verbose deploy action #186
9d1d13f
aquemy added a commit that referenced this issue Feb 4, 2022
@aquemy
More verbose deploy action #186
3f99521
aquemy added a commit that referenced this issue Feb 4, 2022
@aquemy
More verbose deploy action #186
4789769
aquemy added a commit that referenced this issue Feb 6, 2022
@aquemy
Fetch documents only when necessary #186
b1e9dcb
aquemy added a commit that referenced this issue Feb 6, 2022
@aquemy
Fetch documents only when necessary #186
7894673
aquemy added a commit that referenced this issue Feb 6, 2022
@aquemy
Fix the unit tests #186
fbd4674
aquemy added a commit that referenced this issue Feb 6, 2022
@aquemy
Fetch documents only when necessary #186
0973d4c
aquemy added a commit that referenced this issue Feb 6, 2022
@aquemy
Fix the unit tests #186
0c47aa0
aquemy added a commit that referenced this issue Feb 17, 2022
@aquemy
Add list of cases for the Information System build #186
910dc4d
aquemy added a commit that referenced this issue Feb 17, 2022
@aquemy
Adjust the datasett creation to use base_article #186
16c02e3
aquemy added a commit that referenced this issue Feb 17, 2022
@aquemy
Save the list of cases after a build for reproducibility #186
60dc2e3
aquemy added a commit that referenced this issue Feb 17, 2022
@aquemy
Update the condition to speedup document retrieval. Graceful exit. #186
7029987
aquemy added a commit that referenced this issue Feb 17, 2022
@aquemy
Restore the exclusion of the conclusion only #186
4123e1b
aquemy added a commit that referenced this issue Feb 17, 2022
@aquemy
Remove the list of cases to retrieve #186
742c262
aquemy added a commit that referenced this issue Feb 17, 2022
@aquemy
Parse properly the list of cases to retrieve #186
2205ba0
aquemy added a commit that referenced this issue Feb 17, 2022
@aquemy
Add list of cases for the Information System build #186
0e56041
aquemy added a commit that referenced this issue Feb 17, 2022
@aquemy
Adjust the datasett creation to use base_article #186
1a028fa
aquemy added a commit that referenced this issue Feb 17, 2022
@aquemy
Save the list of cases after a build for reproducibility #186
4d250ed
aquemy added a commit that referenced this issue Feb 17, 2022
@aquemy
Update the condition to speedup document retrieval. Graceful exit. #186
51d7371
aquemy added a commit that referenced this issue Feb 17, 2022
@aquemy
Restore the exclusion of the conclusion only #186
92dd9f0
aquemy added a commit that referenced this issue Feb 17, 2022
@aquemy
Remove the list of cases to retrieve #186
6d32637
aquemy added a commit that referenced this issue Feb 17, 2022
@aquemy
Adjust condition and fix unit test #186
6f86efe
aquemy added a commit that referenced this issue Feb 17, 2022
@aquemy
Add list of cases for the Information System build #186
8d70d46
aquemy added a commit that referenced this issue Feb 17, 2022
@aquemy
Adjust the datasett creation to use base_article #186
076e222
aquemy added a commit that referenced this issue Feb 17, 2022
@aquemy
Save the list of cases after a build for reproducibility #186
90516a1
aquemy added a commit that referenced this issue Feb 17, 2022
@aquemy
Update the condition to speedup document retrieval. Graceful exit. #186
e03d2a4
aquemy added a commit that referenced this issue Feb 17, 2022
@aquemy
Restore the exclusion of the conclusion only #186
a39d157
aquemy added a commit that referenced this issue Feb 17, 2022
@aquemy
Remove the list of cases to retrieve #186
911704e
aquemy added a commit that referenced this issue Feb 17, 2022
@aquemy
Parse properly the list of cases to retrieve #186
4ecc8d0
aquemy added a commit that referenced this issue Feb 17, 2022
@aquemy
Adjust condition and fix unit test #186
0a05979
@aquemy aquemy reopened this Feb 17, 2022
aquemy added a commit that referenced this issue Mar 7, 2022
@aquemy
Prepare version 2.1.0 changelogs. Restore original configuration for …
606d9cb 
…NLP models. #186
aquemy added a commit that referenced this issue Mar 7, 2022
@aquemy
Prepare version 2.1.0 changelogs. Restore original configuration for …
62c58f3 
…NLP models. #186
@aquemy aquemy mentioned this issue Mar 7, 2022
Merged
aquemy added a commit that referenced this issue Mar 7, 2022
@aquemy
Prepare version 2.1.0 changelogs. Restore original configuration for …
61a4c3b 
…NLP models. #186
aquemy added a commit that referenced this issue Mar 7, 2022
@aquemy
Adjust the database preparation for unstructured cases #186
aead52b
aquemy added a commit that referenced this issue Mar 7, 2022
@aquemy
Adjust the deploy action #186
eb53efb
aquemy added a commit that referenced this issue Mar 7, 2022
@aquemy
More verbose deploy action #186
9fb2cd4
aquemy added a commit that referenced this issue Mar 7, 2022
@aquemy
Fetch documents only when necessary #186
756ead4
aquemy added a commit that referenced this issue Mar 7, 2022
@aquemy
Fix the unit tests #186
c382396
aquemy added a commit that referenced this issue Mar 7, 2022
@aquemy
Add list of cases for the Information System build #186
1e0b7e1
aquemy added a commit that referenced this issue Mar 7, 2022
@aquemy
Adjust the datasett creation to use base_article #186
7d20fa8
aquemy added a commit that referenced this issue Mar 7, 2022
@aquemy
Save the list of cases after a build for reproducibility #186
c329b24
aquemy added a commit that referenced this issue Mar 7, 2022
@aquemy
Update the condition to speedup document retrieval. Graceful exit. #186
e68b63e
aquemy added a commit that referenced this issue Mar 7, 2022
@aquemy
Restore the exclusion of the conclusion only #186
0357779
aquemy added a commit that referenced this issue Mar 7, 2022
@aquemy
Remove the list of cases to retrieve #186
714ada1
aquemy added a commit that referenced this issue Mar 7, 2022
@aquemy
Parse properly the list of cases to retrieve #186
b396ab2
aquemy added a commit that referenced this issue Mar 7, 2022
@aquemy
Adjust condition and fix unit test #186
8a8afb3
aquemy added a commit that referenced this issue Mar 7, 2022
@aquemy
Prepare version 2.1.0 changelogs. Restore original configuration for …
5653db3 
…NLP models. #186
@aquemy
Copy link
Member Author

aquemy commented Mar 21, 2022

Guide to reproduce the experiments: https://github.com/echr-od/ECHR-OD_process/wiki/Information-Systems-2022---Reproducibility-Guide

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@aquemy aquemy

Labels
None yet
Projects
None yet
Milestone
InfoSys
1 participant
@aquemy