Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Final Report for WT, YH, and IS #8

Open
wants to merge 140 commits into
base: master
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
140 commits
Select commit Hold shift + click to select a range
8157cc8
Added data
Nov 19, 2021
66a08f3
Update readme.md
wtorous Nov 19, 2021
2317728
Copied template files
Nov 19, 2021
9fb0755
Merge branch 'master' of https://github.com/wtorous/rule-vetting
Nov 19, 2021
b1a056a
Update readme.md
wtorous Nov 19, 2021
ae68c90
Update readme.md
wtorous Nov 19, 2021
c6e0b0f
Some working EDA plots with poor code
Nov 19, 2021
aef0f31
Initial report files and Will EDA
Nov 26, 2021
ea26708
Proper writeup file structure
Nov 26, 2021
a6f86d0
Remove old report file structure
Nov 26, 2021
6119168
Added figs folder and test image
Nov 26, 2021
85d7af4
Update readme.md
wtorous Nov 26, 2021
e66002f
Draft introduction
Nov 26, 2021
38af7a8
Merge branch 'master' of https://github.com/wtorous/rule-vetting
Nov 26, 2021
adff9f1
Implemented dataset.py and added char to binary preprocessing
Nov 27, 2021
bd72f8b
Updated dataset.py file and proper loading in notebooks
Nov 27, 2021
51c7100
Update readme.md
wtorous Nov 27, 2021
d78a551
Added robust covariates judgement call
Nov 28, 2021
92937de
Judgement call for Kappa data
Nov 28, 2021
3309827
Removed post-hoc variables and fixed indexing
Nov 28, 2021
723a3e4
Update readme.md
wtorous Nov 28, 2021
f47339b
Cleaned up Will EDA
Nov 28, 2021
d803e08
Edits to dataset.py that didn't push for some reason
Nov 28, 2021
88a62e4
Fix bug in data indexing
Nov 28, 2021
b65f2c1
add impute_missing func
imyaxuan Nov 28, 2021
1938bb1
Fixed some bugs in missing data imputation
Nov 28, 2021
261ae54
Code to remove single-valued columns
Nov 28, 2021
89ee413
part of my eda
imyaxuan Nov 28, 2021
9df1d79
Fixed bug in missing imputation and refactored code in a minor fashion
Nov 28, 2021
da16df9
Merge branch 'master' of https://github.com/wtorous/rule-vetting
Nov 28, 2021
241b254
Refactor code to work with multi-index
Nov 28, 2021
cb25359
Update readme.md to Python 3.8
wtorous Nov 28, 2021
a7de3e5
Example of how to use multi-indexing
Nov 28, 2021
218acf9
Small update to MI example
Nov 28, 2021
d24a7f3
Update readme.md
wtorous Nov 29, 2021
b5831f3
Added function to convert continous var to one-hot encoded
Nov 29, 2021
793cc48
Convert AVPU to one-hot
Nov 29, 2021
a6856f9
update eda
imyaxuan Nov 29, 2021
a375365
Merge branch 'master' of https://github.com/wtorous/csi-pecarn-rule-v…
imyaxuan Nov 29, 2021
f4c148f
Data loading order change
Nov 29, 2021
fb1f8fe
Partial function for splitting analysis var
Nov 29, 2021
00e7243
Partial function for splitting analysis var updated comments
Nov 29, 2021
3b02a1e
Analysis variable pipeline complete
Nov 30, 2021
96096c8
Proper column names when loading AV
Nov 30, 2021
88503e3
Added funcitonality to specify control type in get_data()
Dec 1, 2021
c85432b
robust av parameter added
Dec 2, 2021
814c3df
variable selection by tree(part)
imyaxuan Dec 2, 2021
9979cef
variable selection by tree update
imyaxuan Dec 2, 2021
1f53fb6
missing data plots
imyaxuan Dec 3, 2021
2b330ab
variable selection by tree - update
imyaxuan Dec 3, 2021
42ae5c5
variable selection - update
imyaxuan Dec 4, 2021
65ebee2
some exploration on other tree methods - unfinished
imyaxuan Dec 4, 2021
c1cccf9
try some specific but simple tree structure
imyaxuan Dec 6, 2021
32a804f
compare tree classifiers
imyaxuan Dec 6, 2021
660fcbf
functions for tree methods
imyaxuan Dec 6, 2021
353fcf1
tree based classifiers
imyaxuan Dec 6, 2021
36f64d8
functions needed for simple tree algorithm
imyaxuan Dec 6, 2021
aecf20b
Covariates from full dataset
Dec 7, 2021
86bead1
Small encoding bug fixed
Dec 7, 2021
39ad7f0
Justification for GCS imputation; loads data with NA!
Dec 7, 2021
05bf892
GGS 15 Imputations and added indicator
Dec 7, 2021
9fd8a83
Refactored GCS 15
Dec 7, 2021
2b003e7
Robustness check for binary imputation
Dec 8, 2021
bd2e347
Indicator GCS NA and removed mean imputation
Dec 8, 2021
26b5377
Fixed age bug
Dec 8, 2021
b7efedd
Additonal GCS covar and JCs
Dec 8, 2021
5ecf7f8
VeryYoung with JC
Dec 8, 2021
625e0bd
Improved GCS imputation
Dec 8, 2021
861402a
Refactored data loading process for generating EDA plots
Dec 9, 2021
75d2950
Refactored Dataset() for clarity
Dec 9, 2021
9e990de
GCS thresholding JC
Dec 9, 2021
39ecd75
Update readme.md
wtorous Dec 9, 2021
a2e7110
Create data_dictionary.md
wtorous Dec 9, 2021
5da21bb
Update data_dictionary.md
wtorous Dec 9, 2021
a0d6e73
Update data_dictionary.md
wtorous Dec 9, 2021
61eb3dc
Update data_dictionary.md
wtorous Dec 9, 2021
c5cd9e3
Update data_dictionary.md
wtorous Dec 9, 2021
722a25d
GCS imputation bug fixed
Dec 9, 2021
0be9f15
Update data_dictionary.md
wtorous Dec 9, 2021
581f33c
Update data_dictionary.md
wtorous Dec 9, 2021
6f70770
Merge branch 'master' of https://github.com/wtorous/csi-pecarn-rule-v…
Dec 9, 2021
bd469b4
Update data_dictionary.md
wtorous Dec 9, 2021
c3471aa
Code to generate data_description.md
Dec 9, 2021
feb4cd3
Manually remove some columns
Dec 9, 2021
01977e6
Update readme.md
wtorous Dec 9, 2021
b2a9d8f
Update readme.md
wtorous Dec 9, 2021
6ec99dd
Update readme.md
wtorous Dec 9, 2021
d91730a
classifier comparison with age stratefication on complete variable list
imyaxuan Dec 9, 2021
83b6a4f
Judgements call for aggregation
Dec 10, 2021
3252bdb
Squashing bugs
Dec 10, 2021
825e13c
Less aggregation and flipped improved
Dec 10, 2021
5085ea8
Covariate name change
Dec 10, 2021
d1224b4
Fixed kappa JC
Dec 10, 2021
1c8cdd9
Refactor for EDA clarity
Dec 11, 2021
6543bea
Code to generate demographic charts
Dec 11, 2021
e395ed2
final model
imyaxuan Dec 11, 2021
aa7dc45
final model
imyaxuan Dec 11, 2021
3c70234
Merge branch 'master' of https://github.com/wtorous/csi-pecarn-rule-v…
imyaxuan Dec 11, 2021
63449dc
model functions
imyaxuan Dec 11, 2021
dcc82e7
notebooks for final classifier
imyaxuan Dec 11, 2021
cc20fe8
Older verison of code
Dec 11, 2021
8f9d83c
Working JC dictionary
Dec 11, 2021
2599871
Working JC dictionary small change
Dec 11, 2021
6ce64a1
Update readme.md
wtorous Dec 11, 2021
f42e9f3
final model update
imyaxuan Dec 11, 2021
16b81cf
Merge branch 'master' of https://github.com/wtorous/csi-pecarn-rule-v…
imyaxuan Dec 11, 2021
c9da782
Final functions with working JC
Dec 11, 2021
93c7b89
Merge branch 'master' of https://github.com/wtorous/csi-pecarn-rule-v…
Dec 11, 2021
b903669
Less JCs
Dec 11, 2021
b446019
final model final update
imyaxuan Dec 11, 2021
5630631
final model final update
imyaxuan Dec 11, 2021
301ac33
Update data_dictionary.md
wtorous Dec 12, 2021
9710b64
Update data_dictionary.md
wtorous Dec 12, 2021
2802868
Added more comments to .py files and cleaned repo
Dec 12, 2021
b688c4d
data_dictionry replaced in another location
wtorous Dec 12, 2021
6e18834
Further cleaning up of code for submission
Dec 12, 2021
b598df0
Figures for perturbation stability check
Dec 13, 2021
eaae9c0
Updated function definitons to pass automated tests
Dec 13, 2021
885f946
code for plot
imyaxuan Dec 13, 2021
47186cb
update final model
imyaxuan Dec 13, 2021
8fa3e8b
Update models to return 1D np array instead of list
Dec 13, 2021
a47a24f
add print model
imyaxuan Dec 13, 2021
381225f
add print model
imyaxuan Dec 13, 2021
8db8572
Updated model classes to pass tests
Dec 13, 2021
5504132
Will commit before outcome refactor
Dec 13, 2021
03ca2a6
plot code
imyaxuan Dec 13, 2021
81b3998
Add eda
ishaans99 Dec 13, 2021
c67a0f0
Add variable selection
ishaans99 Dec 13, 2021
37853b1
Updated csi_injury to outcome to pass automated tests
Dec 13, 2021
b4fd9be
Merge branch 'master' of https://github.com/wtorous/csi-pecarn-rule-v…
Dec 13, 2021
17125a4
Add writeup folder
ishaans99 Dec 13, 2021
3602751
Create requirements.txt
ishaans99 Dec 13, 2021
28c4c26
Delete lab4 copy.Rmd
ishaans99 Dec 13, 2021
37a239e
Added Ishaan
Dec 13, 2021
025e2ae
Update data_dictionary.md
wtorous Dec 13, 2021
20b2669
Update readme.md
wtorous Dec 13, 2021
a1947af
Added all figures
Dec 13, 2021
4b58255
Add post hoc
ishaans99 Dec 13, 2021
98b6ad1
Writeup and LaTeX source
wtorous Dec 13, 2021
eafa809
Update readme.md
wtorous Dec 13, 2021
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -39,3 +39,4 @@ dist
experiments/data/
!experiments/data/get_datasets.ipynb
.hypothesis
.Rproj.user
207 changes: 207 additions & 0 deletions data/csi_pecarn/processed/meta_test.csv
Original file line number Diff line number Diff line change
@@ -0,0 +1,207 @@
id,case_id,site,control_type
110020,110020,1,case
110006,110006,1,case
110010,110010,1,case
140108,110014,1,ran
140127,110012,1,ran
140148,110024,1,ran
140110,110014,1,ran
140113,110003,1,ran
140119,110001,1,ran
140138,110002,1,ran
210154,210154,2,case
210163,210163,2,case
240260,210152,2,ran
240264,210161,2,ran
240243,210156,2,ran
240248,210161,2,ran
310296,310296,3,case
310286,310286,3,case
310290,310290,3,case
340424,310302,3,ran
340431,310273,3,ran
340451,310277,3,ran
340422,310306,3,ran
410471,410471,4,case
410474,410474,4,case
410480,410480,4,case
410488,410488,4,case
410470,410470,4,case
440630,410479,4,ran
440612,410483,4,ran
440615,410470,4,ran
440623,410476,4,ran
440629,410473,4,ran
440610,410481,4,ran
510648,510648,5,case
540699,510647,5,ran
540702,510646,5,ran
540689,510650,5,ran
540694,510645,5,ran
610714,610714,6,case
610717,610717,6,case
610722,610722,6,case
610712,610712,6,case
640841,610719,6,ran
640819,610720,6,ran
640825,610724,6,ran
640830,610718,6,ran
640838,610708,6,ran
640817,610707,6,ran
710881,710881,7,case
710862,710862,7,case
710865,710865,7,case
710871,710871,7,case
710880,710880,7,case
710860,710860,7,case
741112,710871,7,ran
741053,710856,7,ran
741069,710894,7,ran
741064,710881,7,ran
741117,710864,7,ran
741066,710866,7,ran
741048,710889,7,ran
741102,710864,7,ran
741059,710881,7,ran
741076,710874,7,ran
741091,710887,7,ran
811165,811165,8,case
811131,811131,8,case
811149,811149,8,case
811143,811143,8,case
811146,811146,8,case
811127,811127,8,case
811136,811136,8,case
811158,811158,8,case
841423,811129,8,ran
841417,811157,8,ran
841443,811163,8,ran
841398,811150,8,ran
841459,811161,8,ran
841369,811136,8,ran
841397,811131,8,ran
841388,811160,8,ran
841458,811137,8,ran
841421,811176,8,ran
841394,811124,8,ran
841462,811131,8,ran
841377,811175,8,ran
841442,811159,8,ran
911488,911488,9,case
911479,911479,9,case
911482,911482,9,case
941575,911471,9,ran
941588,911488,9,ran
941584,911482,9,ran
941586,911484,9,ran
941572,911479,9,ran
941580,911483,9,ran
941594,911484,9,ran
941605,911490,9,ran
1011632,1011632,10,case
1011615,1011615,10,case
1011618,1011618,10,case
1011625,1011625,10,case
1011630,1011630,10,case
1011614,1011614,10,case
1041783,1011622,10,ran
1041798,1011632,10,ran
1041794,1011635,10,ran
1041836,1011620,10,ran
1041796,1011612,10,ran
1041779,1011619,10,ran
1041824,1011626,10,ran
1041789,1011613,10,ran
1041805,1011640,10,ran
1041834,1011621,10,ran
1041819,1011610,10,ran
1111864,1111864,11,case
1111849,1111849,11,case
1111853,1111853,11,case
1111858,1111858,11,case
1111863,1111863,11,case
1111847,1111847,11,case
1142036,1111865,11,ran
1142066,1111849,11,ran
1142020,1111848,11,ran
1142034,1111869,11,ran
1142030,1111860,11,ran
1142076,1111857,11,ran
1142032,1111841,11,ran
1142016,1111850,11,ran
1142058,1111843,11,ran
1142025,1111868,11,ran
1142041,1111862,11,ran
1142067,1111848,11,ran
1142053,1111854,11,ran
1212086,1212086,12,case
1212085,1212085,12,case
1242153,1212083,12,ran
1242148,1212080,12,ran
1242152,1212084,12,ran
1312184,1312184,13,case
1312190,1312190,13,case
1312196,1312196,13,case
1312180,1312180,13,case
1342330,1312192,13,ran
1342337,1312191,13,ran
1342349,1312186,13,ran
1342360,1312178,13,ran
1342327,1312179,13,ran
1412380,1412380,14,case
1412368,1412368,14,case
1412372,1412372,14,case
1442452,1412379,14,ran
1442457,1412370,14,ran
1442467,1412368,14,ran
1442478,1412377,14,ran
1442451,1412367,14,ran
1512515,1512515,15,case
1512496,1512496,15,case
1512501,1512501,15,case
1512506,1512506,15,case
1512523,1512523,15,case
1512514,1512514,15,case
1512495,1512495,15,case
1542753,1512515,15,ran
1542697,1512512,15,ran
1542714,1512500,15,ran
1542709,1512527,15,ran
1542769,1512525,15,ran
1542711,1512490,15,ran
1542689,1512517,15,ran
1542743,1512496,15,ran
1542702,1512527,15,ran
1542725,1512503,15,ran
1542759,1512526,15,ran
1542736,1512511,15,ran
1612803,1612803,16,case
1612794,1612794,16,case
1612807,1612807,16,case
1612778,1612778,16,case
1612800,1612800,16,case
1612780,1612780,16,case
1612789,1612789,16,case
1612810,1612810,16,case
1643011,1612818,16,ran
1643037,1612812,16,ran
1643027,1612817,16,ran
1643097,1612797,16,ran
1643030,1612787,16,ran
1643005,1612772,16,ran
1643076,1612807,16,ran
1643017,1612813,16,ran
1643051,1612817,16,ran
1643090,1612782,16,ran
1643070,1612796,16,ran
1713112,1713112,17,case
1713116,1713116,17,case
1713122,1713122,17,case
1713111,1713111,17,case
1743291,1713114,17,ran
1743263,1713126,17,ran
1743267,1713129,17,ran
1743279,1713102,17,ran
1743307,1713128,17,ran
1743287,1713116,17,ran
1743262,1713112,17,ran
Loading