Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Incorrect evaluation for 2008 Obesity Challenge? #26

Open
bwang482 opened this issue Oct 26, 2021 · 0 comments
Open

Incorrect evaluation for 2008 Obesity Challenge? #26

bwang482 opened this issue Oct 26, 2021 · 0 comments

Comments

@bwang482
Copy link

bwang482 commented Oct 26, 2021

Reading the way labels are being handled in the training script and pred script, for each label (i.e. "Obesity" and the co-morbidities) the classes simply converted to binary (if intuitive[name] is not None and intuitive[name] == 'Y': label[idx] = 1). More importantly, the evaluation seems to have been conducted under the (multi-label) binary classification setting.

Is this correct or have I missed something important here? If so, why would it be comparable to the results of the original challenge?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant