Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ECO - Evidence and Conclusion Ontology #33

Open
HadleyKing opened this issue Nov 12, 2018 · 0 comments
Open

ECO - Evidence and Conclusion Ontology #33

HadleyKing opened this issue Nov 12, 2018 · 0 comments
Assignees
Labels
discuss Discussion/opinions requested Future version Discussion topics or issues for future development help wanted Extra attention is needed

Comments

@HadleyKing
Copy link
Contributor

The error_domain should use ECO to describe the results.
This would mean updating the text as well as creating a good example. @rajamazumder and @openbox-bio are currently working on an example that may be a good test case.

Other suggestions/comments welcome.
Currently this is only described as follows:

The empirical error subdomain contains the limits of detectability, false positives, false negatives, statistical confidence of outcomes, etc. This can be measured by running the algorithm on multiple data samples of the usability domain or in carefully designed in-silico spiked data. For example, a set of spiked, well-characterized samples can be run through the algorithm to determine the false positives, negatives and limits of detection.
The algorithmic subdomain is descriptive of errors that originated by fuzziness of the algorithms, driven by stochastic processes, in dynamically parallelized multi-threaded executions, or in machine learning methodologies where the state of the machine can affect the outcome. This can be measured in repeatability experiments of multiple runs or using some rigorous mathematical modeling of the accumulated errors. For example: bootstrapping is frequently used with stochastic simulation based algorithms to accumulate sets of outcomes and estimate statistically significant variability for the results.

Maybe we could incorporate this elsewhere too?

@HadleyKing HadleyKing added help wanted Extra attention is needed discuss Discussion/opinions requested labels Nov 12, 2018
@corburn corburn changed the title ECO - Evedence and Conclusion Ontology ECO - Evidence and Conclusion Ontology Nov 15, 2018
@HadleyKing HadleyKing added the Future version Discussion topics or issues for future development label Dec 6, 2018
@HadleyKing HadleyKing added this to the Future Versions milestone Nov 5, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
discuss Discussion/opinions requested Future version Discussion topics or issues for future development help wanted Extra attention is needed
Projects
None yet
Development

No branches or pull requests

2 participants