Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Implement lambkin-export to common data formats #113

Open
3 tasks
hidmic opened this issue Oct 24, 2024 · 0 comments
Open
3 tasks

Implement lambkin-export to common data formats #113

hidmic opened this issue Oct 24, 2024 · 0 comments
Labels
enhancement New feature or request good first issue Good for newcomers

Comments

@hidmic
Copy link
Collaborator

hidmic commented Oct 24, 2024

Feature description

LAMBKIN collects a lot of data for each benchmark run, which is then made available through lambkin.data APIs. This is fine and all, but it is overkill for many uses cases. Sometimes, you just need to look at the data on a spreadsheet. Having a CLI to quickly export benchmark data to common formats such as .csv would simplify some workflows.

Definition of Done

  • Update lambkin.data APIs to collect all data by default e.g.:
  • Add an export verb to the lambkin CLI to output lambkin.data frames in CSV e.g.:
    • lambkin export [-f csv] [-i path/to/input] [-o output.csv] evo.stats
  • Update export verb to take filtering predicates on benchmark iteration metadata e.g.:
    • lambkin export -k "variation.parameters.some_parameter == 100" evo.stats
@hidmic hidmic added the enhancement New feature or request label Oct 24, 2024
@hidmic hidmic changed the title Implement lambkin-export CLI to common data formats Implement lambkin-export to common data formats Oct 24, 2024
@hidmic hidmic added the good first issue Good for newcomers label Oct 29, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request good first issue Good for newcomers
Projects
None yet
Development

No branches or pull requests

1 participant