Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Run experiments with enhanced evaluation metrics #43

Open
4 of 8 tasks
isaacmg opened this issue Jun 19, 2020 · 6 comments
Open
4 of 8 tasks

Run experiments with enhanced evaluation metrics #43

isaacmg opened this issue Jun 19, 2020 · 6 comments
Assignees

Comments

@isaacmg
Copy link
Member

isaacmg commented Jun 19, 2020

  • Run on primary US counties w/o transfer
  • Run on primary US counties w transfer (flow)
  • Run on primary US counties w transfer (county)
  • Run primary US counties w transfer (flow + county)
  • Run on Italy Counties w/o transfer
  • Run on Italy counties w transfer (flow)
  • Run on Italy counties w transfer (county)
  • Run on Italy counties w transfer (flow + county)
@isaacmg
Copy link
Member Author

isaacmg commented Jun 21, 2020

We now want to investigate how the model preforms with respect to transfer learning in various scenarios.

@isaacmg
Copy link
Member Author

isaacmg commented Jun 21, 2020

@aradhanacha will cover Italy and I will cover US counties.

@isaacmg
Copy link
Member Author

isaacmg commented Jun 22, 2020

Update so far have experiments both with and without flow transfer for Cook County through Richmond County NYC.

@isaacmg
Copy link
Member Author

isaacmg commented Jun 22, 2020

Clarification: These experiment should be run with just mobility data, new_cases, and day of week as features

@isaacmg
Copy link
Member Author

isaacmg commented Jun 24, 2020

Update most experiments are done. Still need to fill out missing counties specifically Los Angeles County (flow, Wayne County in Michigan and Miami-Dade County (all experiments), Cuyahoga County (flow pre-training, ). Working on reports simultaneously.

@isaacmg
Copy link
Member Author

isaacmg commented Jul 1, 2020

Most experiments are done including for additional counties. Due to some data errors the results are not exactly uniform, however the differences are subtle enough at the moment I think we can proceed to further evaluation steps.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants