Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Using Cityscapes Validation to Test ADVENT #136

Open
tianyu-z opened this issue May 24, 2020 · 3 comments
Open

Using Cityscapes Validation to Test ADVENT #136

tianyu-z opened this issue May 24, 2020 · 3 comments
Assignees

Comments

@tianyu-z
Copy link
Contributor

tianyu-z commented May 24, 2020

I transformed the segmentation map of Cityscapes Validation Datasets (frankfurt, lindau, and munster) into Mask images (by changing the value of the road, sidewalks... to 255 and the rest to 0.)
Then, we have 500 pictures in total to evaluate ADVENT.

The JSON files are at /network/tmp1/ccai/data/mask_generation/Cityscapes/structuredData/val
and the exact images are at /network/tmp1/ccai/data/Cityscapes/structuredData/val

I used it to validate ADVENT model. The mIOU is between 83.23 and 88.32. Because the "ground truth" is the union of road, sidewalks and anything on the ground rather than "where to flood", the mIOU can only be a reference. If you want to know the detailed performance, please checks the result here:
https://www.comet.ml/tianyu-z/advent-ccai/e6eb250447ac4d668c8e2f3225a7fd91?experiment-tab=images

image

@tianyu-z tianyu-z self-assigned this May 24, 2020
@vict0rsch
Copy link
Contributor

I think that's really encouraging! It's able to pick up the main idea (~road + wheels of cars)

@vict0rsch
Copy link
Contributor

(sorry @tianyu-z I had forgotten to press enter!)

@tianyu-z
Copy link
Contributor Author

Haha, no worries. Thank you for commeting on Sunday!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants