Skip to content
/ lcfp Public

Language-Conditioned Feature Pyramids for Visual Selection

Notifications You must be signed in to change notification settings

Alab-NII/lcfp

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

20 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

lcfp

Codes for Language-Conditioned Feature Pyramids for Visual Selection

Content

  • some utilities (e.g. dataset converters)
  • experiment codes

These files are common except for the configration.

  • attribute_selector_onecommon_exp_n.py
  • lcfp_selector_onecommon_exp_n.py
  • lcfp_selector_exp_n.py

Experiment on GuessWhat?! Guesser Sub-task

Preparation of the dataset

Download related files and locate them in the repository.

guesswhat corpus

  • data/guesswhat.train.jsonl
  • data/guesswhat.valid.jsonl
  • data/guesswhat.test.jsonl

coco2014 images

  • data/img/train2014
  • data/img/val2014
  • data/img/test2014

Learning

$ python src/lcfp_selector_exp_0.py

The model directory will be created in models directory.

Weights and validation history will be stored in the directory.

Evaluation

$ python src/eval_model_guesswhat.py src/lcfp_selector_exp_0.py

It choose and evaluate a weight with the best validation based on the history.

It output the result to the standard output.

Experiment on OneCommon Target Selection Task

Preparation of the dataset

Download related files and locate them in the repository.

onecommon corpus

  • onecommon_data/train.txt
  • onecommon_data/train_success_only.txt
  • onecommon_data/train_uncorrelated.txt
  • onecommon_data/valid.txt
  • onecommon_data/valid_success_only.txt
  • onecommon_data/valid_uncorrelated.txt
  • onecommon_data/test.txt
  • onecommon_data/test_success_only.txt
  • onecommon_data/test_uncorrelated.txt

Run convert_onecommon_data.py script to get converted files and images.

$ cd <repository root>
$ python convert_onecommon_data.py -i onecommon_data

Converted directory will be created in onecommon_data directory.

Learning

$ python src/lcfp_selector_onecommon_exp_0.py

Evaluation

$ python src/eval_model_onecommon.py src/lcfp_selector_onecommon_exp_0.py

About

Language-Conditioned Feature Pyramids for Visual Selection

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages