Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

About training and testing #66

Open
zkk-web opened this issue Jan 24, 2022 · 7 comments
Open

About training and testing #66

zkk-web opened this issue Jan 24, 2022 · 7 comments

Comments

@zkk-web
Copy link

zkk-web commented Jan 24, 2022

Hello!
When the code is running, training and testing display 6 and 11 numbers respectively, such as
training acc: [0.18333333 0.37 0.51333333 0.54666667 0.55333333 0.55 ]
Test acc: [0.2974 0.531 0.6133 0.658 0.6636 0.664 0.67 0.6694 0.6714 0.672 0.6714]
What do these numbers mean?
thanks!

@juliusyang97
Copy link

看最后一个数,是最后累计的结果,前面是每步更新过程中的值

@YangJae96
Copy link

@zkk-web Hi, did you figure out what it means?

@juliusyang97
Copy link

@zkk-web Hi, did you figure out what it means?

Hello, you can check the meta.py. Training acc has 6 values because task level inner update steps are 5. The acc will be calculated once for each update. The same is true for test acc。

@YangJae96
Copy link

@zkk-web Hi, did you figure out what it means?

Hello, you can check the meta.py. Training acc has 6 values because task level inner update steps are 5. The acc will be calculated once for each update. The same is true for test acc。

Thank for the explanation.
In the original paper, the 5-way 1shot accuracy for Mini-ImageNet is 48.70.

image

But when I ran the code, the accuracy is lower than original paper.

Which value in Test acc: [0.1996 0.4207 0.4316 0.437 0.4373 0.4377 0.438 0.4382 0.438 0.4387 0.4385]
should I look at to compare with the original paper?

@juliusyang97
Copy link

@zkk-web Hi, did you figure out what it means?

Hello, you can check the meta.py. Training acc has 6 values because task level inner update steps are 5. The acc will be calculated once for each update. The same is true for test acc。

Thank for the explanation. In the original paper, the 5-way 1shot accuracy for Mini-ImageNet is 48.70.

image

But when I ran the code, the accuracy is lower than original paper.

Which value in Test acc: [0.1996 0.4207 0.4316 0.437 0.4373 0.4377 0.438 0.4382 0.438 0.4387 0.4385] should I look at to compare with the original paper?

The last number. That is 43.85

@juliusyang97
Copy link

@zkk-web Hi, did you figure out what it means?

Hello, you can check the meta.py. Training acc has 6 values because task level inner update steps are 5. The acc will be calculated once for each update. The same is true for test acc。

Thank for the explanation. In the original paper, the 5-way 1shot accuracy for Mini-ImageNet is 48.70.
image
But when I ran the code, the accuracy is lower than original paper.
Which value in Test acc: [0.1996 0.4207 0.4316 0.437 0.4373 0.4377 0.438 0.4382 0.438 0.4387 0.4385] should I look at to compare with the original paper?

The last number. That is 43.85

Maml training is not stable and very slow. Keep on training and try to lengthen the training time

@zhaoguangxu666
Copy link

看最后一个数,是最后累计的结果,前面是每步更新过程中的值

你好,我想向您请教一下此项目中的backup文件夹中的naive5_train.py文件里的一个问题。在naive5_train.py中的这句代码“from naive5 import Naive5”,在此项目中好像没有“naive”这个包。请教您一下这个问题如何解决,谢谢。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants