Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

mawps dataset cot incorrect #138

Open
KonstantinHebenstreit opened this issue Nov 3, 2023 · 0 comments
Open

mawps dataset cot incorrect #138

KonstantinHebenstreit opened this issue Nov 3, 2023 · 0 comments

Comments

@KonstantinHebenstreit
Copy link
Collaborator

The COT of id 3 is partially the COT of id 2. Something is mixed up...

{
"id":"2"
"ref_id":""
"question":"One pencil weighs 28.3 grams. How much do 5.0 pencils weigh?"
"type":"number"
"choices":[]
"context":""
"cot":[
0:
"We multiply 28.3 by 5.0 and get 141.5."
]
"answer":[
0:
"141.5"
]
"generated_cot":[]
"feedback":[]
}

{
"id":"3"
"ref_id":""
"question":"Zoe was unboxing some of her old winter clothes. She found 8.0 boxes of clothing and inside each box there were 4.0 scarves and 6.0 mittens. How many pieces of winter clothing did Zoe have total?"
"type":"number"
"choices":[]
"context":""
"cot":[
0:
"We multiply 28.3 by 5.0 and get 141.5. add 4.0 to 6.0 and get 10.0."
1:
"Then we multiply 8.0 by 10.0 and get 80.0."
]
"answer":[
0:
"80.0"
]
"generated_cot":[]
"feedback":[]
}

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant