The f1 and exact match

[Embedding]

Could you tell me the F1 and exact match after 30 epochs? I only achieve {"f1": 40.09514087383774, "exact_match": 27.93755912961211} with official evaluation script

[emilysw]

I also got similar results, @MurtyShikhar: what results did you get?

[lhuang9703]

Me too, I don't know what is wrong

[Penghao-He]

Similar result

[MurtyShikhar]

When I ran the sweep, I was able to get close to 60 exact match using the Boundary model. The Sequence model was much worse. You could try playing around with the hyperparameters (I know the best results I got weren't with these exact parameters but my best config is lost since then).