TASK=xsum HH_SIZE=256 RECENT_SIZE=256 Model=llama-7b and the rouge2 of h2o is low

[duyuxuan1486]

TASK=xsum
HH_SIZE=256
RECENT_SIZE=256
After running eval. sh, the rouge2 of h2o in run_summarization.py is below 5%. Why is this?

[Longyichen]

@duyuxuan1486 hi!
Have you ever encountered such an error?
when bash scripts/streaming/eval.sh full

from streaming_llm.utils import load, download_url, load_jsonl
ModuleNotFoundError: No module named 'streaming_llm'

[ChuanhongLi]

@duyuxuan1486 hi! Have you ever encountered such an error? when bash scripts/streaming/eval.sh full

from streaming_llm.utils import load, download_url, load_jsonl ModuleNotFoundError: No module named 'streaming_llm'

#8

[SherrySwift]

Hi, I meet the same problem. Have you solved this problem?