Error with running run_xsum_flexgen.py

[gushu333]

Hi, I tried to run the summarization task with the command :

python run_xsum_flexgen.py --model opt-6.7b --output flexgen_6.7b.res

but run into the following error:

Traceback (most recent call last):
File "/xxx/H2O/H2O-main/h2o_flexgen/benchmark/xsum/run_xsum_flexgen.py", line 242, in <module>
  main()
File "/xxx/H2O/H2O-main/h2o_flexgen/benchmark/xsum/run_xsum_flexgen.py", line 235, in main
  total_time, throughput = run_inference(model_name, requests)
File "/xxx/H2O/H2O-main/h2o_flexgen/benchmark/xsum/run_xsum_flexgen.py", line 154, in run_inference
  output_ids = model.generate(
File "/xxx/H2O/H2O-main/h2o_flexgen/flexgen/flex_opt.py", line 946, in generate
  self.generation_loop_overlap_single_batch()
File "/xxx/H2O/H2O-main/h2o_flexgen/flexgen/flex_opt.py", line 1085, in generation_loop_overlap_single_batch
  self.store_cache(i, j-1, 0)
File "/xxx/H2O/H2O-main/h2o_flexgen/flexgen/flex_opt.py", line 770, in store_cache
  self.layers[j].store_cache(self.cache_home[j][k], self.cache_write_buf[j][k], i)
File "/xxx/H2O/H2O-main/h2o_flexgen/flexgen/flex_opt.py", line 429, in store_cache
  k_home, v_home, acc = cache_home.val
 ValueError: not enough values to unpack (expected 3, got 2)

Can you figure out the reason?