Specified model filename pattern was: #ID#.ref

[caicai83121]

Hi, thanks for this fantastic work.
Here is my question:
when I do "Example: evaluating the model as a generator on CNNDM"

calculate the ROUGE scores using ROUGE Perl Package

python cal_rouge.py --ref ./cnndm/test.target.tokenized --hyp ./result/cnndm/test.out.tokenized -l

it tell me :
Rouge155.py line 497, in __get_model_filenames_for_id
raise Exception(
Exception: Could not find any model summaries for the system summary with ID 10. Specified model filename pattern was: #ID#.ref

How to solve this problem？Thank you！

[yixinL7]

Hi, were you able to solve this problem?

One thing you could check is if the two files you provided (--ref and --hyp) contain the same number of lines. In your case I'm guessing the file you gave through --hyp is missing some lines.