-
Notifications
You must be signed in to change notification settings - Fork 37
Description
I need ROUGE scores with stemming applied on summaries.
I can get the scores with default settings. But, when I change the 'rouge.properties' and set the stemmer to true (stemmer.use=true), the following exceptions are caught:
$ java -jar rouge2-1.2.1.jar
2019-06-03 15:43:07 INFO SettingsUtil:33 - Using rouge.properties='/data/azs5955/ppt_generation/rouge/java/rouge.properties'
2019-06-03 15:43:07 INFO ROUGECalculator:203 - Working on task1008 ngram=L
2019-06-03 15:43:07 INFO ROUGECalculator:203 - Working on task1008 ngram=1
2019-06-03 15:43:07 INFO ROUGECalculator:203 - Working on task1008 ngram=2
2019-06-03 15:43:07 INFO ROUGECalculator:203 - Working on task1008 ngram=SU4
2019-06-03 15:43:07 INFO ROUGECalculator:203 - Working on task1129 ngram=L
2019-06-03 15:43:07 ERROR ROUGECalculator:180 - 0
2019-06-03 15:43:07 ERROR ROUGECalculator:181 -
You need to have a valid 'references' and 'system' folder under projects/test-summarization. Please check your rouge.properties file
2019-06-03 15:43:07 ERROR ROUGECalculator:183 - 0
java.lang.ArrayIndexOutOfBoundsException: 0
at com.rxnlp.tools.rouge.ROUGECalculator.applyStemming(ROUGECalculator.java:735)
at com.rxnlp.tools.rouge.ROUGECalculator.computeRouge(ROUGECalculator.java:503)
at com.rxnlp.tools.rouge.ROUGECalculator.evaluate(ROUGECalculator.java:213)
at com.rxnlp.tools.rouge.ROUGECalculator.start(ROUGECalculator.java:172)
at com.rxnlp.tools.rouge.ROUGECalculator.main(ROUGECalculator.java:96)
any suggestion is appreciated.