Thanks for the great repo + paper team!
I think results/gpt4_1106_preview/model_outputs.json is missing from the alpaca_eval directory, I'm getting a warning atm:
https://github.com/tatsu-lab/alpaca_eval/blob/main/results/gpt4_1106_preview/model_outputs.json
The eval runs fine once I add the file to alpaca_eval/results/gpt4_1106_preview/model_outputs.json