无法复现Qwen-Image技术报告中的GenEval指标 #197
Description
我使用GenEval官方代码，在不同环境下包括V卡和A卡测试了Qwen-Image上的GenEval指标，始终无法复现tech report中的结果，并且差较大。请问应该如何才能复现该结果呢？
希望能够获得您的帮助！
tech report中的GenEval指标
测试的GenEval 指标
官方demo-rewrite
counting = 68.75%
color_attr = 69.00%
position = 76.00%
colors = 93.62%
two_object = 93.94%
single_object = 100.00%
Overall score (avg. over tasks): 0.83551
原prompt
two_object = 95.96%
single_object = 100.00%
position = 73.00%
color_attr = 73.00%
colors = 89.36%
counting = 91.25%
Overall score (avg. over tasks): 0.87095