how can I compute the coverage values

[Lillian-jia]

Hello,

I have read your paper on GraphQler, and I would like to ask how you calculated the coverage results reported in your paper from the stats file.

For example, I tested graphql-zero from the benchmark with the following settings:

config.USE_OBJECTS_BUCKET = True
config.USE_DEPENDENCY_GRAPH = True

and obtained the following results:

===================HTTP Status Codes===================
{
"200": {
"createUser": 2,
"user": 8,
"createAlbum": 2,
"album": 7,
"createTodo": 2,
"todo": 7,
"createPost": 2,
"post": 7,
"createPhoto": 2,
"photo": 7,
"createComment": 2,
"comment": 7,
"users": 2,
"todos": 2,
"posts": 2,
"photos": 2,
"comments": 2,
"albums": 2,
"": 7,
"updateAlbum": 1,
"updateUser": 1,
"updateTodo": 1,
"updatePost": 1,
"updatePhoto": 1,
"updateComment": 1
}
}
===================Successful Nodes===================
{
"Mutation|createUser": 2,
"Object|User": 2,
"Mutation|createAlbum": 2,
"Object|Album": 2,
"Mutation|createTodo": 2,
"Object|Todo": 2,
"Mutation|createPost": 2,
"Object|Post": 2,
"Mutation|createPhoto": 2,
"Object|Photo": 2,
"Mutation|createComment": 2,
"Object|Comment": 2,
"Query|users": 2,
"Object|UsersPage": 2,
"Query|todos": 2,
"Object|TodosPage": 2,
"Query|posts": 2,
"Object|PostsPage": 2,
"Query|photos": 2,
"Object|PhotosPage": 2,
"Query|comments": 2,
"Object|CommentsPage": 2,
"Query|albums": 2,
"Object|AlbumsPage": 2,
"Mutation|updateAlbum": 1,
"Mutation|updateUser": 1,
"Mutation|updateTodo": 1,
"Mutation|updatePost": 1,
"Mutation|updatePhoto": 1,
"Mutation|updateComment": 1
}
===================Failed Nodes===================
{
"Object|Query": 8,
"Object|PaginationLinks": 8,
"Object|PageMetadata": 8,
"Object|PageLimitPair": 8,
"Object|Mutation": 8,
"Object|Geo": 8,
"Object|Company": 8,
"Object|Address": 8,
"Query|user": 8,
"Query|album": 7,
"Query|todo": 7,
"Query|post": 7,
"Query|photo": 7,
"Query|comment": 7,
"Query|": 7
}
===================General stats ===================

Time taken: 59.66466450691223 seconds
Number of unique query/mutation successes: 18/32
Number of unique external query/mutation failures: 7/32
Number of queries: 13
Number of mutations: 19
Number of objects: 20
Number of successes: 54
Number of failures: 114

After this, how can I compute the coverage values such as (+)93.75% and (-)93.75% shown in your paper? I tried calculating 18/32 and 7/32, but the results are much lower than the values reported in the paper. Did I do something wrong?