How to Export All Reviews into a CSV
API 2 Venues (most common)
To export all reviews for a given venue into a csv file:
If you have not done so, you will need to install and instantiate the openreview-py client.
Retrieve all of the Reviews into the a
reviews
variable. Follow this link and complete all three steps for API 2 venues to Get All the ReviewsGet the super review invitation. You can check out the default review form if you need a reference. You'll need the content of the super invitation to create the headers for the .csv.
If you did not use any custom fields for the review form, we would expect a list like ["title", "review", "rating", "confidence"]. Now create a list of the review form fields found in the content.
If you haven't already,
import csv
. Then iterate through the list of reviews stored in 'reviews' and for each one, append the values associated to the keys in your keylist. If a value does not exist for that key, put an empty string in its place. You may also want to know which submission each review is associated with. You can get the forum of each review, which corresponds to the forum page of its associated submission. For example, if a review's forum is aBcDegh, you could find that submission at https://openreview.net/forum?id=aBcDegh. To create a csv that includes the review forums, do this:
There should now be a .csv of exported reviews in the directory in which you are working.
API 1 Venues
Say you want to export all of the reviews for a given venue into a csv file.
If you have not done so, you will need to install and instantiate the openreview-py client.
Retrieve all of the Reviews into a
reviews
object following the instructions here.Next, get the super review invitation. This is the overall review invitation which each of the Paper#/-/Official_Review invitations are based off of, and it follows the format Venue/ID/-/Official_Review.
Generate a list of the fields in the content in the Review invitation. For reference, this is what the default review invitation content looks like in JSON:
so we would expect a list like ["title", "review", "rating", "confidence"]. This is how we get the list:
If you haven't already, import csv. Then iterate through the list of reviews stored in 'reviews' and for each one, append the values associated to the keys in your keylist. If a value does not exist for that key, put an empty string in its place.
There should now be a csv of exported reviews in the directory in which you are working.
Adding submission information to the exported csv (both API2 and API1)
You may also want to know which submission each review is associated with. You can get the forum of each review, which corresponds to the forum page of its associated submission. For example, if a review's forum is aBcDegh, you could find that submission at https://openreview.net/forum?id=aBcDegh. To create a csv that includes the review forums, do this:
Adding reviewer information to the exported csv (both API2 and API1)
You may also want to know the profile information of the reviewer associated with a review. First, create a mapping between the Reviewer ID (anonymous) and Profile ID:
Then you can use this map to find the profile ID of the reviewer for a review:
If you want additional information about the reviewer, you can get their profile using the Profile ID (see How to Get Profiles and Their Relations for more guidance).
Last updated