All pages
Powered by GitBook
1 of 36

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

I accidentally withdrew a submission, what do I do?

To revert a withdrawal, please contact the Program Chairs of your conference using the contact email on the venue homepage.

When will I be able to withdraw my submission?

For Authors

The timeline for submission withdrawals is determined by the Program Chairs of each venue. Therefore, there is not a single overarching OpenReview withdrawal policy. If you have questions about when in a venue workflow you will be able to withdraw your submission, you should reach out to the Program Chairs of that venue directly.

For Program Chairs

Authors are able to withdraw their paper at any time after the submission deadline or after has been run. You can optionally restrict the withdrawal window from your . You can also use the venue request form to configure the visibility of withdrawn and desk-rejected papers, as well as the identities of their authors.

How do I add a Program Chair to my venue?

After your venue is deployed, add Program Chair(s) by going to your Venue Request form, clicking the Revision button, then adding the emails of the additional program chair(s) to the Program Chair Emails field of the form. The user will need to have an active OpenReview profile with this email confirmed in order to access the venue.

Do not add members to the Program Chairs group directly. This will temporarily give the user access, but any changes to the venue configuration page will reset this group's membership to the users listed in the venue configuration page.

Frequently Asked Questions

I have a question about:

Post Submission Stage
venue request form

What should I do if I find a vulnerability in OpenReview?

A vulnerability is a defect (bug) in the system that compromises the integrity of the application or its data. If you found one, please Contact Us as soon as possible so that it can be fixed. Please do NOT post about the vulnerability elsewhere.

I want to delete my withdrawn or desk-rejected paper, what do I do?

Individual conferences determine the policy on the visibility of withdrawn and desk-rejected submissions. Please refer to the conference website for further information on the policy, and contact the venue organizers with any questions or concerns.

What is the max file size for uploads?

The max file size for uploads is 100 MB.

An author of a submission cannot access their own paper, what is the problem?

The author must make sure that the email address associated with the submission is added to their profile and confirmed.

What is the difference between due date (duedate) and expiration date (expdate)?

Due date is the advertised deadline.

Expiration date is the hard deadline.

What do the different 'status' values mean in the message logs?

Sent: The initial status value, meaning the message was sent to the email service.

Dropped: The email was not sent to the recipient for delivery.

Deferred: The email cannot immediately be delivered, but has not been completely rejected. The service will continue to try for 72 hours to deliver the deferred message. After 72 hours the defferal turns into a block.

Bounce: The server cannot or will not deliver the message. This is often caused by outdated or an invalid email address.

Delivered: The email has been accepted by the receiving server. This does not mean that the email made it to the recipient's inbox.

Blocked: The email was denied temporarily by the server. This is unrelated to the validity of the address.

My submission

  • My reviews

  • For OpenReview Profiles

    • I am an Independent Researcher, how do I sign up?

    • I didn't receive a password reset email, what do I do?

    • I don't want my profile visible to the public, how do I change this?

    • I had an account previously, but lost access to my email, what do I do?

    For Program Chairs

    Setting up a venue

    • How can I access the request form for my venue?

    • How do I find a venue id?

    • How do I add a Program Chair to my venue?

    • How can I override the information on my venue homepage?

    • ?

    • ?

    • ?

    • ?

    Managing active venues

    • How can I extend the Submission deadline?

    • How can I release reviews?

    • How can I enable Camera-Ready Revisions?

    • How can I manually assign Reviewers/Area Chairs?

    • ?

    • ?

    • ?

    • ?

    • ?

    For Reviewers

    • I am a reviewer and I don't have papers for Expertise Selection, what do I do?

    • How can I add formatting to my reviews/comments?

    • I am a reviewer but I can't access my assigned submissions, what do I do?

    • How do I obtain a letter of proof for my services as a reviewer?

    For Authors

    • How do I add/change an author of my submission after the deadline?

    • Why is my LaTeX code not displaying properly?

    • When will I be able to withdraw my submission?

    • I accidentally withdrew a submission, what do I do?

    Other

    • What should I do if my question is not answered here?

    • What should I do if I find a vulnerability in OpenReview?

    • How can I report a bug or request a feature?

    • How do I locate the date a submission is made public?

    My profile
    My venue

    How can I report a bug or request a feature?

    You can report a bug or request a feature by going to our . Before you do so, please read the so that we can understand and address your bug report or request. Once you are familiar with the procedure, you can make use of one of these to help us better understand your issue or feature request.

    Why are the "rating" and "confidence" fields in my PC Console wrong?

    If you removed the rating or confidence fields from your Official Review form, the PC console will show an average rating and/or confidence of 0 for each paper. If you replaced them with custom values, you can customize your PC console to show the average of those values instead.

    1. From your venue request form, click .

    2. Select which field you want to be used in place of rating and/or confidence. It must be in the "Additional Review Form Options" field. The options reviewers can select for that field must follow the format "number: description", for example "1: Very Poor".

    What field types are supported in the forms?

    Forms are rendered in the UI using invitations. You can read more about invitations in the link below.

    What should I do if my question is not answered here?

    The best way to get help with a specific issue is to contact the program chairs or organizers of the venue you are participating in. Contact info can usually be found on the venue's OpenReview page.

    For general inquiries, you can contact the OpenReview team by using the . We are most responsive from 9AM - 5PM EST Monday through Friday. With the exception of urgent issues, requests made on weekends or US holidays can expect to receive a response on the next business day.

    Why does it take two weeks to moderate my profile?

    Participants signing up for an OpenReview profile will notice a with a email domain that is public (ex, gmail.com, 163.com, qq.com, etc.) or if the domain is not included in our institution list. The warning states that signing up with a public domain may spend up to 2 weeks in moderation. This warning has understandably triggered a large number of emails sent to the support address requesting an early activation. We see these emails, we may not answer each depending on the load, but we review moderation daily.

    The warning was added by the staff in response to an increase in the number of fake/spam profiles being submitted with public domains, delaying moderation.

    We encourage users to signup with their institutional (industry/government/university/research org) email domains to bypass moderation. "Institutional" in this case is defined as an established organization or corporation. If your domain is not recognized, please contact us through the feedback form shared in the signup page warning to add your domain to our list.

    Will Reviewers be notified of their Assignments?

    Reviewers will see their assigned papers in their Reviewer console and in their Task list. Depending on what method you used to assign Reviewers to papers, they may have already been notified of their assignments:

    Automatic Assignment Deployed through the Edge Browser

    If you deployed an assignment configuration from the edge browser, Reviewers would not have received a notification of their assignments.

    I am a reviewer but I can't access my assigned submissions, what do I do?

    Ensure that you are logged in with an active OpenReview account that has the email the invitation was sent to added and confirmed to it. To make an OpenReview account, see . To add an email to your account, see .

    If you are logged in and are still not able to see your assigned submissions (but can see assignments under your Tasks), then reviewers have likely not been given reader access for submissions by the organizers of the venue.

    Please contact the venue organizers notifying them of the issue. The contact email can be found on the homepage of the venue.

    Missing Fields

    If part of the submission is missing fields such as the PDF, the most likely causes are:

    Manual Assignment through the Edge Browser

    If you use the "Assign" button to add a Reviewer to a paper, the Reviewer will receive a notification of their new assignment.

    Why can't I update my DBLP link?
    How do I recruit reviewers?
    How can I edit the Submission Form?
    How can I test my venue workflow
    What customizations are available for emails sent through OpenReview
    Reviewers for my venue cannot see their assigned submissions, what should I do?
    What field types are supported in the forms
    What do the default submission, review, metareview, and decision forms look like
    How can I allow LLM generated submissions?
    How can I automatically assign Reviewers/Area Chairs
    What do the different 'status' values mean in the message logs?
    How can I contact Reviewers, Area Chairs, and/or Authors
    An author of a submission cannot access their own paper, what is the problem
    What is the max file size for uploads
    What is the difference between due date (duedate) and expiration date (expdate)
    Will Reviewers be Notified of their Assignments?
    How do I hide a submission field from the submission's readers?
    I want to delete my withdrawn or desk-rejected paper, what do I do?
    issue tracker repository
    guidelines
    templates
    Enter the field name for the "Review Rating Field Name" (or "Review Confidence Field Name"). It must match the case as it is entered in Additional Review Form Options.
  • Click "Submit".

  • Review Stage
    API V2 Invitations
    Feedback Form
    warning if they sign up
  • These fields were optional in the submission

  • The venue organizers have decided to hide the field in review. If you believe this to be in error, please contact the venue organizers.

  • Signing up for OpenReview
    Add or remove an email address from your profile

    How do I obtain a letter of proof for my services as a reviewer?

    This is not something that is generated by OpenReview. Please contact the organizers of the venue where you served as a reviewer to see if they can assist you.

    To see a history of all emails sent to you by the organizers, please login and go to openreview.net/messages. To see your recent activity, including any reviews you may have submitted, you can go to openreview.net/activity.

    There is also the option of retrieving the public reviews you've written with their corresponding submissions using the API.

    How do I recruit reviewers?

    To recruit reviewers, there is a feature located on the venue request form called "Recruitment", clicking this button will allow you to send emails to potential reviewers. To find more information, please see our documentation on Reviewer Recruitment and Reminders.

    I am a reviewer and I don't have papers for Expertise Selection, what do I do?

    The OpenReview system uses the reviewer's publications from Expertise Selection in order to match reviewers and papers via affinity scores. Reviewers who do not have existing publications should leave the Expertise Selection form blank, and the reviewer will not be assigned an affinity score for a paper.

    Decisions on how to assign reviewers without affinity scores is at the discretion of the venue organizers. Please contact the venue organizers if you have further questions about how review assignment will work for a specific venue.

    Note: There is no 'Submit' button for Expertise Selection, and the task will show in your pending queue (where you can make changes) until the task expires at which time the task will automatically leave the queue.

    See also: How do I complete my tasks?

    How do I find a venue id?

    There are a few different ways to find your venue id.

    1. If you are a Program Chair, go to your venue request form and copy the information in the field Venue ID

    2. Use the URL of the submission page. The venue id is the portion of the url after group?id:For example for ICLR 2024 the submission homepage is : https://openreview.net/group?id=ICLR.cc/2024/Conference#tab-accept-oral, and the venue id is ICLR.cc/2024/Conference

    If you are having trouble with your venue id, ensure that there is no trailing backslash (e.g. ICLR.cc/2024/Conference/ is incorrect)

    How can I allow LLM generated submissions?

    All submissions must be represented and submitted by human authors. There are no author profiles representing AI.

    A field should be added to the submission form to indicate the content was generated by an LLM. Please see our guide on how to customize the forms.

    Reviewers for my venue cannot see their assigned submissions, what should I do?

    In order for a reviewer to see their assigned submissions, they need to be logged into an OpenReview account that has read permissions for the submission.

    If a specific reviewer cannot access their assigned submission, they may need to check that the email they received the invitation to is added and confirmed to their account- The email should be listed in their profile with (Confirmed) next to it. If this is not the case, they should follow the steps to add an email to their account.

    If all reviewers cannot access the forum page of their assigned submission, check that they are readers of the submission they are assigned to. On the Venue Request Form, make sure that the Submission Readers field includes reviewers. If reviewers are not listed as a reader, update the Post Submission stage to add them as readers for their submissions.

    Why can't I import my publication data from Google Scholar?

    We understand the frustration, unfortunately, Google Scholar does not have an API that enables us to import author publications.

    How do I add/change an author of my submission after the deadline?

    Each venue decides its own policy for how to handle requests to change the authorship list, order, or author details after the deadline. This is sometimes listed on the venue website or FAQ. If you need to request a change to your submission after the submission deadline has passed, please contact the venue organizers.

    I had an account previously, but lost access to my email, what do I do?

    If you have lost access to your OpenReview account, please try the following steps.

    1. Try resetting your password with alternate email accounts. You can reset your password with any email that was associated with it.

    2. Contact OpenReview Support ([email protected]) from your new email with the following information: your old email or profile ID and any available documentation verifying your institutional history in order to gain assistance in resetting your password.

    How do I complete my tasks?

    Throughout the course of a conference/workshop, members of the committee groups are assigned tasks to complete, such as, Expertise Selection, Reviewing, and the Reviewer License Agreement. Users can find their tasks by clicking on the Tasks button (openreview.net/tasks) on the red nav bar at the top of the page. They can also find these tasks in their respective venue consoles.

    Tasks button

    They'll see a list of different venue IDs and the number of pending and completed tasks.

    Tasks page
    Reviewer console listing tasks

    To view the tasks, click on the arrow next to the venue ID or "Show pending tasks and completed tasks". Clicking on a task link will redirect the user to another page to complete the task. When the task is completed it will be grayed out on the Tasks page. When the expiration date for that task expires the task will disappear from the Tasks page.

    Note: Some tasks, such as Expertise Selection, will continue to show as pending until the task expires, at which time it will be removed from the queue.

    See also: I am a reviewer and I don't have papers for Expertise Selection, what do I do?

    My Profile is "Limited". What does that mean?

    OpenReview’s goal is to provide scientific communication to the entire global community. Initially OpenReview was not available to users in Iran, Cuba, Syria, and several other countries because our cloud service provider blocked access as a simple approach to comply with United States economic sanctions and trade laws.

    Recently the OpenReview staff has done extra work to make OpenReview available in all countries, including those above. In order to comply with relevant laws, OpenReview must guarantee that none of our registered users appear in the Office of Foreign Assets Control of the U.S. Department of the Treasury (OFAC) SDN list. We primarily accomplish this by looking for first-last-name matches in the list. When there is a name match, we ask for additional information that would disambiguate the OpenReview user from the person on the SDN list.

    If you were notified that your profile has been limited, this means that the name on your profile matches that of a person on the SDN list. While in a limited state, you can log in to OpenReview, edit your profile, and view the same amount of data as before, but you will be unable to author any notes on the OpenReview system. This means you will be prevented from performing most common actions, including submitting to venues or posting reviews, meta-reviews, or comments. In order to reactivate your profile, you will need to do the following:

    • Log in to OpenReview at https://openreview.net/login

    • Navigate to your Profile at https://openreview.net/profile

    • Click the Edit button.

    • Find the field where you can enter your year of birth, and enter the information.

    • Click Save at the bottom of the page.

    OpenReview will routinely check for SDN matches, and if your birth year has been updated, your profile will return to active. Note that this change will not be immediate. If you believe you have been waiting longer than expected and your profile has not been reactivated, you can reach out to us using the .

    I don't want my profile visible to the public, how do I change this?

    If you don't want your profile to be publicly visible, you can uncheck the Profile Visibility setting from your Profile/Edit page. With this setting disabled, only authenticated (logged in) OpenReview users can view your profile.

    1. Go to https://openreview.net/profile/edit

    2. Click on "Personal Info"

    3. Under "Profile Visibility", uncheck the box to hide your profile from the public

    If your profile is public, unauthenticated individuals can see your:

    • Name

    • Personal Links

    • Career & Education History

    • Advisors, Relations & Conflicts (you can hide these items from your profile edit page)

    You can see this by copying your profile link and opening it in an incognito browser.

    Please note that OpenReview only displays obfuscated emails (****@umass.edu) and never releases full email addresses to the public.

    Why can't I update my DBLP link?

    The DBLP staff cannot support the exceptionally high number of support and error correction requests they've received from authors submitting to venues hosted on OpenReview. It will currently take several weeks, if not months, to read and address requests. Do not send your request multiple times.

    You can try the following steps to debug issues related to adding your DBLP link to your profile:

    1. Ensure that the DBLP link is properly formatted and uses the persistent URL (see for more details about persistent URLs)

    How do I locate the date a submission is made public?

    Publication date(pdate) means when the venue marked the paper as accepted.

    Modification date(mdate) means when the last time the paper was modified.

    The odate means when the submission becomes public. To check the odate of a submission, see the note object

    To find the id you can check the url of the submission, for example . Use id=KS8mIvetg2 , the note object url will be .

    I didn't receive a password reset email, what do I do?

    There are a few common reasons why you might not have received the password reset email. You can try the following steps to debug the issue

    1. Check that the email was not sent to a spam or junk folder.

    2. Try sending the password reset email again and double check that there are no typos in the email.

    3. Reset your password using a different email that is listed in your profile (such as personal email, previous institutional email).

    Expertise
    Feedback Form

    Ensure that your DBLP link is a single author page. If the link has a banner that states that it is a "disambiguation page", or if the link contains publications that belong to another researcher (See this post by DBLP for more information) there will be issues with importing papers. Please see the above warning about contacting DBLP with correct requests.

  • Check for previous profiles. Sometimes users have previously created profiles with DBLP links. If you get an error stating another user is using your profile, check for previous accounts using past emails.

  • Check for claimable profiles. There are some profiles that have been pre-created by OpenReview. You can go to the sign-up page and type the first and last name in the conflicting profile and check for claimable profiles.

  • Contact support. If none of the above steps work, please Contact Us. Include your profile id, the DBLP link, and the error message you receive when you attempt to update your profile.

  • here
    https://api2.openreview.net/notes?id=
    https://openreview.net/forum?id=KS8mIvetg2
    https://api2.openreview.net/notes?id=KS8mIvetg2

    How do I hide a submission field from the submission's readers?

    As the venue organizer, you can choose to hide specific submission fields from all submission readers. When a field is hidden, it becomes visible only to the Program Chairs and to the paper authors.

    Hide a field using Post Submission

    If you want to restrict a submission's field visibility from everyone except the Program Chairs and the paper authors, you can do as follows:

    1. From your venue request form, click Post Submission.

    2. Under hide_fields, select from the dropdown all the fields you would like to hide.

    After the submission deadline, submissions will be updated to be visible to all users selected under submission_readers in the request form, and all fields selected under hide_fields will be visible only to Program Chairs and paper authors.

    How do I upload a publication with a license that is not listed?

    OpenReview requires every publication to have a license. If you have a paper that is under a license that is not listed, please contact us through the Feedback Form.

    If after these steps, you are still having trouble resetting your password, contact us through the
    .
    Feedback Form

    Can I automatically transfer my Expertise Selection to another venue?

    Expertise Selection is a task for Program Committee members (such as reviewers) that gives them the opportunity to identify which previous publications they would like to be considered when being matched with submissions to review. If you want to use the same Expertise Selection configuration for multiple venues, it is possible to transfer the expertise from one venue to another using the OpenReview Python client using the following steps.

    These instructions are for venues that use the default OpenReview setting of using all papers except those that are excluded by the user in the Expertise Selection Task. Before transferring expertise, please check that both venues use this method for Expertise Selection.

    1.

    2. Get Expertise Selection edges from the previous venue

    OpenReview by default considers all publications as relevant expertise for paper matching and assignment. In Expertise Selection, edges are posted indicating the papers that should be excluded from paper matching. You can get the edges from a previous venue using the following method:

    You will need the following information:

    • profile_id: Your profile ID (such as ~First_Last1). Also see

    • from_venue_id: The id of the venue you want to transfer expertise from. Also see:

    • group_name: The name of the group you are in on the Program Committee (typically this is Reviewers or Area_Chairs)

    The number of edges should correspond with the number of papers that you are excluding from Expertise Selection.

    3. Copy edges to new venue

    Finally, post an edge to the new venue that you are doing Expertise Selection for:

    I am an Independent Researcher, how do I sign up?

    We've received many emails from concerned researchers who want to sign up quickly but aren't affiliated with an academic institution.

    If you are not affiliated with an academic institution, but are employed at a company, you can use that domain and position information to sign up. You may need to request OpenReview add your company as an institutional domain.

    If you do not have a company domain, you can use a personal email. All personal emails will be moderated - see for additional tips on how to make sure your profile is activated as quickly as possible.

    When filling out the profile details for registration, there is a section that will ask for your Education and Career History, which will require a current position. For the role you can type “Independent Researcher” and set that as your current position and type in a domain. See the page for an example of how to fill out institutional information as an independent researcher. Please include as much of your background as possible. If the "Education and Career History" section only lists "Independent Researcher" we will ask you to add another institution record.

    Please do not use an old role or affiliation as your current position, as that may delay moderation.

    Expediting Profile Activation
    Entering Institutional Data
    Download and install the Python Client
    Finding your Profile ID
    How do I find a venue ID?
    import openreview
    from openreview.api import OpenReviewClient
    
    live_client_v2 = OpenReviewClient(
        baseurl='https://api2.openreview.net',
        username=YOUR_USERNAME,
        password=YOUR_PASSWORD
    )
    #set up venue and user information
    profile_id = YOUR_TILDE_ID 
    from_venue_id = FROM_VENUE_ID 
    from_group_name = FROM_GROUP_NAME  #Typically 'Reviewers' or 'Area_Chairs'
    
    #get edges for from_venue
    expertise_edges = openreview_client.get_all_edges(invitation=f"{from_venue_id}/{from_group_name}/-/Expertise_Selection",
     tail=profile_id)
    to_venue_id = TO_VENUE_ID
    to_group_name = TO_GROUP_NAME
    invitation = f"{to_venue_id}/{to_group_name}/-/Expertise_Selection"
    
    for edge in expertise_edges:
        openreview_client.post_edge(openreview.api.Edge(
            invitation = invitation,
            head = edge.head,
            tail = edge.tail,
            signatures = [profile_id],
            label = 'Exclude'
        ))