Overview of Sysrev's Auto Label capabilities

Sysrev has a built-in generative AI Auto Label feature that uses the OpenAI's GPT-4o model. This can be used to automate the labeling process. Sysrev generates an Auto Label report that allows users to compare auto labeling results to human labeling, such that labels can be improved, assessed and optimized to maximize accuracy and provide a transparent assessment process.

There are a few important things to know about the Auto Label feature:

• Restricted to Premium and Enterprise Accounts: The auto labeler is only available to users with verified payment methods.
• It costs money to run the auto labeler: Running the auto labeler requires funds in your Sysrev project. 
• The cost of running the auto labeler varies based on how many records you are labeling, the number of labels that are activated for auto labeling and the amount of content that is being 'read' by the auto labeler (e.g., citation only vs full PDF), among other factors.
• Only owners and admins on the project can run the auto labeler: If your user status for a project is set at 'member', you will not be able to use the auto labeler.

There are some useful settings that you can apply to control how the auto labeler runs, including:

• You can choose which auto labels to activate: Each label you create has settings to indicate whether the label should be included or ignored in the the auto labeling process. Note that the default is to include the label in the auto labeling process.
• You can choose what information the auto label should 'read': You can choose, at the label level, whether the auto labeler should consider citation information (e.g., title and abstract) only or should also 'read' attached content like PDFs.
• You can have the auto label pre-populate label answers or not: You can set whether or not the auto label fills in label answers.
• You can choose to auto label only a subset of records: You can set an article filter and/or limit the auto labeler to a certain number of records to control how many records are labeled in each run of the auto labeler.