Creating a new Project

Child Projects & Clones

Adding and managing team members

Using built-in search functions

Overview of labels and reviewing documents

Reviewing documents with one or more reviewers

Group labels

Adding documents from database searches

Adding PDFs to new or existing documents

Label Analytics

About Sysrev article filters

Export formats: XML & Excel

How to export from Sysrev

Overview of adding documents to Sysrev

Boolean, categorical and string labels

Demos and tutorials

Suggested workflow for testing and running auto labels

FAQs

Foresight Management reduces SDS processing time by 80% using Sysrev.

Carnegie Mellon advances research and education with Sysrev

ToxStrategies minimizes "Time to Data" with Sysrev

Featured Projects

Contact us

Sorting articles

How to use Sysrev article filters

Overview of Sysrev's Auto Label capabilities

How to use the auto label feature

Understanding the auto label report

The prediction histogram

Using filters to leverage Sysrev predictions

Adding funds to the auto label

Tips for optimizing your auto label prompts

Suggested workflow for structured literature review projects

About Sysrev's prediction model

How to Use Sysrev

Starting a New Project

Adding Documents

Labeling & Reviewing Documents

Filtering & Sorting

Using Sysrev's Prediction Model

Using LLM Auto Labeling

Exporting Data

Tips and Workflows

Success Stories

More to explore

<h2>Starting a new project</h2>Once logged in, create a new project by clicking the New button:<figure class="image"><img src="https://cdn-assets.productfruits.com/31deaa85-5c4f-4c24-929c-483f516029bc"></figure>If you have access to an enterprise license of Sysrev, you should see an option to choose the Organization as the project owner, which will enable the premium features that are available with the enterprise license.&nbsp;After selecting one of the options, you must decide if you would like your project to be publicly viewable or private. See below for more information about public and private projects. &nbsp;<figure class="image image_resized" style="width:478px;"><img src="https://d2jv02qf7xgjwx.cloudfront.net/accounts/117978/images/new_project2.png" alt="Choose project owner and privacy settings"></figure><h3>What is the difference between a Public and Private project?</h3>Public projects can be used to share the article metadata (including abstracts) and individual reviewer labels with anyone with the project URL. Note that this does not include public access to attached files in a project. With public projects, anyone with a Sysrev account can <a href="https://help.sysrev.com/en/article/child-projects-clones">clone your project,</a> including articles, labels and label answers (again not including attached PDFs). Private projects are viewable only by you and your collaborators. If you created a project as part of an organization, all other members in your organization will also be able to see the details of your project.<h3>Project names</h3>Project names can only contain letters, numbers and dashes. No spaces or other characters are allowed.<h2>Transferring a project from a personal to an enterprise license</h2>If you would like to transfer a project into an enterprise license, first open the project. Next, open the Manage -&gt; Settings dashboard, select Transfer Project, and choose which Organization the project should be transferred to.&nbsp;Note: You can NOT transfer projects from an enterprise license to a Basic or Premium account.&nbsp;<figure class="image image_resized" style="width:792px;"><img src="https://d2jv02qf7xgjwx.cloudfront.net/accounts/117978/images/transfer.png" alt="transfering project in sysrev"></figure>&nbsp;

Your label question acts as the generative AI prompt that is used by the auto labeler to apply label answers to each record. For categorical labels, the auto labeler will also access the Categories to retrieve its answers. To set up your labels for auto labeling, go to Manage -&gt; Label Definitions. Click on an existing label to edit it or create a new one by clicking on the label type at the bottom of the page.In the following example, we have created a categorical label and want the auto labeler to answer the question "What types of wildfire impacts are covered by this review?", providing one or more of the following answers: health, environmental, ecological, economic, or social.&nbsp;Note: We could also include a 'none of these' option, but if we don't, the auto labeler will simply not provide an answer.In this example, we have selected the following options:&nbsp;<ul><li>the checkbox for auto label Extraction to turn on the auto labeling for this label;&nbsp;</li><li>the Citations only option under Full Text to indicate that we want the auto labeler to only look at the metadata and not any attached PDFs;&nbsp;</li><li>No to the Probability and Reasonings feature, to disable the built-in chain-of thought reasoning questions that can be added to the prompt.&nbsp;</li></ul>Note: The Probability and Reasonings will add a set of built-in reasoning steps (known as 'chain-of thought' prompting) to your prompt and will likely impact auto labeler performance. It is useful to run your prompt with and without this feature selected to determine which setting works better in your case.<h2>1. Set your label question prompt and auto label settings</h2><img src="https://d2jv02qf7xgjwx.cloudfront.net/accounts/117978/images/2025-01-30_14-40-16.png" alt="Setting up categorical auto-label"><h2>2. Set up your article filter and auto label limit</h2>After clicking Save, we can go back to the Articles tab to set the articles that we want to auto label. In this example, we filtered for only records that have been included by two reviewers. We set our Max Articles (the number of records we want the auto labeler to label) to 20. You can see that the auto labeler has estimated the cost of this run to be $0.05.<img src="https://d2jv02qf7xgjwx.cloudfront.net/accounts/117978/images/2025-01-30_14-51-49.png" alt="Set auto-label to run">When you are ready, and your selection does not exceed the budget in your account, click the Run auto label button. Upon successful completion, the message "Last run just now: success" will appear at the bottom of the auto labeler box. To view auto label answers, click on one of the labeled articles from the list and scroll down. Below the article abstract you will see the auto label answers. In this example, you can see that the auto label identified ecological and environmental impacts in this study record. It also included this record with 80% certainty.Note: If instead of Last run just now: success, there is an indication that some of the run failed, simply click the Run auto label again. It will only run again on the failed items and often will succeed on a second try.<h2>3. Review auto label answers</h2><img src="https://d2jv02qf7xgjwx.cloudfront.net/accounts/117978/images/2025-01-30_14-57-22.png" alt="auto-label answers">Once you run the auto labeler, you will see auto label answers at the bottom of each record as shown in the image above. If you enabled "Probability and Reasoning", you can view the auto labeler's reasoning process by clicking on the dropdown arrow next to the auto label answer.You will also now also see an auto label report, located at the bottom left of the Overview page of your project. This report provides detailed analytics of the auto label answers in comparison to reviewer answers. See more about the report on the <a href="https://help.sysrev.com/en/article/understanding-the-auto-label-report">Understanding the Auto Label Report page</a>.&nbsp;For a recommended process for testing and revising your prompt, check out our <a href="https://help.sysrev.com/en/article/suggested-workflow-for-testing-and-running-auto-labels-copy">Suggested Workflow for Testing and Running Auto Labels page</a>.&nbsp;Pro tip: For tips and tricks on optimizing your prompts, check out the <a href="https://help.sysrev.com/en/article/tips-for-optimizing-your-auto-label-prompts-copy">Tips for Optimizing your Auto Label Prompts page</a>.&nbsp;

Go back to Sysrev

Was this article helpful?

You recently requested to reset your password for your account. Use the button below to reset it. This password reset is only valid for the next 24 hours.

If you’re having trouble with the button above, copy and paste the URL below into your web browser.

Please check your email for instructions to reset your password.

Check your email

Enter your email address and we will send you instructions to reset your password.

Please enter a new password below.

Set your password

How can we help?