A guide to practicing Open Science with Sysrev Part 1: Data sharing

Creating a new project

Child Projects & Clones

Adding and managing team members

Using built-in search functions

Adding documents from database searches

Adding PDFs to new or existing documents

Label Analytics

Export formats: XML, Excel and Parquet

Overview of adding documents to Sysrev

Suggested workflow for testing and running the Auto-labeler

FAQs

Foresight Management reduces SDS processing time by 80% using Sysrev.

Carnegie Mellon advances research and education with Sysrev

ToxStrategies minimizes "Time to Data" with Sysrev

Contact us

Project and review settings

Sorting articles

How to use the Auto-labeler

Using filters to leverage Sysrev predictions

Auto-labeler pricing and payments

Tips for optimizing your Auto-label prompts

Suggested workflow for structured literature review projects

About the Sysrev's prediction model

The prediction histogram

Navigating the Overview page

Overview of labels and reviewing documents

About Sysrev article filters

How to use Sysrev article filters

Overview of Sysrev's Auto-labeler

Understanding the Auto-label Report

How to export from Sysrev

Creating and managing labels

Group labels

Display options and Presets

Importing labels from other projects

Data Security & Privacy

Reasoning with Confidence

Reviewing documents with one or more reviewers

Demos and tutorials

Sysrev in the Classroom: Enhancing Research Literacy Through Collaborative Reviews

August 2025 - Release Notes

September 2025 - Release Notes

November 2025 - Release Notes 

October 2025 - Release Notes 

How to Use Sysrev

Starting a New Project

Adding Documents

Labeling & Reviewing Documents

Filtering & Sorting

Using Sysrev's Prediction Model

Using the Sysrev Auto-labeler

Exporting Data

Tips and Workflows

Success Stories

More to explore

Sysrev in Practice

Release Notes

<h2>Starting a new project</h2>Once logged in, create a new project by clicking the New button:<figure class="image"><img src="https://cdn-assets.productfruits.com/31deaa85-5c4f-4c24-929c-483f516029bc"></figure>You can choose whether to create the project under your main Sysrev user profile or under an Organization. If you have access to an Enterprise license of Sysrev, you should see an option to choose the Enterprise Organization as the project owner. If you have already created other Organizations in your account, these will also be available in the drop-down list. Note that if you are an Enterprise user, you will have access to premium features regardless of the Organization in which you create your account.After selecting one of the options, you must decide if you would like your project to be publicly viewable or private. See below for more information about public and private projects. &nbsp;<figure class="image image_resized" style="width:478px;"><img src="https://d2jv02qf7xgjwx.cloudfront.net/accounts/117978/images/new_project2.png" alt="Choose project owner and privacy settings"></figure><h3>What is the difference between a Public and Private project?</h3>Public projects can be used to share the labels, article metadata, users, and other information within the review with anyone with the project URL. Public projects also make reviews discoverable through Google search. Data created in publicly accessible reviews are re-usable by other reviewers and data scientists. With public projects, anyone with a Sysrev account can <a href="https://help.sysrev.com/en/article/child-projects-clones">clone your project,</a> including article metadata, labels and label answers. Note that PDF attachments are only visible to project members. People not affiliated with your project will not be able to view PDF attachments in public projects.Private projects are viewable only by you and your collaborators. Private projects will not show up in Google search results or be publicly visible. They can only be viewed after a user is granted permission from a project administrator. Note that if you created a project as part of an organization, all other members in your organization will also be able to see the details of your project.&nbsp;<h3>Project names</h3>Project names can only contain letters, numbers and dashes. No spaces or other characters are allowed.<h2>Transferring a project from a personal to an enterprise license</h2>If you would like to transfer a project into an enterprise license, first open the project. Next, open the Manage -&gt; Settings dashboard, click the Transfer button, and choose which Organization the project should be transferred to.&nbsp;Note: You can NOT transfer projects from an enterprise license to a Basic or Premium account.&nbsp;<figure class="image image_resized" style="width:88.39%;"><img src="https://cdn-assets.productfruits.com/53efcf4a-2cf6-4dd1-98b9-0081ba30277e"></figure><h2>Sysrev Organizations</h2>Sysrev Organizations offer another level of project management and organization. To create a new Organization under your main user account, go to your Sysrev account page by clicking on your username in the upper right hand corner. Then click on the Organization tab. Enter an name in the Organization Name field and click Create. Note that Organization names may only contain letters, numbers, and hyphens.<figure class="image image_resized" style="width:92.22%;"><img src="https://cdn-assets.productfruits.com/702dae74-9594-44b2-90ab-7d97bc984967"></figure>You can now create new projects and manage members within the Organization. You can also allow any member of the Organization to join any project within the Organization, or turn that option off, such that Organization members can only join a project if invited by the project admin or owner.<figure class="image image_resized" style="width:91.78%;"><img src="https://cdn-assets.productfruits.com/77f958a4-b7d7-42cf-a157-d7f2cf6762a6"></figure>Note that at this time, Organizations cannot be renamed or deleted.

Your label description acts as the generative AI prompt that is used by the Auto-labeler to apply label answers to each record. For categorical labels, the Auto-labeler will also access the Categories to retrieve its answers. To set up your labels for auto-labeling, go to Manage -&gt; Label Definitions. Click on the gear icon for an existing label to edit it or create a new one by clicking on the Create New Label button.<h2>1. Set your label description prompt and Auto-label settings</h2>In this example, we have created a categorical label and want the Auto-labeler to answer the question "In what geographic region was this study conducted?", providing the following answers: Africa, North America, Caribbean, Asia, Central America, South America, Oceania, Europe, Middle East, Other, not specified.&nbsp;Note: We included a 'not specified' option, but if we didn't, the Auto-labeler would be forced to select an answer, even if incorrect. We could turn off "Require answer", allowing the auto-labeler to skip the article if no answer is appropriate.In this example, we have selected the following Auto-labeler options:&nbsp;<ul><li>toggled ON the Enable Auto Extraction so that the Auto-labeler runs on this label;&nbsp;</li><li>toggled OFF Use Full Texts, so the Auto-labeler only looks at the metadata (title and abstract) and not any attached PDFs;&nbsp;</li><li>toggled ON Reasoning with Confidence, to enable the built-in chain-of thought reasoning questions that can be added to the prompt.&nbsp;</li></ul><figure class="image"><img src="https://cdn-assets.productfruits.com/1e3a1476-d480-429f-8ff6-9adb9fbd3419"></figure>&nbsp;Note: The <a href="https://help.sysrev.com/en/article/probability-reasoning">Reasoning with Confidence</a> will add a set of built-in reasoning steps (known as 'chain-of thought' prompting) to your prompt and will likely impact Auto-labeler performance. It is useful to run your prompt with and without this feature selected to determine which setting works better in your case.<h2>2. Set up your article filter and Auto-label limit</h2>After clicking Save, we can go back to the Articles tab to set the articles that we want to Auto-label. In this example, we filtered for only records that have been included by two reviewers. We set our Max Articles (the number of records we want the Auto-labeler to label) to 10. You can see that the Auto-labeler has provided a breakdown of the cost and estimated the cost of this run to be $0.05<figure class="image"><img src="https://cdn-assets.productfruits.com/63fd0b74-3be2-4202-96bc-c9a9d22a1413"></figure>When you are ready, and your selection does not exceed the budget in your account, click the Run Auto-label button. Upon successful completion, the message "Last run just now: success" will appear at the bottom of the Auto-labeler box. To view Auto-label answers, click on one of the labeled articles from the list and scroll down. Below the article abstract you will see the Auto-label answers. In this example, you can see that the Auto-label identified ecological and environmental impacts in this study record. It also included this record with 80% certainty.Note: If instead of Last run just now: success, there is an indication that some of the run failed, simply click the Run Auto-label again. It will only run again on the failed items and often will succeed on a second try.<h2>3. Review auto label answers</h2>Once you run the Auto-labeler, you will see Auto-label answers at the bottom of each record as shown in the image above. If you enabled "Reasoning with Confidence", you can view the Auto-labeler's reasoning process by clicking on the dropdown arrow next to the Auto-label answer.In this example, we can see that the Auto-labeler selected Europe with 100% certainty in its answer.<figure class="image"><img src="https://cdn-assets.productfruits.com/df3288b5-b692-4081-96ba-03bdaf5afcb9"></figure>You will also now also see an Auto-label Report, located at the bottom left of the Overview page of your project. This report provides detailed analytics of the Auto-label answers in comparison to reviewer answers. See more about the report on the <a href="https://help.sysrev.com/en/article/understanding-the-auto-label-report">Understanding the Auto-label Report page</a>.&nbsp;For a recommended process for testing and revising your prompt, check out our <a href="https://help.sysrev.com/en/article/suggested-workflow-for-testing-and-running-auto-labels-copy">Suggested Workflow for Testing and Running Auto-labels page</a>.&nbsp;Pro tip: For tips and tricks on optimizing your prompts, check out the <a href="https://help.sysrev.com/en/article/tips-for-optimizing-your-auto-label-prompts-copy">Tips for Optimizing your Auto-label Prompts page</a>.&nbsp;

<h2>Features &amp; Releases</h2>Label Definitions: The Label Definitions page has been updated. The update includes the Label(s) Overview, Create New Label, and Edit Label sub-pages.The following features have been removed:&nbsp; 1) default boolean, categorical, and string labels 2) designating boolean or categorical (options) as inclusion criteria.To learn more about the redesign, visit the <a href="https://help.sysrev.com/en/article/boolean-categorical-and-string-labels">Labeling and Reviewing Documents</a> section of the Help Center.&nbsp;Project Settings: The Project Settings page has been updated. While the layout and button iconography has changed, no functionality has been removed. To learn more about the redesign, visit the <a href="https://help.sysrev.com/en/article/project-and-review-settings">Project and Review Settings</a> article in the Help Center.&nbsp;<h2>Bugs &amp; Defects</h2>XML Export Missing Metadata: A defect was fixed whereby Sysrev was not including all article metadata when exporting to XML. Moving forward, any article metadata successfully imported Sysrev will be included in XML exports.&nbsp;

Go back to Sysrev

Was this article helpful?

You recently requested to reset your password for your account. Use the button below to reset it. This password reset is only valid for the next 24 hours.

If you’re having trouble with the button above, copy and paste the URL below into your web browser.

Please check your email for instructions to reset your password.

Check your email

Enter your email address and we will send you instructions to reset your password.

Please enter a new password below.

Set your password

How can we help?