CERPEmpowering the computing community through evidence-based decision making.
  • Link to LinkedIn
  • Link to Facebook
  • Link to Youtube
  • About
    • About CERP
    • Advisory Board
    • Contact Us
  • Data
    • Data Overview
    • Data Buddies
    • DAPPIC
    • Data Visualization
    • Taulbee Survey
  • Evaluation
    • Evaluation Overview
    • REU Evaluation
  • Community Resources
    • Data Resources and Reports
    • Research Findings
  • Bulletin
  • Newsletter
  • Click to open the search input field Click to open the search input field Search
  • Menu Menu
About

About

The NSF Research Experiences for Undergraduates (REU) Survey, managed by the CRA Center for Evaluating the Research Pipeline (CERP), is an evaluation resource that provides critical information to the community on how participation in undergraduate research opportunities influences student pathways to computing graduate education and computing careers. 

The project began as a contract between CERP and the National Science Foundation (NSF) Directorate for Computer and Information Science and Engineers (CISE) in 2021, wherein CERP provided an evaluation of the NSF CISE REU programs (including REU Sites and REU Supplements). In 2024, CERP was awarded a cooperative agreement with NSF CISE (Award# 2335072). During that time, data collection and evaluation activities transitioned within the umbrella of CERP’s extensive portfolio of projects. 

Who can request evaluation services? Any REU project with a computing-related focus, regardless of funding source, may sign-up for CERP’s free evaluation. To do so, simply complete our online interest form and you will receive a confirmation email from a CERP team member (cerpreu@cra.org) within 1-2 business days.

Submitting a proposal? You’ve come to the right place for collecting what you need for submission. Simply complete our interest form, indicating you are preparing a proposal. From there,  you will receive an email from us with a paragraph that can be inserted directly into the evaluation section of your proposal.

Submit an interest form

Meet the team

Kari George, Lead Evaluator

Brendan Kane, Administrator

Burçin Campbell, Project oversight

Heather Wright, Project oversight

Acknowledgements

The CISE REU Evaluation Project is currently supported through a U.S. National Science Foundation cooperative agreement #2335072. Previous support came from a U.S. National Science Foundation contract (49100421C0010) and was approved by the Office of Management and Budget (OMB control number 3145-0265).

Evaluation Process

Evaluation Process

Depending on whether you are running an REU Site or you have an REU Supplement, we will use an evaluation method most appropriate for your awarded project and student population.

Data Collection

  1. Four weeks prior to your REU start date, we will send PI instructions and a PI form. This form must be completed within 1 week and is a required form.
  2. Two weeks prior to your REU start date, we will send a suggested participant recruitment email and the pre-survey link for you to send to your REU participants. Participants will have until 1 week after the REU starts to complete this pre-survey (a total of 3 weeks). We will monitor that data collection and request reminders as appropriate.
  3. About a week before the end of your REU, we will send you the second PI form for you to complete (completion required). Two days later, we will send you the post-survey link and suggested participant recruitment email to be sent to all REU participants. All forms and surveys must be completed within 3 weeks after your REU ends. We will also monitor that data collection and request reminders as appropriate.

Reporting

Approximately 2-3 months after data collection is complete, you will receive (depending on sample sizes): 

  • A key findings page – a one-page report summarizing the evaluation survey data collected from your REU participants. 
  • A site report – summarizing your REU participants’ responses alongside other REU sites. 

If you are in an REU Supplement, your report may include aggregated findings with other REU Supplements if you only have a few students in your project. The reporting timeline for Supplements will vary depending on the type of Supplement and when the project concludes.

Click here to view a sample comparison report

Measures

Measures

Our REU Evaluation surveys include various measures tailored towards different experiences of students that participate in NSF CISE REUs. Below is a non-exhaustive list of measures included.

Click here to request a copy of our participant surveys.

Previous REU experiences 
  • Year, setting, and details of previous REUs that students have participated in
General attitudes and beliefs regarding computing
  • Perceptions of abilities, skill sets, and accomplishments
  • Levels of identification with computing and sense of belonging
  • Perceived support from professional network and mentors
Future plans and career aspirations
  • Highest degree intentions
  • Employment and graduate school plans
  • Future career interests
  • Career values and perceptions of computing careers
Characteristics and Experiences
  • Academic background (e.g. pre-college CS and Math courses)
  • Enrollment information and reasons for matriculation and persistence
  • Perceptions of degree program and institution
  • Degree of involvement in curricular, co-curricular and extracurricular activities
  • Demographics
Results

Results

As part of our ongoing dedication to being a resource for the computing community, CERP makes it a priority to provide timely access to our research findings as soon as they become available. Explore our latest results to stay up-to-date with the REU evaluation team.

Survey Reports

The CERP team prepares an annual report highlighting key insights from the pre-survey, offering a snapshot of who participated in the formal research experience program for that cohort.

Feedback Report

At the end of the 2024 cohort survey cycle, CERP reached out to all PIs that had participated in the previous three years’ evaluations to gather feedback on the project. From the results, the CERP team generated a report highlighting key takeaways from this data collection.

Click here to view the Community Feedback Summary Report. 

Infographics in CRN

Explore our CERP Infographics, published in Computing Research News, for a visual dive into research findings and key takeaways on formal research experiences. These infographics provide valuable insights that the computing community will find both informative and engaging.

Infographic: Highlights on Faculty Support for REU Students from CERP’s REU Evaluation

https://cra.org/cerp/wp-content/uploads/sites/7/2026/04/April2026_Infographic_Thumbnail.jpg 2160 2160 edaniels /cerp/wp-content/uploads/sites/4/2015/05/cerp-header-logo.png edaniels2026-04-01 16:00:072026-05-19 12:32:34Infographic: Highlights on Faculty Support for REU Students from CERP’s REU Evaluation

Infographic: Student Motivations for Participating in Research Experiences for Undergraduates (REUs)

https://cra.org/cerp/wp-content/uploads/sites/7/2025/10/Examining-Students-Motivations-for-Participating-in-REUs_thumbnail.png 200 200 edaniels /cerp/wp-content/uploads/sites/4/2015/05/cerp-header-logo.png edaniels2025-10-01 12:00:282025-11-19 11:23:03Infographic: Student Motivations for Participating in Research Experiences for Undergraduates (REUs)

Infographic: NSF CISE REU 2023 Annual Report: Student Characteristics of REU Participants

https://cra.org/cerp/wp-content/uploads/sites/7/2025/02/thumbnail-2.png 1654 1672 edaniels /cerp/wp-content/uploads/sites/4/2015/05/cerp-header-logo.png edaniels2025-02-01 20:00:062025-04-15 16:42:14Infographic: NSF CISE REU 2023 Annual Report: Student Characteristics of REU Participants
Cleveland dot plot showing the seventeen motivating reasons undergraduate computing students decided to participate in a formal research experience. The most frequently cited reason is to build work experience or their resume/CV, with 63% selecting this option.

CERP Infographic: What motivates students to participate in formal research experiences?

https://cra.org/cerp/wp-content/uploads/sites/7/2024/05/CERP-Graphic_001R.png 6600 7150 edaniels /cerp/wp-content/uploads/sites/4/2015/05/cerp-header-logo.png edaniels2024-05-01 13:00:022025-01-31 13:47:18CERP Infographic: What motivates students to participate in formal research experiences?
Fact sheet presenting a summary of the demographic makeup of CISE REU Past Participants who participated in REU projects between 2013 and 2021.

Who has participated in an NSF CISE REU in the last ten years?

https://cra.org/cerp/wp-content/uploads/sites/7/2023/04/CERPInfographic_202305_thumbnail.png 200 200 Shar Steed /cerp/wp-content/uploads/sites/4/2015/05/cerp-header-logo.png Shar Steed2023-05-01 16:00:192025-01-31 13:47:37Who has participated in an NSF CISE REU in the last ten years?
Thumbnail for CERP infographic showing a horizontal bar graph

Compared to Peers, Students from Low-Income Backgrounds Report Less Awareness of – but Greater Interest in – Formal Research Experiences

https://cra.org/cerp/wp-content/uploads/sites/7/2021/06/CRN-Infographic_Thumbnail-June-2021.png 200 200 Shar Steed /cerp/wp-content/uploads/sites/4/2015/05/cerp-header-logo.png Shar Steed2021-06-01 21:22:072025-01-31 13:47:58Compared to Peers, Students from Low-Income Backgrounds Report Less Awareness of – but Greater Interest in – Formal Research Experiences
Text reads “REU Participation” with 3 graduation caps underneath

REU Participation Encourages Students to Pursue Graduate Degrees

https://cra.org/cerp/wp-content/uploads/sites/7/2021/03/March-2021-Infographic_Thumbnail.jpg 200 200 Shar Steed /cerp/wp-content/uploads/sites/4/2015/05/cerp-header-logo.png Shar Steed2021-03-01 08:59:032025-01-31 13:50:37REU Participation Encourages Students to Pursue Graduate Degrees
Thumbnail for CERP infographic

One Year Later, CERP Data Still Indicate REU Participation Relates to Graduate School Enrollment

https://cra.org/cerp/wp-content/uploads/sites/7/2020/02/202002_thumbnail200x200.jpg 200 200 Shar Steed /cerp/wp-content/uploads/sites/4/2015/05/cerp-header-logo.png Shar Steed2020-02-01 09:37:392025-01-31 13:48:21One Year Later, CERP Data Still Indicate REU Participation Relates to Graduate School Enrollment
Thumbnail for CERP infographic

IT Majors are Less Likely to Intend to Pursue Formal Research Before Graduation Compared to CS and CSE Majors

https://cra.org/cerp/wp-content/uploads/sites/7/2019/06/REU.png 200 200 Shar Steed /cerp/wp-content/uploads/sites/4/2015/05/cerp-header-logo.png Shar Steed2019-06-01 18:28:432025-01-31 13:49:10IT Majors are Less Likely to Intend to Pursue Formal Research Before Graduation Compared to CS and CSE Majors
Previous Previous Previous Next Next Next
Click here for more

IRB

IRB

Thank you for your interest in CERP’s evaluation of your NSF CISE REU project. While CERP has received IRB approval to conduct this evaluation, your institution’s IRB may require you to get separate approval to conduct the evaluation. CERP urges you to consult your institution’s IRB to determine whether they will require their own separate review.

Click here to request our IRB approved materials.

Guidelines for talking to your local IRB about the REU Evaluation

The information below is intended to support PIs with guidelines and talking points for approaching your own institution’s IRB about the REU evaluation.

The Center for Evaluating the Research Pipeline (CERP) has received IRB approval from BRANY for this REU Evaluation project as an Exempt, Category 2 project. All currently-funded NSF REU projects in the U.S. are eligible to use evaluation services being offered by CERP and are covered by this IRB approval.

Based on current OHRP definitions of when an institution is considered to be “engaged” in research, most institutions we work with do not require separate review and approval from their own institution’s IRB. This is because the local REU PI distributes anonymous pre-program and post-program survey links to the REU participants on behalf of CERP but has no other involvement in the research process (e.g., creation of the survey instruments, consent process, data collection, data analysis, or any other aspect of the study), and the PI will not have access to any data files or individually-identifying information resulting from this study. 

If you are a PI seeking to clarify your local IRB’s requirements, here are some key points to cover:

  • The Center for Evaluating the Research Pipeline (CERP) is conducting a national evaluation and has IRB approval from BRANY as an Exempt, Category 2 project. This site is part of the national evaluation being conducted by CERP.
  • The full study involves the distribution of surveys to REU participants at three timepoints: (1) prior to the start of their REU participation; (2) at the end of their REU participation; and (3) a one-year follow-up. These surveys will track changes over time among REU participants in their knowledge and skills, attitudes, and intentions to pursue further computing-related education and career pathways.
  • The REU PI’s only involvement in the data collection process is to distribute an anonymous survey link to their REU participants on behalf of CERP for the first two survey administrations (at the beginning and end of the REU).
  • The REU PI will have no involvement in the data collection for the third survey (the one-year follow-up); CERP will administer the one-year follow-up survey.
  • The REU PI will have NO involvement in any other aspects of the research process.
  • The REU PI will not receive a data file or any individually-identifying information resulting from this study. They will receive a summarized report of their REU results.
  • For information purposes: The national evaluation being conducted by CERP also includes a comparison group of participants who will be tracked alongside the REU participants. Importantly, this is completely separate from the data collection that is taking place with REU participants, and local REU PIs have no involvement in this aspect of the project. The comparison sample is derived from participants in previous CERP surveys who gave permission to be contacted for future data collection efforts.

If your institution’s IRB does require separate review and approval, you or another colleague will need to serve as PI for the portion of the research project that will occur with students at your institution.

Please complete the request form linked above to receive CERP-created materials that will help you with your local submission. 

You can choose to receive a version of the materials that only pertains to the local implementation (recommended), or you may receive a version of materials that includes the comprehensive set of materials for the full national evaluation being conducted by CERP. Both sets will include a document “IRB resources for individual institutions,” which includes common IRB application questions and suggested answers.

If you have any other questions or need any additional information to satisfy the requirements for a particular question on your local IRB forms, please contact us at cerpreu@cra.org.





FAQ

Frequently Asked Questions about CERP NSF REU Evaluation

What is the cost of working with CERP evaluation?

With funding from the U.S. National Science Foundation, CERP’s REU evaluation services are free. PIs do not need to include a budget for CERP’s evaluation in their proposals.

If I work with CERP, do I need to hire another evaluator to fulfill NSF’s evaluation requirement?

CERP’s evaluation fulfills NSF’s evaluation requirement, so another evaluator is not necessary for this purpose. If you have other funding sources, please contact your program officer to confirm CERP’s evaluation services alone are sufficient.

Will CERP collaborate with other evaluators?

While CERP is happy to provide other evaluators with the methodology and copies of the survey, CERP is not directly collaborating with other REUevaluators for this project.

Will CERP share data with other evaluators?

Due to privacy considerations, CERP does not share raw data collected through this project. PIs are encouraged to share the summary reports that CERP will provide each year (assuming that there are enough participant responses) with other evaluators as needed.

When I signed up to work with CERP for evaluation, I received a proposal paragraph. How do I include it in my NSF REU Site/Supplement proposal?

The proposal paragraph that we provide should be inserted directly into the required section of your proposal on evaluation. As it is a general paragraph, please feel free to add minor modifications to the language so that the paragraph includes any project-specific language or institutional information.

As an REU PI working with CERP for evaluation, do I need to have my own IRB approval?

CERP has IRB approval to conduct evaluation through BRANY IRB. As an REU PI, you are encouraged to contact your IRB office to determine whether additional oversight is required by your institution. You can find a copy of our approval letter and templates here that you can use to initiate that conversation.

Can I add specific questions to the CERP survey?

We have some limitations in our ability to change our surveys, as our project requires approval of all study instruments by our IRB. You may contact us if you have suggestions for new measures. We will keep a record of any requested additions and will consider suggestions for future surveys.

Will surveys also be sent to mentors/staff?

CERP collects information about the REU from PIs and other project leadership to better understand the structure of each REU. Surveys are not sent to REU mentors or other staff.

Who is responsible for distributing the evaluation surveys to student participants?

Each REU PI or Co-PI will be responsible for distributing the evaluation surveys to participants for the pre-test and post-test REU student surveys. Prior to data collection, CERP will provide the PIs (or the determined contact person) with all materials necessary for distribution, such as recruitment templates and the survey link. All communications from CERP will come from cerpreu@cra.org. For more information, see Evaluation Process.

Where can I share feedback about my experience working with CERP?

If you have feedback or suggestions for improvements, please contact us or complete our Evaluation Feedback Form.

Provide Feedback
Contact Us
CRA - Uniting Industry, Academia and Government to Advance Computing Research and Change the World.
CCC - Catalyzing the computing research community and enabling the pursuit of innovative, high-impact research.
Increasing the Success and Participation of Underrepresented Groups in Computing Research.
CRA-E - Addressing society’s need for a continuous supply of talented and well-educated computing researchers.
CERP - Promoting diversity in computing through evaluation and research.
Increasing interaction between industry partners and other organizations involved in computing research for the benefit of all.
CRA Home | Contact Us | Unsubscribe/Removal of Information | Terms of Use         © Copyright 2025 - CRA
  • About
  • Data
  • Evaluation
  • Community Resources
  • Bulletin
  • Newsletter
Scroll to top
We use cookies to understand how you use our site and to improve your experience. By continuing to use our site, you accept our use of cookies.Accept Read More
Disclaimer

Privacy Overview

This website uses cookies to improve your experience while you navigate through the website. Out of these, the cookies that are categorized as necessary are stored on your browser as they are essential for the working of basic functionalities of the website. We also use third-party cookies that help us analyze and understand how you use this website. These cookies will be stored in your browser only with your consent. You also have the option to opt-out of these cookies. But opting out of some of these cookies may affect your browsing experience.
Necessary
Always Enabled
Necessary cookies are absolutely essential for the website to function properly. This category only includes cookies that ensures basic functionalities and security features of the website. These cookies do not store any personal information.
Non-necessary
Any cookies that may not be particularly necessary for the website to function and is used specifically to collect user personal data via analytics, ads, other embedded contents are termed as non-necessary cookies. It is mandatory to procure user consent prior to running these cookies on your website.
SAVE & ACCEPT