Johns Hopkins’ Study Found What Resumes Don’t Always Show: A Research on Pioneer Students’ Learning Outcomes

August 7, 2026
Helpful Resources, Key references, News
Johns Hopkins’ Study on Students’ Learning

Three Key Takeaways:

  1. A shorter resume may signal stronger internal drive, especially among underserved students. Students with fewer resources often show high levels of motivation and follow-through when given the opportunity. 
  2. Interviews may give US applicants an edge. In self-efficacy surveys, U.S. students reported greater confidence in planning, cross-cultural interaction, and finding resources. However, non-U.S. students often described richer, more complex experiences with greater modesty. A confident tone may not indicate greater capability. 
  3. Advanced academic challenges with guidance prepare students to appreciate a college education more. Students who reflect on connections with professors, mentorship, or peer support may be demonstrating the maturity needed to grow in post-secondary education. 

Beyond the Surface of an Application

A third-party evaluation by Dr. Matthew Makel in 2022 at the Johns Hopkins School of Education offers some rare, data-driven insight. Drawing on surveys and focus groups with high school students who completed rigorous, college-level research through Pioneer Academics, the study offers concrete evidence of how hidden potential can be surfaced and recognized.

1. Equity Lens: A Leaner Resume Does Not Signal Less Drive

What should educators and reviewers make of a promising applicant whose resume is a bit on the thin side? The evaluation of Pioneer Academics confirms what we already know: a shorter list of credentials does not mean lower readiness or less drive, especially when the student has overcome barriers to access even one high-impact experience.

Fewer Resources, Yet Greater Drive

High school students who received needs-based scholarships from Pioneer tend to come from backgrounds that limit their ability to participate in traditional resume-builders such as summer programs, international travel, or unpaid internships. These opportunities may be especially difficult to pursue while managing demanding high school classes. Yet we found that across all metrics, they either outperformed or equaled their peers.

  • Higher intrinsic motivation: Scholarship recipients scored higher on internal motivation to pursue their academic goals and career success [6.25 vs. 6.07].
  • Stronger self-efficacy: They also reported higher confidence in areas like executive function (planning) [81.3 vs. 78.7] and engaging across cultures [90.4 vs. 86.4]. They also score slightly higher on finding resources [79.2 vs. 76.3], but the difference was not statistically significant.
  • Transformational framing: In focus groups, these students described the Pioneer experience not as a line on a resume, but as a rare opportunity they would not otherwise have had. It was a rare chance for them to test their limits and connect deeply with academic work.


This suggests that scholarship students who gain access to Pioneer’s rigorous learning process may have demonstrated greater-than-average initiative and persistence. (Pioneer Academics offers need-based scholarships only) As Dr. Makel notes, the higher motivation and self-efficacy levels likely predated the program. That is, the students had to push harder to get there in the first place.

It is unlikely that their research experience caused this gap,” the report states. “This gap could have been present prior to the Pioneer experience (and been necessary for scholarship recipients to persist despite financial difficulties)” (Makel, 2022, p. 36).

What This Means for Academic Readiness

This finding confirmed that college admissions evaluating underserved applicants within their own context is the right approach. Besides research-based validation of this contextual approach, this finding highlights the value of assessing the level of college readiness through challenging courses and extracurricular activities involvement that help students prepare for college. As the report finding indicates, readiness goes hand-in-hand with the rigor of the program in which students have been involved. 

Underserved students who manage to access and succeed in a truly rigorous academic background by obtaining financial aid or federal student aid may demonstrate unseen levels of resilience, drive, and college readiness. 

2. Confidence Does Not Equal Experience

When evaluating thousands of applications, tone can matter a lot. A confident essay, a polished interview, or an assertive description of leadership can shape how readiness is perceived. Yet the John Hopkins evaluation cautions that while certain high school students may sound more confident, they don’t always have more experience.

The Confidence Gap

U.S.-based students in the study scored higher than international peers across several self-efficacy domains:

Self-Efficacy DomainU.S. StudentsNon-U.S. StudentsEffect Size
Cultural Interaction89.685.50.28
Executive Function (Planning)81.077.70.23
Finding Resources79.674.30.33

These results certainly sound like U.S. students were more confident in their ability to plan, interact across cultures and find support. But the report cautions against over-interpreting these scores. These differences may in fact reflect self-presentation style rather than actual experience.

“It may be that U.S. students feel confidence out of ignorance… their non-U.S. peers may have more experience interacting with others from a different cultural background” (Makel, 2022, p. 36).

Focus Groups: Tone vs. Reality

Focus groups support this interpretation. International students often described challenges that suggest deeper cross-cultural fluency. That is, navigating visa restrictions, adapting to new education systems, or building community far from home. But their language in reflecting on these experiences was more measured, modest, or tentative.

By contrast, U.S. students were more likely to describe outreach, leadership, and engagement in confident, assertive terms, yet their underlying experiences were narrower in scope.

The key insight is not a comparison of who is more prepared. It is that tone is not a reliable indicator of depth of experience.

What This Means for College Admission and Academic Preparation

This cultural nuance matters. Evaluators who read confidence as a proxy for capability risk undervaluing students whose self-presentation can reflect cultural humility, modest norms or second language diffidence.

Look for:

  • Specific, concrete challenges the student has navigated, even when described modestly
  • Evidence of adaptation across environments, school systems or cultural contexts
  • Recommendation clues about how the student works, collaborates and seeks support

Attending to the substance of experience rather than the confidence of the narrative can surface students whose readiness may be understated on paper but strong in practice.

3. Beyond Academics: Process and Networks Matter

Educators and reviewers often look for signs of reflection and self-awareness in college applications, especially when students talk about personal growth, relationships, or challenges they’ve faced. One of the clearest findings from the Johns Hopkins evaluation is that Pioneer students value more than accomplishments. They also reflect most deeply on the guidance through the process and on how that support prepared them to become successful college students.

In focus groups, many Pioneer alumni said that alongside the academic challenge, what they really needed was mentorship, soft skills guidance, and a lasting sense of connection to peers and professors.

What High School Students Said They Needed Most

Students—particularly scholarship recipients and international students—told us that academic experience was important, but they also significantly valued building relationships.

Students told us they wanted:

  • Help with time management and work-life balance
  • Deeper relationships with faculty
  • Continued contact with mentors or peers, and expressed regret for not doing so
  • Stronger alumni networks to stay connected after the program

“I wish I had learned more about networking and stayed connected with my professor and peers,” one student shared. “That would have helped me a lot more in college.”

What we heard was that they valued readiness, belonging and the soft skills that may help shape academic success in the college environment.

What This Means for College Readiness

Many students recognized, in hindsight, where they needed more support. Some expressed regret for not asking more questions, or not maintaining relationships that could have helped them successfully navigate university life on campus. We view this type of self-awareness as a signal of maturity. It shows that the student is learning to grow through reflection, and will most likely make use of the support systems available in college. 

College readiness requires more than strong academic performance. It also involves goal setting, time management, help-seeking, relationship-building, and the ability to reflect on past experiences. For admissions officers, guidance counselors and academic advisors, these reflections may offer useful evidence that a student is becoming college ready.

So we suggest looking out for:

  • Students who acknowledge how they’ve learned to seek help, manage competing demands or reflect on past mistakes.
  • Comments about mentorship, missed connections or what they could do differently
  • Evidence in recommendations that the student was proactive in asking for support or showing growth in self-management

This insight also has implications for educational programs more broadly. If students value the opportunity to learn how to seek support and build relationships, colleges and universities, as well as other higher education institutions can highlight post-admission and first-year programs that provide valuable support through connections with faculty, teachers, mentors and peers. Strengthening the visibility of these programs can make admitted students more confident in choosing your institution, increasing the likelihood that they enroll.

How to Read Between the Lines

The evaluation from John Hopkins gave us the data to back up what we already knew: College readiness sometimes doesn’t always announce itself clearly.

This point was confirmed by Mike Steidel, Dean of Admission – Emeritus at Carnegie Mellon University, who noted: “College readiness isn’t always evident in a cursory review—students with fewer opportunities may demonstrate exceptional drive, confidence does not reliably indicate depth of experience, and self-awareness can reflect growing maturity. The findings underscore the importance of an experienced, contextual evaluation in recognizing potential and college readiness that a resume alone cannot capture.” (personal communication, December 5, 2025).

So how does one conduct that contextual evaluation? Reviewers have to look for hidden signals. These can include persistence in the face of limited opportunities, self-awareness in reflection of what they still need to thrive, and humility that may mask extraordinary capabilities.

These are the types of students that will outperform what their credentials might predict.

Citations

Makel, M. C. (2022, December). Evaluation report for Pioneer Academics. Center for Research & Reform in Education, Johns Hopkins School of Education.

Online Info Session

Doing research is commonplace.
How do you choose the research opportunity that makes a difference?

Join us for a free online info session to learn about Pioneer

At Pioneer Co-Curricular Summit

Check exclusive sharings
From directors of prestigious programs

  • Questbridge
  • Rise
  • Oberlin Colllege & Conservatory
  • Northwestern Center for Talent Development
  • Davidson Institute
  • Johns Hopkins University