Case Study 03 • Research Leadership & Product Direction

Provider Search & 15,000-Page Site Wayfinding

Securing executive buy-in for the organization's first usability testing program—turning behavioral data, 128 patient feedback signals, and iterative prototype testing into measurable mobile search gains and persistent site orientation.

Organization
Johns Hopkins Medicine
Leadership Scope
Research Strategy, Executive Advocacy & IA Direction
Stakeholders Aligned
Senior Directors, UX/Research Partners & Engineering
Key Outcomes
First Usability Testing Approved • Mobile Pass Rate 25% -> 62.5%

01 / Business Context & Breaking Cultural Resistance

Across a 15,000-page medical enterprise website, two core patient journeys were creating measurable friction: finding the right physician in the provider directory, and knowing where you are when navigating deep clinical sections.

At the time, formal usability testing was not part of the standard delivery culture—leadership was hesitant to commit budget, time, and perceived opportunity cost to user studies. As a UX leader, my first challenge was advocating upward to secure manager approval and present evidence to senior directors, establishing the organization's first formal usability testing workflow.

02 / Turning Multi-Source Signals Into Clear Direction

Rather than relying on opinions or isolated metrics, I triangulated survey feedback, session recordings, and controlled task testing across both initiatives:

SIGNAL SYNTHESIS

128 Search Comments & Behavioral Logs

I analyzed ForeSee survey feedback—isolating 128 provider-search comments—alongside previous/next-page analytics and session recordings to pinpoint exact breakdowns in specialty filtering and section orientation.

RIGOROUS EXPERIMENTATION

Counterbalanced Mobile & Desktop Testing

I authored test protocols, built competing prototypes (open vs. closed facets), and partnered with a third-party testing vendor using counterbalanced tasks to eliminate order bias across devices.

SYSTEMS WAYFINDING

Solving Deep Hierarchy Blind Spots

Wayfinding testing on Vision Critical revealed that menus only exposed two levels while lacking persistent sub-site markers. I architected persistent sub-site headers and scoped section menus to anchor users without visual clutter.

03 / Evidence in Action: Round 1 vs. Round 2 Iteration

Toggle between testing rounds below to see how Round 1 behavioral insights directly shaped our Round 2 interface changes and task performance.

Interactive Research Readout • Provider Faceted Search

Baseline Findings (8 Participants • Mobile & Desktop)

Users strongly preferred closed facets over open facets (which felt cluttered), and consistently scanned initial results before filtering. However, mobile task pass rates were only 25% (2/8 passed, 4 struggled, 2 failed) because the "narrow your results" control lacked visual affordance.

Key Insight: Users judge search trust by initial results first, and need unmistakable mobile filter affordance second.

Targeted UI & Microcopy Refinements

  • Committed to Closed Facets: Reduced cognitive load while keeping filters immediately accessible.
  • Action-Oriented Microcopy: Changed passive "narrow your results" label to clear "refine your results" CTA.
  • Visual Hierarchy & Mobile Affordance: Visually separated the refine header from interactive filter controls so mobile users immediately recognized it as interactive.

Validated Round 2 Improvements

Mobile Task Pass Rate: Jumped from 25% (2/8) to 62.5% (5/8), cutting mobile failures in half (2/8 down to 1/8) and improving mobile ease-of-use ratings from 3.8 to 2.7 (on a 1=easy to 7=hard scale).
Desktop Task Pass Rate: Improved from 37.5% (3/8) to 62.5% (5/8), cutting participant struggles from 5/8 down to 1/8.

Result: Faceted search was deployed to production physician profiles with executive alignment.

04 / Organizational Impact & Leadership Takeaway

  • Unlocked Organizational Testing Culture: Proved the ROI of user testing to skeptical leadership, establishing a repeatable research precedent for future digital initiatives.
  • Shipped Evidence-Backed Product Changes: Deployed closed faceted search on physician profiles and persistent sub-site headers across deep clinical sections.
  • Shaped Upstream Search Requirements: Translated user synthesis into concrete technical requirements for engineering and search-vendor teams.