Eye Tracking Study – NYU Langone Health

About

Advanced usability analytics for NYU Langone using eye-tracking method.

NYU Langone Health is one of the nation’s premier academic medical centers. Located in the heart of Manhattan, with additional facilities throughout the New York City area, NYU Langone is a popular choice for students with insurance health plan.

NYU Langone Health | Military.com

Our study goal is to Evaluate the usability of specific pages:

  1. How do users find a doctor based on their insurance, symptoms, and location? 
  2. How do users find ways to donate blood on the website? 
  3. Identify what can be improved and provide actionable recommendations.

Conclusion Preview

The overall experience of using the website differs a lot regarding each individual. In order to improve the usability and friendliness, we recommend NYU Langone Health that:

1. For search result page, differentiate in-person vs. video visits and move the date horizontal scrolling option to each doctor’s section.

2. For blood donation page, add a side navigation bar and organize the information using bullet points in order to avoid a text-heavy page.

Methodology

Tool

Material

  • Pre-test Questionnaire
  • Post-test Questionnaire
  • Tasks
  • Observation
  • Retrospective Think Aloud Interview

Tasks

1. Find a doctor based on insurance, symptoms, and  location (check information on how to schedule a virtual video visit)

You have seasonal allergies and you want to schedule a video visit with a doctor in your neighborhood who accepts your insurance.

2. Find information about blood donation

You want to donate blood and you are not sure if you are eligible to do so. Find out if you are eligible and what to expect on the day of your donation.

Participants Overview

Target Audience: graduate students with health insurance plans.

Participants : 3 students from Pratt Manhattan campus.

According to the pre-test questionnaire, we found that:

2 out of 3 participants think virtual doctor visits are helpful especially after COVID-19.

Forms response chart. Question title: What are some of the factors that you consider when selecting a doctor? From most important to not important.. Number of responses: .
Forms response chart. Question title: Do you find virtual doctor visits useful?. Number of responses: 2 responses.

Analytics Metrics

Qualitative

  1. Recordings
  2. Observation
  3. User quotes

Quantitative

  1. Task accuracy
  2. Ease of use
  3. Average time for task completion 

Data Visualization

  1. Gaze plot: analyze each participant individually of their eye movements
  2. Heat map: aggregated data of all participants, focusing on the home page and search results page 

After we analyzed all gathered data, we created a problem list and rated the frequency and severity. Then we defined the main issues and trivial issues (and we put forward recommendations for main problems).

Main problem list
Other problem list

Findings & Recommendations

Overall

The majority of the participants found the website to be easy to use. However, they struggled to:

1. Book appointments

  • Lack of indicators for online visits 
  • Lack of correlation between dates and time slots  

2. Find relevant information on the Donate Blood page due to: 

  • Text heavy 
  • Lack of visual cues 

Task 1

Finding 1

Video visit option is not easily discoverable on the search results page, which led to longer task complete duration (5 min 54 secs on average) and confusion:

I was expecting to see some kind of video signifer next to the time slots. 

I need to click doctor’s bio pages to find out more information about video visits.

Finding 2

Participants had difficulty correlating the dates and time due to spatial gap, created by a banner between them.

I was wondering what day I’m booking appointments. 

Recommendation 1 & 2

Differentiate in-person vs. video visits and move the date horizontal scrolling option to each doctor’s section.

Task 2

Finding 3

For task 2, participants found blood donation page to be too text heavy.

  • They spent a long time reading the information to find the eligibility criteria for blood donation (3 min 26 secs on average to complete the task).  

Recommendation 3

Add a side navigation bar and organize the information using bullet points in order to avoid a text-heavy page.

Conclusion

The overall experience of using the website differs a lot regarding each individual. In order to improve the usability and friendliness, we recommend NYU Langone Health that:

1. For search result page, differentiate in-person vs. video visits and move the date horizontal scrolling option to each doctor’s section.

2. For blood donation page, add a side navigation bar and organize the information using bullet points in order to avoid a text-heavy page.