AI-Powered Personalization

Freed AI captures conversations between doctors and patients and instantly generates post-visit notes. New users are blown away by the accuracy, comprehensiveness, and speed of the output.

However, it's one thing to generate a great note, and a whole different beast to generate a personalized note that matches the unique preferences and requirements of each individual user.

Company

Freed AI

Role

Product Designer

Timeline

January – March 2024

Freed Case Study Hero Image
Freed case study mobile

Freed's design system is simple, focusing on note content, key actions, and a cross-device workflow.

Problem

Freed was great at catching all of the details discussed during a visit and generating a clear, comprehensive post-visit note, but it wasn't learning clinicians' writing style and preferences like a human scribe would.

This meant users had to spend time editing every note to fit their style. Even worse, they often made the same edits over and over again – such as adding a specific subheading or changing a paragraph to bullet points.

Not only was this a frustrating experience, but no saved preferences meant no product lock-in. It was easy for users to shop around and try competitors to see if they did a better job matching their writing style.

Research Phase

Strategy Overview

We knew personalization was a problem and that users were leaving Freed because of it, but we needed to know more about specific pain points and shortcomings. To do so, we took the following approach:

  1. Interview Freed clinicians to find out how they're manually personalizing and editing their notes
  2. Design potential solutions to simplify personalization based on findings
  3. Test solutions with the original interviewees and additional users to see which approach best meets their needs

From the initial interviews, we landed on three solution concepts to test with users.

25Clinicians
Interviewed
7Medical
Specialties
6Competitors
Evaluated
3Concepts
Tested

Lo-Fi Concepts

A. Learn by Instruction

Users convey their preferences through explicit instructions. Freed adds these instructions to the base AI prompt, regenerates the note, and uses them for future notes.

👍Pros
  • Intuitive; users understood what to do and what would happen
  • Most useful option for improving an existing Freed-generated note
👎Cons
  • Some users weren't sure what to write or what specifically to request
  • Not as exciting without the ability to dictate instructions
Lo-fi Concept 2

B. Learn by Example

Users save example notes that reflect their style and preferences. Freed builds a list of rules based on the saved examples to apply to future notes.

👍Pros
  • Familiar; clinicians are used to sharing examples with human scribes
  • Requires the least amount of effort of the three options
👎Cons
  • Users weren't sure what exactly Freed would learn from their examples
  • Unclear how many examples should be saved
Concept Placeholder

C. Note Templates

Users create templates that define the structure and content of their notes. They indicate preferences by choosing settings for sections and subsections in the template.

👍Pros
  • Users had experience creating and managing templates in other medical applications
  • Liked that multiple templates could be made for different visit types
👎Cons
  • Most limiting of the three options; unable to handle complex preferences
  • Unsure if/when they'd have time to create their templates
Concept Placeholder

Final Designs

After considering the tradeoffs of our test concepts, we landed on a final design strategy that combined both example-based and instruction-based learning. The reason for this decision was that in most cases, example notes covered ~80% of users' note preferences, and they were able to get the rest of the way by providing instructions.

As for the template builder, we thought we could expand the use cases it could cover, but we ultimately scrapped it because it required a separate workflow, and users didn't want to spend the extra time setting them up.

1. Collect note examples during onboarding

Teach Freed Onboarding

By uploading note examples during onboarding, users will see their style reflected in their very first Freed-generated note.

1/4

2. Use Magic Edit to improve Freed-generated notes

Magic Edit

With magic edit, users tell Freed exactly how they want their note to be improved, and the instructions can be saved for future notes.

1/4

Impact

Teach Freed and Magic Edit were launched at the end of February. By April we saw a 15% drop in churn coupled with a substantial drop in complaints and requests related to personalization. Most of the drop in churn was new users fully adopting the product instead of trying and then leaving shortly after.

We also saw that users were signing off on notes 22% faster with these tools in place than before launch (4:10 down to 3:13 per note). For some customers, this saved them an additional ~15 to 20 minutes per day.

Churn
15%

Drop in churn over 2 months correlated with a drop in personalization complaints.

Time Spent Editing
22%

Users signed off on their notes by clicking Send to EHR two minutes faster with these new tools.

Brand