Carolyn Dew Carolyn Dew

UX design and research in the civic space

Caseflow build hearing schedule discovery

Brief

I worked as a senior designer and researcher on Caseflow Hearings (a sub-product of Caseflow) in an individual contributor role. Caseflow Hearings supports the scheduling and preparation for hearings on veterans appeals. I was on a team with three other designers (the Hearings design lead, one early-career, and one mid-career designer) embedded within a cross-functional agile team.

The process for building the hearing schedule for the months ahead (that is, determining which days the Board would hold hearings and when Veterans Law Judges (VLJs) and hearing coordinators would be available) was a huge point of frustration for Hearings leadership. The original functionality had been built in a period of a few weeks in 2019 to accommodate a last minute change in how the Board manages hearings, and improvements had not been prioritized until spring of 2021.

We knew that this process was a huge pain point for hearing branch leadership but didn’t fully understand the shape of the problem or the best opportunities to make improvements. Additionally, our product manager suspected that even though this work was prioritized now, that could change before we had a chance to implement a wholesale redesign of the process. He was specifically interested in finding small, incremental improvements that the team could implement in smaller chunks, and which would be easier to get approval to work on.

Our team of four designers conducted a targeted discovery research study to better understand this problem and where our potential intervention points would be. I served as design’s ‘feature owner’ for this study – the primary design point of contact for the team in shaping the work and driving it forward. I was working with two other designers, both of whom had limited experience conducting discovery research and ensuring those findings were relevant to upcoming product decisions.

We had about eight weeks to understand the current problem space and communicate our learnings out to the broader team and VA stakeholders. But because our product manager needed to begin mapping out the next quarter’s roadmap before the end of our study, we knew we needed to have a near complete understanding within six weeks. To that end, I requested the product manager and lead engineer attend as many user sessions as possible so they would develop an understanding of the problem in real time.

I also recommended we forgo writing a traditional research report in favor of capturing our insights into a service blueprint. This way we could co-create the blueprint during our user interviews to quickly build our understanding and keep the conversations productive, and we would end with a durable artifact that could be picked up by a future team quickly should development work be postponed.

As we went, we learned that a traditional service blueprint did not fit our communication needs – the frontstage and backstage delineations did not make sense for a wholly internal process. We pivoted the format a journey map that better represented our insights.

A user journey map showing all the steps required to build the hearing schedule, highlighting pain points, people involved, tools used, and additional notes.
Main research deliverable: user journey map
See full size journey map (PNG)

What I did

  • Shaped the research plan and course of the research study – including multiple co-creation sessions with our core users and several interviews with VLJs, who were impacted by the build hearing schedule process.
  • Provided guidance to the team for what kinds of insights to focus on during user interviews and co-creation sessions.
  • Introduced ‘Synthesis Fridays’ – where the research team would get together to reflect on that week’s learnings and determine if we needed to pivot in the following week.
  • Provided guidance to designers on the team to analyze interview transcripts for key insights and synthesize those into the user journey.
  • Supported our junior designer in introducing an ‘equity pause’ to reflect on our own biases and ensure we treated our research participants equitably.
Output from an equity pause workshop where research participant groups are identified and placed on a heirarchy of power, with notes on how we can make their participation more equitable
Output from an equity pause workshop
  • Facilitated a workshop to guide the team in prioritizing which pain points would be the most important to solve first.
A foursquare used as part of a workshop to prioritize pain points in the build hearing schedule against impact on hearings held as scheduled (on the y-axis) and organizational risk (on the x-axis). Participants in the workshop indicated where they thought a card should go with an animal icon and then placement was discussed until the team came to a consensus.
Output from a prioritization workshop (detail)

Key Techniques and deliverables

  • discovery research
  • collaborative design
  • user interviews
  • journey maps
  • prioritization
  • workshop facilitation

Results

As predicted, the Board shifted its priorities before the next quarter arrived and improvements to this process were pushed further out into the future. I followed up with our product manager, who expressed appreciation for our research and deliverable, and stated that through our research he gained several ideas for how to break out smaller chunks of work that could be more easily slotted into the road map.