AMPLIFYING ASSOCIATE VOICES

Leveraging AI to improve Walmart managers'
associate feedback response speed by 48x

BACKGROUND

In order for Walmart to be the best place to shop, it has to be the best place to work.

Every year, Walmart store associates participate in a survey to share their engagement, intent to stay, and sense of belonging. There was an opportunity to improve the way managers respond to these valuable insights within the Me@Walmart mobile app.

ROLE

Senior Product Designer

TEAM

Associate Experiences > People > Associate Listening

Associate Experiences > People > Associate Listening

RESPONSIBILITIES

Research, discovery, strategy, ideation, execution, testing, iteration

Research, discovery, strategy, ideation, execution, testing, iteration

Research, discovery, strategy, ideation, execution, testing, iteration

COLLABORATORS

Principal Product Designer, Product Manager, Engineering, Business partners

Principal Product Designer, Product Manager, Engineering, Business partners

Principal Product Designer, Product Manager, Engineering, Business partners

BUSINESS NEED

Leadership plans to begin holding store managers accountable for survey response effectiveness.

GOAL

Empower managers with tooling in the Me@Walmart to effectively respond to associate feedback.

CHALLENGE

How can we empower Walmart managers to review and
respond to annual engagement surveys effectively?

How can we empower Walmart managers to review and respond to annual engagement surveys effectively?

RESEARCH

I learned the process managers use today is disjointed and time-consuming, resulting in low-impact manager response and skepticism among store associates.

Collaborating with Walmart’s research team we developed a comprehensive research plan defining research goals and objectives. Once aligned on a discussion guide we conducted conversations with my users.

Our users

STORE MANAGERS

Salaried leaders responsible for store management and performance.

STORE ASSOCIATES

Hourly employees responsible for a store’s daily tasks and operation.

Research goals

How do managers review survey results today?

How do managers take action in response to survey results today?

How do store associates perceive the value of engagement surveys?

Key takeaways

MANAGERS ARE TIME-POOR

Managers simply don’t have the time required to use the current toolset provided to respond to survey feedback effectively.

ASSOCIATES DON’T FEEL HEARD

Store associates don’t feel like their voice can lead to change in their own stores, largely due to lack of manager response.

PROBLEM TO SOLVE

Managers struggle to respond to associate feedback due to time constraints and manual process, which leads to low engagement scores and a belief among associates that their feedback is ignored.

How can we empower managers to review and respond to associate feedback effectively so that associates feel like their voice matters?

STRATEGY

I understood my solution needed to be lightweight & streamlined so busy managers could review survey results and create action plans on-the-go.

Guiding principles

From user insights I understood these principles must be true in order for my solution to be successful.

INSIGHTS OVER DATA

INSIGHTS OVER DATA

Walmart managers are not data scientist or analysts

RESPECT EXPERTISE

RESPECT EXPERTISE

Managers know their store and employees best

SUBTRACT DON'T ADD

SUBTRACT DON'T ADD

Avoid adding non-critical responsibilities

COMPLIMENT IRL

COMPLIMENT IRL

Don’t aim to replace in-person collaboration

PRIORITIZE SPEED

PRIORITIZE SPEED

Managers are commonly racing against the clock

MAINTAIN FLEXIBILITY

MAINTAIN FLEXIBILITY

Different managers have different work styles

A feedback flywheel

Speaking with managers and associates I discovered the feedback ecosystem is powered by a flywheel dynamic.

STORE ASSOCIATES

The more associates share their feedback, the more opportunities managers have to learn and respond effectively.

STORE MANAGERS

As managers address feedback quickly and in meaningful ways, it inspires more associates to share their insights.

A feedback flywheel

Speaking with managers and associates I discovered the feedback ecosystem is powered by a flywheel dynamic.

STORE ASSOCIATES

The more associates share their feedback, the more opportunities managers have to learn and respond effectively.

STORE MANAGERS

As managers address feedback quickly and in meaningful ways, it inspires more associates to share their insights.

A feedback flywheel

Speaking with managers and associates I discovered the feedback ecosystem is powered by a flywheel dynamic.

STORE ASSOCIATES

The more associates share their feedback, the more opportunities managers have to learn and respond effectively.

STORE MANAGERS

As managers address feedback quickly and in meaningful ways, it inspires more associates to share their insights.

Manager journey

To simplify complexity I outlined the manager journey into four distinct phases.

LEARN FROM INSIGHTS

Gain insight and reflect on survey results.

RECEIVE RECOMMENDATIONS

Consider proposed recommended actions.

CREATE PLAN

Add recommended or create custom actions.

TAKE ACTION

Execute on action plans to deliver response.

Manager journey

To simplify complexity I outlined the manager journey into four distinct phases.

LEARN FROM INSIGHTS

Gain insight and reflect on survey results.

RECEIVE RECOMMENDATIONS

Consider proposed recommended actions.

CREATE PLAN

Add recommended or create custom actions.

TAKE ACTION

Execute on action plans to deliver response.

QUICK-WINS

First, I identified small enhancements within the existing associate-facing survey experience to take advantage of available engineering bandwidth.

Developing a comprehensive solution was going to take some time. To assure our team remained productive during design phases there was an opportunity to quickly enhance the existing associate survey experience.

PROBLEM THIS SOLVED

The previous survey failed usability and accessibility standards. Busy associates were also unable ability to pause and resume survey progress.

WHY IT MATTERS

While I was primarily focused on improving the manager's experience, the associate survey experience is critical to powering the flywheel.

ABILITY TO PAUSE

Save survey progress to continue at later time

Save survey progress to continue at later time

IMPOROVED CONTRAST

Previous design failed A11Y contrast standards

Previous design failed A11Y contrast standards

PROGRESS INDICATION

Displaying progress made and how much survey remains

SELECTED STATES

Selected states with multiple signifiers beyond just color

PROPER TAP TARGETS

All tap targets 44px or more to meet A11Y standards

DESIGNED FOR SCALE

I assured my proposed updates would accommodate all future survey formats.

Assuring all proposed design system updates scale to any future survey formats.

INNOVATION

Next, I identified two opportunities to reduce cognitive load and streamline manager response by utilizing AI.

I collaborated closely with Walmart's AI team to explore innovation in two areas:

INSIGHTS FROM RAW DATA

Managers aren’t data analysts. With generative AI we can quickly share meaningful insights from complex data.

RECOMMEND ACTIONS

Starting an action plan from scratch can be overwhelming. A recommendation engine can springboard managers into feedback response.

Managers are presented meaningful insight into their store's engagement health, and most importantly — what to do about it.

PROBLEM SOLVED

Managers on-the-go often don’t have time to stop and review in-depth results. They typically prioritize more immediate issues like assuring all shifts are supported.

Managers on-the-go often don’t have time to stop and review in-depth results. They typically prioritize more immediate issues like assuring all shifts are supported.

HOW

Instantly suggesting actions "above-the-fold" helps managers dive into feedback response right away, letting them save a more detailed review for their downtime.

Instantly suggesting actions "above-the-fold" helps managers dive into feedback response right away, letting them save a more detailed review for their downtime.

WHY

Guided by my design principle "prioritize speed," busy managers value a "tell me what to do next" experience.

Guided by my design principle "prioritize speed," busy managers value a "tell me what to do next" experience.

DATA DRIVEN INSIGHT

Summarizing complex data into succinct and meaningful insights helps managers identify trends and themes from their results quickly.

Summarizing complex data into succinct and meaningful insights helps managers identify trends and themes from their results quickly.

RECOMMENDED ACTION

Managers respond to focus areas with actions driven by a recommendation engine trained by explicit and implicit signals.

Managers respond to focus areas with actions driven by a recommendation engine trained by explicit and implicit signals.

INSIGHT SUMMARIZED BY AI

Pairing result overview with ai-driven summary quickly makes sense of overall health.

Pairing result overview with ai-driven summary quickly makes sense of overall health.

REASONS TO CELEBRATE

"What did I do well?" is often a top-of-mind question when managers first review results.

"What did I do well?" is often a top-of-mind question when managers first review results.

All managers have visibility into a singular store-wide action plan.

PROBLEM SOLVED

Communicating plans across multiple teams and shifts is one of the most time-consuming aspects of the entire survey response process.

Communicating plans across multiple teams and shifts is one of the most time-consuming aspects of the entire survey response process.

HOW

A central shared location where all store leaders can view and collaborate on action plans.

A central shared location where all store leaders can view and collaborate on action plans.

WHY

Adhering to design principal "subtract don't add", this removes footwork from the current process.

Adhering to design principal "subtract don't add", this removes footwork from the current process.

Each action is fully customizable and flexible to accommodate diverse management styles.

PROBLEM SOLVED

In research sessions, it was clear each manager had their own unique way of responding to associate feedback.

In research sessions, it was clear each manager had their own unique way of responding to associate feedback.

HOW

Even pre-written recommended actions can be fully rewritten so managers can add helpful details and context.

Even pre-written recommended actions can be fully rewritten so managers can add helpful details and context.

WHY

Honoring design principal “maintain flexibility”, our solution needs to accommodate diverse use cases.

Honoring design principal “maintain flexibility”, our solution needs to accommodate diverse use cases.

ACTIVITY

Managers shared they would appreciate being able to see who assigned an action to them.

Managers shared they would appreciate being able to see who assigned an action to them.

COMMENTS

Action comments enable managers to add helpful context and facilitate collaboration.

Action comments enable managers to add helpful context and facilitate collaboration.

IMPACT

A cumbersome process that once took managers days to complete was transformed into an intuitive workflow requiring only a few hours.

BEFORE

Busy managers were forced to review complex results and manually create action plans.

AFTER

Managers are empowered to quickly learn from insights and create action plans on-the-move.

Usability testing highlights

5 out of 5 managers enthusiastically preferred this new feedback experience.

"Finally I can make sense out of those overwhelming result printouts!"

"I'm so excited to use this to make my store better for my associates!"

Results

UP TO

48x

faster task completion time

APPROX.

1.6m hrs

hours of labor saved annually

APPROX.

$84.6m

costs saved annually