Walmart Associate XR App

💡 About

When I first joined Walmart as a Senior Software Engineer, I joined the team working on a product called “Associate Use Case” (AUC).

This is a tool we developed and tested in-store that helped associates fulfill pick-up orders. We built custom software that allowed us to author a digital twin of the entire store. This enabled us to perform navigation to help the associate find products in the store as if they had a GPS guiding them. We also used custom product recognition software to ensure that the product the associate was picking off the shelf was correct.

This tool helped improve efficiency by 20% but due to hardware costs and limitations at the time, it was not feasible for a large scale roll out.

This is our first rough prototype where we demonstrated the ability to navigate a user through the store over several aisle distances. Note that AR tracking in recordings is not as smooth as what the headset wearer sees.

Here we demonstrate our custom 3D UI library that allows the user to look up an order using hand tracking. We also demonstrate our ability to recognize products on the shelf.