Project Description

In the NYC Media Lab & Verizon 5G Retail Prototyping Challenge, I was paired with echoAR, a NYC-based startup that uses a cloud platform for augmented reality (AR) /virtual reality (VR) /3D application development, to identify and scale a solution for retailers and small businesses utilizing Verizon’s 5G network. Over the course of seven weeks, we met with experts in 5G technologies and development, and a local retailer to build, test, and refine our prototype. This collaboration resulted in the development of RESONATE, an augmented reality product discovery prototype for use in retail environments. The low latency and higher bandwidth of 5G means the elimination of the response time of AR products no matter how many people are accessing the product. On a 5G network, the AR technology, which our product is founded on, can be seamlessly and efficiently deployed to improve product discovery.

What is RESONATE?

During the prototyping sprint, our team met with WC Art & Drafting Supply, a small local business in Brooklyn, NY, and learned that a challenge universal to all retailers regardless of size, is providing a product discovery experience that increases market basket size without the need for consumer analytics. With the use of a 5G enhanced application, like augmented reality, we realized that retailers could use technology to turn this situation into a market opportunity by generating a personalized and informative consumer experience, where products resonate their interconnectivity.

RESONATE is an app-less in store augmented reality experience for product discovery, which enables retailers to recommend related products to consumers for purchase. For consumers, RESONATE is easier than taking a selfie! All they need to do is scan a QR code, and they will instantly see related products and where to find them in the store. The beauty of RESONATE is that its use does not require the development of an expensive application, just a print out of a QR code. Making it possible for all retailers to capitalize on AR without any technical work.

My Role

As an active graduate research fellow, I collaborated on the development of RESONATE. I provided research on our targeted retailers and a competitive analysis of AR applications currently in use in the retail environment. Additionally, I contributed to data visualization iterations of the user interface.

Insights

Through this project, I developed an understanding of the power of data analysis and visualization beyond factual information exchange. As RESONATE is a product discovery channel for cross-selling product without knowledge of a consumer market, it affords retailers the ability to acquire data analytics on store locations, consumers, and products in real time. This then can enable retailers to upsell and make product recommendations specific to the shoppers’ needs and their geography. In the wake of the COVID-19 pandemic, this ability can also enable faster delivery of supplies and merchandise to areas of greatest need.

Though retail environments are not my specialty, this project also provided access to the latest tools, products, and technologies being developed for 5G and their potential for developing experiences that restructure the relationship between humans and machines. I believe what is essential for further development in this area is crafting key experiences that refine human to human interaction. Wearables and Internet of Things devices provide a landscape for this type of exchange. For example, if one is equipped with a wearable device capable of monitoring condition-related biometrics, in the event of a health emergency, 5G network access has the potential to instantaneously activate an augmented reality (AR) or mixed reality (MR) emergency help system. In this type of help system, one can be connected to a human triage assistant who, by being able to see limited health data history and current circumstances, may provide a deeper sense of comfort and possibly assistance until physical help can arrive.

While the development of this type of technological interface continues, its potential relies on the directed management of consumer data, a humanistic understanding of behavior, and the advantages of low latency and massive connectivity of 5G networks. And, in building with 5G, these technologies may lead the way in developing a seamless and mindful understanding (and resolution between) one’s physical and virtual self. As some philosophies affirm, it is this type of understanding of oneself, which enables a beneficial contribution to society at large. Therefore, I believe the refinement of data generated from the use of 5G networks has the potential to lead the way into a sustainable future.