← back

overview

I worked alongside a small team of designers at Moment from user research to product design. We designed for Voice UI’s and how they might be used to empower immigrant families and parents to raise their children to be multilingual in a culturally immersive home.

How might Voice UI's be used as tools for learning and celebrating the values of our diverse cultures?

Loree is an Artificially Intelligent companion that incorporates language through conversation and storytelling to introduce cultural concepts to children in immigrant families. As children grow older and their speech patterns become more complex, Loree helps expand their understanding of abstract concepts and ensures that parents are taking an active role in this learning process.

intro

Voice activated assistants are some of the hottest products in the smart-home market and yet, despite significant innovation in hardware, and the many talented developers that work on making them as 'smart' as they are, voice assistants are still remarkably irrelevant.

Even now, most voice assistants follow a command/response paradigm that is only working to streamline screen-based navigation. Our team wanted to go beyond that paradigm and design a voice UI that looked at voice in a new way and took its strengths into account by highlighting conversation as a unique and humanized interaction.

user research

A solution can only be as good as the understanding of the problem.

In order to better define and come to understand our problem space, we interviewed a group of parents who would help us empathize with the many challenges that they face in parenting.

Obstacles

Initially, we had written an interview protocol that was more suited for evaluating pain points in a user flow for step-by-step interactions.

In our interview dry-runs, parents had trouble recalling past experiences when asked up-front, but would bring them up while talking about a related topic. We needed a better way to get parents to recall their experiences without making them feel too pressured.

Solution

From books and online resources, we learned about different parenting milestones and common challenges and we used them to overhaul our entire interview protocol to shift the focus on letting parents tell stories of how they faced those different milestones and challenges.

We created a game-like activity called “conjure cards” using cards depicting a specific milestone that parents would flip from face down in pairs upon which they would choose one to speak on. The reactive and evenly paced nature of this activity did a lot to help “conjure” the parents’ memories where, before, they had trouble.

Why?

While understanding the stresses of parenting are important, we needed to go in deeper:

The stories that parents told us about their experiences did much more to flesh out the information that we were looking for while also allowing us to make the parents comfortable to speak.

As we focused on conversation based on these stories, we came to empathize with parenting on an emotional and mental level and we used that understanding to see how each parent differed from the other.

synthesis

At this point in our process, several events reflected the beliefs of movement towards the suppression of cultural diversity in the United States. We were deeply troubled by what we were seeing in the news and asked ourselves, “How might we use design to stand up for our values in the celebration of culture in the United States?”. This led to a shift in the project’s focus towards helping immigrant families raise their children to be bilingual and stay connected to their native culture.

Obstacles

The challenges of parents raising bilingual children in America presented a more compelling and impactful project space although it was a departure from the original prompt of helping parents track their child’s cognitive development.

We also needed to gather more evidence to justify a shift into this new direction.

Solution

In order to stay on schedule, we quickly re-interviewed parents who previously expressed insecurities on raising a bilingual child to explore the problem further.

To expand our findings, we also found more parents to interview who could offer valuable insight into the subject.

Using those insights, we developed a unique set of personas depicting parents who faced different kinds of obstacles as immigrants in the United States.

We also created a competitive analysis graph of products, services, and experiences that showed a clear gap in offerings for accessible and immersive language and cultural learning.

Why?

From the beginning, we were told by John Devanney to ask ourselves, “Why the f— does it matter?”. With the celebration and protection of cultural diversity in the United States in mind, we believed our new prompt would come to answer that question.

We made sure to refine our personas and competitive analysis as they would be a great aid for us in understanding our problem space and the people we were designing for and in communicating our value proposition to stakeholders in our project.

diverge

With the problem space now defined and a better picture of who we were designing for, we needed to broaden the generation of solutions to iterate on and to uncover new potential ideas to evaluate. We did this through several cycles of divergent ideation and sketching. We recruited Moment designers at different stages of this process so that they could evaluate our concepts and contribute to iteration.

Obstacles

In this phase of our project, we were pressed on time as we had chosen to take a step back and restrategize in the research phase and our synthesis had taken longer than we thought it would.

In this short amount of time, we needed to generate as many fresh and different ideas as not to limit our thinking to what we already knew.

Solution

We recruited a group of Moment designers and managing directors to participate in a design sprint workshop to sketch out concepts and ideas with us.

Using our personas and competitive analyses, we got designers to empathize with struggles faced by immigrant families and then created a deck of situational problems to inspire the designers to sketch out-of-the-box solutions that would help the families overcome them.

After executing the workshop, we voted on the concepts that were the most compelling in the concept of transferring culture.

Why?

Moment gave us the valuable resource of a concentrated group of smart designers and it would have been a waste for us not to integrate their thoughts and insights in the phase that really needed a large quantity of ideas to refine and iterate on.

While the design sprint with the Moment designers did bring in many great ideas, it was an ideal opportunity for us to test the viability of our problem space and to get buy-in and support from teams and leaders outside of our project.

converge

We used this opportunity to refine our value proposition to help us reorient and organize the parent and child needs that we had to address. This helped us in clustering sketches and producing storyboards for how our solutions could be impactful. At the last leg of this stage, we were left with three different solutions: a language tracking device, a narrative RPG with tiered difficulty, and a conversational storytelling AI. Our decision to move forward with storytelling would then lead us into creating Loree.

Why conversation and storytelling?

By having a conversation with a voice UI and then reading a culturally oriented story, the use of language and culture is reinforced in the home through active use and introduced through story.

Storytelling closely addressed many of our early insights in that it was an activity that parents universally regarded as a valuable part of their day that they shared with their child.

Stories reinforce and introduce new and sometimes abstract concepts to children through active use of language and interaction with their parents.

Throughout history, stories were used to pass down culture and identity to future generations. It was a perfect fit.

Obstacles

Choosing between different iterations and features was difficult and initially made us combine features which led to “frankenstein” concepts.

While we had a diverse set of sketches and concepts, we were mostly biased towards our own as we had invested the most amount of time into them.

As we refined and iterated on the designs, we needed to make sure that we weren’t straying from parent needs.

Solution

To keep from frankenstein-ing different features, we agreed to focus on very different concepts which is how we came to our final three storyboards.

In order to balance out our investment into the different concepts, we rotated on sketching and iteration so as not to have us personally invested in any single concept.

At different points, we called in other designers at Moment who could better evaluate and critique the weaknesses in concepts and storyboards.

By having constant touch-points with parents, we were not only able to make sure that we were aligned with their needs, but we were also able to prototype our solution with them.

design

How do you design for an invisible interaction/interface?

While popular voice assistants like the Amazon Echo or Google Home are devoid of visual interfaces aside from small visual cues like lights, we found that screens made the sometimes clunky navigation more accessible and would be especially useful in the designing for storytelling.

How do you bring a concept project to life?

In order to give life to Loree, we focused on creating a video with a strong use-case narrative and animations and illustrations that would clearly show how and why Loree should be used. We also developed a website that better presented our value proposition.

Why make Loree a character and how should it look?

We chose to make Loree a moving and living character as to give visual context for what is being heard rather than an abstract voice from an inanimate object. Loree was given a minimal stylization as the emphasis so as to be applicable to many kinds of stories and situations. The emphasis was to show that Loree is a blank slate that adapts to its further use.