Practice speaking foreign languages through mimicking

Timeline
Role
Tools
Sep. 2021 - Dec. 2021 (4 months) | Class project
Research, UXUI Design, Prototyping, 3D, Branding
Figma, Cinema 4D, Protopie
Background

As online education has become popular, more and more tryouts are made to use virtual spaces such as the Metaverse and AR/VR for educational purposes. However, these attempts have mainly focused on the students' environmental factors. I thought there would be a way to use avatars as a helpful factor in education as well.

Research

For the project, I conducted a user interview for further understanding of foreign language practice to discover insight. Based on the insights I gathered, I researched ‘Shadowing’, investigating how to use this avatar system to enhance the efficiency of practicing speaking in a foreign language.

User Interview
Interviewees
People who practiced talking in a foreign language alone
Questions
1 How did you practice your speaking skills?
2 Why did you choose that method? How was it useful?
Research goal
Find out how people learn and practice speaking foreign languages.
Interview highlights
“There is a method called 'Shadowing'. You basically follow what someone says in the language you want to practice. It really helped improve my speaking skills.”
“I watched dramas related to the language I tried to learn. It was fun watching them. I learned the language quickly since it was enjoyable, and they used real phrases for speaking.”
Shadowing & LARPING

One of my key findings from the interviews was 'Shadowing,' a language learning technique where people repeat what their role-model says. Also, through research, I learned about Live Action Role-Playing education, in which students act on the role they chose. Both techniques shared a common factor for learning practices, which is acting. I thought by using the avatar, I could amplify the effect of acting to enhance student's speaking skills.

Project Goal
Help users enhance speaking skills by acting as the avatars of their choice.
Target User
10-20s, intermediates who want to improve their speaking skill
Principles
#1
Help synchronize with the character

Make sure the users do not feel awkward so that they can focus on acting

Blur the background and use facial recognition when it’s time to act
#2
Simple & Understandable

UI elements and the user flow should not disturb concentration

Provide visual cues and highlight the lines the user has to act out
Ideations & Iterations

Before designing the screens, I planned out the user flow of the service. Then I performed user testing on my target audience to see if it was easy to understand. After doing multiple user tests with the prototypes, I created the final design for this project.

User Flow
User Testing
#1 Paper prototype
#2 Mid fidelity prototype
Final Design
1. Design System
2. MVP Highlights
Main Page

View all available courses

Users can choose the language they want to practice and view courses they wish to try. The clips they choose are listed on the left side of the page.

Choose course

Select a clip and character of your choice

Users can see detailed information about the clip and select the character they want to act.

Practice

Start practicing speaking through 3 steps

After choosing a role, users can practice speaking a foreign language by following each step.

Read the script to now the overall context

Listen to the clip and follow the character

Record yourself and view the recording

Review

View results & learn how to improve your speaking skill

After submitting the final recording, users can view the overall score and see which parts they can improve.

Next

islet's: Zero-waste mobile game service