Made with a cups of coffee and loud desi music 🎵️
©2024 Portfolio by Vaishnavi Kondhalkar

About

Resume

Curiosity Corner

Project 3

SignFlow: Bridging the Gap, One Sign at a Time

Our Solution

Connecting Hands, Connecting Lives:

Seamless Sign Language Communication with SignFlow

Tools

Figma, FigJam, Google Suites

Duration

12 weeks

Introduction

My Role

UX Designer. Research, Conceptualization, Design, and Prototyping.

SignFlow is an app that provides seamless translation between various sign languages and spoken languages through real-time camera-based translation and text input. Users can select their preferred sign language, allowing for easier communication and understanding across different sign language users.

What is the Problem?

HMW improve accessibility and inclusivity for sign language users?

Language connects us, but it can also divide us. Sign language bridges gaps between spoken languages and is vital for millions worldwide. Hearing loss can lead to isolation and limited opportunities, while deaf communities often face discrimination. Our team leverages technology to tackle communication challenges for sign language users, aiming to create a more inclusive society.

How Can We Bridge Communication Gaps for

Sign Language Users Through Inclusive Technology?

The Process

Why is it crucial to address it?

Drastic Change in the behavior of Post-Pandemic Traveler

When will the goals be achieved?

We had 1 goal and 3 objective in our mind…

Evaluation and Improvement

Enhance user engagement and learning outcomes for sign language apps by adopting a gamified approach similar to Duolingo. This involves integrating flexible, interactive features to boost user interaction and improve the effectiveness of the learning process.

Goal

Communication Disabilities

Make it difficult to express thoughts, feelings, and emotions effectively.

Communication Disabilities

Make it difficult to express thoughts, feelings, and emotions effectively.

Individuals are not fully proficient in using different sign language, creating a communication gap.

Major Scenarios Assistance

Effective

Communication

Communication barriers and disabilities affect both individuals and society.

Broader

Impact

Helps in fostering a diverse and inclusive society, as it embodies a shared responsibility that benefits all.

How can the technology benefit the users?

Impact and Use Cases of the Solution

Communication Disabilities

Make it difficult to express thoughts, feelings, and emotions effectively.

Public Communication

A deaf person can use the app to interact with hearing individuals in restaurants or medical offices.

📢 🏬

Communication Disabilities

Make it difficult to express thoughts, feelings, and emotions effectively.

Parent-Teacher Communication

Parents of deaf children can use the app to engage with teachers and other parents.

👩‍🏫 🧑‍🧒

Communication Disabilities

Make it difficult to express thoughts, feelings, and emotions effectively.

Educational Participation

Deaf students can take notes and participate in class discussions using the application.

🙇🏻‍♀️🙇🏼‍♂️

Communication Disabilities

Make it difficult to express thoughts, feelings, and emotions effectively.

Workplace Interaction

Deaf employees can use the app to communicate with co-workers and during presentations.

💼🧑🏼‍💻

Communication Disabilities

Make it difficult to express thoughts, feelings, and emotions effectively.

Travel Communication

Deaf travelers can use the app to communicate in different countries.

🛩️ 🛃

Focus on both hearing-impaired and hearing individuals who need or want to learn sign language.

Human

Enhance sign language learning apps to be more gamified and user-friendly.

Activity

Use existing sign language apps as assistive tools and aim to improve their quality and effectiveness.

Assistive Technology

Leverage the widespread use of smartphones to make sign language learning more accessible to a broader audience.

Context

H

A

AT

C

Focus on improving app technology to be more user-friendly and efficient.

HandTalk

🟢

Pros

🔴

Cons

  • Real-time translation.

  • Movement recognition technology for enhanced digital accessibility.

  • Interaction and information access.

  • Primarily focus on Portuguese and Libras, limiting its utility.

  • Requires specific device capabilities.

Our Competitors

We tried to study what the current apps lacks…

The current sign language apps—HandTalk, Jeenie, and ASL Pocket Sign—each offer distinct solutions for bridging communication gaps, but they come with their own advantages and limitations.

Jeenie

  • Connects users with HIPAA-trained interpreters.

  • Serves various industries.

  • Real-time support provided.

  • Live interpreters is not always feasible or cost-effective.

  • Support not always be guaranteed depending on on time zones & availability.

🟢

Pros

🔴

Cons

ASL Pocket Sign

  • Video lessons, Dictionary, and activities to learn ASL.

  • Suitable for a wide range of users.

  • Convenient go-to learning and practicing tool.

  • Lack of real-time interaction or feedback.

  • Limited content scope as it only focuses on ASL.

🟢

Pros

🔴

Cons

System Gaps

We observed user needs that our competitors didn't meet!

Users increasingly favor apps incorporating interactive features beyond the screen to foster social and emotional engagement, supporting their integration into a globalized world. To enhance the learning experience, users also prefer apps that integrate multimedia elements and animations.

Communication Disabilities

Make it difficult to express thoughts, feelings, and emotions effectively.

Users seek apps with AR and Gamification for enhanced engagement and integration.

Interactive

Features

👾

📱

📖

👩🏻‍💻

📉

Functionality Concerns

Content Limitations

Design and Compatibility

Impact of Poor Performance

Communication Disabilities

Make it difficult to express thoughts, feelings, and emotions effectively.

Detection and Conversion: Issues with sign language data handling.

Gesture Recognition: Accuracy challenges in gesture interpretation.

User Experience: Need for intuitive interfaces and effective performance.

Communication Disabilities

Make it difficult to express thoughts, feelings, and emotions effectively.

Vocabulary and Signs: Limited content and inconsistencies across sign languages.

Communication Disabilities

Make it difficult to express thoughts, feelings, and emotions effectively.

Multimedia and Device Adaptation: Challenges with diverse media use and compatibility with various screen sizes and operating systems.

Communication Disabilities

Make it difficult to express thoughts, feelings, and emotions effectively.

User Frustration: May lead to disengagement and app abandonment.

Negative Reviews: This can deter new users and impact app success.

Development: May discourage further improvements and investment

Possible Features

Enhancing user experiences for the users

Effective sign language apps are essential for bridging communication gaps. We aim to develop a comprehensive application that seamlessly integrates multiple sign languages and advanced features to enhance accessibility and user engagement.

  • Multi-Language Support

  • Text Translation

  • Live Sign Language Translator

  • Interactive Learning Interface

🔍 Must-Haves

👍🏻 Nice to Have

✨ Surprise, Delightful

↪️ Can come later

  • Real-Time Camera-Based Translation

  • Gamification Elements

  • Community Features

  • Rich Multimedia Content

  • Plugin for Other Platforms

  • Advanced Gamification

  • Personalized Learning Goals

  • Enhanced Customization Options

  • Expanded Language Options

Information Architecture

Enhancing user experiences for the users

Effective sign language apps are essential for bridging communication gaps. We aim to develop a comprehensive application that seamlessly integrates multiple sign languages and advanced features to enhance accessibility and user engagement.

Wireframing

Early designs

Multiple iterations of the screens helped better user flow for Signflow and make navigation easier and better for the user experience.

UI Design

Early Design

Effective sign language apps are essential for bridging communication gaps. We aim to develop a comprehensive application that seamlessly integrates multiple sign languages and advanced features to enhance accessibility and user engagement.

High fidelity Prototype

Final Outcome

Effective sign language apps are essential for bridging communication gaps. We aim to develop a comprehensive application that seamlessly integrates multiple sign languages and advanced features to enhance accessibility and user engagement.

  • Mobile-Based Sign Language Translator

  • Cultural Compatibility and Icons

  • Addressing Language Barriers on Social Media

  • Holistic Approach to Navigate Limitations

  • Challenges in Mobile-Based Language Learning (MMLSL)

Pain Points

Success

🎖️

Future Changes

✍🏻

  • Accessible to a larger user audience

  • Available on different platforms

  • Better User Experience of the app

  • Encouraging users to Learn Sign Language.


  • Enhance Interpretation System

  • Expand Compatibility

  • User-Friendly Interface

  • Culturally Inclusive 

  • Improve Stability

  • User Engagement

  • Refine and Optimization

🤕

Conclusion

Intended positive impact created for the users

Effective sign language apps are essential for bridging communication gaps. We aim to develop a comprehensive application that seamlessly integrates multiple sign languages and advanced features to enhance accessibility and user engagement.

Measuring Success

📐

📝

What did I learn?

  • Multi-Language Support

  • Text Translation

  • Live Sign Language Translator

  • Interactive Learning Interface

  • Multi-Language Support

  • Text Translation

  • Live Sign Language Translator

  • Interactive Learning Interface