InnerVoice Unreal
Unreal Engine Developer
Developed an Android-based assistive communication application that helps children with speech and reading disabilities through customizable avatars, AI-assisted speech generation, and interactive learning activities.
Technologies
Unreal Engine • Blueprint • Android • Amazon Polly • UI/UX
InnerVoice was developed to help children with speech and reading disabilities communicate and learn using customizable avatars, personalized content, and interactive educational activities. The application gives caregivers the ability to tailor lessons around each user's individual needs while providing engaging visual and audio feedback.
Challenge
Developing a flexible communication platform required balancing ease of use with highly customizable functionality for caregivers and educators. Technical challenges included implementing accurate phonetic pronunciation using Amazon Polly, importing media directly from Android devices, and extending an existing codebase after joining the project midway through development.
My Contributions
Developed customizable button, pocket, and challenge creation systems.
Implemented Android media import workflows for user-created content.
Integrated Amazon Polly for AI-generated speech and phonetic pronunciation.
Designed and implemented phonetic pronunciation logic.
Developed drag-and-drop interfaces for content organization.
Built achievement tracking and challenge systems.
Extended and maintained an existing Unreal Engine codebase after joining the project mid-development.
Engineering Challenges
Joining the project midway through development required quickly understanding the existing architecture before implementing major new features without disrupting the application. Working within Android's media access restrictions while maintaining an intuitive user experience also presented significant technical challenges.
Core Systems
Drag-and-Drop Organization
Developed an intuitive drag-and-drop organization system that allows caregivers to rearrange buttons and folders, including nested pocket structures for personalized content organization.
Initial Items
Start off by showing items that the user will be matching to
Add Answers
Drag and drop the correct answers, and other answers that will show up for the challenge
Complete Challenge
The user can then click on the challenge icon and attempt to complete it
Track achievements
Keep track of all completed challenge, export as an image to share with others
Challenge Creation
Developed a customizable challenge system that allows caregivers to create interactive vocabulary and reading exercises using personalized educational content.
Custom Content Authoring
Developed a flexible content authoring system allowing caregivers to create custom buttons, folders, and educational challenges using imported photos, videos, and AI-generated speech.
Phonetic Pronunciation
Integrated Amazon Polly phoneme support to generate speech and synchronized mouth shapes that closely matched natural pronunciation, improving speech learning accuracy for children.
Results
Delivered a production-ready assistive communication platform tailored to client requirements.
Enabled caregivers to build personalized learning experiences through custom educational content.
Expanded the application with advanced authoring tools, challenge systems, and AI-assisted speech.
Improved the flexibility and accessibility of the platform through customizable workflows and phonetic speech generation..