Digital avatar, verbal and non-verbal solutions enable users to regain freedom of expression
NTT Corporation (NTT), WITH ALS and Dentsu Lab Tokyo (DLT) demonstrated technologies from Project Humanity, an NTT-led initiative designed to enhance the quality of life for those living with disease and disability through the development of advanced communications technologies.
Read More: CIO Influence Interview with Joe Ramieri, VP of North America at Instabase
@NTTPR, @d_labtokyo and WITH ALS is enabling those affected by disease or disability to regain their freedom with speech synthesis and metaverse tech. Learn more, including DJ @Masatane_Muto’s live performance using this tech @ArsElectronica. #TechforGood
The demonstration occurred at the 2023 Ars Electronica Festival, an event celebrating art, advanced technology and culture held in Linz, It featured a live, virtual performance by WITH ALS founder and DJ Masatane Muto, who lives with ALS (amyotrophic lateral sclerosis).
Digital Avatars in the Metaverse
NTT enables individuals to operate avatars in a digital space by equipping their bodies with myoelectric sensors that track muscular activity, which is then converted into operational information and reflected in the free operation of the avatar.
In laboratory tests, NTT installed myoelectric sensors on the body (in two places on each of the neck, arms and legs) and confirmed the reception of data on body parts responsive to the will of the individual. Additionally, when viewed in real space, movements from subjects living with ALS were detected in distinct waveforms when viewed as myoelectric data.
NTT converts the sensed data into information for avatar operation and uses that information to implement the free operation of the avatars generated in the metaverse.
Read More: CIO Influence Interview with Jim Alkove, CEO and Co-Founder at Oleria
Voice Technologies
NTT is developing the capability to reproduce an individual’s voice from recorded audio by using speech synthesis technology. This technology enables communication in multiple languages while maintaining an individual’s unique voice.
Additionally, NTT is developing a non-verbal communications solution based on proprietary biometric transcription technology that enables speech through small movements.
Future Initiatives
In 2024, NTT aims to further develop its communications technologies to enable those living with ALS to interact without limitations more freely both in the metaverse as well as the real world, through robots. NTT ultimately aims to realize a future in which all people can interact with each other regardless of barriers caused by disease or disability.
NTT contributes to a sustainable society through the power of innovation. We are a leading global technology company providing services to consumers and business as a mobile operator, infrastructure, networks, applications, and consulting provider. Our offerings include digital business consulting, managed application services, workplace and cloud solutions, data center and edge computing, all supported by our deep global industry expertise. We are over $95B in revenue and 330,000 employees, with $3.6B in annual R&D investments. Our operations span across 80+ countries and regions,
Read More: CIO Influence Interview with Conor Egan, VP of Product and Engineering at Contentstack
[To participate in our interview series, please write to us at sghosh@martechseries.com]