View all newsletters
Receive our newsletter - data, insights and analysis delivered to you
  1. News
April 25, 2019

Scientists develop device to translate thoughts into speech sounds

Neuroscientists at the University of California, San Francisco (UCSF) have developed a brain-machine interface to produce understandable synthetic speech by analysing brain signals.

Neuroscientists at the University of California, San Francisco (UCSF) have developed a brain-machine interface to produce understandable synthetic speech by analysing brain signals.

Free Report
img

Medical Device Industry Landscape In Asia-Pacific

GlobalData's APAC Medical Devices Industry Landscape – 2022 free study breaks down the APAC medical devices market by segment and region and includes insights on local and global competitors, pipeline product developments, clinical trials studies, and significant deals in the industry. The APAC medical device industry witnessed significant developments, launches, implementations, and adoption of new medical device technologies in the past decade, however the high cost of devices, regulatory hurdles, reimbursement pressure, and healthcare budget constraints have challenged market expansion across various territories and segments. APAC is the fastest growing regional market for medical device clinical trials, with China and Japan emerging as major clinical trial hotspots. The growth in medical device clinical trials in the APAC region is attributed to an increase in research partnerships between biopharma companies and clinical research organizations (CROs). This report also provides an in-depth analysis of the medical device market's opportunities and challenges, the influence of COVID-19 on the market, and government activities aimed to develop the APAC medical device market.
by GlobalData
Enter your details here to receive your free Report.

Funded by the National Institutes of Health (NIH) Brain Research through Advancing Innovative Technologies (BRAIN) Initiative, the research is believed to have the potential to help certain patients who have lost the ability to speak because of neurological damage.

The brain-machine interface is powered by a computer that is programmed using brain signals recorded from epilepsy patients who have normal speaking abilities.

Data captured from brain scans of these patients was used to facilitate synthetic speech involving entire sentences, rather than the letter-by-letter approach with existing assistive devices.

UCSF speech scientist Gopala Anumanchipalli said: “Current technology limits users to, at best, ten words per minute, while natural human speech occurs at roughly 150 words/minute.

“This discrepancy is what motivated us to test whether we could record speech directly from the human brain.”

“Current speech assistive technology limits users to, at best, ten words per minute, while natural human speech occurs at roughly 150 words/minute.”

During the study, patients who had temporary implants in their brains to map their disease activity were asked to read several sentences aloud. The team recorded their brain activity during the speech process.

The researchers then used the recordings and linguistic principles to reverse engineer the vocal tract movements that are needed to produce those sounds.

Based on the mapping of sound to anatomy, the researchers devised a virtual vocal tract, an anatomically detailed computer simulation that includes the lips, jaw, tongue and larynx. This vocal tract, which can be controlled by each volunteer’s brain activity, consists of two ‘neural network’ machine learning algorithms.

Volunteers who listened to the computer-generated sentences were able to correctly determine the sentences in majority of the cases. Moreover, the new system was able to generate understandable synthetic versions of sentences that were just mimed by the participant.

In the future, the programme is expected to restore communication to people with severe speech disability.

The researchers intend to conduct a clinical trial in paralysed, speech-impaired patients in order to find the best approach to collect their brain signal data, which can be applied to the previously trained computer algorithm.

In January 2019, scientists from the Mortimer B. Zuckerman Mind Brain Behavior Institute at Columbia University also announced a brain-computer interface that directly translates thoughts into intelligible speech.

Related Companies

Free Report
img

Medical Device Industry Landscape In Asia-Pacific

GlobalData's APAC Medical Devices Industry Landscape – 2022 free study breaks down the APAC medical devices market by segment and region and includes insights on local and global competitors, pipeline product developments, clinical trials studies, and significant deals in the industry. The APAC medical device industry witnessed significant developments, launches, implementations, and adoption of new medical device technologies in the past decade, however the high cost of devices, regulatory hurdles, reimbursement pressure, and healthcare budget constraints have challenged market expansion across various territories and segments. APAC is the fastest growing regional market for medical device clinical trials, with China and Japan emerging as major clinical trial hotspots. The growth in medical device clinical trials in the APAC region is attributed to an increase in research partnerships between biopharma companies and clinical research organizations (CROs). This report also provides an in-depth analysis of the medical device market's opportunities and challenges, the influence of COVID-19 on the market, and government activities aimed to develop the APAC medical device market.
by GlobalData
Enter your details here to receive your free Report.

NEWSLETTER Sign up Tick the boxes of the newsletters you would like to receive. The top stories of the day delivered to you every weekday. A weekly roundup of the latest news and analysis, sent every Friday. The medical device industry's most comprehensive news and information delivered every month.
I consent to GlobalData UK Limited collecting my details provided via this form in accordance with the Privacy Policy
SUBSCRIBED

THANK YOU

Thank you for subscribing to Medical Device Network