TY - JOUR
T1 - Evaluating the accuracy of speech to text applications for cochlear implant candidates during COVID-19
AU - Roychowdhury, Prithwijit
AU - Castillo-Bustamante, Melissa
AU - Gandhi, Dhrumi
AU - Knoll, Renata M.
AU - Wu, Matthew J.
AU - Kozin, Elliott D.
AU - Remenschneider, Aaron K.
N1 - Publisher Copyright:
© 2022 Informa UK Limited, trading as Taylor & Francis Group.
PY - 2023
Y1 - 2023
N2 - Objectives: Universal mask wearing due to COVID-19 has introduced barriers to clear communication. In hearing impaired individuals this can impact informed surgical consent. For cochlear implant candidates, who do not rely on sign language, real-time transcription with a stenographer (CART) is the gold-standard in assistive technologies. If CART is not available, speech to text (STT) applications have been advertised as solutions, but their transcription accuracy with or without an N95 mask is not well-established. Herein, we sought to investigate the transcription accuracy of three STT solutions for iPhone and compare their performance to the CART service at our institution. Methods: Three native English speakers and three non-native English speakers read two passages (a cochlear implant consent and the non-medical ‘Rainbow passage’) with and without an N95 mask. Error rates from the comparison of the transcript (from either the STT app or CART) with the original passage were calculated. Results: The CART service had the lowest error rate of all testing conditions (4.79–7.14%). Ava 24/7 (15.0 ± 9.49%) and the iPhone dictation (15.6 ± 6.65%) had significantly lower average error rates than the Live Transcribe (37.7 ± 20.3%) (P < 0.0001) application. Neither the presence of an N95 nor the type of passage had a statistically significant impact on the error rate. Conclusion: CART should be used to augment communication with patients who are hard of hearing. If CART is not available, a STT application such as Ava 24/7 or the native iPhone dictation application may be considered, even in the context of medical terminology.
AB - Objectives: Universal mask wearing due to COVID-19 has introduced barriers to clear communication. In hearing impaired individuals this can impact informed surgical consent. For cochlear implant candidates, who do not rely on sign language, real-time transcription with a stenographer (CART) is the gold-standard in assistive technologies. If CART is not available, speech to text (STT) applications have been advertised as solutions, but their transcription accuracy with or without an N95 mask is not well-established. Herein, we sought to investigate the transcription accuracy of three STT solutions for iPhone and compare their performance to the CART service at our institution. Methods: Three native English speakers and three non-native English speakers read two passages (a cochlear implant consent and the non-medical ‘Rainbow passage’) with and without an N95 mask. Error rates from the comparison of the transcript (from either the STT app or CART) with the original passage were calculated. Results: The CART service had the lowest error rate of all testing conditions (4.79–7.14%). Ava 24/7 (15.0 ± 9.49%) and the iPhone dictation (15.6 ± 6.65%) had significantly lower average error rates than the Live Transcribe (37.7 ± 20.3%) (P < 0.0001) application. Neither the presence of an N95 nor the type of passage had a statistically significant impact on the error rate. Conclusion: CART should be used to augment communication with patients who are hard of hearing. If CART is not available, a STT application such as Ava 24/7 or the native iPhone dictation application may be considered, even in the context of medical terminology.
KW - Accessibility
KW - Assistive devices
KW - Cochlear implant
KW - Communication access realtime translation
KW - COVID-19
KW - Hearing loss
KW - Mobile applications
KW - Speech to text applications
UR - http://www.scopus.com/inward/record.url?scp=85139097550&partnerID=8YFLogxK
U2 - 10.1080/14670100.2022.2120450
DO - 10.1080/14670100.2022.2120450
M3 - Artículo en revista científica indexada
C2 - 36148962
AN - SCOPUS:85139097550
SN - 1467-0100
VL - 24
SP - 1
EP - 5
JO - Cochlear Implants International
JF - Cochlear Implants International
IS - 1
ER -