Proceedings of the 7th International Conference on Applied Engineering (ICAE 2024)

<Previous Article In Volume
Next Article In Volume>

Implementation and Performance Analysis of a Speech-Based Question Answering System on The Humanoid Robot Barelang 7

Authors
Donny Prasetya Hutagalung1, Alvareza Armadhika1, Wilbert Yo1, Shabrina Rachmawati Azzahra1, Yenni Lailatul Rezki1, Eko Rudiawan Jamzuri1, *
1Department of Electrical Engineering, Politeknik Negeri Batam, Batam, Indonesia
*Corresponding author. Email: ekorudiawan@polibatam.ac.id
Corresponding Author
Eko Rudiawan Jamzuri
Available Online 25 December 2024.
DOI
10.2991/978-94-6463-620-8_14How to use a DOI?
Keywords
Automatic Speech Recognition; Question Answering System; Text to Speech; Human-Robot Interaction; Humanoid Robot
Abstract

This paper describes developing and evaluating a speechbased question-answering (QA) system on the Barelang 7 humanoid robot. The human voice is recorded by the system using a microphone and subsequently transformed into text using VOSK’s automatic speech recognition (ASR). The RoBERTa question-answering model analyses the transcribed text to formulate suitable replies, which are then transformed into speech using a text-to-speech (TTS) engine. The robot then delivers the response through a speaker affixed to its body. The system was tested with five non-native speakers across 125 trials, resulting in a word error rate (WER) of 0.187 for the ASR component and attained a mean response time of 464.04 milliseconds of QA system. The results validate practical realization of the speech-based question-answering system on the humanoid robot, showcasing its potential for utilization in autonomous service systems. Furthermore, the study highlights significant obstacles associated with ASR accuracy, which might guide future enhancements and broader applications.

Copyright
© 2024 The Author(s)
Open Access
Open Access This chapter is licensed under the terms of the Creative Commons Attribution-NonCommercial 4.0 International License (http://creativecommons.org/licenses/by-nc/4.0/), which permits any noncommercial use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license and indicate if changes were made.

Download article (PDF)

<Previous Article In Volume
Next Article In Volume>
Volume Title
Proceedings of the 7th International Conference on Applied Engineering (ICAE 2024)
Series
Advances in Engineering Research
Publication Date
25 December 2024
ISBN
978-94-6463-620-8
ISSN
2352-5401
DOI
10.2991/978-94-6463-620-8_14How to use a DOI?
Copyright
© 2024 The Author(s)
Open Access
Open Access This chapter is licensed under the terms of the Creative Commons Attribution-NonCommercial 4.0 International License (http://creativecommons.org/licenses/by-nc/4.0/), which permits any noncommercial use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license and indicate if changes were made.

Cite this article

risenwbib
TY  - CONF
AU  - Donny Prasetya Hutagalung
AU  - Alvareza Armadhika
AU  - Wilbert Yo
AU  - Shabrina Rachmawati Azzahra
AU  - Yenni Lailatul Rezki
AU  - Eko Rudiawan Jamzuri
PY  - 2024
DA  - 2024/12/25
TI  - Implementation and Performance Analysis of a Speech-Based Question Answering System on The Humanoid Robot Barelang 7
BT  - Proceedings of the  7th International Conference on Applied Engineering (ICAE 2024)
PB  - Atlantis Press
SP  - 179
EP  - 189
SN  - 2352-5401
UR  - https://doi.org/10.2991/978-94-6463-620-8_14
DO  - 10.2991/978-94-6463-620-8_14
ID  - Hutagalung2024
ER  -