Interactive Dialogue Learning
PI: 蔡宗翰教授, CoPI: 李宏毅老師
計畫簡介：
本團隊以「智慧工廠」為主旨，設計一任務輔助機器人(helper bot)，在使用者組裝機器人(Meccanoid2.0)的過程中給予協助，針對使用者提出之組裝問題提供操作指示。我們將組裝任務切分為多個步驟，組裝過程中透過影像辨識判斷使用者正在組裝之步驟，當使用者發問時，除了分析使用者的問句，也透過影像辨識得知使用者組裝步驟，針對該步驟可能發生之問題提出相對應解答，以期幫助使用者解決組裝難題。
Members
Publications
Che-Ping Tsai and Hung-Yi Lee, "Order-Free Learning Alleviating Exposure Bias in Multi-Label Classification", Proceedings of the AAAI Conference on Artificial Intelligence, vol. 34, no. 04, Apr. 2020, pp. 6038-6045.
Yi-Chen Chen, Sung-Feng Huang, Hung-yi Lee, Yu-Hsuan Wang, and Chia-Hao Shen, "Audio Word2vec: Sequence-to-Sequence Autoencoding for Unsupervised Learning of Audio Segmentation and Representation", IEEE/ACM Transactions on Audio, Speech, and Language Processing, vol. 27, no. 9, 2019, pp. 1481-1493.
Chia-Hung Wan, Shun-Po Chuang, and Hung-Yi Lee, "Towards Audio to Scene Image Synthesis Using Generative Adversarial Network", in ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 496-500.
Alexander H. Liu, Hung-yi Lee, and Lin-shan Lee, "Adversarial Training of End-to-end Speech Recognition Using a Criticizing Language Model", in ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 6176-6180.
Chia-Hsuan Lee, Yun-Nung Chen, and Hung-Yi Lee, "Mitigating the Impact of Speech Recognition Errors on Spoken Question Answering by Adversarial Domain Adaptation", in ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 7300-7304.
Che-Ping Tsai and Hung-Yi Lee, "Adversarial Learning of Label Dependency: A Novel Framework for Multi-class Classification", in ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 3847-3851.
Richard Tzong-Han Tsai, Chia-Hao Chen, Chun-Kai Wu, Yu-Cheng Hsiao, and Hung-yi Lee, "Using Deep-Q Network to Select Candidates from N-best Speech Recognition Hypotheses for Enhancing Dialogue State Tracking", in ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 7375-7379.
Tzu-Wei Sung, Jun-You Liu, Hung-yi Lee, and Lin-shan Lee, "Towards End-to-end Speech-to-text Translation with Two-pass Decoding", in ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 7175-7179.
Hung-Yi Lee, Pei-Hung Chung, Yen-Chen Wu, Tzu-Hsiang Lin, and Tsung-Hsien Wen, "Interactive Spoken Content Retrieval by Deep Reinforcement Learning", IEEE/ACM Transactions on Audio, Speech, and Language Processing, vol. 26, no. 12, 2018, pp. 2447-2459.
Sam Weng, Kevin Chun-Kai Wu, Yu-Chun Wang, and Richard Tzong-Han Tsai, "Question Retrieval with Distributed Representations and Participant Reputation in Community Question Answering", in Proceedings of the 29th Conference on Computational Linguistics and Speech Processing (ROCLING 2017), Taipei, Taiwan: The Association for Computational Linguistics and Chinese Language Processing (ACLCLP), pp. 148–148.
National Central University
