Skip to Content

Department of Linguistics


Evaluation of speech technology

An interest in the development of speech technology is very often associated with an interest in the evaluation of speech technology. My research career in speech science commenced with an honours thesis that examined aspects of speech synthesis performance. I have also carried out some commercial consultancies on voice codec evaluation. In one project (Mannell, 2002) I examined Mean Opinion Scores (MOS) of perceived voice codec quality as well as examining the interaction between codec quality and simulated satellite delay time on the performance of complex interactive tasks between two subjects.

As MU-Talk is further developed, subjective evaluations are planned for the system. Additionally, I have an interest in developing "objective" tests of voice codec quality based on the work that I have been carrying out on the perception of vocoded speech.

Click here for a brief overview of speech synthesis evaluation.

Relevant Papers

Mannell, R. (2006), "The combined effect of speech codec quality and transmission delay on human performance during complex spoken interactions", International Journal of Speech Technology, 9(3-4), 53-74 (Volume date is 2006, but publication date and copyright date is December 2008)

Mannell R.H. (2002), "The interaction between voice codec quality and delay time in satellite telephony", Proceedings of the Ninth Australian International Conference on Speech Science and technology, Melbourne, December 2002.

Mannell R.H., Ostry D., & Clark J.E., (1985) "Channel vocoder performance", Working Papers, 1985, Speech Hearing and Language Research Centre, Macquarie University.

Mannell R.H., (1984) Aspects of Speech Synthesis Performance, unpublished honours dissertation, Macquarie University. (click here for chapter 3)