Evaluation of Text and Speech Systems

In its nine chapters, this book provides an overview of the state-of-the-art and best practice in several sub-fields of evaluation of text and speech systems and components. The evaluation aspects covered include speech and speaker recognition, speech syn

  • PDF / 13,696,720 Bytes
  • 306 Pages / 439.37 x 666.142 pts Page_size
  • 39 Downloads / 188 Views

DOWNLOAD

REPORT


Text, Speech and Language Technology VOLUME 37

Series Editors Nancy Ide, Vassar College, New York, USA Jean Véronis, Université de Provence and CNRS, France Editorial Board Harald Baayen, Max Planck Institute for Psycholinguistics, The Netherlands Kenneth W. Church, AT & T Bell Labs, New Jersey, USA Judith Klavans, Columbia University, New York, USA David T. Barnard, University of Regina, Canada Dan Tufis, Romanian Academy of Sciences, Romania Joaquim Llisterri, Universitat Autonoma de Barcelona, Spain Stig Johansson, University of Oslo, Norway Joseph Mariani, LIMSI-CNRS, France

The titles published in this series are listed on www.springer.com.

Evaluation of Text and Speech Systems Edited by

Laila Dybkjær Prolog Development Center A/S BrØ ndby dua, Italy Denmark

Holmer Hemsen DFKI Language Technology Lab Berlin Germany

Wolfgang Minker Institute for Information Technology University of Ulm Germany

Editors Laila Dybkjær

Dr. Wolfgang Minker

Prolog Development Center A/S BrØndby Denmark [email protected]

Institute for Information Technology University of Ulm Germany [email protected]

Holmer Hemsen DFKI Language Technology Lab Berlin Germany [email protected]

ISBN 978-1-4020-5816-5

e-ISBN 978-1-4020-5187-2

Library of Congress Control Number: 2008924781 © 2008 Springer Science+Business Media B.V. No part of this work may be reproduced, stored in a retrieval system, or transmitted in any form or by any means, electronic, mechanical, photocopying, microfilming, recording or otherwise, without writte n permission from the Publisher, with the exception of any material supplied specifically for the purpose of being entered and executed on a computer system, for exclusive use by the purchaser of the work. Printed on acid-free paper 9 8 7 6 5 4 3 2 1 springer.com

Contents

Preface Contributing Authors

ix xi

Introduction Laila Dybkjær, Holmer Hemsen and Wolfgang Minker

xv

1 Speech and Speaker Recognition Evaluation Sadaoki Furui 1. Introduction 2. Principles of Speech Recognition 3. Categories of Speech Recognition Tasks 4. Evaluation of Speech Recognition Systems 5. Principles of Speaker Recognition 6. Categories of Speaker Recognition Tasks 7. Normalization and Adaptation Techniques 8. Evaluation of Speaker Recognition Systems 9. Factors Affecting the Performance and Evaluation Paradigm Design for Speech and Speaker Recognition Systems 10. System-Level Evaluation of Speech and Speaker Recognition 11. Conclusion References 2 Evaluation of Speech Synthesis Nick Campbell 1. Introduction 2. Components of Computer Speech 3. Evaluation Methodologies 4. Organised Evaluations and Assessment 5. Speaking to (and on Behalf of) People 6. Conclusion References

1 1 2 3 6 12 13 15 17 22 23 24 24 29 29 30 36 41 45 45 48

vi 3 Modelling and Evaluating Verbal and Non-Verbal Communication in Talking Animated Interface Agents Bj¨ orn Granstr¨ om and David House 1. Introduction 2. KTH Parametric Multimodal Speech Synthesis 3. Data Collection and Data-Driven Visual Synthesis 4. Evaluating Intelligibility and Informa