Performance Evaluation and Benchmarking of Intelligent Systems

Performance Evaluation and Benchmarking of Intelligent Systems presents research dedicated to the subject of performance evaluation and benchmarking of intelligent systems by drawing from the experiences and insights of leading experts gained both through

  • PDF / 12,055,192 Bytes
  • 351 Pages / 505.54 x 758.311 pts Page_size
  • 68 Downloads / 204 Views

DOWNLOAD

REPORT


| | | | |

|

| | | | | |

| | | | | | | | | | |

| |

|

| |

| | | | | |

| | | |

|

| | | |

| | | | | |

| | | | | | | | | | | | |

| | |

| |

| | | | | |

| | | | | | | | | | |

| |

Performance Evaluation and Benchmarking of Intelligent Systems 1 23

| | | | | | |

|

| | |

| | |

| | | | | |

Performance Evaluation and Benchmarking of Intelligent Systems

R. Madhavan · E. Tunstel · E. Messina Editors

Performance Evaluation and Benchmarking of Intelligent Systems

123

Editors Raj Madhavan Computational Sciences and Engineering Division Oak Ridge National Laboratory 1 Bethel Valley Road Oak Ridge TN 37831 USA and Intelligent Systems Division National Institute of Standards and Technology (NIST) Gaithersburg MD 20899 USA [email protected]

Edward Tunstel Johns Hopkins University Applied Physics Laboratory 11100 John Hopkins Road Laurel MD 20723 USA [email protected]

Elena Messina National Institute of Standards & Technology (NIST) Intelligent Systems Division 100 Bureau Drive Gaithersburg MD 20899 Mail Stop 8230 USA [email protected]

ISBN 978-1-4419-0491-1 e-ISBN 978-1-4419-0492-8 DOI 10.1007/978-1-4419-0492-8 Springer New York Dordrecht Heidelberg London Library of Congress Control Number: 2009934851 © Springer Science+Business Media, LLC 2009 All rights reserved. This work may not be translated or copied in whole or in part without the written permission of the publisher (Springer Science+Business Media, LLC, 233 Spring Street, New York, NY 10013, USA), except for brief excerpts in connection with reviews or scholarly analysis. Use in connection with any form of information storage and retrieval, electronic adaptation, computer software, or by similar or dissimilar methodology now known or hereafter developed is forbidden. The use in this publication of trade names, trademarks, service marks, and similar terms, even if they are not identified as such, is not to be taken as an expression of opinion as to whether or not they are subject to proprietary rights. COMMERCIAL PRODUCT DISCLAIMER Commercial equipment and materials are identified in this book in order to adequately specify certain procedures. Such identification does not imply recommendation or endorsement by the National Institute of Standards and Technology (NIST), nor does it imply that the materials or equipment identified are necessarily the best available for the purpose. Printed on acid-free paper Springer is part of Springer Science+Business Media (www.springer.com)

To Priti, Priyanka and Kalpana – RM To my wife and children whose well-being is my performance benchmark – ET In loving memory of my parents, Margherita and Nicola – EM

Preface

To design and develop capable, dependable, and affordable intelligent systems, their performance must be measurable. Scientific methodologies for standardization and benchmarking are crucial for quantitatively evaluating the performance of emerging robotic and intelligent systems’ technologies. There is currently no accepted standard for quantitatively measuring the performance of th