Banner National Institute of Standards and Technology
ISD Research Area Banner
ISD home About ISD ISD Research Areas ISD's Products and Services What's New in ISD Search ISD

Research and Engineering of Intelligent Systems

Performance Metrics

Performance Metrics for Intelligent Systems
PerMIS '04

August 24 - 26, 2004
Edited by: E.R. Messina and A.M. Meystel

Co-Sponsored by:

in Cooperation with:


The Proceedings are available in PDF format. You can preview each paper below. If you do not have Adobe Acrobat Reader you can download it for free from Adobe.

Tuesday, August 24, 2004
 
TuAM1 – Invited Session: Performance Metrics for Perception and Sensor Systems I (Chair: M. Juberts)
 
Chellappa, R., and Chowdhury, A.K., An Information Theoretic Evaluation Criterion for 3D Reconstruction Algorithms
Cowley, A., Hsu, H.-C., and Taylor, C.J., Modular Programming Techniques for Distributed Computing Tasks
Latecki, L.J., Miezianko, R., and Pokrajac, D., Evaluating Reliability of Motion Features in Surveillance Videos
Krishna, K.M., and Hexmoor, H., A Framework for Measuring Tracking Performance of a Sensor Network

TuAM2 – Performance of Goal Oriented Systems (Chair: A. Meystel)
 
Orr, S. Goal-Oriented Intelligence in Optimization of Distributed Parameter Systems
Polyakov, L.M., Agent with Reasoning and Learning. The Structure Design

TuPM1 – Invited Session: Performance Metrics for Perception and Sensor Systems II (Chair: T. Hong)
 
Oggier, T., Seitz, P., and Blanc, N., Miniaturized all-solid-state 3D camera for real-time range imaging
Hong, T., Bostelman, R., and Madhavan, R., Obstacle Detection using a TOF Range Camera for Indoor AGV Navigation
Madhavan, R., and Messina, E., Performance Evaluation of Temporal Range Registration for Unmanned Vehicle Navigation
Livingston, M.A., Swan, J.E, Julier, S.J., Baillot, Y., Brown, D., Rosenblum, L.J., Gabbard, J.L., Hollerer, T.H., and Hix, D., Evaluating System Capabilities and User Performance in the Battlefield Augmented Reality System

TuPM2 – The advantages of practical use of MIQ Panel Discussion (Chair: H. Szu)
 
Hu, X., and Zeigler, B., Measuring Cooperative Robotic Systems Using Simulation-Based Virtual Environment

Wednesday, August 25, 2004
 
WeAM1 – Evaluation of Human and Robot Interactions (Chair: J. Scholtz)
 
Goodrich, M.A., Boer, E. R., Crandall, J.W., Ricks, R.W., and Quigley, M.L., Behavioral Entropy in Human-Robot Interaction
Scholtz, J., Antonishek, B., and Young, J., Evaluation of Human-robot Interaction in the NIST Reference Search and Rescue Test Arenas
Burke, J.L., Murphy, R.R., Riddle, D.R., and Fincannon, T., Task Performance Metrics in Human-Robot Interaction: Taking a Systems Approach
Morfopoulos, A., McHenry, M., and Matthies, L., Reduction of User Interaction by Autonomy
Freedy, A., McDonough, J., Jacobs, R., Freedy, E., Thayer, S., Weltman, G., Kalphat, M., and Palmer, D., A Mixed Initiative Human-Robots Team Performance Assessment System for Use in Operational and Training Environments

WeAM2 – (Chair: A. Meystel)
 
Wang, P., Biologizing Control Systems
Saridis, G.N., Entropy as a Philosophy

Wednesday, August 25, 2004
Afternoon Plenary
Spall, J., Issues in Stochastic Search and Optimization

WePM1 – General Approaches and Tools (Chair: M. Anderson)
 
Balakirsky, S., and Kramer, T.R, Comparing Algorithms: Rules of Thumb and an Example
Spall, J.C., Hill, S.D., and Stark, D.R., Theoretical Framework for Comparing Several Stochastic Optimization Approaches
Nau, D., and Ghallab, M., Measuring the Performance of Automated Planning Systems
Langley, P., and Messina, E., Experimental Studies of Integrated Cognitive Systems
Anderson, M., A Flexible Approach to Quantifying Various Dimensions of Environmental Complexity
Haring, G., Juiz, C., Kurz, C., Puigjaner, R., and Zottl, J., Framework for the Performance Assessment of Architectural Options on Intelligent Distributed Applications

Wednesday, August 25, 2004
Information Interpretation and Integration Conference (I3CON) (Chair: T. Hughes)

 
Hughes, T.C, and Ashpole, B.C, The Semantics of Ontology Alignment
Hughes, T., Introducing I3CON
Pool, M., Semantic Interoperability: Case Study in Ontology-Based Solutions
Ashpole, B., Ontology Translation Protocol Ontology Translation Protocol (Ontrapro)
Andersen, B., Application of Formal Ontology to Database Schema Alignment - an Outline
Ehrig, M., Ontology Mapping
Peng, Y., Ding, Z., and Pan, R., Uncertainty in Ontology Mapping: A Bayesian Perspective
Emery, P., CODIP Technology at Work
Gruninger, M., Using Model-Theoretic Invariants for Semantic Integration
Li, J., LOM: A Lexicon-based Ontology Mapping Tool

Thursday, August 26, 2004
 
Morning Plenary
Sowa, J., The Challenge of the Knowledge Soup

ThAM1 – Measuring Performance of Autonomous Vehicles (Chair: S. Lewis)
 
Commuri, S., Li, Y., Hougen, D., and Fierro, R., Evaluating Intelligence in Unmanned Ground Vehicle Teams
O'Day, S., Steinberg, M., Yglesias, C., Bonnevier, K., Moulds,T., Sincavage, R., Ricard, M., Cleary, M., Curry, M., Sliski, T., Tierno, J., Clark, J., and Snyder, F., Metrics for Intelligent Autonomy
Freed, M., Harris, R., and Shafto, M., Measuring Autonomous UAV Surveillance Performance
Lewis A.S., and Weiss, L.G., Intelligent Autonomy and Performance Measures for Coordinated Unmanned Vehicles
Shirkhodaie, A., Amrani, R., Chawla, N., and Vicks, T., Traversable Terrain Modeling and Performance Measurement of Mobile Robots

ThAM2 – Issues in Developing Adaptive Intelligence I (Chair: Gary Berg-Cross)
 
Berg-Cross, G., Introduction to Issues in Developing Adaptive Intelligence
Berg-Cross, G., Developing Rational-Empirical Views of Intelligent Adaptive Behavior
Arata, L.O., Interactive Immunity and Adaptive Innovation
Gunderson J.P., and Gunderson, L.F., Intelligence ≠ Autonomy ≠ Capability
Cottam, R., Ranson, W., Vounckx, R., Intelligence?

ThPM1 – Tools and Testbeds for Evaluating Autonomous Systems (Chair: S. Balakirsky)
 
Szabo. S., and Wilson, B., Application of a Crash Prevention Boundary Metric to a Road Departure Warning System
Schlenoff, C., Ajot, J., and Madhavan, R., PRIDE: A Framework for Performance Evaluation of Intelligent Vehicles in Dynamic, On-Road Environments
Scrapper, C., Balakirsky, S., and Weiss, B., Autonomous Road Driving Areans for Performance Evaluation
Joshi, S., Slicker, M., and Surianarayan, A., Software Tools for Design and Performance Evaluation of Intelligent Systems

ThPM2 – Issues in Developing Adaptive Intelligence II (Co-Chairs: A. Meystel and Gary Berg-Cross)
 
Rodriguez, A., and Reggia, J.A., Adaptive Problem Solving with Particle Systems
Bickhard, M.H., Negative Knowledge and Rational Creativity
Hein, C., and Zebrowitz, H., Agent and Multi-Entity Systems Modeling
Abramovich, A., On Knowledge Representation Issues

Workshop Agenda

 

Contact

Ms. Elena Messina
NIST
Intelligent Systems Division
100 Bureau Drive, Mail Stop 8230
Gaithersburg, MD 20899-8230
Phone: 301-975-3510
Fax: 301-990-9688
E-mail: elena.messina@nist.gov

Date created: 5/5/2005
Last updated: 5/5/2005

Manufacturing Engineering Laboratory Skip navigation