Research and Engineering of Intelligent Systems

PerMIS '03

Performance Metrics for Intelligent Systems Workshop

The 2003 Performance Metrics for Intelligent Systems Workshop is being held at NIST in Gaithersburg, MD on September 16-18, 2003.

To be admitted onto the NIST campus, you must be pre-registered for the conference and present a photo ID. International attendees are required to present a passport. Please wear your conference badge at all times while on the NIST campus.

Workshop Agenda - Final (PDF) dated 9/12/03	On-Line Registration Form
Workshop Announcement and Call for Papers (in pdf)	Accommodations
White Paper - Draft (PDF)	Transportation
Paper Preparation Instructions	Directions
Submission Information	Map
Important Dates	Coffee Breaks and Lunch
Registration Information	Advisory Board

Get Adobe Acrobat Reader

Workshop Organizers: Elena Messina, NIST, Alex Meystel, Drexel University, Dennis K. Leedom, Evidence Based Research Inc.

Co-Sponsored by:

NIST	DARPA	IEEE Control Systems Society	IEEE Systems, Man, and Cybernetics Society

in Cooperation with:

IEEE Neu ral Network Council

In the fourth workshop in a series targeted at defining measures and methodologies of evaluating performance of intelligent systems, we will examine more closely applications of performance measures to practical problems in commercial, industrial, and military applications. In the quest for providing researchers, users, and developers of intelligent systems with meaningful and usable measures and methodologies, we will attempt to draw upon measurement technologies and practices from other disciplines.

Papers and invited sessions are being sought. Topic areas include, but are not limited to

Leveraging Measures from other disciplines:

	Technology Readiness Levels (TRL)
	Uncertainty Measures
	Complexity Measures, such as Kolmogorov
	Biometric Approaches
	Linguistic Approaches
	Levels of Autonomy
	Cognitive Science Approaches

Measuring Components of Intelligent Systems

	Sensing and Perception
	Modeling and Knowledge Content, Representation
	Planning and Control
	Learning and Adapting
	Communications with Humans (and Other Systems)
	Collaboration with Other Systems (and Humans)

Code of Best Practice for Experimentation
Testbeds and Competitions for Inter-comparisons
Tools for Facilitating Performance Measures
Evaluating Architectures for Intelligence

Submission Information

Prospective authors are requested to either send a draft paper (maximum 8 pages) or an extended abstract for review. All submissions must be written in English, starting with a succinct statement of the problem, the results achieved, their significance and a comparison with previous work. Position papers are welcomed as well.

Electronic submissions (ps, pdf, Word) are strongly preferred. Please submit to:

PerMIS@cme.nist.gov
Phone: (301) 975-3235

Important Dates

June 16, 2003: Submissions due
July 28, 2003: Notification of acceptance
August 22, 2003: Final papers due - Paper Preparation Instructions
September 16-18, 2003: Workshop

Registration Information

Registration information is availale on the NIST Conference Page.
The registration fee is $300.00
On-line registration will close on Sept. 10, 2003. For more information contact Teresa Vicente at (301) 975-3883.

Students - Discounted registration is available for students.
The registration fee is $135.00
On-line registration will close on Sept. 10, 2003. For more information contact Teresa Vicente at (301) 975-3883.

Return to top

Accommodations

Conference registration does not include your hotel reservation. A block of rooms has been reserved at the Gaithersburg Holiday Inn, (301) 948-8900, at a rate of $90, single or double, plus 12% tax. To register for a room, please call the hotel directly. This rate will only be available until September 1, 2003.

A NIST bus will provide service between the hotel and NIST each day.

Date	Time	From	To
9/16	7:30am	Holiday Inn	NIST
	6:00pm	NIST	Holiday Inn
9/17	7:30am	Holiday Inn	NIST
	6:00pm	NIST	Holiday Inn
9/18	7:30am	Holiday Inn	NIST
	6:00pm	NIST	Holiday Inn

All attendees are strongly encouraged to ride the NIST bus from the Holiday Hotel to NIST each day. Individual cars are subject to searches and you should allow extra time for admittance onto the NIST campus.

Attendees should arrange departure to the airport from the hotel rather than NIST.

Transportation

Super-Shuttle, 1-800-258-3826, offers commercial van service from Dulles International, Ronald Reagan National, and Baltimore-Washington International Airports to Gaithersburg. Call for reservations.

The Washington Metro has subway service to Gaithersburg. Metro can be boarded at National Airport. Take a Yellow Line train marked “Mount Vernon Square” to Gallery Place and transfer to a Red Line train marked “Shady Grove” to the Shady Grove station. Service is every 6 to 15 minutes, depending on the time of day. The travel time from National to Shady Grove is about 50 minutes. Taxis are available from the Shady Grove Metro station to area hotels.

A NIST shuttle van operates for official visitors from the Shady Grove metro station to NIST. The van leaves the Shady Grove station on the quarter and three-quarter hour (e.g. 8:15, 8:45,. . .4:45, 5:15) from the east side parking lot.

Directions

To reach NIST:
Traveling north on I-270: take Exit 10, Rt. 117 West, Clopper Road. At the first light on Clopper Road, turn left onto the NIST grounds.
Traveling south on I-270: take Exit 11, Rt. 124, Montgomery Village Avenue/Quince Orchard Road. Bear to the right off the exit ramp. At the second light turn left onto Clopper Road. At the next light, turn right onto the NIST grounds.
To reach the Administration Building, turn left after passing the guard office. Signs will direct you to visitor parking.

To reach the Gaithersburg Holiday Inn:
Traveling north on I-270: take Exit 11, Rt. 124 East, Montgomery Village Avenue. At the second traffic light, turn left onto Rt. 355. The hotel will be on your right.
Traveling south on I-270: take Exit 11. Turn left at the first traffic light. At the third light, turn left onto Rt. 355/N. Frederick Avenue. The hotel will be on your right.

Map
A map of the Washington DC area in pdf. Map

Coffee Breaks and Lunch

Refreshments will be provided during moring, mid-morning, and mid-afternoon breaks. Lunch will also be provided in the NIST cafeteria. There will be reception at Holiday Inn on Tuesday and dinner at Holiday Inn on Wednesday.

Return to top

Advisory Board

G. Adorni, University of Parma, Italy
J. Albus, NIST, USA
P. Antsaklis, University of Notre Dame, USA
M. Asada, Osaka University, Japan
G. A. Bekey, University of Southern California, USA
K. Bellman, Aerospace Integration Science Corp., USA
J. G. Blitch, SAIC, USA
P. Borne, Ecole Centrale de Lille, France
H.-H. Bothe, Technical University of Denmark, Denmark
B. Chandrasekaran, Ohio State University, USA
J. Cherniavsky, NSF, USA
M. Cotsaftis, LTME/ECE, France
R. Cottam, ETRO VUB, Belgium
F. Darema, NSF, USA
P. Dario, Scuola Superiore, Italy
P. Davis, RAND Graduate School., USA
J. Fetzer, University of Minnesota, USA
D. Filev, Ford, USA
R. Finkelstein, Robotic Technology, Inc., USA
D. Fogel, Natural Selection, Inc., USA
N. Foo, University of New South Wales, Australia
W. Freeman, University of California at Berkeley, USA
E. Fromm, Drexel University, USA
T. Fukuda, University of Nagoya, Japan
D. Gage, DARPA, USA
R. Garner, Loebner Prize Winner for 1998 and 1999, USA
G. Gerhart, US Army TACOM, USA
E. Grant, CRIM, North Carolina State University, USA
S. Grossberg, Boston University, USA
R. Gudwin, State Univerity of Campinas, Brazil
W. Hamel, University of Tennessee, USA
W. Hargrove, Oak Ridge National Laboratory, USA
M. Herman, NIST, USA
E. Horvitz, Microsoft Research, USA
M. Jabri, University of Sydney, Australia
D. Jaron, Drexel University, USA
A. Jones, NIST, USA
R. Jordan, Lockheed Martin, USA
C. Joslyn, Los Alamos National Laboratory, USA
S. Kak, Louisiana State University, USA
O. Kaynak, Bogazici University, Istanbul, Turkey
H. Kitano, Sony Computer Science Labs, Japan
K. Kreutz-Delgado, University of California at San Diego
F. Kurfess, California Polytechnic State University
J. E. Laird, University of Michigan, USA
C. Landauer, Aerospace Integration Science Corp., USA
S. Lee, Samsung Advanced Inst. of Technology, Korea
C. S. George Lee, Purdue University, USA
P. B. Luh, University of Connecticut, USA
B. Mirkin, Birkbeck College, GB
U. Ozguner, Ohio State University, USA
T. Parisini, Politecnico di Milano, Italy
K. Passino, Ohio State University, USA
L. Perlovsky, AFRL/SNHE, USA
L. Pouchard, Oak Ridge National Lab, USA
J. Pustejovsky, Brandeis University, USA
D. Repperger, AFRL/HECP, USA
E. H. Ruspini, SRI International, USA
T. Samad, Honeywell, USA
A. Sanderson, RPI, USA
R. Sanz, University of Madrid, Spain
G. Saridis, RPI, USA
A. Schultz, Naval Research Laboratory, USA
T. Shih, Tamkang University, Taiwan
R. Simmons, Carnegie Mellon, USA
M. Swinson, Sandia National Lab, USA
H. Szu, ONR Navy, USA
M. Tilden, Los Alamos National Lab., USA
S. Tzafestas, National Techical University of Athens, Greece
L. Tsoukalas, Purdue Universtity, USA
I. B. Turksen, University of Toronto, Canada
C. Weisbin, NASA, USA
T. Whalen, Georgia State University, USA
A. Wild, Motorola, USA
V. Winter, University of Omaha, USA
R. Yager, Iona College, USA
A. Yavnai, RAFAEL, Israel
Y. Ye, IBM T. J. Watson Research Center, USA
B. Zeigler, University of Arizona, USA
L. Zadeh, University of California at Berkeley, USA

Past Workshops

isd-webmaster@cme.nist.gov
Date Created: February 13, 2003
Last updated: September 12, 2003