|
PerMIS '02
Performance Metrics for Intelligent Systems Workshop
The 2002 Performance Metrics for Intelligent Systems Workshop is being
held at NIST
in Gaithersburg, MD on August 13-15, 2002.
To be admitted onto the NIST campus, you must be
pre-registered for the conference and present a photo ID. International
attendees are required to present a passport. Please wear your conference
badge at all times while on the NIST campus.
Viewgraphs of the August 13th Evening Presentation: RoboCup02
Workshop Organizers: Elena
Messina, NIST, Alex Meystel,
Drexel University and NIST, Larry
Reeker, NIST
Co-Sponsored by:
in Cooperation with:
As expectations for intelligent systems continue to
grow, the need for quantitative evaluation of system performance becomes
more critical. This third workshop in a series will bring together
leading researchers to address methods for measuring the abilities
of intelligent systems.
We wish to discuss ideas for quantitative engineering
approaches to measuring intelligence. Performance tests and competitions
are in this class. These measure the overall system performance in
structured situations. There are mathematical approaches to quantifying
the abilities of a system, be it through complexity measures, entropy
computations, or other calculations of either internal factors or
external manifestations.
Many issues remain. Must performance tests be domain
specific? How can tests be propagated throughout the community? Is
it reasonable to expect that researchers publish their results? Can
systems with fundamentally different designs be compared? Who determines
what the criteria for evaluation, or "success" are?
Among the topic areas to be considered for this workshop
are:
- Adaptive and Learning Systems
- Unmanned Autonomous Systems
- Knowledge Intensive Subsystems
- Cognitive and Neural Modelling
- Large Systems with Human-Computer Interaction for Decision Making
- Evolutionary Computations and Activities
- Hierarchical and Distributed Controllers with Elements of Autonomy
- Image Processing, Classification and Interpretation
- Cooperating Autonomous Robots
- Multi Agent Systems
- Optimization, Heuristics and Search Methods
- Pattern Recognition and Classification
- Behavior based Control
- Self-organizing Systems
- Measuring Systems for Integration Purposes
- Heuristic Interpretation of test results
- Automated Interpretation of test results
- Modeling of Neuro-biological Autonomic Systems
- Mapping Design Specifications into Performance of Intelligent
Systems
- Understanding Incomplete and Ambiguous Assignments
- Interpreting and Performing the Assignment Under Conditions of
Reduced Technological Capabilities
- How Performance Depends on Knowledge Representation
- Multiresolutional Ontology of Performance
- Linkage Between Multiple Sensor Modalities and Performance in
Intelligent Systems
- Can Natural Language Communication with an Intelligent System
Affect Performance?
- Testing and Improving Performance by Playing Games
- Development of SELF in Intelligent Systems
Submission Information
Prospective authors are requested to either send a draft
paper (maximum 8 pages) or an extended abstract for review. All submissions
must be written in English, starting with a succinct statement of the
problem, the results achieved, their significance and a comparison with
previous work. Position papers are welcomed as well.
Electronic submissions (ps, pdf, Word) are strongly preferred.
Please submit to:
Gwendolyn White
gwendolyn.white@nist.gov
Phone: (301) 975-3235
Important Dates
May 25, 2002: Submissions due (date extended)
June 7, 2002: Notification of acceptance
July 22, 2002: Final papers due - Paper Preparation
Instructions
August 13-15, 2002: Workshop
Registration Information
Registration information is availale on the
NIST Conference Page
On-line registration is now closed. For more information contact
Teresa Vicente at (301) 975-3883.
Registration will be available at the Holiday Inn on Tuesday,
August 13, 2002 starting at 7am and on site at NIST. However, due to
security at NIST your name has to appear on a list of attendees before
you will be allowed on the NIST campus. Please contact Teresa Vicente
at (301) 975-3883 to register and have your name added to the list.
Students - Discounted registration is available
for students. Please e-mail Elena
Messina for more information.
Accommodations
Conference registration does not include your hotel reservation.
A block of rooms has been reserved at the Gaithersburg Holiday Inn,
(301) 948-8900, at a rate of $99, single and double, plus 12% tax. To
register for a room, please call the hotel directly.
A NIST bus will provide service between the hotel and
NIST each day.
| Date |
Time |
From |
To |
| 8/13 |
7:30am |
Holiday Inn |
NIST |
| |
6:00pm |
NIST |
Holiday Inn |
| 8/14 |
7:30am |
Holiday Inn |
NIST |
| |
6:00pm |
NIST |
Holiday Inn |
| 8/15 |
7:30am |
Holiday Inn |
NIST |
| |
6:00pm |
NIST |
Holiday Inn |
All attendees are strongly encouraged to ride the NIST
bus from the Holiday Hotel to NIST each day. Individual cars are subject
to searches and you should allow extra time for admittance onto the
NIST campus.
Attendees should arrange departure to the airport from
the hotel rather than NIST.
Transportation
Super-Shuttle, 1-800-258-3826, offers commercial van service
from Dulles International, Ronald Reagan National, and Baltimore-Washington
International Airports to Gaithersburg. Call for reservations.
The Washington Metro has subway service to Gaithersburg.
Metro can be boarded at National Airport. Take a Yellow Line train marked
“Mount Vernon Square” to Gallery Place and transfer to a Red
Line train marked “Shady Grove” to the Shady Grove station.
Service is every 6 to 15 minutes, depending on the time of day. The
travel time from National to Shady Grove is about 50 minutes. Taxis
are available from the Shady Grove Metro station to area hotels.
A NIST shuttle van operates for official visitors from
the Shady Grove metro station to NIST. The van leaves the Shady Grove
station on the quarter and three-quarter hour (e.g. 8:15, 8:45,. . .4:45,
5:15) from the east side parking lot.
Directions
To reach NIST:
Traveling north on I-270: take Exit 10, Rt. 117 West, Clopper Road.
At the first light on Clopper Road, turn left onto the NIST grounds.
Traveling south on I-270: take Exit 11, Rt. 124, Montgomery Village
Avenue/Quince Orchard Road. Bear to the right off the exit ramp. At
the second light turn left onto Clopper Road. At the next light, turn
right onto the NIST grounds.
To reach the Administration Building, turn left after passing the guard
office. Signs will direct you to visitor parking.
To reach the Gaithersburg Holiday Inn:
Traveling north on I-270: take Exit 11, Rt. 124 East, Montgomery Village
Avenue. At the second traffic light, turn left onto Rt. 355. The hotel
will be on your right.
Traveling south on I-270: take Exit 11. Turn left at the first traffic
light. At the third light, turn left onto Rt. 355/N. Frederick Avenue.
The hotel will be on your right.
Map
A map of the Washington DC area in pdf. Map
Coffee Breaks and Lunch
Refreshments will be provided during moring, mid-morning,
and mid-afternoon breaks. Lunch will also be provided in the NIST cafeteria.
There will be reception at Holiday Inn on Tuesday and dinner at Holiday
Inn on Wednesday.
Advisory Board
- G. Adorni, University of Parma, Italy
- J. Albus, NIST, USA
- P. Antsaklis, University of Notre Dame, USA
- M. Asada, Osaka University, Japan
- G. A. Bekey, University of Southern California, USA
- K. Bellman, Aerospace Integration Science Corp., USA
- J. G. Blitch, SAIC, USA
- P. Borne, Ecole Centrale de Lille, France
- H.-H. Bothe, Technical University of Denmark, Denmark
- B. Chandrasekaran, Ohio State University, USA
- J. Cherniavsky, NSF, USA
- M. Cotsaftis, LTME/ECE, France
- R. Cottam, ETRO VUB, Belgium
- F. Darema, NSF, USA
- P. Dario, Scuola Superiore, Italy
- P. Davis, RAND Graduate School., USA
- J. Fetzer, University of Minnesota, USA
- D. Filev, Ford, USA
- R. Finkelstein, Robotic Technology, Inc., USA
- D. Fogel, Natural Selection, Inc., USA
- N. Foo, University of New South Wales, Australia
- W. Freeman, University of California at Berkeley, USA
- E. Fromm, Drexel University, USA
- T. Fukuda, University of Nagoya, Japan
- D. Gage, DARPA, USA
- R. Garner, Loebner Prize Winner for 1998 and 1999, USA
- G. Gerhart, US Army TACOM, USA
- E. Grant, CRIM, North Carolina State University, USA
- S. Grossberg, Boston University, USA
- R. Gudwin, State Univerity of Campinas, Brazil
- W. Hamel, University of Tennessee, USA
- W. Hargrove, Oak Ridge National Laboratory, USA
- M. Herman, NIST, USA
- E. Horvitz, Microsoft Research, USA
- M. Jabri, University of Sydney, Australia
- D. Jaron, Drexel University, USA
- A. Jones, NIST, USA
- R. Jordan, Lockheed Martin, USA
- C. Joslyn, Los Alamos National Laboratory, USA
- S. Kak, Louisiana State University, USA
- O. Kaynak, Bogazici University, Istanbul, Turkey
- H. Kitano, Sony Computer Science Labs, Japan
- K. Kreutz-Delgado, University of California at San Diego
- F. Kurfess, California Polytechnic State University
- J. E. Laird, University of Michigan, USA
- C. Landauer, Aerospace Integration Science Corp., USA
- S. Lee, Samsung Advanced Inst. of Technology, Korea
- C. S. George Lee, Purdue University, USA
- P. B. Luh, University of Connecticut, USA
- B. Mirkin, Birkbeck College, GB
- U. Ozguner, Ohio State University, USA
- T. Parisini, Politecnico di Milano, Italy
- K. Passino, Ohio State University, USA
- L. Perlovsky, AFRL/SNHE, USA
- L. Pouchard, Oak Ridge National Lab, USA
- J. Pustejovsky, Brandeis University, USA
- D. Repperger, AFRL/HECP, USA
- E. H. Ruspini, SRI International, USA
- T. Samad, Honeywell, USA
- A. Sanderson, RPI, USA
- R. Sanz, University of Madrid, Spain
- G. Saridis, RPI, USA
- A. Schultz, Naval Research Laboratory, USA
- T. Shih, Tamkang University, Taiwan
- R. Simmons, Carnegie Mellon, USA
- M. Swinson, Sandia National Lab, USA
- H. Szu, ONR Navy, USA
- M. Tilden, Los Alamos National Lab., USA
- S. Tzafestas, National Techical University of Athens, Greece
- L. Tsoukalas, Purdue Universtity, USA
- I. B. Turksen, University of Toronto, Canada
- C. Weisbin, NASA, USA
- T. Whalen, Georgia State University, USA
- A. Wild, Motorola, USA
- V. Winter, University of Omaha, USA
- R. Yager, Iona College, USA
- A. Yavnai, RAFAEL, Israel
- Y. Ye, IBM T. J. Watson Research Center, USA
- B. Zeigler, University of Arizona, USA
- L. Zadeh, University of California at Berkeley, USA
Past Workshops
PerMIS
'00
PerMIS
'01
|
