|
Home
Exhibitor
Booth
Plenary
Speakers
Announcement and
Call for Papers
Special
Sessions
Draft
White Paper
Paper
Preparation Instructions
Submission
Information
Important Dates
Registration
Information
On-Line
Registration
Accommodations
Transportation
Directions
General Information
Advisory
Board
|
|
PerMIS '04
Performance Metrics for Intelligent
Systems Workshop - Special Sessions
Metrics for Knowledge Representations
This session builds off of other successful workshops
and sessions that have focused on this general area. This special
session will explore applying metrics to knowledge representation
within autonomous system, with an emphasis on leveraging existing
efforts that are exploring similar issues both within and outside
of the autonomous systems community.
Topic areas within this session include, but are not
limited to:
- How to assess which types of knowledge representation are appropriate
for which type of information, including corresponding performance
measures?
- How to assess the value of the knowledge that is captured in
the knowledge representation with respect to the goal that is trying
to be achieved?
- How to assess the overall quality of knowledge within the knowledge
representation?
- How to understand and measure the uncertainty that is associated
with knowledge captured in the autonomous system?
- How to insure the consistency of knowledge that is captured within
different knowledge bases within the autonomous system?
- How to determine and measure the role of ontologies in autonomous
systems?
Back to top
I3CON
The Information Interpretation and Integration Conference
(I3CON, prounounced "icon") 0.1 will be the first in what
is hoped will become a series of workshops that supports the ontology
and schema interpretation and integration research communities. I3CON
will provide an open forum and a software framework for the systematic,
and comprehensive evaluation of ontology/schema interpretation and integration
tools. I3CON will bring researchers, stakeholders, and technologies
together to compare approaches, encouraging the exchange of ideas between
industry, academia, and government.
PerMIS will host the I3CON "pilot," which is
being modeled after the NIST Text Retrieval Conference (TREC). Like
TREC, I3CON will deliver an (ontology and/or schema) alignment challenge
and a software platform on which participants run their own algorithms
at the workshop. The results will be collated, allowing for an initial
evaluation of alignment performance. Participants will have the opportunity
to present their unique technical approaches to the alignment challenge
and lessons learned from the evaluation.
For more information, please visit our web site at http://www.atl.external.lmco.com/projects/ontology/i3con.html.
Back to top
Issues in Developing Adaptive
Intelligence
Papers and panel sessions are being sought for a special
track on "Issues in Developing Adaptive Intelligence" which
will be part of the next Performance Metrics for Intelligent Systems
Workshop (PerMIS '04), being held at the National Institute of Standards
and Technology in Gaithersburg, MD USA August 24-26, 2004.
Issues in Developing Adaptive Intelligence
This track seeks to provide an interdisciplinary look at the construction
and metrics of systems that demonstrate adaptive behaviors. An important
test of any such system is how they cope with the open-ended, unbounded,
and changing range of knowledge and processing needed for true intelligence.
This track will consider individual and coordinated cognitive tasks
such as planning with uncertainty; interleaving of perception, planning
and action; and agent communication. The track is intended to further
practical, interdisciplinary views of adaptive, learned and evolutionary
processes by providing infrastructure for the design and performance
evaluation of such intelligent systems.
TOPIC AREAS for the track overlap with the PerMIS topics
including, but not limited to:
- Meaning and measurement of autonomy of a system and its relations
to learning, knowledge and adaptation
- Evaluating Components and component inter-relations within Intelligent
Systems
- Sensing , Planning, Control and Perception
- Knowledge Representation, World Models
- Ontologies and knowledge bases
- Learning , Adapting and Evolving
- Communications & Collaboration with Humans (and Other Systems)
- Testbeds, Grand Challenges and Competitions for Inter-comparisons
- Evaluating Architectures for Intelligence
- Hybrid and Unified Systems
- Central/top-down and decentralized/bottom-up,
- Symbolic, Reactive, Neural net, Fuzzy, Self organizing etc.
- Adaptive robots, Biorobotics and Evolutionary robotics
Papers and panel proposal ideas can be sent to WORKSHOP
TRACK ORGANIZERS
Gary Berg-Cross (gbergcross@yahoo.com)
Ron Cottam (ricottam@etro.vub.ac.be)
Luis Arata (luis.arata@quinnipiac.edu)
Louise Gunderson (lgunders@gamma-two.com)
IMPORTANT DATES
Submission deadline: May 14
Notification of acceptance/rejection: June 14
Final Papers due: July 12
Workshop: August 24-26
Back to top
Simulation and Modeling
A special session on how simulation and modeling can
enhance the quantitative evaluation of system performance and system
intelligence will take place. Topics areas to be considered for this
session include:
-
How simulation and modeling can be used to test
and validate real system performance.
-
How successful are we at modeling intelligent systems?
-
Real experiences with using simulation to develop,
test, and validate intelligent system performance.
-
Simulation and modeling in support of machine learning.
-
Simulation and modeling of sensors, planners, and
other components of intelligent systems.
-
Ground truth capture for constructing simulations
and models.
-
Modeling decision making with uncertain and incomplete
information.
-
Developing realistic system performance requirements
using modeling and simulation tools
-
Evaluating multi-system control paradigms using
modeling and simulation.
IMPORTANT DATES
May 24, 2004: Submissions due
June 14, 2004: Notification of acceptance
July 12, 2004: Final papers due
August 24-26, 2004: Workshop
Electronic submissions (ps, pdf, Word) are strongly preferred.
Please note on your submission that this is for the Simulation and Modeling
Session and submit to:
PerMIS@cme.nist.gov
(please include Special Session on Simulation in subject line)
Back to top
Perception Systems and Sensors
Evaluation
A special session will take place that will explore applying
metrics to perception systems and sensors evaluation. Topic areas to
be considered for this session include:
- Perception system performance evaluation and metrics
- Stereo sensor evaluation and metrics
- 3D range sensor evaluation
- Performance evaluation and metrics for object recognition, obstacle
detection, terrain classification, landmark recognition, road detection
and tracking, etc
- Developing and applying perception techniques to aid in the evaluation
of autonomous system performance
- Exploring existing perception efforts in applying performance metrics
for autonomous systems
IMPORTANT DATES
June 14, 2004: Submissions due
June 20, 2004: Acceptance/rejection
August 5, 2004: Final papers due
Back to top
|
