neal@CS.BUFFALO.EDU (Jeannette Neal) (01/10/91)
CALL FOR PARTICIPATION
Workshop on Evaluation of Natural Language Processing Systems
18 June 1991
University of California
Berkeley, CA
There has been increased concern with the evaluation of natural
language processing (NLP) systems over the past few years.
The evaluation of NLP systems is essential in order to measure
the capabilities of individual systems, to measure technical progress
and growth in the field, and to provide a basis for selecting NLP
systems to best fit the communication requirements of application
domain systems. This 1991 Workshop is a follow on to the workshop
on evaluation held in December of 1988 at the Wayne Hotel in Wayne, PA.
Technical report RADC-TR-89-302 on the previous workshop is available
from Rome Laboratory.
Important issues for any evaluation effort and relevant to this workshop
include identification of the items or capabilities to be evaluated, choosing
between "black box" and "glass box" approaches, definition of evaluation
criteria, development of methods or procedures for evaluation, determination
of evaluation metrics, and determination of the type of output to be produced
by the evaluation procedures. The areas of NLP relevant for this workshop
include syntactic analysis, semantic analyisis, pragmatic analysis, lexical
processing, morphology, sharable knowledge bases and ontologies, speech
understanding, and trainable systems.
The purpose of this workshop is to provide a forum for computational
linguists to report on and discuss current efforts and activities,
research progress, new approaches, problems and issues; to promote
scientific interchange on important evaluation issues; and to
generate recommendations and directions for future investigations
in the evaluation area.
Workshop attendance will be by invitation, limited to 45 people.
The workshop will be held June 18th at the University of California,
Berkeley Campus, in association with the 29th Annual Meeting of the
Association for Computational Linguistics.
SUBMISSIONS:
Interested participants should submit a 3-5 page abstract of their
presentation and a brief description of their research activities.
Persons desiring to attend the workshop, but not make a presentation,
should send only a brief description of their research activities.
All persons should include name, mailing address, phone number, and
electronic mail address. Submission may be transmitted via electronic
mail, U.S. Postal Service, or FAX. If hardcopy is submitted, please
include six copies (including the original). Send submissions to:
Jeannette G. Neal, Ph.D.
Calspan Corporation
P.O. Box 400, Buffalo, NY 14225
(716) 631-6844
FAX: (716) 631-6722
neal@cs.buffalo.edu
SCHEDULE:
March 1, 1991 Submissions due
April 1, 1991 Notification of acceptance/invitation
ORGANIZATION AND PROGRAM COMMITTEE:
Jeannette G. Neal, Calspan Corporation (Committee Chair)
Tim Finin, Unisys Center for Advanced Information Technology
Ralph Grishman, New York University
Christine Montgomery, Language Systems, Inc.
Sharon Walter, Rome Laboratory
SUPPORT for this workshop is provided by Rome Laboratory.bacha@lynx.cat.syr.edu (Hamid Bacha) (02/13/91)
INVITATION TO ATTEND...
ICON '91
The Annual Conference of the Association for Intelligent Systems Technology
--------------
Welcome to ICON '91, the Annual Conference of the Association for Intelli-
gent Systems Technology, Inc. (AIST). The Conference provides a unique
forum for the exchange of information pertaining to Issues in Developing
Knowledge Based Systems. We will share lessons learned, communicate bene-
fits produced, and promote transferable technologies in the pursuit of
economic and scientific advancement.
The technical sessions include presenters with interests in energy,
manufacturing, finance, large scale expert systems, government applica-
tions, and novel concepts. We have added a special poster session on
energy applications where close interaction with the presenters can facili-
tate the exchange of information and better understanding.
The program is highlighted by three prominent speakers:
Dr. Karl Stahlkopf Dr. Larry Harris Dr. Robert Hoffman
Electric Power Research Institute AICorp Adelphi University
A number of leading companies and consultants will demonstrate some of the
latest concepts with exhibits covering a range of AI applications.
- Charles Saylor
1991 Conference Chair
--------------------
SCHEDULE OF EVENTS...
TUTORIALS I & II
Monday, March 11, 8:30 - 11:30
Chair: Dr. Richard Fenzl
Lunch - 11:30
Tutorial registrants will be provided with lunch immediately
following the last session at 11:30 am. (cost of lunch included
in the Tutorial fee).
The Tutorials for ICON '91 address topics very relevant to current interest
in the practical applications of AI. The targeted audience in both ses-
sions includes managers and technical professionals with responsibilities
for the evaluation or deployment of intelligent systems technology.
----------------------------------------------------------------------
Tutorial I:
"Neural Networks: An Introduction"
Dr. Paul DuBose
Vice President for Advanced Technology
Neuralware, Inc.
Neural networks are introduced, with consideration for conceptual basis as
well as means of implementation. Comparisons are made with other technolo-
gies such as expert systems and statistics. Emphasis is placed on identi-
fying where neural networks can be successfully applied. Examples in
technical and financial areas will be discussed. The tutorial will con-
clude with an assessment of future directions for neural network technology
and its applications.
---------------------------------
Tutorial II:
"The Management Process for Large Scale Intelligent System Development"
Mr. Fred Miller Ms. Rose Paradis Mr. J. Kevin Whalen
Advisory Programmer/Analyst Staff Programmer Knowledge Engineer
Intelligent Systems Support Group Intelligent Systems Support Group
IBM Information Systems IBM Corporation
E. Fishkill, NY Endicott, NY
Problems unique to the development of large expert systems can include one
or more of the following: the involvement of more than one domain expert;
requirements for integration with databases and other conventional systems;
feasibility analysis involving a new technology, and the need to evaluate
and organize an overwhelming quantity of information.
This tutorial will outline a management process developed by the IBM Intel-
ligent Systems Support Group that takes into account issues encountered in
many large system undertakings plus those introduced by expert system
technology. Key points associated with past successes and failures during
project development will be identified.
-----------------------------------
PLENARY SESSION
MONDAY, MARCH 11, 1:15 - 4:30
Chair: Dr. Mohan Tanniru
12:30 REGISTRATION
1:15 - 2:00 KEYNOTE ADDRESS
Dr. Karl Stahlkopf
Director of Safety & Reliability
Electric Power Research Institute
2:00 - 4:30 PANEL DISCUSSION
"Verification and Validation
of Expert Systems"
Chair: Mr. Mark Fausett
PANELISTS
Dr. Kirstie Bellman
Aerospace Corporation
Mr. Chris Culbert
NASA, Johnson Space Center
Dr. Lance Miller
SAIC, McLean Virginia
Dr. Ted Linden
NASA, Johnson Space Center
EXHIBITS
The AIST exhibition will be held in conjunction with the AIST Conference.
The exhibition provides a forum for the dissemination and exchange of
technical information about AI technology and research. Conference atten-
dees have the opportunity to observe the vendor's displays and demonstra-
tions providing exposure to state-of-the-art technology.
Exhibitors include AI software and hardware vendors, research educators,
consultants, firms from the energy industry, and defense contractors.
The exhibit area will be open to conference registrants, non-registrants,
and guests.
---------------------
POSTER SESSION
MONDAY, MARCH 11, 4:30 - 6:30
Chair: Ray DeLuke
In conjunction with the regular conference program, a special poster ses-
sion will be held that focuses on energy industry applications. Selected
participants will discuss and/or demonstrate systems employing expert sys-
tems techniques applied to the energy domain.
Interest by natural resource managers, utilities, and energy consumers in
the use of Artificial Intelligence as a means to help solve problems has
continued to increase in recent years. This interest has spurred further
research and systems development in expert systems and AI. The intent of
this program is to provide a forum to showcase a sample of these results.
The Poster Session is designed to provide an informal yet structured
presentation which can stimulate discussion and encourage prospective use
of expert systems. Each participant will run through a use-scenario of his
expert system using a computer or other audio-visual presentation aides so
that the audience may understand how a working expert system operates. A
one-page "poster" description of each product or application will be
displayed in each participant's poster session area. Copies of these
"posters" will be made available to conference attendees. This format
allows the attendee to see, as well as hear, actual uses of the technology
in the energy field.
The poster session will not be chaperoned, allowing the audience to spend
as much time as desired at the poster session exhibits of most interest to
them. Outlines of the featured Poster Session presentations will also be
made available to attendees.
MONDAY EVENING DINNER ADDRESS
March 11
Dr. Robert Hoffman, Adelphi University
TUESDAY LUNCHEON ADDRESS
March 12
Dr. Larry Harris, Founder, AICORP
TUESDAY MORNING SESSIONS, March 12, 8:30 a.m. - 11:30 a.m.
SESSION #1 ENERGY APPLICATIONS
Chair: Timothy Fink, Consolidated Edison
INDUCTIVE INFERENCE FOR EXTRACTING INFORMATION
FROM HISTORIC DATABASES
James Cook Roy Senn Larry Jones Sid Lipton DeWayne Dill
IITRI Enerlog Systems Inc. Cornell U. Niagara Mohawk Univ. of Illinois
NMFLEET - AN INTELLIGENT TRANSPORTATION DATABASE ASSISTANT
Xiaolin Zhang & Dick Wood Jack Kaplan & Rich Viehdorfer
Syracuse University Niagara Mohawk
USE OF DYNAMIC INTERACTIVE GRAPHIC SIMULATOR
FOR ENERGY APPLICATIONS
Chet Hosmer
IITRI
EMERGING AI APPLICATIONS FOR THE POWER UTILITY INDUSTRY
Alvin Shoop
Expert Systems Consulting Group
------------------
SESSION #2 GOVERNMENT APPLICATIONS
Chair: Kerry Gates, PAR Government Systems Corporation
A BLACKBOARD ARCHITECTURE FOR IDENTIFICATION
OF COMMAND & CONTROL NODES
Stephen Barth, Scott Barrett and Kerry Gates
PAR Government Systems Corporation
IMPLEMENTING AN EXPERT SYSTEM FOR ADAPTIVE RADAR CONTROL
Carol C. Shilepsky Vincent Vannicola
Cornell University RADC
CONTROLLING REQUIREMENTS CREEPIN A RAPID
PROTOTYPING/EVOLUTIONARY ACQUISITION ENVIRONMENT
John Beyerle
CTA Incorporated
EXPERT SERVICES FOR MOBILE DISTRIBUTED
COMMUNICATIONS NETWORKS
Mike Baldwin
GENISYS
---------------
TUESDAY MORNING SESSIONS, March 12, 8:30 a.m. - 11:30 a.m. (con't)
SESSION #3 BANKING AND FINANCE SECTOR APPLICATIONS
Chair: Christine Togni, Mutual of New York
EXPERT SYSTEMS: MAXIMIZING THE CHANCE FOR SUCCESS
Paul Howman
Mutual of New York
KNOWLEDGE BASED SYSTEM APPLICATION INITIATIVE AT UNUM
John Roberts
UNUM
A SURVEY OF EXPERT SYSTEMS IN THE INSURANCE INDUSTRY
Joseph DeSalvo
Coopers & Lybrand
A PROTOTYPE EXPERT SYSTEM FOR LOAN EVALUATION
Susan Brown & Kathy Murphy
Syracuse University
-------------------------
SESSION #4 MANUFACTURING APPLICATIONS
Chair: Charles Higgins, Carrier Corporation - UTC
ISSUES IN EXPERT SYSTEM DEVELOPMENT
IN A MANUFACTURING ORGANIZATION
Scott Cameron
Carrier Corporation - United Technologies
NEURAL NETWORKS IN SALES FORECASTING
&
USING NEURAL NETWORKS FOR READING HARDCOPY CHEMICAL STRUCTURES
Hamid Bacha
International Computer Services
Mohan Tanniru
Syracuse University
KBS APPLICATIONS IN IBM POUGHKEEPSIE MANUFACTURING FACILITY
David Starke
IBM
----------------------
TUESDAY AFTERNOON SESSIONS, March 12, 1:30 p.m. - 4:30 p.m.
SESSION #5 ENERGY APPLICATIONS
Chair: Dr. Walter Meyer, Energy Institute, Syracuse University
SOCCS - A REAL TIME ALARM ANALYZER
Steven Silverman
Consolidated Edison
EXTRACTING INTELLIGENCE FROM ENGINEERING DRAWINGS
Mark Costello
Kaman Sciences Corporation
KBTAC - OUTREACH TO THE UTILITY INDUSTRY
Dr. Walter Meyer
Energy Institute, Syracuse University
INTELLIGENT SUPPORT SYSTEMS FOR TRAINING IN EMERGENCY
OPERATING PROCEDURES
Dr. Paral Pangaro
Pangaro Associates
--------------------------
SESSION #6 NOVEL CONCEPTS AND APPLICATIONS
Chair: Dr. John Lemmer, Knowledge Systems Concepts
A MIXED MODEL APPROACH TO ROTATION IN VARIANT PATTERN
CLASSIFICATION USING NEURAL NETWORKS
Hamid Bacha
International Computer Services
KNOWLEDGE ACQUISITION FOR IS DESIGN - A COMPARISON
OF THREE FRAME - BASED APPROACHES
Mike Nilan
Syracuse University
A C++ BLACKBOARD SYSTEM BUILDING TOOL
Scott Barrett & Stephen Barth
PAR Government Systems Corporation
CONNECTIONIST EXPERT SYSTEM FOR FAULT DETECTION
Y.B. Reddy
Grambling University
Russel Deich
General Dynamics
------------------
TUESDAY AFTERNOON SESSIONS, March 12, 1:30 p.m. - 4:30 p.m. (con't)
SESSION #7 LARGE SCALE EXPERT SYSTEMS DEVELOPMENT
Chair: Mr. James Brule', Coherent Research
A MANAGEMENT PROCESS FOR LARGE SCALE
INTELLIGENT SYSTEM DEVELOPMENT
Rose Paradis & Kevin Whalen
IBM
A MODULE-BASED ARCHITECTURE FOR KNOWLEDGE SYSTEMS
Rajeev Kaula, Leslie Lander & Ojelanke Ngwenyama
SUNY - Binghamton, NY
A COMPARISON OF KNOWLEDGE SYSTEM DEVELOPMENT AND
TRADITIONAL SYSTEM DEVELOPMENT
Wendy Faulkner & Mark Bailey
Mutual of New York
EFFICIENT REASONING IN IMPERATIVE LANGUAGES
Leslie Lander & Kym Horsell
SUNY - Binghamton, NY
----------------------
SESSION #8 EXPERT SYSTEM APPLICATIONS
Chair: Philip Craul, SUNY - Environmental Science & Forestry (ESF)
INTEGRATING AN EXPERT SYSTEM AND A GEOGRAPHIC INFORMATION SYSTEM
Lee Herrington, Don Koten, Craig Davis & Robert Chambers
SUNY - ESF
FIRE SUPPORT SYSTEM FOR FIELD ARTILLERY
John Phillips
Captain, US Army
AVIATION RISK ASSESSMENT SURVEY
Kenneth L. Quaglio
Captain, US Army
KB SUPPORT FOR DESIGNING CONTROLS IN A PURCHASING SYSTEM
Ramu Kannan
Syracuse University
---------------------
Registration Information...
Conference Site
In keeping with its fine tradition of excellence & serviceability, the
Syracuse/Carrier Circle Holiday Inn Atrium & Conference Center has taken a
giant leap to ensure guest satisfaction, featuring over 200 tastefully
decorated guest rooms, 90 seat lounge, 100 seat dining area, indoor pool,
sauna & whirlpool, exercise room, excellent banquet/meeting facilities, a
lounge for dancing or relaxing, and much more. Located at Exit 35 of the
New York State Thruway (I- 90) across from Carrier Corporation, the facil-
ity offers easy access to the City of Syracuse and Interstates I-690/I-81.
The Syracuse Airport is 5 miles from the Hotel and the Carrier Dome is just
6 miles away.
Hotel Accommodations
AIST does not arrange hotel reservations. However, the Syracuse/Carrier
Circle Holiday Inn will hold a limited number of rooms for registrants.
To take advantage of this service, act promptly to be sure of accommoda-
tions. Contact the hotel directly at (315) 437-2761 or 1-800-465-4329 for
reservations, mentioning AIST to assure preferred treatment and special
rates.
Syracuse: The Heart of New York
Syracuse and Central New York offer a wide variety of activities in a beau-
tiful spring setting. It is a short drive to the scenic Thousand Islands
of the St. Lawrence River, the Adirondack Mountains, the Baseball Hall of
Fame, the Finger Lakes Wine Country and Syracuse University, home of the
Carrier Dome.
Getting To Syracuse
Located in the geographic center of New York State, Syracuse is readily
accessible by road, air or rail. Two major interstate highways, the New
York State Thruway (I-90) and I-81, cross at Syracuse. Eleven airlines
offer more than 120 daily flights to and from Hancock International Air-
port, located 5 miles from the Holiday Inn Conference Center. A
hotel/airport shuttle service is available. Amtrak also offers convenient
service to Syracuse.
Travel Arrangements
AIST has selected AAA Travel/Syracuse as the Official Conference Travel
Agency. For special conference discount air fares from your city, contact
Kim Fleming at 1-315-452-2666.
-----------------------------------------------------------
Choose Your Areas of Interest & Register Now for ICON '91
Name:_________________________
Title/Dept:_____________________
Organization:___________________
Address:_______________________
City/State/Zip:_________________
Phone No.: (_____)______________
Registration Fees:
Full Conference Tutorial
Including Conference I or II
Tutorial I or II Only Only
AIST Member $345 $295 $75
Non-Member 395 345 75
F/T Student 75 25 25
-"Full Conference Including Tutorial" includes lunches Monday and Tuesday
plus Monday dinner.
-"Conference Only" includes Monday dinner and Tuesday lunch.
-Student Registration includes Tuesday lunch only.
Return this form & check payable to:
AIST Conference & Exhibition
6310 Fly Road
East Syracuse, NY 13057
Amount Enclosed $
Confirmation and other details sent upon receipt of registration fees.
If you should have any questions, or need additional information, please
contact Christine Togni, AIST Coordinator, at (315) 477-2878.
I plan to attend the following sessions:
Monday: Tutorial I Tutorial II Plenary Session Reception/Dinner
Poster Session
Tuesday AM: Session #1 Session #2 Session #3 Session #4
Tuesday PM: Session #5 Session #6 Session #7 Session #8
==>Early Bird Conference Registration postmarked by February 22, receives
a $5 0.00 discount (not available to student registrants).
==>The non-member conference fee includes a one year membership to AIST.
==>Any organization with more than five registered attendees will pay 1/2
price for all attendees over five.neal@CS.BUFFALO.EDU (Jeannette Neal) (02/19/91)
CALL FOR PARTICIPATION
Workshop on Evaluation of Natural Language Processing Systems
18 June 1991
University of California
Berkeley, CA
There has been increased concern with the evaluation of natural
language processing (NLP) systems over the past few years.
The evaluation of NLP systems is essential in order to measure
the capabilities of individual systems, to measure technical progress
and growth in the field, and to provide a basis for selecting NLP
systems to best fit the communication requirements of application
domain systems. This 1991 Workshop is a follow on to the workshop
on evaluation held in December of 1988 at the Wayne Hotel in Wayne, PA.
Technical report RADC-TR-89-302 on the previous workshop is available
from Rome Laboratory.
Important issues for any evaluation effort and relevant to this workshop
include identification of the items or capabilities to be evaluated, choosing
between "black box" and "glass box" approaches, definition of evaluation
criteria, development of methods or procedures for evaluation, determination
of evaluation metrics, and determination of the type of output to be produced
by the evaluation procedures. The areas of NLP relevant for this workshop
include syntactic analysis, semantic analyisis, pragmatic analysis, lexical
processing, morphology, sharable knowledge bases and ontologies, speech
understanding, and trainable systems.
The purpose of this workshop is to provide a forum for computational
linguists to report on and discuss current efforts and activities,
research progress, new approaches, problems and issues; to promote
scientific interchange on important evaluation issues; and to
generate recommendations and directions for future investigations
in the evaluation area.
Workshop attendance will be by invitation, limited to 45 people.
The workshop will be held June 18th at the University of California,
Berkeley Campus, in association with the 29th Annual Meeting of the
Association for Computational Linguistics.
SUBMISSIONS:
Interested participants should submit a 3-5 page abstract of their
presentation and a brief description of their research activities.
Persons desiring to attend the workshop, but not make a presentation,
should send only a brief description of their research activities.
All persons should include name, mailing address, phone number, and
electronic mail address. Submission may be transmitted via electronic
mail, U.S. Postal Service, or FAX. If hardcopy is submitted, please
include six copies (including the original). Send submissions to:
Jeannette G. Neal, Ph.D.
Calspan Corporation
P.O. Box 400, Buffalo, NY 14225
(716) 631-6844
FAX: (716) 631-6722
neal@cs.buffalo.edu
SCHEDULE:
March 1, 1991 Submissions due (changed from February 1)
April 1, 1991 Notification of acceptance/invitation
ORGANIZATION AND PROGRAM COMMITTEE:
Jeannette G. Neal, Calspan Corporation (Committee Chair)
Tim Finin, Unisys Center for Advanced Information Technology
Ralph Grishman, New York University
Christine Montgomery, Language Systems, Inc.
Sharon Walter, Rome Laboratory
SUPPORT for this workshop is provided by Rome Laboratory.
For Technical Report RADC-TR-89-302, contact:
Sharon Walter
Rome Laboratory
Griffiss AFB, New York 13441-5700
USA
E-mail: walter@aivax.radc.af.mil