paul@rta.oz.au (Paul Tazzyman) (05/08/91)
This article follows on from the more general discussion earlier this year about validation and verification of knowledge. This discussion has tended to discuss the technical aspects of V&V whereas the question we are faced with relates to the legal defendability of decisions reached as a result of applying an expert system to a problem and the establishment, in legal terms, of the "expertness" of the knowledge base. In cases where the knowledge is used in a system which is subject to public scrutiny, and consequently subject to scrutiny by the courts when the eventual output of KB systems is implemented, the heuristics may be challenged by other "experts". The issue that this raises is "how is the source of the knowledge used by a KB system given expert status by a court charged with hearing legal challenges to decisions based on the KB system". Under most legal systems the "expert" must satisfy the court that they are in fact suitably qualified in the topic. In the case of a KB system the heuristics may be the result of many "experts" input to the system and therefore there is no single "expert" who can be produced to give expert evidence. This implies that the knowledge gathering process must first establish, and document, the sources of the knowledge and be able to establish, in sufficient clarity for the courts, the development of the KB system's rulebase. Presumably the courts have reasonably well established guidelines for the admission of "expert" witnesses and the qualification of such witnesses. How is a witness given "expert" status and how must the documentation of the knowledge acquisition phase of an expert system be undertaken in order to allow the system to withstand legal challenge to the decisions based on its inferences. Obviously differences between the legal systems in the US and Australia will produce differing opinion, but because of the infant nature of the technology, from the legal aspect, any decision will be cited as a precedent. A discussion of these issues within this forum will help us, and no doubt other organisations, establish more correct procedures. --------------------------------------------------------------- shaung@xwdev.rta.pandc.oz.au paul@xwdev.rta.pandc.oz.au Roads and Traffic Authority of NSW Information Services Branch 3rd Floor, 260 Elizabeth Street SURRY HILLS. NSW. Australia 2010 postmaster - Shaun Gray -----------------------------------------------------------------