koomen@CS.ROCHESTER.EDU (04/14/88)
> Canadian Pacific developed an expert system to analyze oil samples > form a diesel locomotive. [...] A mechanic decided to disregard the > recommendations of the system causing a $250,000 failure. A dangerous bias. What about the times that the disregard was correct, or the acceptance incorrect? If we do not allow for mistakes on the part of the human operator, the "recommendations" will no longer be recommendations but injunctions. And then where does that leave us? Without further particulars about the case, the following comment would have done equally well: "However, the system explained its reasons for a recommendation so poorly that a mechanic decided to disregard it, causing a $250,000 failure." -- Hans EMail: Koomen@CS.Rochester.Edu Paper: Johannes A. G. M. Koomen Dept. of Computer Science Phone: (716) 275-9499 [work] University of Rochester (716) 442-4836 [home] Rochester, NY 14627