[comp.graphics] Image metrics

adrianb@brothers.stat.washington.edu (Adrian Baddeley) (08/19/89)

Since we're all talking about the accuracy of fractal compressions etc.,
are there any good references on the question of 

	measuring the discrepancy between two images?

In practice I've only ever seen this done with an L^p metric, 
e.g.
	- number of pixels that have different values in the two images
	- sum of absolute differences between corresponding pixel values
	- root-mean-square "	"	"	"	"	"	"

The mathematics of computed tomography is often done with a Sobolev
metric, somewhat harder to describe, but this is not really appropriate
to the present problem.

Comments?

----
adrianb@castor.ms.washington.edu	(until 21 august 1989)
Adrian Baddeley, visiting Department of Statistics GN-22,
University of Washington, Seattle WA 98195, USA.
	tel (U of W): +1 206 545-2617 / 543-7237 

chucko@saturn.ucsc.edu (Chuck Stein) (08/22/89)

In article <2190@uw-entropy.ms.washington.edu>, adrianb@brothers.stat.washington.edu (Adrian Baddeley) writes:
> Since we're all talking about the accuracy of fractal compressions etc.,
> are there any good references on the question of 
> 	measuring the discrepancy between two images?

	Well, you asked for it.  Here is a REFER formated bibliography
I've collected that deals with image quality, image fidelity, subjective
rating (scaling) testing, psychophysical testing, and other related
materials.  The 1st reference I found today, and is itself a bibliography
dealing with image (quality & fidelity) evaluation.  Much of the previous
rating scale testing has been aimed at television image quality.
	My own work has involved psychophysical testing to rate various
image compression techniques (last reference) and Master's thesis (almost
done).
	An image fidelity metric must take into account the purpose of
the reconstruction.  Is it for use by humans, machines, ????.

	Chuck Stein  {chucko@saturn.ucsc.edu}

p.s. The bibliography is in no particular order.
-------------------------------------------------------------------------

%A Frederick J. Kolb
%T Bibliography: Psychophysics of image evaluation
%J SMPTE Journal
%V 98
%N 8
%P 594-599
%D Aug. 1989

%A Susan A. Werness
%T Statistical Evaluation of Predictive Data Compression Systems
%J IEEE Trans. on Acoustics, Speech, and Signal Proc.
%V ASSP-35
%N 8
%P 1190 - 1198
%D Aug. 1987
%L Werness,'87
%K statistics, data compression, image compression, coding

%A Hans Marmolin
%T Subjective MSE Measures
%J IEEE Trans. on Systems, Man, & Cybernetics
%V SMC-16
%P 486-489
%I IEEE
%D June, 1986
%K MSE, measures

%A Howard Silver
%A Shi-Kuo Chang
%T Picture Information Measures
%J Policy and Information
%V 10
%N 1
%P 1-16
%D June, 1986
%K information measures

%A Edward M. Granger
%T A summary measure of image quality
%J ??
%P 340-347
%K measures, image quality

%A A. B. Watson
%T Efficiency of a model human image code
%J J. Opt. Soc. of Am.
%V 4
%N 12
%P 2401
%D Dec. 1987
%K image compression, perceptually lossless, vision, quantization, cortex
transform, psychophysical testing technique

%A James L. Mannos
%A David J. Sakrison
%T The Effects of a Visual Fidelity Criterion on the Encoding of Images
%J IEEE Trans. Info. Theory
%V IT-20
%N 4
%P 525-536
%D July, 1974
%K fidelity, image coding, distortion, measures


%A King N. Ngan
%A Kin S. Leong
%A Harcharan Singh
%T Cosine transform coding incorporating human visual system model
%J SPIE - Visual Comm. & Image Proc.
%V 707
%P 165-171
%D 1986
%K cosine transform, hvs, image compression, coding

%A Norman B. Nill
%T A Visual Model Weighted Cosine Transform for Image Compression and Quality Assessment
%J IEEE Trans. on Comm.
%V COM-33
%N 6
%P 551-557
%D June 1985
%K cosine transform, hvs, image compression, quality, coding

%A Piere Mertz
%A A. D. Fowler
%A H. N. Christopher
%T Quality Rating of Television Images
%J Proc. IRE
%V 38
%P 1269-1283
%D Nov. 1950
%K quality rating psychophysical testing television

%A David J. Sakrison
%T On the Role of the Observer and a Distortion Measure in Image Transmission
%J IEEE Trans. on Comm.
%V COM-25
%N 11
%P 1251-1267
%D Nov. 1977
%K distortion measure, coding, psychophysical testing, image transmission

%A Thomas G. Stockham, Jr.
%T Image Processing in the Context of a Visual Model
%J Proc. IEEE
%V 60
%N 7
%P 828-842
%D July 1972
%K distortion, coding, visual model

%A Zigmantas L. Budrikis
%T Visual Fidelity Criterion and Modeling
%J Proc. IEEE
%V 60
%N 7
%P 771-779
%D July 1972
%K fidelity, visual model, coding

%A R. W. Cohen
%A I. Gorog
%T Visual Capacity - An Image Quality Descriptor for Display Evaluation
%J Proc. SID
%V 15
%N 2
%P 53-62
%D 1974
%K quality, visual model

%A John R. Parsons
%A Andrew G. Tescher
%T An Investigation of MSE Contributions in Transform Image Coding Schemes
%J SPIE
%V 66
%P 196-206
%D 1975
%K MSE, coding, distortion measure, quality, fidelity

%A John O. Limb
%T Visual Perception Applied to the Encoding of Pictures
%J SPIE
%V 87
%P 80-87
%D 1976
%K coding, visual model, distortion

%A John O. Limb
%T Distortion Criteria of the Human Observer
%J IEEE Trans. on Sys., Man, & Cybernetics
%V SMC-9
%N 12
%P 778-793
%D Dec. 1979
%K distortion, fidelity, visual model

%A Charles F. Hall
%T The Application of Human Visual System Models to Digital Color Image Compression
%J SPIE
%V 594
%P 21-28
%D 1985
%K visual model, coding, distortion, fidelity

%A Ian Overington
%T Some important observations concerning human visual coding
%J SPIE
%V 594
%P 158-167
%D 1985
%K visual model

%A Douglas J. Granrath
%T The Role of Human Visual Models in Image Processing
%J Proc. IEEE
%V 69
%N 5
%P 552-561
%D May 1981
%K visual model, coding, quality, coding, enhancement

%A Frank X. J. Lukas
%A Zigmantas L. Budrikis
%T Picture Quality Prediction Based on a Visual Model
%J IEEE Trans. on Comm.
%V COM-30
%N 7
%P 1679-1692
%D July 1982
%K quality, fidelity, visual model, coding

%A V. Ralph Algazi
%T The psycho-physics of vision and their relation to picture quality and coding limitations
%J Acta Electronica
%V 19
%N 3
%P 225-232
%D 1976
%K psychophysics, coding, quality, fidelity, visual model, distortion

%A Sakuichi Ohtsuka
%A Masayuki Inoue
%A Kazuhisa Watanabe
%T Quality Evaluation on Pictures with Multiple Impairments Based on Visually Weighted Error
%J NTT Human Interface Labs. techical report
%C Kanagawa, Japan
%D 1987
%K quality, fidelity, visual model

%A Charles E. Dean
%T Measurements of the Subjective Effects of Interference in Television Reception
%J Proc. IRE
%P 1035-1049
%D 1960
%K fidelity, quality, psychophysical testing, television

%A R. D. Prosser
%A J. W. Allnatt
%A N. W. Lewis
%T Quality grading of impaired television pictures
%J Proc. IEE
%V 111
%N 3
%P 491-502
%D March 1964
%K quality, television, testing

%A Gordon L. Fredendall
%A William L. Behrend
%T Picture Quality - Procedures for Evaluating Subjective Effects of Interference
%J Proc. IRE
%P 1030-1033
%D June 1960
%K quality, television, testing

%A Curtis R. Carlson
%A Roger W. Cohen
%T Visibility of Displayed Information
%I Office of Naval Research
%C Arlington, VA
%V PRRL-78-CR-34
%D 1977
%K modulation transfer, displays, visual perception, quality, fidelity, contrast detection, JND

%A A. B. Watson
%A D. G. Pelli
%T QUEST: a Bayesian adaptive psychometric method
%J Perceptual Psychophysics
%V 33
%P 113-120
%D 1983
%K psychophysical testing

%A John Allnatt
%T Transmitted-picture Assessment
%I John Wiley & Sons
%C New York, NY
%D 1983
%K quality, fidelity, television

%A CCIR %T Recommendation 500-2: Method for the Subjective Assessment of the Quality of Television Pictures
%J Recommendations and Reports of the CCIR; XVth Plenary Assembly, Geneva
%V XI-Part I
%P 165-168
%D 1982
%K Subjective tests, television, fidelity, quality

%A Bronwen L. Jones
%A Pamela R. McManus
%T Graphic Scaling of Qualitative Terms
%J SMPTE Journal
%P 1166-1171
%D Nov. 1986

%A Jacques A.J. Roufs
%A Huib de Ridder
%A Joyce H.D.M. Westerink
%T Perceptual image quality metrics
%J Proc. of Optical Soc. Am. Applied Vision Meeting, San Francisco, CA
%D July, 1989

%A CCITT
%T Quality comparison of visual telephone pictures
%J Annex 3 of Report of the working party on visual telphone pictures
%C ITU, Geneva
%V COM XV
%D 1972

%A Charles S. Stein
%A Andrew B. Watson
%A Lewis E. Hitchner
%T Psychophysical rating of image compression techniques
%J SPIE Proceedings
%V 1077
%D Jan. 1989