J.Wexler@edinburgh.ac.uk (08/29/90)
I asked for recommendations of interesting books a little while back. I got a number of specific suggestions plus two large lists. I will spare you the lists, but here are the individual nominations. More titles would still be welcome. John Disclaimer: comments about the books are from the contributors to the list. I pass them on for information only. ________________________________________________________________________ Hockney, R. W., and C.R. Jesshope., Parallel Computer: 2 Architecture, Programming, and Algorithms, 2nd ed. Pennsylvania, IOP Publishing Ltd., 1988. ISBN 0-85274-811-6 (World's most expensive paperback; matched only by Hockney's book on particle simulations; both worth the price.) Hwang, Kai and Faye A. Briggs., Computer Architecture and Parallel Processing, New York, McGraw-Hill Book Company, 1984. ISBN 0-07-031556-6 ________________________________________________________________________ A series which is worth considering is John Wiley's Series in Parallel Computing: Carey(ed): Parallel Supercomputing: Methods, Algorithms and Applications de Bakker(ed): Languages for Parallel Architectures: Design, Semantics, Implementation Models Axford, T., Concurrent Programming: Fundamental Techniques for Real- Time and Parallel Software Design, Wiley, 1989. ISBN 0 471 92303 6 Fundamentals of Concurrent Programming, by Axford (more about software techniques for concurrency than about parallel programming, but still useful [greg's comment]). Gelenbe: Multiprocessor Performance Treleaven (ed): Parallel Computers: Object-oriented, Functional and Logic. ________________________________________________________________________ I have been working through parts of the following book with a student and have found it very nice (especially in the theoretical complexity coverage): Lakshmivarahan S., and Dhall, S.K. Analysis and Design of Parallel Algorithms: Algebra and Matrix Problems. McGraw Hill. 1990. A bit away from the transputer. I would be interested in what you put together from this request. ________________________________________________________________________ I have always found the book by Quinn "Designing efficient algorithms for parallel computers" to be useful and interesting. In fact, I usually take it with me when I cross the world (still having ties in SA). My other gem is "Synchonisation of parallel programs" by Andre, Herman and Verjus, translated from the French. In a slim volume, they capture the history, essence and application of all the current synchronisation techniques and implement these in Ada. The example of the swimming pool is very good! ________________________________________________________________________ I suggest a book of a different flavour to many which will doubtless be on display: Gibbons, A., and W. Rytter, Efficient Parallel Algorithms, Cambridge, 1988. ISBN 0-521-34585-5. (Stress symbolic processing) ________________________________________________________________________ You ought to know that there is now a book by Dennis Parkinson & John Litt (editors) entitled "Massively Parallel Computing with the DAP" (Pitman, London, 1990 ISBN 0-273-08809-2). ________________________________________________________________________ Bertsekas's book on parallel computing is very good for O.R. applications: Bertsekas, D. P., and J. N. Tsitsiklis, Parallel and Distributed Computation, Prentice Hall, 1989. ISBN 0-13-648700-9 ________________________________________________________________________ Highly Parallel Computing, by Almasi and Gottleib and, of course, Topham and Ibbett's book on high-performance architectures. ________________________________________________________________________ I reckon that Pitman's series of Research Monographs in Parallel and Distributed Computing are a must. Titles include: "Massively Parallel computing on the DAP" "Execution models of Prolog on Parallel Computers" "Functional Programming for Loosely-coupled Microprocessors" "Partitioning and scheduling programs for multiprocessor execution" "Optimizing supercompilers for supercomputers" "Languages and compilers for parallel machines" etc. They are in the main modified theses. Note that these titles are from memory and are vague, nor do they include the whole series. ________________________________________________________________________________ Concurrent Programming ed. Narain Gehani & Andrew D McGettrick Adison-Wesley, 1988 ISBN 0-201-17435-9 Parallel Program Design K Mani Chandy & Jayadev Misra Adison-Wesley 1988 ISBN 0-201-05866-9 Communication and Concurrency Robin Milner Prentice Hall 1989 ISBN 0-13-114984-9 & 0-13-115007-3 Communicating Sequential Processes C A R Hoare Prentice-Hall 1985 ISBN 0-13-153271-5 & 0-13-153289-8 Programming in occam 2 Geraint Jones & Michael Goldsmith Prentice-Hall 1988 ISBN 0-13-730334-3 Concurrent Programming in occam 2 John Wexler Ellis Horwood 1989 ISBN 0-7458-0394-6 Concurrency and Programming Languages David M Harland Ellis Horwood 1986 ISBN 0-85312-846-4 Concurrent Programming for Software Engineers Dick Whiddett Ellis Horwood 1987 ISBN 0-7458-0036-X Strand: New Concepts in Parallel Programming Ian Foster and Stephen Taylor Prentice Hall, 1989, ISBN 13-850587-X Parallel Logic Programming Techniques Stephen Taylor Prentice Hall, 1989, ISBN 13-648767-X Systems Programming in Parallel Logic Languages Ian Foster Prentice Hall, 1989, ISBN 13-880774-4 Parallel Programming R.H. Perrott Addison Wesley ISBN 0201 14231 7 Inside the Transputer D. A. P. Mitchell, J. A. Thompson, G. A. Manson, G. R. Brookes Blackwell Scientific Publications (1990) ISBN 0 632 01689 2, UK Price L14.95 ________________________________________________________________________
J.Wexler@edinburgh.ac.uk (09/10/90)
Thanks for all the suggestions for interesting books which people sent in response to my enquiry a few weeks back. I've had a few more suggestions since I last posted a compendium, but now the trickle of new offerings has dried up, so it's time to present the final list. This is NOT a full bibliography - there are a couple of large booklists accessible via e-mail elsewhere. This is just a list of books which people have nominated as being useful/interesting/relevant. Comments about the individual books are not mine. No criticism or commented is intended about books which don't appear. New suggestions are still welcome. John Wexler _______________________________________________________________________________ Almasi and Gottleib Highly Parallel Computing Andre, Herman and Verjus, Synchonisation of parallel programs translated from the French - A gem. - In a slim volume, they capture the history, essence and application of all the - current synchronisation techniques and implement these in Ada. The example of - the swimming pool is very good! Axford, T. Concurrent Programming: Fundamental Techniques for Real-Time and Parallel Software Design John Wiley's Series in Parallel Computing, 1989 ISBN 0 471 92303 6 - more about software techniques for concurrency than about parallel - programming, but still useful. Bertsekas, D. P., and J. N. Tsitsiklis Parallel and Distributed Computation Prentice Hall, 1989 ISBN 0-13-648700-9 - Very good for O.R. applications. Bowler, K. C., R. D. Kennway, G. S. Pawley, and D. Roweth, An introduction to occam 2 programming Chartwell-Bratt Carey(ed) Parallel Supercomputing: Methods, Algorithms and Applications John Wiley's Series in Parallel Computing K Mani Chandy & Jayadev Misra Parallel Program Design Adison-Wesley 1988 ISBN 0-201-05866-9 de Bakker(ed) Languages for Parallel Architectures: Design, Semantics, Implementation Models John Wiley's Series in Parallel Computing Ian Foster Systems Programming in Parallel Logic Languages Prentice Hall, 1989, ISBN 13-880774-4 Ian Foster and Stephen Taylor Strand: New Concepts in Parallel Programming Prentice Hall, 1989, ISBN 13-850587-X Fox,G., M.Johnson, G.Lyzenga, S.Otto, J.Salmon, and D.Walker, Solving Problems on Concurrent Processors, Vol. I: General Techniques and Regular Problems [Volume 2 exists, and is also recommended, but I have no details.] Prentice Hall, 1988 ISBN 13-823022-6 (HB), 13-823469-8 (PB) - My Bible of Distributed Parallel Computing; even if you are not using Express - it is a wonderful book to have ! Narain Gehani & Andrew D McGettrick( eds.) Concurrent Programming Adison-Wesley, 1988 ISBN 0-201-17435-9 Gelenbe Multiprocessor Performance Gibbons, A., and W. Rytter Efficient Parallel Algorithms Cambridge, 1988 ISBN 0-521-34585-5 - A book of a different flavour to many which will doubtless be on display. - Stress symbolic processing. David M Harland Concurrency and Programming Languages Ellis Horwood 1986 ISBN 0-85312-846-4 J.L. Hennessy and D.A. Patterson Computer Architecture --- A Quantative Approach Morgan Kaufman Publishers Inc., San Mateo, CA. ISBN 1-55880-069-8 - is an excellent book. Don't know if it's out here yet. Hockney, R. W., and C.R. Jesshope. Parallel Computer: 2 Architecture, Programming, and Algorithms, 2nd ed. IOP Publishing Ltd., Pennsylvania, 1988 ISBN 0-85274-811-6 - World's most expensive paperback; matched only by Hockney's book on particle - simulations; both worth the price. C A R Hoare Communicating Sequential Processes Prentice-Hall 1985 ISBN 0-13-153271-5 & 0-13-153289-8 Hwang, Kai and Faye A. Briggs. Computer Architecture and Parallel Processing McGraw-Hill Book Company, New York, 1984 ISBN 0-07-031556-6 Ibbett and Topham The Architecture of High Performance Computers (2 volumes) Macmillan Geraint Jones & Michael Goldsmith Programming in occam 2 Prentice-Hall 1988 ISBN 0-13-730334-3 Lakshmivarahan S., and Dhall, S.K Analysis and Design of Parallel Algorithms: Algebra and Matrix Problems McGraw Hill, 1990 - I have been working through parts of this book with a student and have found - it very nice (especially in the theoretical complexity coverage). - A bit away from the transputer. Robin Milner Communication and Concurrency Prentice Hall 1989 ISBN 0-13-114984-9 & 0-13-115007-3 D. A. P. Mitchell, J. A. Thompson, G. A. Manson, G. R. Brookes Inside the Transputer Blackwell Scientific Publications (1990) ISBN 0 632 01689 2, UK Price L14.95 Modi, J. J. Parallel Algorithms and Matrix Computation Oxford (Applied Mathematics and Computing Science Series), 1988 ISBN 0-19-859655-3 (HB), 0-19-859670-7 (PB) R.H. Perrott Parallel Programming Addison Wesley ISBN 0201 14231 7 Dennis Parkinson & John Litt (editors) Massively Parallel Computing with the DAP Pitman, London, 1990 ISBN 0-273-08809-2 Quinn Designing efficient algorithms for parallel computers - I have always found this book to be useful and interesting. Reed, Daniel A. and Richard M. Fujimoto., Multicomputer Networks: Message-based parallel processing, Massachusetts, MIT Press, 1987. ISBN 0-262-18129-0 - A great book covering practical aspects of programming multiprocessors. - It has some very nice (very practical) studies of programming on message-based - multiprocessors. Stephen Taylor Parallel Logic Programming Techniques Prentice Hall, 1989, ISBN 13-648767-X Treleaven (ed) Parallel Computers: Object-oriented, Functional and Logic. John Wexler Concurrent Programming in occam 2 Ellis Horwood 1989 ISBN 0-7458-0394-6 Dick Whiddett Concurrent Programming for Software Engineers Ellis Horwood 1987 ISBN 0-7458-0036-X ________________________________________________________________________ Pitman's series of Research Monographs in Parallel and Distributed Computing are a must. Titles include: "Massively Parallel computing on the DAP" "Execution models of Prolog on Parallel Computers" "Functional Programming for Loosely-coupled Microprocessors" "Partitioning and scheduling programs for multiprocessor execution" "Optimizing supercompilers for supercomputers" "Languages and compilers for parallel machines" etc. They are in the main modified theses. Note that these titles are from memory and are vague, nor do they include the whole series. ________________________________________________________________________________