A Critique of “An Exploratory Investigation of Programmer Performance Under On-Line and Off-Line Conditions”

Butler Lampson

 

Citation: IEEE Trans. Human Factors in Electronics HFE-8, 1 (Mar. 1967), pp 48-51.

Links: Abstract, Acrobat. Here is an HTML version created by OCR for the benefit of search engines; it is not meant for human consumption.

Email: blampson@microsoft.com. This paper is at http://www.research.microsoft.com.

 

Abstract:

The preceding paper by Grant and Sackman, “An Exploratory Investigation of Programmer Performance Under On-Line and Off-Line Conditions” is discussed critically. Primary emphasis is on this paper’s failure to consider the meaning of the numbers obtained. An understanding of the nature of an on-line system is necessary for proper interpretation of the observed results for debugging time, and the results for computer time are critically dependent on the idiosyncrasies of the system on which the work was done. Lack of attention to these matters cannot be compensated for by any amount of statistical analysis. Furthermore, many of the conclusions drawn and suggestions made are too vague to be useful.