Wednesday, October 31, 2007

Common and Special Causes

From 1703 until his death in 1705, Jacob Bernoulli exchanged a number of letters with Gottfried Leibniz. Leibniz wrote to him:

"La nature a sans doute ses habitudes, provenant du retour des causes, mais ce n'est que la plupart du temps. C'est pourquoi, ne peut-on pas objecter qu'une nouvelle expérience puisse s'écarter un tant soit peu de la loi de toutes les précédentes, du fait de la variabilité même des choses ? De nouvelles maladies se répandent souvent sur le genre humain et par conséquent quelque soit le nombre de morts dont vous avez fait l'expérience ce n'est pas pour autant que vous avez établi les limites des choses de la nature au point qu'elle ne puisse en varier dans le futur."

"Nature has established patterns originating in the return of events but only for the most part. Therefore, can't we argue that a new experience could deviate from the law of all the previous ones, even a little bit, because of the very essence of variability of things ? New illnesses often flood the human race, so that no matter how many experiments you have done, you have not thereby established a limit on the nature of events so that in the future they could not vary."


Later, John Maynard Keynes directly refers to Leibniz in his essay on "Probability in relation to the theory of knowledge". According to a Cambridge Journal's article, "Keynes's Treatise on Probability contains some quite unusual concepts, such as non-numerical probabilities and the ‘weights of the arguments’ that support probability judgements. Their controversial interpretation gave rise to a huge literature about ‘what Keynes really did mean’, also because Keynes's later views in macroeconomics ultimately rest on his ideas on uncertainty and expectations formation". But what Keynes really means was just what he once told clearly:

"By uncertain knowledge … I do not mean merely to distinguish what is known for certain from what is only probable. The game of roulette is not subject, in this sense, to uncertainty ...

The sense in which I am using the term is that in which the prospect of a European war is uncertain, or the price of copper and the rate of interest twenty years hence, or the obsolescence of a new invention … About these matters there is no scientific basis on which to form any calculable probability whatever. We simply do not know!"

At the same time, during the 1920s, Walter A. Shewhart, statistician and engineer, was commissioned to improve the quality of telephones manufactured by Bell Laboratories.

Shewhart framed the problem in terms of Common and Special-Causes of variation. Though Shewhart may not have been the first to reveal this concept, he is the first who has established an operational mean to distinguish between the two: on May 16, 1924, he wrote an internal memo introducing Statistical Process Control with a Control Chart as a tool for Continuous Process Improvment.

Quality Gamebox


Quality Gamebox 2.0 is a collection of simulations and experiments that is both entertaining and educational. Each game demonstrates and explains classic concepts that are useful in quality management and SPC. Quality Gamebox uses colorful graphics, animation, and sound to enhance the learning experience.


Deming’s red bead experiment demonstrates the theory of variation while his funnel experiment shows the effects of tampering. John McConnell’s dice experiment illustrates the benefits of reducing variation. The central limit theorem shows the effect of sampling, and the quincunx explains the normal curve.



Quality Gamebox is useful for training staff members, consultants, or anyone who wants to illustrate basic statistical concepts.

Sunday, October 21, 2007

Really undestanding Statistical Process Control (SPC)

1°) Shewhart's original rule of statistical process control is:


"Variation from common-cause systems should be left to chance, but special causes of variation should be identified and eliminated."


So SPC indicates when an action should be taken in a process, but it also indicates when NO action should be taken. An example is a person who would like to maintain a constant body weight and takes weight measurements weekly. A person who does not understand SPC concepts might start dieting every time his or her weight increased, or eat more every time his or her weight decreased. This type of action could be harmful and possibly generate even more variation in body weight. SPC would account for normal weight variation and better indicate when the person is in fact gaining or losing weight.

2°) The rule should not be misinterpreted as meaning that variation from common causes should be ignored. Rather, common-cause variation is explored "off-line." That is, we look for long-term process improvements to address common-cause variation.

3°) A controlled process isn't necessarily a sign of good management, nor is an out-of-control process necessarily producing non-conforming product.

Statistical Process Control (SPC)

Walter A. Shewhart defined control as follows:

"A phenomenon will be said to be controlled when, through the use of past experience, we can predict, at least within limits, how the phenomenon may be expected to vary in the future. Here it is understood that prediction within limits means that we can state, at least approximately, the probability that the observed phenomenon will fall within the given limits."

This definition means that control is not equivalent to a complete absence of variation but rather that the system is in a state where variation is predictable within some fixed limit.

Shewhart also realized that frequent process-adjustment in reaction to non-conformance actually increased variation and degraded quality. That's why he expressed the fundamental rule of statistical process control in this way:

"Variation from common-cause systems should be left to chance, but special causes of variation should be identified and eliminated."



Without Statistical Process Control guidance, there could be endless debate over whether special or common causes were to blame for variability. This is crucial as the type of action needed to reduce the variability in each case are of a different nature.

Six Sigma

"Six Sigma" is associated to Motorola. Six Sigma deviates from the original rules of the founder of Statistical Process Control Walter A. Shewhart.

SPC Book - Statistical Process Control: The Deming Paradigm and Beyond


While the common practice of Quality Assurance aims to prevent bad units from being shipped beyond some allowable proportion, statistical process control (SPC) ensures that bad units are not created in the first place. Its philosophy of continuous quality improvement, to a great extent responsible for the success of Japanese manufacturing, is rooted in a paradigm as process-oriented as physics, yet produces a friendly and fulfilling work environment. The first edition of this groundbreaking text showed that the SPC paradigm of W. Edwards Deming was not at all the same as the Quality Control paradigm that has dominated American manufacturing since World War II. Statistical Process Control: The Deming Paradigm and Beyond, Second Edition reveals even more of Deming’s philosophy and provides more techniques for use at the managerial level. Explaining that CEOs and service industries need SPC at least as much as production managers, it offers precise methods and guidelines for their use. Using the practical experience of the authors working both in America and Europe, this book shows how SPC can be implemented in a variety of settings, from health care to manufacturing. It also provides you with the necessary technical background through mathematical and statistical appendices. According to the authors, companies with managers who have adopted the philosophy of statistical process control tend to survive. Those with managers who do not are likely to fail. In which group will your company be?

SPC Book - Statistical Method from the Viewpoint of Quality Control by Walter A. Shewhart


Nearly all of the books about Statistical Process Control are quite awful. They contain errors, poor examples, and promote bad practices. Except for a few that may still exist, there is only one book one can recommend for sure: it's "Statistical Method from the Viewpoint of Quality Control" by Walter A. Shewhart, the original founder of Industrial Quality Management.

For superficial readers and students in statistics, this book could be easily misunderstood as an other book on Probability Calculations whereas it does fundamentally deal with the Epistemology of Probability and Mathematics in the Real World of Manufacturing and Science.

The current publisher's description on Amazon doesn't say much. It's better to read the original publisher's description of the book in the 1920s:

The application of statistical methods in mass production makes possible the most efficient use of raw materials and manufacturing processes, economical production, and the highest standards of quality for manufactured goods. In this classic volume, based on a series of ground-breaking lectures given to the Graduate School of the Department of Agriculture in 1938, Dr Shewhart illuminates the fundamental principles and techniques basic to the efficient use of statistical method in attaining statistical control, establishing tolerance limits, presenting data, and specifying accuracy and precision.

In the first chapter, devoted to statistical control, the author broadly defines the three steps in quality control: specification, production and inspection; he then outlines the historical background of quality control. This is followed by a rigorous discussion of the physical and mathematical states of statistical control, statistical control as an operation, the significance of statistical control and the future of statistics in mass production.

Chapter II offers a thought-provoking treatment of the problem of establishing limits of variability, including the meaning of tolerance limits, establishing tolerance limits in the simplest cases and in practical cases, and standard methods of measuring. Chapter III explores the presentation of measurements of physical properties and constants. Among the topics considered are measurements presented as original data, characteristics of original data, summarizing original data (both by symmetric functions and by Chebyshev's theorem), measurement presented as meaningful predictions, and measurement presented as knowledge.

Finally, Dr Shewhart deals with the problem of specifying accuracy and precision - the meaning of accuracy and precision, operational meaning, verifiable procedures, minimum quantity of evidence needed for forming a judgment and more.

In this book Shewhart asks:-

What can statistical practice, and science in general, learn from the experience of industrial quality control?

He wrote in this book:-

The definition of random in terms of a physical operation is notoriously without effect on the mathematical operations of statistical theory because so far as these mathematical operations are concerned random is purely and simply an undefined term. The formal and abstract mathematical theory has an independent and sometimes lonely existence of its own. But when an undefined mathematical term such as random is given a definite operational meaning in physical terms, it takes on empirical and practical significance. Every mathematical theorem involving this mathematically undefined concept can then be given the following predictive form: If you do so and so, then such and such will happen.

Statistical Process Control Softwares

SPC for MS Excel:

SPC for MS Excel
is used to generate and easily update SPC charts and to perform other statistical functions from Microsoft Excel spreadsheets. This affordable software is easy to learn and easy to use and fits the needs of the SPC novice or SPC expert. It is the premier Excel-based SPC program. We have reached this position by listening to what our users say they need. This product has been used around the world for more than a decade. Countries include the United States, Canada, Mexico, United Kingdom, Ireland, Spain, Greece, Hong Kong, Turkey, Indonesia, and Vietnam. It is a key part of many manufacturing and service organizations process improvement efforts.