On the Use of Permutation Tests in the Significance Testing of Response Surface Function Parameters
DOI:
https://doi.org/10.15678/AOC.2020.2202Keywords:
design of experiments, permutation tests, response surface function, model significanceAbstract
Objective: The methods of experimental design were first used in agricultural experiments performed by R. A. Fisher. The development of experimental design methods took place along with their effective use in production companies. The most frequently used designs of experiments are the factorial designs. One of the stages in the factorial design of experiments is the estimation of the response surface function formula which describes the influence of factors on the response variable values. The aim of this article is to propose a method to indicate the factors which have a significant influence on the response variable.
Research Design & Methods: In this case, in the classical approach, the t-test of the significance of particular parameters of the response surface function is used. The t-test requires fulfilment of the assumptions about the distribution and independence of the model errors. If the assumptions are not fulfilled, or the sample size is not sufficient, the use of the t-test is unjustified. An alternative approach to verify the significance of response surface parameters is a permutation test. Permutation tests use simulation methods and do not entail the fulfilment of strict assumptions relating to the distribution of errors and the sample size of experimental data.
Findings: The paper deals with the use of a permutation test that allows us to assess the significance of response surface function parameters when the quantity of experimental data is small. These results were obtained using parametric tests and permutation tests.
Implications/Recommendations: Based on the performed calculations, it was found that it is possible to use permutation tests to analyse the response surface function, especially when the assumptions about the residuals of the model are not fulfilled or the number of considered experimental trials is small.
Contribution: A proper analysis of the response surface function is an important stage in the design of experiments. In the case of a small quantity of experimental data, assessment of the significance of the model and the parameters of the response surface function using parametric tests may lead to incorrect conclusions. Therefore, the use of permutation tests was indicated as an alternative approach in the analysis of the response surface function.
References
Aczel, A. (2000) Statystyka w zarządzaniu. Warszawa: Wydawnictwo Naukowe PWN.
Berry, K. J., Johnston, J. E. and Mielke Jr., P. W. (2014) A Chronicle of Permutation Statistical Methods. New York: Springer International Publishing.
Elandt, R. (1964) Statystyka matematyczna w zastosowaniu do doświadczalnictwa rolniczego. Warszawa: Państwowe Wydawnictwo Naukowe.
Good, P. (2005) Permutation, Parametric and Bootstrap Tests of Hypotheses. New York: Springer Science Business Media.
Kończak, G. (2007) Metody statystyczne w sterowaniu jakością produkcji, Katowice: Wydawnictwo Akademii Ekonomicznej w Katowicach.
Kończak, G. (2012) “On Testing the Significance of the Coefficients in the Multiple Regression Analysis”. Acta Universitatis Lodziensis. Folia Oeconomica 269: 61–71.
Kończak, G. (2016) Testy permutacyjne. Teoria i zastosowania., Katowice: Wydawnictwo Uniwersytetu Ekonomicznego w Katowicach.
Montgomery, D. C. (1997) Introduction to Statistical Quality Control, New York: John Wiley & Sons.
Montgomery, D. C. (2001) Design and Analysis of Experiments. New York: John Wiley & Sons.
O’Gorman, T. W. (2012) Adaptive Tests of Significance Using Permutations of Residuals with R and SAS. New Jersey: John Wiley and Sons.
Wawrzynek, J. (1993) Statystyczne planowanie eksperymentów w zagadnieniach regresji w warunkach małej próby, Wrocław: Wydawnictwo Akademii Ekonomicznej we Wrocławiu.
Wawrzynek, J. (2009) Planowanie eksperymentów zorientowane na doskonalenie jakości produktu, Wrocław: Wydawnictwo Uniwersytetu Ekonomicznego we Wrocławiu.
