220 likes | 511 Views
Using support vector machines for time series prediction and product quality control. Uwe Thissen Department of Analytical Chemistry. University of Nijmegen. Regression. Reaction vessel. Composition o f copolymer. Raman. Copolymerisation. Time series prediction:. (Auto)regression.
E N D
Using support vector machines for time series prediction and product quality control Uwe Thissen Department of Analytical Chemistry University of Nijmegen
Regression Reaction vessel Composition of copolymer Raman Copolymerisation • Time series prediction: (Auto)regression AutoRegressive Moving Average Models (ARMA) Time Applications • Product quality control: Partial least Squares (PLS)
f(x) i x Ordinary Least Squares (OLS) • Solution:
Solution: f(x) + • Constraints: 0 - x Support Vector Regression (SVR)
Minimise: f(x) + 0 • Constraints: - * x Support Vector Regression (SVR)
Target Constraints Lagrange Optimisation
Resulting Regression • Regression: • Properties: • Sparseness • Dimension of input is irrelevant • Global and unique • Nonlinear extension
f(x) f(x) + + 0 0 - - x (x) Nonlinear Regression
Linear: • Nonlinear: • General: Regression Formulas
Kernel Types • Linear: • Polynomial: • Radial basis function: • Exponential RBF:
CH3 (BA-MMA)n + H2C CH COCH2CH2CH2CH3 H2C C COCH3 MMA BA O O 1 Fraction MMA in polymer 0 1 Fraction MMA in solution Copolymerisation (TU Eindhoven)
Conclusion: Copolymerisation • Copolymerisation • SVMs outperform PLS • Low resolution Raman spectra can be used • Optimisation • PLS: very fast (1 parameter) • SVM: relatively slow (3 parameters)
Filtration System P0 P1 Filter Pressure (Teijin Twaron) • ΔP as a measure of product quality
Time Series Training Set2 Time Series 1 Time Series 2
Conclusion: Filter Pressure • Filter pressure • SVM outperforms ARMA • Prediction 2.5 hours in advance • Optimisation • ARMA: very fast (2 parameters) • SVM: relatively slow (3 parameters)
Usability Of SV Regression • Performance in industrial applications • SVMs are useful candidates • Lower prediction errors • Usage of low resolution data • Optimisation • PLS, ARMA are fast • SVM is relatively slow
Acknowledgements Head of Department:Prof. Dr. L. Buydens Supervisor:Dr. W. Melssen Students: R. van Brakel, B. Üstün Partners:M. Pepers (University of Eindhoven, NL) Dr. T. de Weijer (Teijin Twaron, Arnhem, NL) Funds: Dutch Technology Foundation (STW)