Abstract
B-splines are attractive for nonparametric modelling, but choosing the optimal number and positions of knots is a complex task. Equidistant knots can be used, but their small and discrete number allows only limited control over smoothness and fit. We propose to use a relatively large number of knots and a difference penalty on coefficients of adjacent B-splines. We show connections to the familiar spline penalty on the integral of the squared second derivative. A short overview of B-splines, of their construction and of penalized likelihood is presented. We discuss properties of penalized B-splines and propose various criteria for the choice of an optimal penalty parameter. Nonparametric logistic regression, density estimation and scatterplot smoothing are used as examples. Some details of the computations are presented.
Keywords
MathematicsSmoothingNonparametric statisticsEquidistantSmoothnessSmoothing splineComputationMathematical optimizationSpline (mechanical)Applied mathematicsNonparametric regressionB-splinePenalty methodAlgorithmStatisticsSpline interpolationMathematical analysisGeometry
Affiliated Institutions
Related Publications
Spline Smoothing: The Equivalent Variable Kernel Method
The spline smoothing approach to nonparametric regression and curve estimation is considered. It is shown that, in a certain sense, spline smoothing corresponds approximately to...
Linear Smoothers and Additive Models
We study linear smoothers and their use in building nonparametric regression models. In the first part of this paper we examine certain aspects of linear smoothers for scatterpl...
Multivariate Adaptive Regression Splines
A new method is presented for flexible regression modeling of high dimensional data. The model takes the form of an expansion in product spline basis functions, where the number...
Simultaneous Regression Shrinkage, Variable Selection, and Supervised Clustering of Predictors with OSCAR
Summary Variable selection can be challenging, particularly in situations with a large number of predictors with possibly high correlations, such as gene expression data. In thi...
Regularization Paths for Generalized Linear Models via Coordinate Descent
We develop fast algorithms for estimation of generalized linear models with convex penalties. The models include linear regression, two-class logistic regression, and multi- nom...
Publication Info
- Year
- 1996
- Type
- article
- Volume
- 11
- Issue
- 2
- Citations
- 3564
- Access
- Closed
External Links
Social Impact
Altmetric
PlumX Metrics
Social media, news, blog, policy document mentions
Citation Metrics
3564
OpenAlex
Cite This
Paul H.C. Eilers,
Brian D. Marx
(1996).
Flexible smoothing with B-splines and penalties.
Statistical Science
, 11
(2)
.
https://doi.org/10.1214/ss/1038425655
Identifiers
- DOI
- 10.1214/ss/1038425655