Kernel Methods, Smoothing and Adaptiveness

Week 6: Sep 30 – Oct 4

Weekly Objectives

Previously we introduced KNN, which is a type of local averaging approach. In this week, we will introduce a general formulation for local estimations, defined using the concept of kernel functions. To improve smoothness, we introduce local polynomial.

• Understand the Nadaraya-Watson kernel regression
• kernel weights and their similarities/differences with \(k\)NN
• Difference choices of kernel functions
• Tune \(h\) by understanding the bias-variance trade-off
• Local polynomial regressions
• Use the locpoly() function in KernSmooth package

Lecture Notes and R Examples

• Kernel Regression [Source File]

Additional Readings

• Kernel Density Estimation

Homework

• Homework 6 [Source File]
• Due Oct 10, 11:59PM CT
• Solution