Welcome to STAT 894: The Elements of Statistical Learning

Prof. Prem Goel

   Office: 204C Cockins Hall
   Tel.: 292-8110
   E-mail: Prem Goel
   OFFICE HOURS: Tues, Thur 2:00PM-3:30PM, or BY APPOINTMENT.

 

RECENT ANNOUNCEMENTS:

1) Presentation Slides for are now posted on this site.

2) The project presentations and Final Report are due by Noon, Monday, June 6, by so that I can post them in time for presentations on Tuesday, June 7th, 9:30AM-11:30AM.

COURSE INFORMATION:

SYLLABUS

READING MATERIAL:

    1) ERRATA for 4th Printing of the text by Hastie, Tibshirani and Friedman

    2) Dawning of the age of Stochasticity, By David Mumford

    3) Model Assessment via Cross Validation: Hold-Out Vs. Leave-One-Out, By D. Hawkins et al

    4) Recursive Partitioning and Simulated Annealing, By Verducci et al

    5) Models and metrics for handwriten digit recognition, By T. Hastie and P. Simard

LECTURE SLIDES:

    1) Intro to Data Mining and Statisical Learning

    2) Supervised Learning Overview

    3) Linear Regression Methods

    4) Linear Classication Rules

    5) Basis Expansions and Regularization

    6) Kernel Methods for Local Smoothing

    7) Model Assessment and Selection

    8) Support Vector Machines and Flexible Discriminant Analysis

    9) Additive Models, RP Trees and PRIM

    10) MARS and HME

    11) Boosting Methods and Learning Ensembles

    12) Prototype Methods and Nearest Neighbors

    13) Cluster Analysis

PROJECTS RELATED INFO:

    1) LINKS FOR MACHINE LEARNING DATA BASES and SOFTWARE CODE SOURCES

    2) Project-Preliminary Report (EXAMPLE 1)

    3) Project-Preliminary Report (EXAMPLE 2)

    4) Project-Preliminary Report (EXAMPLE 3)

    5) Project-Preliminary Report (EXAMPLE 4)

    6) Classification for Functional Data(Presentation-Example 1)

    7) Character Recognition(Presentation-Example 2)

    8) Credit Card Approval(Presentation-Example 3)

    9) Statistical Learning for DNA(Presentation-Example 4)

    10) Diabetes Among Pima Indian Women(Presentation-Example 5)

    11) Subspace Methods in Face Recognition(Presentation-Example 6)

    12) Final Report-Example 1

    13) Final Report-Example 2

    14) Final Report-Example 3

    15) Final Report-Example 4

    16) Final Report-Example 5

SPRING 05 PROJECTS PRESENTATION

    1) Project 1 Presentation By Roxana Alexanderidis

    2) Project 2 Presentation By Zhuojun Jiang

    3) Project 3 Presentation By Victor Guerroro and Bernhard Renard

    4) Project 4 Presentation By Chao Wang and Shang Zhao

    5) Project 5 Presentation By David Wheeler and Brady Brady

    6) Project 6 Presentation By Yan Xu and Xiuyun Zhang

    7) Project 7 Presentation By Youding Zhu