Schedule
Schedule as of “Last modified” date at bottom. Subject to change.
Assignments are due by class time (12pm) on their due date.
| Week | Dates | Topic | Slides/Tutorials | Reading | Assignments |
|---|---|---|---|---|---|
| 1 | Jan 21 | Introduction and overview | Abney, Ch. 1 | ||
| 2 | Jan 26 | Self-training and co-training | Abney, Ch. 2 | ||
| Jan 28 | NLP tasks; Applications of self-training and co-training | Abney, Ch. 3 • Collins and Singer 1999 • Mihalcea 2004 | |||
| 3 | Feb 2 | Supervised learning; linear regression | Ng lecture 1 • Ng lecture 2 | Abney 4 • Ng: Supervised Learning, pp 1-15 | |
| Feb 4 | Logistic regression, GLMs | Ng Lecture 3 • Ng Lecture 4 | Ng: Supervised Learning, pp 16-30 | ||
| 4 | Feb 9 | Boundary-oriented methods: preliminaries | Ng Lecture 6 (starting at 44:00) • Ng Lecture 7 | Abney, Ch. 5 • Ng: SVMs | |
| Feb 11 | continued | Project ideas | |||
| 5 | Feb 16 | Boundary-oriented methods [Presenter: Leif] | Ng Lecture 8 • Chih-Jen Lin, SVM Tutorial | Abney, Ch. 6 • Collins and Duffy 2002 • Hsu et al. 2008 | |
| Feb 18 | continued; also, 3-minute project pitches | ||||
| 6 | Feb 23 | Clustering [Presenter: Dylan] | Ng Lecture 12 (up to 18:00) | Abney, Ch. 7 • Ng: K-means | |
| Feb 25 | continued | Schulte im Walde (2006) | Project proposal | ||
| 7 | Mar 2 | Generative models (GDA, NB, Gaussian mixtures) [Presenter: Josh] | Ng Lecture 5 •Ng Lecture 6 (up to 44:00) | Abney 8.1 • Ng: Generative Algorithms • Ng: Gaussian mixtures | |
| Mar 4 | continued | ||||
| 8 | Mar 9 | Expectation maximization [Presenter: Mike] | Ng Lecture 12 (starting at 18:00) •Ng lecture 13 | Abney 8.2 • Ng: The EM Algorithm | |
| Mar 11 | Catch-up time • Project discussions | ||||
| * | Mar 16,18 | Spring Break | |||
| 9 | Mar 23 | Bayesian models | IPAM Summer School 2007 | Griffiths and Yuille 2006 • Levy lecture notes, Chapter 4 (Chapter 3 of the version currently available online) • Goldwater 2006, Chapter 2 | |
| Mar 25 | continued | ||||
| 10 | Mar 30 | Topic models [Presenter: Carissa] | David Blei at Google | Steyvers and Griffiths 2006, Blei and Lafferty 2009 (see also Blei, Ng, and Jordan 2003) | |
| Apr 1 | continued | ||||
| 11 | Apr 6 | Applications of hierarchical Bayesian methods: word segmentation | Goldwater at MLCS 2007 | Goldwater et al (2009) | |
| Apr 8 | Dirichlet Processes | Yee Whye Teh tutorial on Dirichlet Processes • Michael Jordan at ICML 05 | Navarro et al 2006 | Project progress report | |
| 12 | Apr 13 | Agreement constraints in cotraining | Abney 9 | ||
| Apr 15 | Agreement-based cotraining for POS tagging [Presenter: German] | Clark et al 2003 | |||
| 13 | Apr 20 | Propagation methods | Abney 10 | ||
| Apr 22 | continued | Baluja et al 2008 | |||
| 14 | Apr 27 | Spectral methods [Presenter: Joey] | Abney 11, 12 | ||
| Apr 29 | Continued | ||||
| 15 | May 4 | Project Presentations | |||
| May 6 | Project Presentations | ||||
| Finals | May 13 | Project paper |