Assignments

Data, Representations, and Simple Prediction Problems

Works through the fundamental skills of data representation, error measurement, constant prediction rules, and related topics.

Past due

Due Sep 29

Conditional Prediction

Introduces the notion of making predictions using features, how to encode data into useful features, multiple regression, and classification via logistic regression.

Past due

Due Oct 13

Learning with Natural Language

Discusses representations for natural language data, and how to make it amenable to making predictions. Introduces methods like n-gram models, TF-IDF, truncated singular value decomposition and latent semantic analysis, working with larger datasets, and hyperparameters.

Past due

Due Oct 27

How Much Can a Machine Learn?

Two-part assignment. The first introduces more expressive models, via implementing simple neural networks. Also introduces automatic differentiation. The second part studies predicting with little to no labeled data at all using pretrained language models as zero-shot and few-shot predictors. Introduces in-context learning and calibration methods.

Past due

Due Nov 3

AI Measurement

Introduces benchmarks, uncertainty quantification, and deployment-relevant considerations such as distribution shift. The goal of this assignment is to prepare students for real-world deployments of predictors which they can now use.

Past due

Due Nov 17