Welcome to the Advanced Linear Models for Data Science Class 1: Least Squares. This class is an introduction to least squares from a linear algebraic and mathematical perspective. Before beginning the class make sure that you have the following:
- A basic understanding of linear algebra and multivariate calculus.
- A basic understanding of statistics and regression models.
- At least a little familiarity with proof based mathematics.
- Basic knowledge of the R programming language.
After taking this course, students will have a firm foundation in a linear algebraic treatment of regression modeling. This will greatly augment applied data scientists' general understanding of regression models.
Background We cover some basic matrix algebra results that we will need throughout the class. This includes some basic vector derivatives. In addition, we cover some some basic uses of matrices to create summary statistics from data. This includes calculating and subtracting means from observations (centering) as well as calculating the variance.
One and two parameter regression In this module, we cover the basics of regression through the origin and linear regression. Regression through the origin is an interesting case, as one can build up all of multivariate regression with it.
Linear regression In this lecture, we focus on linear regression, the most standard technique for investigating unconfounded linear relationships.
General least squares We now move on to general least squares where an arbitrary full rank design matrix is fit to a vector outcome.
Least squares examples Here we give some canonical examples of linear models to relate them to techniques that you may already be using.
Bases and residuals Here we give a very useful kind of linear model, that is decomposing a signal into a basis expansion.
MOOCs stand for Massive Open Online Courses. These arefree online courses from universities around the world (eg. StanfordHarvardMIT) offered to anyone with an internet connection.
How do I register?
To register for a course, click on "Go to Class" button on the course page. This will take you to the providers website where you can register for the course.
How do these MOOCs or free online courses work?
MOOCs are designed for an online audience, teaching primarily through short (5-20 min.) pre recorded video lectures, that you watch on weekly schedule when convenient for you. They also have student discussion forums, homework/assignments, and online quizzes or exams.
Gaetano Paganicompleted this course, spending 4 hours a week on it and found the course difficulty to be medium.
Really nice course. Everything was explained clearly through linear algebra topic. Of course there are some pre-requisites that are essential for understanding the course. Also the R coding examples were really interesting. Dr. Brian Caffo has made a great job!!!