Empirical Risk Minimization

Before studying machine learning theory and algorithms, you need a reliable starting point. The Getting Started lesson is designed to orient you to how the course works. Its immediate purpose is not to teach a particular tool or command. Instead, it helps you determine where course activities take place, whether anything must be installed, and what successful completion of the first activity looks like.

Read the workflow from left to right. First identify where the course work takes place. Next determine whether the lesson specifies an installation requirement. Then identify what a successful first activity should look like. Only after these checks do you have the known starting point that the lesson is meant to establish.

The course progresses in stages. It begins with Getting Started, moves into foundations of machine learning theory and the statistical learning framework, and then advances toward learning theory, algorithms, and more advanced machine learning topics. Later topics include empirical risk minimization, halfspaces, linear regression, feature representation, computational complexity, learnability, model selection, optimization, neural networks, classification, clustering, and other learning methods.

This organization gives the first lesson a specific role. Getting Started establishes the conditions for learning; it is followed by the technical sequence rather than replacing that sequence. Once the starting checkpoint is complete, the course can move into foundations and then toward the theory, algorithms, and advanced topics that come later.

This concept belongs to the technical part of the course, not to the setup checkpoint itself. The orientation lesson prepares you to reach concepts such as ERM without confusing a course-starting problem with a machine learning problem. The source also notes that the maximum likelihood estimator can be viewed as an ERM for a particular loss function, and that a related regularized principle jointly minimizes empirical loss and a Kullback-Leibler distance term.

The comparison separates evidence from guesswork. A course location and a successful first activity are useful confirmed facts. A particular environment or installation requirement should remain unconfirmed until the lesson specifies it. This distinction prevents you from treating an imagined setup detail as a requirement.