Online Learning Round
The essential sequence is not training examples followed by test examples. It is instance, prediction, correct label, and support for future predictions, repeated over consecutive rounds.
The Timing Challenge
Imagine a learner that must make a decision before knowing whether the decision is correct. The learner predicts first, receives the true answer afterward, and uses that answer to improve later decisions. This timing pattern is the central idea of online learning.
Online learning has no separate training phase followed by a separate prediction phase. Instead, prediction and learning are interwoven across a sequence of consecutive learning rounds.
The Four Events
An online learning round follows a fixed timing pattern. First, an instance is presented. Second, the learner must make a prediction about that instance. Third, the correct label is revealed. Fourth, the learner uses that label to support predictions in later rounds. The learner therefore acts before receiving feedback, not after it.
A Papaya Decision
A learner must decide whether a current papaya has the target taste before knowing the correct answer.
- 1Receive the instance
The current papaya is the instance for this round.
- 2Make a prediction
The learner predicts the papaya's label before obtaining the correct label.
- 3Obtain the correct label
The true answer is revealed after the prediction.
- 4Support later predictions
The labeled papaya can now contribute to the learner's future predictions.
One round combines a prediction event with a later learning event rather than placing them in separate phases.
From Test to Training
The same example has two roles at different moments in the round. Before its correct label is known, it tests what the learner currently predicts. After the correct label is obtained, that example can serve as training information for future predictions. The role changes because the learner has moved from making a prediction to receiving feedback.
Suppose a learner predicts the label of a papaya before tasting it. At that moment, the papaya tests the learner's current prediction. Once the papaya is tasted and its correct label is available, the same papaya becomes labeled information that can support later predictions.
A Chain of Rounds
Online learning does not stop after one prediction and one label. The round ends with information that can support a later prediction, and the next round begins with another instance. Repeating this pattern creates consecutive rounds in which each round combines prediction with learning for the rounds that follow.
The essential sequence is not training examples followed by test examples. It is instance, prediction, correct label, and support for future predictions, repeated over consecutive rounds.
Online Learning and PAC Learning
The main difference is the schedule of events. In the PAC learning model, the learner first receives a batch of training examples, learns a hypothesis from that batch, and then applies the learned hypothesis to new examples. Online learning instead processes examples through consecutive rounds, requiring a prediction before the correct label for the current instance is available.
| Feature | PAC learning | Online learning |
|---|---|---|
| Training timing | A batch of training examples comes first | Learning information becomes available after each round's label |
| Prediction timing | Predictions are made after learning from the batch | The learner predicts the current instance before its correct label is known |
| Organization | A training stage followed by a prediction stage | Consecutive rounds that combine prediction and learning |
| Example role | The batch is used for training before new examples are predicted | The current example first tests the prediction and then can support future predictions |
The distinction is about when examples, predictions, labels, and learning occur.
Mistakes About the Schedule
Common mistake Treating online learning as a separate training phase followed by a separate prediction phase.
What it looks likeThe learner trains completely first and only afterward begins making predictions.
Why it failsOnline learning interweaves prediction and learning across consecutive rounds.
Do this insteadPlace the prediction before the current correct label, then use that label to support later predictions.
Common mistake Assuming the correct label is available before the prediction.
What it looks likeThe learner sees the answer and then decides what the instance should be labeled.
Why it failsThe online round requires a prediction before the correct label is revealed.
Do this insteadKeep the order as instance, prediction, correct label, and support for future predictions.
Common mistake Calling an example only a test example or only a training example.
What it looks likeThe example cannot have a testing role because it eventually becomes labeled training information.
Why it failsIn online learning, the same example first tests the current prediction and later contributes to future predictions after its label is obtained.
Do this insteadTrack the example's role over time: test before feedback, training after feedback.
Common mistake Describing PAC learning and online learning as having the same schedule.
What it looks likeA batch of training examples is used in exactly the same way as one current online instance.
Why it failsPAC learning begins with a batch and then applies the learned hypothesis to new examples, whereas online learning processes examples through consecutive rounds.
Do this insteadCompare the timing of training, prediction, and feedback rather than only comparing the names of the models.
Check the Sequence
A learner receives one current instance, predicts its label, receives the correct label, and then uses the labeled instance when making a prediction about the next instance. Explain which event makes the current instance a test example, which event lets it serve as training information, and whether this schedule matches online learning or the PAC learning model.
Hints
- Identify what the learner knows at the moment of prediction.
- Look for the point at which the correct label becomes available.
- PAC learning begins with a batch of training examples, while online learning repeats prediction and later feedback across rounds.
What do you think happens?
A current example has just been predicted, but its correct label has not yet been revealed. Is it already training information for future predictions?
Reveal answer
No, it first serves as a test example; it can support future predictions after its correct label is obtained
The example tests the learner's current prediction before feedback. Once the correct label is available, the example can contribute to future predictions.
Round by Round
- 1Online learning is organized as a sequence of consecutive learning rounds.
- 2Each round presents an instance, requires a prediction, reveals the correct label, and uses that label to support future predictions.
- 3An example first tests the learner's current prediction and then becomes training information after its correct label is obtained.
- 4PAC learning separates a batch-based training stage from a later prediction stage, while online learning interweaves prediction and learning.
Key Takeaways
- Online learning has no separate training phase followed by a separate prediction phase.
- An online learning round proceeds from instance to prediction to correct label to support for future predictions.
- The same example can move from a test role to a training role once its label is known.
- PAC learning starts with a batch of training examples, whereas online learning processes examples through consecutive rounds.