Foundations of Neuroscience for Reinforcement Learning

A useful starting point for reinforcement learning is to treat a neuron as an information pathway with two broad directions.

Programming

A Neuron as an Information Pathway

A useful starting point for reinforcement learning is to treat a neuron as an information pathway with two broad directions. Information arrives through dendrites, while neuronal output leaves through the axon. The cell body, dendrites, and axon are the main structural parts to identify when tracing this pathway.

Where are the dendrites, cell body, and axon located in the direction of information flow?

Following One Action Potential

A neuron's output is not a continuous stream carried as an ordinary substance. It consists of electrical pulses called action potentials, also known as spikes. When a neuron generates one of these spikes, the neuron fires. The action potential then travels along the axon, carrying the neuron's output as an electrical event.

How does a neuron's electrical output move from the cell body along the axon to its targets?

What do you think happens?

A neuron generates an action potential. What is the next part of the pathway to trace?

The action potential travels along the axon
The action potential becomes a continuous substance
The action potential stops immediately

Reveal answer

Answer:

The action potential travels along the axon.

An action potential is an electrical pulse that travels along the axon. This active conduction means the signal is carried forward as an electrical event rather than simply fading away as it moves.

Active Conduction Along the Axon

Worked example

Tracing a Single Output Event

Trace one output event from the moment a neuron fires until the activity approaches its target sites.

1
Generation
The neuron generates an action potential. This is the event described by saying that the neuron fires.
2
Travel
The action potential travels along the axon. The axon carries the neuron's output.
3
Conduction
The signal is carried forward as an electrical event rather than simply fading away as it moves.
4
Arrival path
If the axon divides, the action potential reaches a branch point and can produce action potentials on the outgoing branches.

Result

The neuron's output can move along the axon and continue into outgoing branches when the axon divides.

What Happens at a Branch Point

An axon does not have to remain a single unbroken path. When an action potential reaches a point where the axon divides, it reaches an axonal branch point. At that point, the activity can produce action potentials on the outgoing branches. The branch point therefore lets the neuron's output continue along more than one path.

When an action potential reaches a branch point, how can it continue into different axon branches?

Edge case

Do not describe the branch point as creating a new kind of signal. The source description remains the same: the neuron fires an action potential, that electrical pulse travels along the axon, and at a division it can produce action potentials on the outgoing branches.

The Axonal Arbor

The branching arrangement of an axon is called an axonal arbor. By branching the axon, the arbor allows the neuron's activity to reach many target sites. This is the larger consequence of branch points: one neuron's output can follow multiple outgoing paths instead of remaining confined to one axon segment.

How can one neuron's axon divide into multiple branches and deliver its activity to many target sites?

Key point

The axonal arbor explains how a single neuron's activity can influence many target sites: the axon branches, and activity can continue along the outgoing branches.

Common Misreadings

Common mistake
Treating the axon as the place where information arrives.
What it looks like
The axon receives the neuron's input.
Why it fails
The source describes dendrites as receiving information and the axon as carrying neuronal output.
Do this instead
Trace information arriving through dendrites and output leaving through the axon.
Common mistake
Treating an action potential as a continuous substance.
What it looks like
A stream of material flows down the axon.
Why it fails
The output consists of electrical pulses, also called action potentials or spikes.
Do this instead
Describe the output as an electrical event that travels along the axon.
Common mistake
Assuming that a branch point ends the action potential.
What it looks like
The pulse stops when the axon divides.
Why it fails
At a branch point, the pulse can produce action potentials on the outgoing branches.
Do this instead
Trace the activity into the outgoing branches.
Common mistake
Missing the role of the axonal arbor.
What it looks like
One neuron's output can follow only one route.
Why it fails
The axonal arbor branches the axon so activity can reach many target sites.
Do this instead
Look for the branching structure when explaining how activity reaches multiple sites.

Practice the Trace

MEDIUM

A neuron generates one action potential, and its axon later divides into several branches. Describe the event in order: where information is received, what carries the neuron's output, what travels along the axon, what can happen at the branch point, and why the branching matters.

Hints

Begin with the distinction between dendrites and axon.
Use the terms action potential, electrical pulse, and fires.
At the branch point, explain what can occur on the outgoing branches.
Connect the branches to the many target sites reached by an axonal arbor.

Your attempt (not saved)

Best practice

When reading or explaining a neuron pathway, trace it in this order: dendrites receive information, the neuron fires by generating an action potential, the action potential travels along the axon, and an axonal arbor can carry the activity into multiple branches toward many target sites.

Key Takeaways

1
A typical neuron can be traced through its dendrites, cell body, and axon. Dendrites receive information, while the axon carries neuronal output. That output consists of electrical pulses called action potentials, or spikes. When a neuron generates one, it fires. The action potential travels along the axon, and at an axonal branch point it can produce action potentials on outgoing branches. The resulting axonal arbor allows the neuron's activity to reach many target sites.

At a glance

Dendrites receive information, and the axon carries neuronal output.
An action potential is an electrical pulse, also called a spike, that travels along the axon.
A neuron fires when it generates an action potential.
At an axonal branch point, the activity can produce action potentials on outgoing branches.
An axonal arbor allows one neuron's activity to reach many target sites.

More concepts starting with F