Measurement
Measurements can be taken from just about any part of a system.
They fall into three categories:
Given information, such as model parameters, inputs, targets, etc.
Intermediate information, a.k.a. calculations, such as pre-activations, activations, derivatives, loss, gradients, etc.
Analytical information, a.k.a. calculations on calculations, such as