For tasks where direct verification is difficult, training loss can provide an early signal that correlates with downstream evaluation performance.
Training loss predicts evaluation performance
A practical evaluation signal for non-verifiable tasks.
A practical evaluation signal for non-verifiable tasks.
For tasks where direct verification is difficult, training loss can provide an early signal that correlates with downstream evaluation performance.