Ring-Zero: Scaling Zero RL to a Trillion Parameters for Emergent Reasoning

When for the training part you have to consider brains had like billions of years to develop. Maybe one of the reasons llms seem to be so expensive to train is because we are "compressing" in far less time that learning part

The human brain is estimated to have approaching 10^11 neurons (most of them in the cerebellum).

However, a neuron is much more than a single parameter. The brain is estimated to have from 10^14 to 5x10^14 synapses.

the active layers concept seems to be experiencing convergent evolution to how synapses in a human function

huge parameter models with many small but efficient layers can work quickly on low resource hardware

similar to how neurons experience chemical spiking to activate small portions of the brain at once