Threadwell

Recent Notes

DemetriSpanos
Oct 06, 2026
NOTimothyLottes
Oct 06, 2026
bonzajplc
Oct 06, 2026

fchollet

7 items with this tag.

Aug 29, 2026
fchollet
Feb 20, 2023
True -- deep learning folks even redefined "normalization" (of vectors) to mean "standardization", instead of the actual definition of "make it unit-norm"...
Feb 21, 2023
@fchollet Me: *Trying to resist the urge of invoking a book that has become a meme for symbolizing truth being diluted in a dystopian society using a math equation as the primary example, despite it feeling poetically relevant when discussing machines that spew both truth & lies*
Feb 20, 2023
@fchollet Yes, but LayerStand just doesn't have the same ring as LayerNorm
Feb 20, 2023
@fchollet Yes, it was indeed confusing.
Feb 20, 2023
@fchollet normalization is only when it fits inside the range [0,1]?
Feb 20, 2023
@fchollet You've answered a question I've had for a while, thanks

Created with Quartz v5.0.0 © 2026

GitHub