Source
- URL: https://x.com/fchollet/status/1627816100972068866
- Author: François Chollet (@fchollet)
- Posted: 2023-02-20 23:42:56
Thread
1/ @fchollet
True — deep learning folks even redefined “normalization” (of vectors) to mean “standardization”, instead of the actual definition of “make it unit-norm”… which is wild
2/ @fchollet
Even math isn’t safe from semantic takeover
3/ @fchollet
For those who don’t know what I’m talking about: deep learning includes well-known techniques named “batch normalization”, “layer normalization”, “group normalization”, etc. which all refer to standardization rather than normalization.
Branches: 2023-02-20-connormcmk-normalization-is-only-when-it-fits-inside-the, 2023-02-20-MinhaHwang-yes-it-was-indeed-confusing, 2023-02-20-lewisbowes-youve-answered-a-question-ive-had-for-a-while, 2023-02-20-KevinIndrebo-yes-but-layerstand-just-doesnt-have-the-same-ring, 2023-02-21-stealcase-me-trying-to-resist-the-urge-of-invoking-a-book