Threadwell

Recent Notes

  • DemetriSpanos

    Oct 06, 2026

    • archive
    • twitter
    • demetrispanos
  • NOTimothyLottes

    Oct 06, 2026

    • archive
    • twitter
    • notimothylottes
  • bonzajplc

    Oct 06, 2026

    • archive
    • twitter
    • bonzajplc
Home

❯

Archive

❯

Threads

❯

fchollet

❯

True -- deep learning folks even redefined "normalization" (of vectors) to mean "standardization", instead of the actual definition of "make it unit-norm"...

❯

@fchollet Yes, but LayerStand just doesn't have the same ring as LayerNorm

@fchollet Yes, but LayerStand just doesn't have the same ring as LayerNorm

Properties5
typearchive
sourcetwitter
date2023-02-20
tagsarchive, twitter, fchollet
description@fchollet Yes, but LayerStand just doesn't have the same ring as LayerNorm

Feb 20, 20231 min read

  • archive
  • twitter
  • fchollet

Source

  • URL: https://x.com/KevinIndrebo/status/1627819579530702848
  • Author: Kevin Indrebo (@KevinIndrebo)
  • Posted: 2023-02-20 23:56:45

Branch

1/ @KevinIndrebo

@fchollet

Yes, but LayerStand just doesn’t have the same ring as LayerNorm

Related

  • Spine: 2023-02-20-true-deep-learning-folks-even-redefined

Graph View

  • Source
  • Branch
  • Related

Backlinks

  • True -- deep learning folks even redefined "normalization" (of vectors) to mean "standardization", instead of the actual definition of "make it unit-norm"...

Created with Quartz v5.0.0 © 2026

  • GitHub