@NOTimothyLottes One thing I know about multi-gpu is that tinygrad (the ai training framework he is building) want to use peer-to-peer gpu communication on consumer hardware (rtx 4090 and rx 7900 xtx), but it is only enabled on enterprise hw, so he made his own driver to support it on consumer hw

Source

• URL: https://x.com/alifahrri2/status/1880525767303713050
• Author: Fahri Ali Rahman (@alifahrri2)
• Posted: 2025-01-18 08:00:56

Branch

1/ @alifahrri2

@NOTimothyLottes

One thing I know about multi-gpu is that tinygrad (the ai training framework he is building) want to use peer-to-peer gpu communication on consumer hardware (rtx 4090 and rx 7900 xtx), but it is only enabled on enterprise hw, so he made his own driver to support it on consumer hw

2/ @NOTimothyLottes

@alifahrri2

Consumer PCs certainly are soft-crippled there using the CPU as an intermediate stop on the perf tax train when going device to/from GPU. SteamDeck was page fault limited (soft-cripped) on initial load from SSD for example. These seem like good things to actually fix.

3/ @NOTimothyLottes

@alifahrri2

Meaning likely had AMD actually worked with Hotz, the fruits of that would probably be useful outside AI too. So our loss.

Related

• Spine: 2025-01-18-good-landmine-to-step-on-amd-vs-hotz