Source

Branch

1/ @onatt0

@NOTimothyLottes

IMO code compilation is inherently sequential+ “execution contextual”, dynamic logic execution to get the binary as the essence vs a static lang

codegen with execution on GPU could work as 2-items(vreg)/stack and 32K cells per lane for AI to map code to data instead of weights?

2/ @NOTimothyLottes

@onatt0

So for x86 I’ve many times written code gen with extra nop-prefix padding to fix all instructions to a multiple of known 32-bits. Which means you know in advance sizing of everything, then you can easily do parallel code generation. So need not necessarily all be serial

3/ @NOTimothyLottes

@onatt0

However I’m often building then instantly using code while generating a baked binary to use later, so that regard much is inherently serially dependent. This bootstrapping technique is perhaps one the great things to learn from things like color forth IMO.