Marvell’s Dave Lazovsky is holding a tiny module that uses photonics to move high-bandwidth memory (HBM + DDR) as far as 50 meters away from the GPU.

this can sit up to 50 meters from a GPU instead of the usual 1.5 mm.

For the first time, memory no longer has to live right next to compute, letting AI clusters share massive capacity without being locked to the accelerator package.

Latency stays in the hundreds of nanoseconds, close enough for practical memory use.
Basically, Memory and compute now scale on separate axes instead of being locked together. https://x.com/MarvellTech/status/2112227641759871266/video/1