This article is like a crapshoot of guesses which ended up being pretty random.

Cerebras can handle weights larger than on-chip memory:

https://www.cerebras.ai/blog/announcing-the-cerebras-archite...