To my ears, this sounds very similar to what AMD's "Vega" cards provided for high-end compute. The "High Bandwidth Cache Controller" allows datasets outside of the GPU's memory to be accessed in a transparent way.
I can't find a decent technical article at the moment, but here's a link to the "Radeon SSG," a $7k graphics card that ships with 2TB of solid-state storage attached, designed to be used to process absolutely massive datasets as though they were in RAM: https://www.amd.com/en/products/professional-graphics/radeon...
I can't find a decent technical article at the moment, but here's a link to the "Radeon SSG," a $7k graphics card that ships with 2TB of solid-state storage attached, designed to be used to process absolutely massive datasets as though they were in RAM: https://www.amd.com/en/products/professional-graphics/radeon...