Provide bigger NDBuffers (and interface).

[Zripzri]

When targeting Vulkan, the size of a single buffer is often limited by maxMemoryAllocationSize and maxBufferSize to much less than the physical memory (most commonly ca. 2GB or 4GB, see vulkaninfo) .
It appears to me that NDBuffer is currently bound by the same limits.
It would be very convenient if either NDBuffer would internally lift this limit (probably by using multiple allocations) or if slangpy could provide an alternative container with an interface like NDBuffer that is not bound by the limit. The first option could be problematic since there may be implications to performance and memory continuity (although a guarantee to use a single buffer if possible and compiler optimizations in this special case may take care of that).

In particular if multiple different NDBuffer-like types are provided (but also in general), I would also appreciate an interface for get / set similar to ITensor and IRWTensor but without the differentiability constraint.

[szihs]

The limit comes from the Vulkan buffer size limit. However, I assume that we could address more than 2GB of contiguous memory through pointers. We just currently don't expose ways to allocate raw VRAM.

Posting reply from skallweitNV