TensorBuffers is a data storage format optimized for efficient partial reads from large tensor collections. It is designed to:
- Efficiently handles datasets that exceed system memory
- Enables fast, partial data access without loading entire files
- Integrates seamlessly with cloud storage via HTTP Range Requests
Go to docs