Skip to content

Splitting data into data batches #24

@arunoruto

Description

@arunoruto

Currently, the particle_interaction function implemented on GPU is taking the whole dataset. This can lead to out of memory errors, especially on GPUs with less VRAM. To mitigate this problem, the data should be batched into smaller chunks before processing!

This should be addressed by calculating the needed and available memory on the GPU. Dividing these two values gives a lower bound on the number of batches to divide the dataset into.

Metadata

Metadata

Labels

bugSomething isn't workingenhancementNew feature or request

Type

No type

Projects

Status

In Progress

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions