View with dynamic parameters

[matscalia]

is it possible to get the view of a tensor specifying offset and count at inference time without a considerable refactoring or generating a new graph?

[ggerganov]

You can always get a view to a tensor using the ggml_view_xd() functions.