-
The buffer static void ggml_backend_zdnn_buffer_get_tensor(ggml_backend_buffer_t buffer, const ggml_tensor * tensor, void * data, size_t offset, size_t size);
static void ggml_backend_zdnn_buffer_set_tensor(ggml_backend_buffer_t buffer, ggml_tensor * tensor, const void * data, size_t offset, size_t size); Do I have the following understanding correct?
I understand that this was briefly explained here but the wording was not very clear to me. |
Beta Was this translation helpful? Give feedback.
Replies: 1 comment 8 replies
-
llama.cpp/ggml/src/ggml-backend.cpp Lines 1908 to 1918 in c8c4495 If the backend does not store the tensor data in the standard ggml layout, you will need to apply any transformations in |
Beta Was this translation helpful? Give feedback.
get_tensor
andset_tensor
copy data between a user buffer and a backend buffer. If the buffer is stored in the CPU and does not apply any transformations to the tensor data layout, the implementation is simply amemcpy
:llama.cpp/ggml/src/ggml-backend.cpp
Lines 1908 to 1918 in c8c4495