Load MLX tensors from the GGUF format

Load MLX tensors from the GGUF format

Usage

mlx_load_gguf(file, device = mlx_default_device())

Arguments

file

Path to a .npy file. The extension is appended automatically when missing.

device

Execution target: supply "gpu", "cpu", or an mlx_stream created via mlx_new_stream(). Defaults to the current mlx_default_device() unless noted otherwise (helpers that act on an existing array typically reuse that array's device or stream).

Value

A list containing:

tensors

Named list of mlx arrays.

metadata

Named list where values are NULL, character vectors, or mlx arrays depending on the GGUF entry type.

See also

https://ml-explore.github.io/mlx/build/html/python/io.html#mlx.core.load_gguf