MLX streams for asynchronous execution — mlx_new_stream • Rmlx

Streams provide independent execution queues on a device, allowing overlap of computation and finer control over scheduling.

mlx_default_stream() returns the current default stream for a device.

Usage

mlx_new_stream(device = mlx_default_device())

mlx_default_stream(device = mlx_default_device())

Arguments

device: Execution target: supply "gpu", "cpu", or an mlx_stream created via mlx_new_stream(). Defaults to the current mlx_default_device() unless noted otherwise (helpers that act on an existing array typically reuse that array's device or stream).

Value

An object of class mlx_stream.

See also

https://ml-explore.github.io/mlx/build/html/usage/using_streams.html

Examples

stream <- mlx_new_stream()
stream
#> mlx stream [gpu] index=2