JavaScript’s garbage collector is not very ready for machine learning
The problem When using node-mlx for training LLM, the RAM was quickly exhausted. After some profiling, it turned out that MLX’s tensors (mx.array) were too slow to be garbage collected before runni…
Read more »