A new post on Apple’s Machine Learning Research blog shows how much the M5 improved over the M4 when it comes to running a local LLM.

Apple's notebooks, desktops, and workstations are well-suited for running local AI systems. The key to this is the MLX software.

The best kind of follow-up article isn’t one that clarifies a topic that someone got wrong (although I do love that, especially when that “someone” isn’t me); it’s one that provides more context to a ...

Apple’s machine learning research team has quietly introduced and released a new machine learning framework called MLX, designed to optimize the development of machine learning models on Apple Silicon ...

The MLX framework was released on GitHub amid the generative AI storm. While mostly staying out of the generative AI competition, Apple has released an open source array framework on GitHub for ...

When I try to build the latest mlx main branch via: env CMAKE_BUILD_PARALLEL_LEVEL="" pip install -U . I get: Processing /Users/oori/medical_llm/mlx Installing build ...