Apple Starflow is open source and requires Python, PyTorch, and a GPU, so you can try research builds and measure speed gains ...
You can apply a Processor to any input stream and easily iterate through its output stream: The concept of Processor provides a common abstraction for Gemini model calls and increasingly complex ...