Orchard

Every Apple needs an Orchard.

Local inference on Apple Silicon. The engine underneath Proxy. Run multiple models at once on your Mac.

Download Proxy

Requires macOS 15+

Read the Docs

Local First

  • Multiple models, at the same time
  • Structured output, multimodal, streaming
  • Custom kernels and inference engine built for Apple Silicon

Open Source

Python SDK
Rust SDK