1 repo

Apple Silicon Accelerators — Deployment Targets

We curate 1 GitHub repository matching deployment targets · Apple Silicon Accelerators. Refine with filters or upvote what's useful.

Apple Silicon Accelerators — Deployment Targets

We'll search the best matching repositories with AI.
  • vllm-project/vllm

    vllm-project/vllm

    70,745GitHub

    vLLM is a high-throughput inference engine designed for the efficient serving and execution of large language models. It functions as a production-ready distributed model server, providing standard API protocols for online serving while also supporting offline batch processing. The system is built to maximize token gen

    Pythonamdblackwellcuda