Jan bundles a chat UI, a model hub, and an OpenAI-compatible server on top of a Cortex/llama.cpp engine — Apache 2.0, no account, no telemetry. A hands-on look at where it beats Ollama and LM Studio, where it doesn't, and how to tune it.
Jan
-
Jan: The Open-Source Local LLM Runner Coming for Ollama and LM Studio