Directory / Local AI

whisper.cpp

Offline speech-to-text for site-walk voice memos and meeting recordings, run on your own machine.

Local AIOpen sourceFree option
Visit site
CategoryLocal AI
PricingFree, open source (MIT)(summary; confirm on vendor site)
Free pathFree; build and run locally, no cloud
Official sitehttps://github.com/ggml-org/whisper.cppLink last checked 2026-10-16

Research notes

How we research

Listed because it fits the Local AI category. Listings are free; sponsored placements, if any, are labeled and never change rankings.

Alternatives

Ollama

Local AI

Run open models locally with one command and a local API.

Free locally; cloud Pro $20/mo ($200/yr), Max $100/mo; Team $500/mo (early access)Free option

LM Studio

Local AI

Desktop app to download and chat with local models (GGUF/MLX).

Free for local models; optional Bionic+ $20/mo, Pro $100/mo (cloud)Free option

llama.cpp

Local AI

C/C++ LLM inference engine behind many local AI apps.

Free, open sourceOpen sourceFree option

MLX

Local AI

Apple's array framework for fast ML on Apple silicon.

Free, open sourceOpen sourceFree option

Open WebUI

Local AI

Self-hosted ChatGPT-style web UI for Ollama and other backends.

Free self-host; enterprise optionsFree option

vLLM

Local AI

High-throughput LLM serving engine for NVIDIA GPU servers.

Free, open sourceOpen sourceFree option

Apple desktop with large unified memory, popular for local LLMs.

Hardware; from $2,499 (M5 Max); M5 Ultra from $5,499

Desktop Grace Blackwell AI system with 128GB unified memory (64GB version coming).

Hardware purchase

Jan

Local AI

Open-source desktop app for running LLMs locally.

Free, open sourceOpen sourceFree option

Desktop app for running local LLMs privately.

Free download; Nomic self-service platform from $20/moFree option

AnythingLLM

Local AI

All-in-one local/self-hosted AI app with RAG and agents.

Desktop free; self-host free; Cloud Basic $50/mo, Pro $99/mo, Enterprise customFree option

LocalAI

Local AI

Open-source, OpenAI-compatible API server for running models locally.

Free, open sourceOpen sourceFree option

Msty

Local AI

Desktop app for local and cloud LLMs.

Free; Aurum $149/user/yr; Aurum Lifetime $349 one-time; Teams contactFree option

Free open-source Mac and Windows (including Windows on Arm) tray app from ggml-org that runs Hugging Face models locally on llama.cpp with an OpenAI-compatible API.

Free, open sourceOpen sourceFree option

Compact Apple Silicon desktop for small local-model setups.

From $899 (Apple Store); configs $1,699 / $1,899

LibreChat

Local AI

Open-source, self-hosted ChatGPT-style platform: one interface for local models (Ollama, LocalAI) and cloud models, with agents, MCP, document search and SSO for a private team chat.

Free, open source (MIT); no paid tiers listedOpen sourceFree option

oMLX

Local AI

Free, open-source MLX model server for Apple Silicon Macs, with a menu-bar app, multi-model serving, an SSD-backed prompt cache that makes follow-up questions on long documents fast, and OpenAI- and Anthropic-compatible APIs. Advanced: best for Mac Studio owners wiring up coding or agent tools; pre-1.0 releases from a single maintainer.

Free, open source (Apache-2.0); no paid tierOpen sourceFree option

Self-hosted document archive: scan, OCR, index and search receipts, permits, lien waivers and COIs.

Free, open source (GPL-3.0)Open sourceFree option

Docling

Local AI

Converts PDFs like specs and submittals into clean text/Markdown that local AI models can read.

Free, open source (MIT)Open sourceFree option

BetterWispr

Local AI

Free, open-source Mac dictation: hold Option+Space in any app and talk, and speech is transcribed on your Mac (Apple speech, Parakeet or Whisper models). Built-in meeting notes. New (v0.1.x), Mac only.

Free, open source (Apache-2.0); macOS 14+Open sourceFree option
Visit whisper.cpp