LocalAI Hub

Acerca de esta app

LocalAI Hub is an iOS application designed for managing and interacting with local large language models (LLMs). Developed by Roman Beliaev, the app allows users to import GGUF model files directly from the Files app, download them from Hugging Face, or fetch them via direct links. A built-in model catalog features search capabilities, a “GGUF only” filter, and curated recommendations to help users find suitable models.

For connectivity beyond local execution, LocalAI Hub offers optional integration with OpenRouter, requiring an API key to browse and use vision-capable models. The interface supports multimodal inputs, including photos, videos, and PDFs, with OCR/text extraction added to the prompt context. Users can dictate prompts using speech-to-text functionality.

Advanced users have access to granular generation controls, including system prompts, context size, temperature, top-p, and maximum token limits. The app organizes interactions through chat history, supporting multiple threads that can be renamed or deleted. This tool is aimed at users seeking privacy and control over their AI inference processes on Apple devices.