Cactus Chat

Acerca de esta app

Cactus Chat is an iOS application developed by Roman Shemet that provides offline artificial intelligence capabilities. The app allows users to interact with AI models directly on their device, ensuring that personal data remains local and does not leave the phone. This approach offers a free, private alternative to cloud-based AI services. Additionally, the software serves as a utility for developers, enabling them to benchmark the performance, specifically latency and throughput, of various large language models (LLMs) running locally on the hardware. The application supports version updates, such as v1.4, to maintain compatibility with newer model versions.