#edge-ai

Google Gemma, developed by Google DeepMind, is a family of lightweight, state-of-the-art open-source large language models. Derived from Google's Gemini technology, Gemma offers various parameter sizes (1B, 4B, 12B, 27B) to cater to diverse applications, from edge devices to high-performance servers. It features robust multimodal understanding, supporting text and image inputs, and an exceptional 128K token context window. Designed for efficiency, Gemma runs smoothly on a single GPU or even personal laptops, significantly lowering the barrier for local deployment and development, making it ideal for lightweight applications, rapid prototyping, and AI deployment in resource-constrained environments.

LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models (LLMs) efficiently on edge devices. It achieves peak performance through GPU and NPU accelerators and supports cross-platform deployment on Android, iOS, Web, Desktop, and IoT. The framework also offers multi-modality (vision and audio), tool use (function calling) capabilities, and broad compatibility with models like Gemma, Llama, and Phi-4. It powers on-device generative AI experiences in Google's Chrome, Chromebook Plus, and Pixel Watch.

Garmin-Sync is a micro-core AI Agent specifically engineered for Garmin running watches, providing efficient and accurate sports calorie expenditure analysis directly on the device, even in offline environments without network connectivity. This innovative embedded solution ensures users receive precise, personalized real-time fitness data feedback, even in outdoor areas with no signal. It significantly optimizes performance for resource-constrained devices, guaranteeing continuous and reliable data analysis without relying on cloud processing. By enhancing the running watch's independent operational capabilities, Garmin-Sync greatly improves the immediacy and effectiveness of user training, making it an ideal companion for outdoor enthusiasts.