An open and practical guide to Edge AI Engineering.
ASAN: A conceptual architecture for a self-creating (autopoietic), energy-efficient, and governable multi-agent AI system.
KodaAI is a performance analytics platform that quantifies the efficiency gains provided by AI-assisted development using Kiro. It bridges the gap between human estimation (Jira) and machine-accelerated output (GitHub/Kiro) to calculate a "Speed Multiplier" for software teams.
Ternary Quantization for LLMs: Implement balanced ternary (T3_K) weights for 2.63-bit quantization—the first working solution for modern large language models.
NeuroMem is a memory middleware layer that sits between your client and an upstream model. It retrieves session-scoped memories, injects them as structured context, stores the new turn, and returns the upstream model's answer. Use it when long conversations, large projects,
Advanced cloud code optimization tool that dramatically reduces token consumption by up to 75% for AI and LLM applications. Perfect for developers and teams seeking maximum efficiency in 2026.
Smart LLM and cloud code optimization tool that cuts token costs by up to 75%. Perfect for AI developers seeking maximum efficiency and lower expenses in 2026.
An open and practical guide to Edge Vision.
Claude Limit Extender is a smart desktop application that helps users significantly extend their productive time with Claude AI. It includes token optimization, session management, and intelligent prompt tools to maximize efficiency within platform limits.
Monitors token usage in real-time and suggests cost-effective model alternatives or prompts optimizations to reduce spending
The final project for EdgeAI course at NYCU, focusing on accelerating Llama-3.2-3B-Instruct inference on a single NVIDIA T4 GPU.
Detect avoidable LLM waste: cache breakers, context bloat, and inefficient prompt design
Cut your AI coding agent costs by 60%. Battle-tested efficiency skills for Claude Code, Cursor, and any AI coding agent.
An open and practical guide to Edge Language
Quick-reference guide covering memory, computation, performance, energy, and cost metrics for AI Systems.
Interactive Training Dashboard & CAGS-Operator Verification for JamOne Nano.
An open and practical guide to Edge Audio.
AI Performance Engineering Cheatsheet: From Cloud to Edge.
Add a description, image, and links to the ai-efficiency topic page so that developers can more easily learn about it.
To associate your repository with the ai-efficiency topic, visit your repo's landing page and select "manage topics."