on-device-llm
One interface for Apple’s on-device model and your cloud endpoint, with context management, routing, and React hooks.
Apple on-device inference · iOS 26+ · Expo SDK 57
INDEPENDENT TOOLS. OPEN SOURCE.
Thoughtfully built.
Openly shared.
Useful tools for the things you’re building.
Explore our packages, read the docs, and make the code your own.
Explore the packagesTHE PACKAGES
02 / AND GROWINGon-device-llm-android
An Android provider for Gemini Nano through ML Kit and AICore. A separate install, with shared routing and context management.
Eligible AICore devices · ML Kit SDK opt-in required
ML Kit sends usage and performance metrics to Google. Add the SDK explicitly and review its data-handling terms. Read the details →
Good tools leave room
for your ideas.
Start with the docs. Look through the source. Open an issue or contribute an improvement.
Find us on GitHub