Reads the live phone screen through the dock, with clear session controls.
Kickstarter pre-launch hardware
Lumi AI Dock: The First Desktop AI That Physically Uses Your Phone
Lumi sees your real phone screen, taps like a human, and turns phone fragments into tasks, people context, calendar reminders, and notes. Local-first, with your permission.
Follow on KickstarterReal phone. Real screen. Real taps.
Real phone access. No APIs, root, or jailbreak required.Physical phone control. 4-axis mechanism for real screen tapping.Private AI memory. Todo, People, Calendar, and Notes, local-first.
tap
AI memory outputTodo created
Send investor update by Friday
Source: Phone chat 09:41observe_screen()tap target confirmedwrite Todo + trace
Problem
Your Phone Is Where Work Actually Happens. AI Still Can't Reach It.
Private chatsScreenshotsCalendar promisesMobile filesBooking appsPeople context
Uses a physical mechanism for real screen tapping, swiping, and typing.
Turns fragments from apps, people, screenshots, and calendars into useful memory.
Demo-driven
Phone fragments become usable memory.
Turn Hidden Phone Promises Into Actionable Tasks
Phone chatPhysical actionTodo with source trace
Lumi sees screen and taps the message thread
Promised quote due Friday -> Todo, contact, reminderA Relationship Inbox for the People Who Matter
Chats, calls, calendarPhysical actionPeople memory
Lumi checks visible context with approval
Waiting reply, next meeting, promised follow-upTurn Phone Fragments Into an AI-Ready Knowledge Base
Screenshots, files, linksPhysical actionNotes, Calendar, Todo
Lumi groups fragments from the real phone
Tagged sources with editable memory cardsDemo 1
Turn Hidden Phone Promises Into Actionable Tasks
A message promise is captured from the real phone, traced back to its source, and filed into Todo without pretending the mobile app has an API.
Phone chat -> Lumi physical tap -> Todo card
Replace with prototype footage.
Relationship inbox demo
People cards with waiting reply, promised quote, and next meeting.
Demo 2
A Relationship Inbox for the People Who Matter
Lumi helps high-relationship-density professionals recover the follow-ups, preferences, and open loops scattered across mobile apps.
Demo 3
Turn Phone Fragments Into an AI-Ready Knowledge Base
Screenshots, files, links, mobile-only notes, and calendar moments become structured Notes, Calendar, and Todo memory with visible sources.
Fragments -> Notes, Calendar, Todo
Show source trace and editable memory output.
Physical control
Real Phone. Real Screen. Real Taps.
Lumi does not emulate the phone. It docks a real phone and acts through visible, permissioned control.
Sees the real phone screen
Positions for real taps and swipes
Physical interaction with the screen
Stable alignment for common phones
Session state, voice, and local controls
Privacy
Private by Default. Useful by Design.
Lumi does not hack apps. It sees and taps like a human, with your permission. Your phone data stays local by default, and you decide when Lumi can act.
Local-first by defaultNo root or jailbreakVisible action logUser confirmationNo app hacking
Confirmation requiredSend this message?
Lumi asks before sensitive or irreversible actions.
09:41 observed Messages09:42 opened source thread09:42 created Todo draft09:43 waiting for approval
Developer SDK
Phone Use SDK: Browser-Use for Real Phones
A hardware-level phone-use layer for agents that need to observe, tap, swipe, type, screenshot, and ask for confirmation on real mobile apps.
session = phone_use.connect("lumi-dock")
screen = session.observe_screen()
target = screen.find("Confirm appointment")
session.confirm_action("Tap confirmation button?")
session.tap(target)
session.type("Friday works. Sending calendar invite.")
memory.write({
type: "todo",
source: session.screenshot(),
trace: session.action_log()
})Early list
Join the Lumi pre-launch list.
Get prototype updates, Kickstarter launch alerts, and developer kit news.