Map and control a whole smart home
Community report: karpathy prompted the agent in chat with "Can you find my Sonos?". The agent scanned the home IP network, logged into the unprotected Sonos, web-searched and reverse-engineered its API endpoints, then repeated the process on lights, HVAC, shades, pool, spa, and security systems. The agent produced a unified control center for the full house and now executes high-level commands across all devices.
- Agent or tool
- Custom agent
- Topic
- Home & Family
- Reported on
- X
- Added
- 2026-10-15
Why it matters
Household admin never stops: food, schedules, bills and repairs. Cases like this show agents helping with the everyday logistics of running a home. It is one of 23 sightings filed under Home & Family on Agent Sightings (number 22 by interest), and one of 182 involving Custom agent.
How you could try it
Here is a reusable prompt, written by us in our own words, that captures the task. Paste it into your own agent or any similar agent and adjust the details to your situation.
Home/family task: map and control a whole smart home. Keep changes reversible and ask before messages, payments, or deletes.
Tip: Begin with one small routine, check the results for a week, then widen what the agent is allowed to do.
Source
Read the original first-hand account on X: https://x.com/MilkRoadAI/status/2036820969067524357. Our summary is a paraphrase; details are in the source.