Run the smart home by natural language
Karpathy's Dobby agent controls lights, HVAC, shades, pool and security, alerts on visitors, and replaces six apps.
Done with OpenClaw
What they did
Karpathy built Dobby the Elf Claw as the smart home AI agent. It was given access to control lights, HVAC, shades, pool, and security, with AI used to detect visitors and send alerts. Natural language replaced the six separate apps.
How it went
All controls now run through one agent. The source gives no further metrics or shortfalls.
Worth knowing
Keep a human in the loop for anything that sends messages, spends money or commits to a booking.
Try it yourself with OpenClaw
Connect to my smart home devices ([lights, thermostat, shades, security, other]) and let me control them by chat in plain language, like 'dim the living room' or 'set the house to night mode'. Also alert me when [visitor or event] is detected. Test each device with me one at a time, and ask before changing any security or lock settings.
Source on X - Mar 22, 2026
Read the original