It uses several artificial intelligence techniques, including natural language processing, speech recognition, face recognition, and reinforcement learning, written in Python, PHP and Objective C. He explained what he built and what he learned along the way.

Before he could build any AI, he first needed to write code to connect his home systems, which all speak different languages and protocols.
They use a Crestron system with their lights, thermostat and doors,
a Sonos system with Spotify for music, a Samsung TV, a Nest cam for Max, and
of course his work is connected to Facebook's systems.

He had to reverse engineer APIs for some of these to even get to the point where he could issue a command from his computer to turn the lights on or get a song to play.