This is brilliant. One of those things that actually seem obvious but somehow you never thought of it before:
Part of the interface is written in software, and part of it can be written by anyone with knowledge of the physical world, simply by using things from the physical world!
I wonder if one could hack one of them computer controlled chess games to create a poor mans version of this.

