Machine Listening: Human hearing modeled via the computer. An example is the program Tartini. Nick’s idea is to use machine listening programs as the user interface for live coding.
Some background work:
Nick developed a system called Algoravethmic, that analyzes the music you make with SuperCollider, and then generated an interface with which you can change the music.
It gets even more crazy, now Nick is controlling a data reading program with sounds:
“This might sound crazy, but it is the future”
More details in the paper (all ICLC papers are by the way: http://iclc.livecodenetwork.org/papers.html)