A colleague of mine pointed me to UPF’s reactable site:
http://mtg.upf.edu/reactable/?media
During my Masters year I was in a project with a team from UPF, and we worked on something a bit similar (but, which never got finished and wasn’t as cool as this).
This sort of intuitive interfaces make me think, maybe I should get myself a hobby-project involving audio again…!