"Live writer" integrated/merged with the text

[dandrewstewart]

Okay, here is a challenge, yes? I had several comments from audience members who wanted me to interact with the visuals (literally working with the screen) – I did use some "shadow play" during the dress rehearsal, but not during the concert. What are your thoughts about have some graphical representation of the "live writer" integrated/merged with the text? I realise this would take the project into a wildly different performance practice. Seeing how we can never guarantee that the screen and the live writer will be side by side, like at Stengade, I would favour "emulating" (or faking) the integration of the live writer simply with incoming OSC messages that are cleverly created with mappings to the physical gestures of the live writer. Does this make sense? "Computer vision" would also be wild, but another level. Imagine a software interface to bring, say, Kinect data into the LW environment. Probably you've already thought about this, yes? For example: a shadow, which represents the live writer, appears on the screen, interfering/distorting the text. I think the "push and pull" idea (in another "Issue") is a first attempt at this concept.

[panavrin]

I like it. Currently, i do now know. What would be awesome is the letters themselves form a shadow of the performer. haha. Kinect data into the LW environment is not impossible. However, this will need some time for me to dig some information as well as resources (gears, kinect-chrome interface (some sort of API) and lots of WebGL coding.)

I guess you meant something like this: http://mrdoob.com/lab/javascript/webgl/kinect/