Week One
Installed Kode and working on installing Three.Js which will be the way the visuals will be controlled on the third screen. The front screen will be Hydra plus multi camera rig, the second screen will be Marching.js with audio reactive visuals and I would like to experiment with a third shader.
Currently, Kode from Hexler.net does not share documentation on how to write to the shader, so I am hoping some of the leads I have found about shader code is universal across the board.
Lastly, I looked into a few tutorials on how to create some motion controlled lights using ardruino, so hoping to start building a test model of controllable light by next week.
Front of House Test Recording, video input + audio reactive. Visuals work for the front of house camera that will be fed the camera feed of the performer, for this feedback loop, I just used a video input which can be swapped for a camera source.
This utilizing the fft and working with the webcam I was able to apply effects to the webcam, I will add cine camera to the web input and see what is possible with better optics. Also, it might be possible to have a switcher to move around to different cameras in the space and have the same effects applied to the images. I also wonder if it is possible to code while filming.
One of the side walls will use marching.js and I am still undecided on the third projection but this is a test using marching.js with audio reactive
Next, I would like to text and confirm that we can connect multiple cameras to the video switcher and then access the video switcher video the .initcam function. I am also hoping that the video effects will work seamlessly across the different camera angles. After this is confirmed I will finish mocking up the visuals for the third screen using the additional shader language.
I also need to do some location scouting this week and I would like to run the idea of having “aerial codes” or “movements in the sky” be the title of the visual work, lately I have been looking at the sky a lot and all the different colors and even though the work will be released in winter I still think the vibe will be nice for making digital effects.
Lastly, I am curious if there is a more aggressive way to control the speed of the image as I have noticed that many of the still images look really good but they go by so fast.