Replies sorted oldest to newest
I fully appreciate that Pajama Club is meant to be "experimental," but a 3D music video which doesn't work properly on 90% of computers doesn't seem like a smart ploy.
There's a video interview and article here
So we have a promo clip which the majority of fans can't access and have been waiting for for several months.....to promote what exactly.
Is there an alternative promo beiong released to music channels....or is it just the sh*tty technology that's being promoted here?
quote:Originally posted by neilsknees:
It works for me using Chrome on a one year old computer.
Works fine for me, too. Graphics are fuzzy, even on best quality, but maybe they are supposed to be. Loaded quick, too.
non-interactive version on youtube
I love this song, it's one of my favorites on the album. But I'm not really sure of the point of this video (or others for the album). Hardly anyone watches them (the viewing figures are pathetic by youtube standards) and they don't seem to be promoting any particular product, given that there aren't any single releases anymore (apart from erratic releases of 'radio singles' in some countries).
Maybe Neil just enjoys making videos, and experimenting with different media? Producing videos used to cost a fortune - but perhaps it can be done cheaply with today's technology?
Neil might just be giving this technique a test drive for the future, his solo release perhaps. If this technology is taken a bit further in creative directions, he could even be a bit of a trailblazer (like Arcade Fire were with their customized Google maps video...)
I liked the video. Its a different and creative idea.
Neil Finn Unveils 3D Video
23 June, 2012
Neil Finn's Pajama Club today unveiled new clips for tracks TNT For Two and These Are Conditions.
In a press release today it's claimed that the clips are the "world's first 3D-captured interactive" music videos that can be watched in your web browser.
In TNT, the viewer is "in control of the camera" while the band perform on a deserted beach and in Conditions, you can "pull them to bits" (they give as an example, swapping Neil and Sharon Finn's heads), create an audience of penguins or stack a tower of amps.
The clips were created using a $200 video game camera but to view them the latest versions of Chrome or Firefox are required. Fans wanting to view the clips are also warned: "If your computer is more than 3 years old, it may not work properly for you."
If your browser can't play the new clips, enjoy 2D Pajama Club performing From A Friend To A Friend acoustically for theMusic Sessions.
We're very excited to announce that our TNT For Two video is now finished and ready for us all to enjoy. It has taken a while to get out to you and if you're interested to find out why that is and how it was created we would like to share our little journey with you. We hope you enjoy.
Using a $200 video game camera, months of experimenting, and a trillion lines of programming, we've created the worlds first 3D-captured interactive music video you can watch in your web browser. Two videos, actually. In 'TNT For Two', you're in control of the camera while the band performs on a deserted beach and takes on an ominous journey through beach and bush. In 'These Are Conditions' you are in control of everything; as the band plays you can pull them to bits in 3D, swap Neil's head for Sharon's, create an audience of giant penguins, stack a tower of amps a thousand kilometers into the sky, or anything else you can dream up to do in this surreal sandbox.
TNT FOR TWO VIDEO
Everything one sees when experiencing the TNT For Two film is rendered in 3D on the fly by the user’s computer; they are thus able to spin around and interact with Neil, the band and the environment in real time.
To bring the video to life, we had quite a few hurdles to overcome. First we had to invent a new way of shooting with a Kinect camera, find a way to save the information it sees, develop a process for editing and compositing this 'footage', and then create a way to display it in a web browser so that anyone can experience the video in 3D.
Months of experimentation have paid off, and we’re finally ready to release “TNT For Two” to the world.
The performers, the environment and the props have been captured by a 3D infrared sensor, the new XBOX Kinect.
This bit of consumer gaming equipment has been subject to a lot of hacking from nerds the world over since the day it was released.
In short, it shoots out thousands of infrared beams, and then counts the time it takes for each of them to bounce back. When each beam returns, the camera knows that it must have bounced off a solid object a certain distance away. It pieces together all this information to create a three-dimensional picture of the world around it.
This way of “sensing” the world with infrared is similar to the way dolphins and bats “see” with sound.
To help us understand what the camera senses, we pipe the raw depth data out of the camera and into the computer, where we can spin around and zoom into a 3d “point cloud” of space around the camera.
One can capture this stream of data and interpret it in many ways. Most people use the camera to sense motion and accurately detect a person moving in front of it. This is what the camera was designed for, and is great for playing games. When you wave your right arm, your character on the Xbox waves his right arm as well. When you jump, he jumps.
We chose to use the camera in quite a different way. We wanted to use it the same way that you might use a film camera. We wanted to take it out of the game room and into the field to record footage and then play it back later. To do this, we developed software to record what the Kinect detects with its infrared camera, as well as what it sees with its color camera. We used this setup to capture the band's performance as well as a narrative storyline.
We then encoded the video in a specific way that doesn't make much sense to the human eye, but our software can decode back into 3d points in space on the other end. We then stream it over the web to a web browser just like a normal video. The data is decoded by the user's web browser using a new technology called “WebGL.” Clever code on our website re-interprets the encoded data and displays it three dimensionally in a way that the person experiencing it can manipulate on the fly, in realtime.
Microsoft XBOX Kinect using depth and RGB data output over USB sampled at 30 frames per second with a depth sensing range of 300cm to around 12m. This equates to nearly 2 million data points per second.
Bespoke capture software written by Jeff Nusz; allows for continuous data capture with a live view of what is being captured. Adjustable image size and compression ratios.
It was crucial that the software could read, encode, and save to disk in time for the next frame, because if we missed even a single frame during a 5 minute take, all the audio synchronization would be wrong and the shot would be useless. We ended up using two high powered MacBook Pro towers to run the software and process the gigabytes of data quickly enough for the shoot to progress without delays.
The raw data is captured at around a gigabyte per minute. Total data captured for project is around 150GB. We also collected 3D data of objects to use in the videos including the all band's equipment, a pile of nautical props, and over 2 dozen mounted birds from the Auckland Museum’s storage area.
EDITING AND CLEANUP
No 3D software was used in the making of this video. A combination of Apple Final Cut Pro and Adobe After Effects were used to time align and clean up visualizations of the data streams and still images. Photoshop was used to clean-up the props and key out the green screens.
RGB and depth data compressed using h264 and OGV to web compatible data rates of under 1500kbps
Google Chrome using inbuilt WebGL with custom shaders to decompress the RGB and depth data back into an interactive point cloud. WebGL takes advantage of the processing power of the computers graphic card. With out the power of the graphics processing unit (GPU), we would never be able to process the millions of particles that make up the video.
I think Neil has just turned me on with his new Sexy Martian look... move over Lady Gaga!
I was admiring this song again the other day. Such a great quirky song completely different from other Neil stuff. I passed it along to other music fans and they love it compare to standard Crowded House stuff. I still think the Pajama Club album was great and To The Island could have fit right in....which is why I like that one too. But TNT is a great, grower, long lasting song. Just like Golden Child and others on the album.
And to top it off, I like those pics of the video shoot. Neil looking quite alien. Looks like one of those sports creatures/fans you see in the stands (or in Canada...bugging the players behind the penalty box!)
I was admiring this song again the other day. Such a great quirky song completely different from other Neil stuff. I passed it along to other music fans and they love it compare to standard Crowded House stuff.
Funny because I always thought TNT For Two was by far the most Crowded House-sounding song on the album. At least the verses. It has that really sturdy, compact melody that gets in your head and fits Neil's voice perfectly. Reminds me a lot of Amsterdam actually.