Jump to content



Photo

Autonomous framing and subject tracking


  • Please log in to reply
11 replies to this topic

#1 Prasenjit Mukherjee

Prasenjit Mukherjee

    New Member

  • Members
  • Pip
  • 3 posts

Posted 08 September 2014 - 07:31 PM

Hey Guys!

 

We aren't officially cinematographers, but a couple of friends and I like shooting footage with Drones and Gimbals (hand-held and otherwise). We noticed a problem sometimes (esp with shooting aerial footage) where it was hard to frame shots while controlling a moving platform. 

 

We knew our way around computer vision techniques so we prototyped some autonomous tracking on just a laptop and camera. We are thinking of ways to put this on steadicams, gimbals and drones. I'm wondering if people have experience with something like this or would use something like this. We aren't camera operators, so I'd love to get some thoughts on it!

 

Here is some footage (the first ones actually on a gimbal, the second one is just GoPro footage put through our tracker)!

 

 


  • 0

#2 Eric Fletcher S.O.C.

Eric Fletcher S.O.C.

    Advanced Member

  • Sustaining Members
  • 2922 posts
  • LA, Ca

Posted 08 September 2014 - 08:06 PM

That's what operators are for. 

 

Like they say Drum machines lack soul and so do Autonomous framing and subject tracking computers

 
  • 1

#3 Prasenjit Mukherjee

Prasenjit Mukherjee

    New Member

  • Members
  • Pip
  • 3 posts

Posted 08 September 2014 - 10:26 PM

 

That's what operators are for. 

 

Like they say Drum machines lack soul and so do Autonomous framing and subject tracking computers

 

 

 

For sure! We envisioned this to mostly be a tool to help operators frame shots in difficult situations when the camera is mounted on a platform (Drone, cars etc.), awkward angles or to help track fast relative motion between operators and subjects. We were thinking of ways to make the actual operation easier while leaving the creative control and framing with the operator. 


  • 0

#4 Shawn Wang

Shawn Wang

    Advanced Member

  • Sustaining Members
  • 92 posts
  • Vancouver, Canada

Posted 08 September 2014 - 10:53 PM

well, I believe this certainly has its place in consumer market. 

 

yet I do not believe it will get respect in the film world. 

 

you see, everything in film is manual.... lighting, focus, movement. cuz you need control on everything. not a robotic 

 

BUT ! I know a guy will love this... Dziga Vertov, Kino-eyes.... unfortunately he died 50 years ago.

 

it would be interesting if someone can continue to develop his idea in the film world. 


  • 0

#5 Eric Fletcher S.O.C.

Eric Fletcher S.O.C.

    Advanced Member

  • Sustaining Members
  • 2922 posts
  • LA, Ca

Posted 08 September 2014 - 11:58 PM

 

For sure! We envisioned this to mostly be a tool to help operators frame shots in difficult situations when the camera is mounted on a platform (Drone, cars etc.), awkward angles or to help track fast relative motion between operators and subjects. We were thinking of ways to make the actual operation easier while leaving the creative control and framing with the operator. 

 

If operating was easy everyone would do it.  


  • 0

#6 Rob Vuona SOC

Rob Vuona SOC

    Advanced Member

  • Sustaining Members
  • 1143 posts
  • Los Angeles

Posted 10 September 2014 - 12:00 AM

Can I use this with a go pro and quad copter and the controller rides with me on my mt bike or while I'm skiing so it will just follow on a wide angle ?
  • 0

#7 James Davis

James Davis

    Advanced Member

  • Sustaining Members
  • 638 posts
  • London

Posted 10 September 2014 - 02:30 AM

Here you go Rob:

http://www.gizmag.co...me-drone/33747/
  • 0

#8 Prasenjit Mukherjee

Prasenjit Mukherjee

    New Member

  • Members
  • Pip
  • 3 posts

Posted 10 September 2014 - 07:03 PM

Can I use this with a go pro and quad copter and the controller rides with me on my mt bike or while I'm skiing so it will just follow on a wide angle ?

 

Absolutely! That's exactly the kind of situation we are thinking of! Another user posted a link to a drone that can follow you, however it uses a GPS signal which is delayed because of the transmission delay, so it will be reactively following your position. With a camera, everything can be run onboard, making for a smoother, faster tracking experience!


  • 0

#9 Alan Rencher

Alan Rencher

    Advanced Member

  • Sustaining Members
  • 1091 posts
  • Los Angeles

Posted 10 September 2014 - 08:48 PM

I think of you can develop this, it will be great for the consumer market. There isn't much demand for it in the professional market, though.
  • 0

#10 Victor Lazaro

Victor Lazaro

    Advanced Member

  • Sustaining Members
  • 1231 posts
  • Sunnyside Queens, NY

Posted 10 September 2014 - 11:02 PM

It reminds me of this Kickstarter https://www.kickstar...ion-sports-dron


  • 0

#11 JimBartell

JimBartell

    Advanced Member

  • Sustaining Members
  • 494 posts
  • Long Beach, CA, USA

Posted 10 September 2014 - 11:53 PM

I think of you can develop this, it will be great for the consumer market. There isn't much demand for it in the professional market, though.

 

One of these was developed for the consumer market in the early 90's that tracked via an ultrasonic emitter worn by the "target".  Everyone thought it was cool but no one bought it.  It's a solution in search of a problem.  Maybe the GoPro/Drone application is that problem.

 

Jim Bartell


  • 0

#12 Rob Vuona SOC

Rob Vuona SOC

    Advanced Member

  • Sustaining Members
  • 1143 posts
  • Los Angeles

Posted 11 September 2014 - 01:57 PM

I've heard about this,  so freaking cool,  so if you guys can do what these guys are doing only better, well you sold one to me  =)

 

in the mean time,  i think Christmas present to myself is the 3-D robotics set up

 

way big fun


  • 0




Engineered Cinema Solutions

Betz Tools for Stabilizers

Teradek

BOXX

rebotnix Technologies

GPI Pro Systems

IDX

PLC - Bartech

Ritter Battery

PLC Electronics Solutions

Paralinx LLC

Varizoom Follow Focus

Omnishot Systems

Wireless Video Systems

Media Blackout - Custom Cables and AKS

SkyDreams

Boland Communications