US researchers developing smart cameras for predictive surveillance

Robots watching you, everywhere
Robots watching you, everywhere

Security cameras are going to get a lot smarter, and a lot more automated, if a pair of Carnegie Mellon University researchers have anything to say about it.

Imagine a security camera that could detect when a bag is left unattended at the airport with no human help. No more need for monitor banks of security feeds with an fallible person behind the desk.

It sounds like science fiction, but that is exactly what a paper presented this week by researchers Alessandro Oltramari and Christian Lebiere proposes.

The U.S. government-funded research has developed what it terms a "Cognitive Engine" for artificial intelligence to automatically detect and interpret a person's actions through a surveillance feed.

Making cameras think

While computer vision technology can detect objects, understanding what those objects are doing requires the "Cognitive Engine."

For example, when a person picks up a ball they might bend over and outstretch their arms or simply kneel down and stand up again.

While video detection on its own would interpret those as two very different actions, the Cognitive Engine understands they are the same.

It would make connections between the person and ball, along with all possible interactions between the two, in order to replicate an almost human-like process of interpreting actions.

Predictive cameras for future tech

Oltramari and Lebiere believe that the research can have wide ranging applications, and that the Cognitive Engine will be able to "eventually predict" outcomes based on the actions it observes.

Bringing back the ball example, the Cognitive Engine could predict that the man will throw the ball by anticipating the most likely actions for what a person would do with a ball.

This predictive analysis is the ultimate goal of Oltramari and Lebiere's research, which is conducted as part of the DARPA Mind's Eye program to develop smart cameras for automated video surveillance.

The technology could even come home to consumer products eventually, possibly bringing Google's self-driving car, and our inevitable robot overlords, another step closer to a reality.

Via CNET, Alessandro Oltramari and Christian Lebiere research paper

TOPICS
Latest in Cameras
Nikon Zf camera in the hand with Z 28mm F2.8 SE lens attached
Forget Fujifilm – Nikon's retro full-frame Zf camera hits new low price in the Amazon Spring Sale
DJI Osmo Action 4
Forget GoPro – the DJI Osmo Action 4 is the action camera deal I'd go for in Amazon's Spring Sale
Nikon Z5
The Nikon Z5 II could land soon – here's what to expect from Nikon's rumored entry-level full-frame camera
DJI Mavic 3 Pro
More DJI Mavic 4 Pro leaks seemingly reveal launch date, price and key features of the triple camera drone – here's what to expect
L-mount alliance
Sirui joins L-Mount Alliance to deliver its superb budget lenses for Leica, DJI, Sigma and Panasonic cameras
Nikon Z8 camera in the hand with 4-axis screen pulled out
We think the Nikon Z8 is the best hybrid camera for pros and it just hit a record-low price
Latest in News
EA Sports F1 25 promotional image featuring drivers Oscar Piastri, Carlos Sainz and Oliver Bearman.
F1 25 has been officially announced, with this year's entry marking a return for Braking Point and a 'significant overhaul' for My Team mode
Garmin clippd integration
Garmin's golf watches just got a big software integration upgrade to help you improve your game
Robert Downey Jr reveals himself as Doctor Doom to a delighted crowd at San Diego Comic-Con 2024
Marvel is currently making a major announcement about Avengers: Doomsday's cast on YouTube, and I think it's going to be a long-winded reveal
Samsung QN90F on yellow background
Samsung announces US prices for its 2025 mini-LED TV lineup, and it’s good and bad news
Nintendo Switch Lite
Forget the Nintendo Switch 2, the original Switch is getting one last hurrah in a surprise Nintendo Direct tomorrow
The Samsung Galaxy S25 Edge on display the January 22, 2025 Galaxy Unpacked event.
Samsung Galaxy S25 Edge colors seemingly revealed in new video, and there’s another sign of an imminent launch