Dual Cam

The DualCam technology is based on an innovative hybrid sensor which exploits two complementary imaging modalities which allow the system to be reliable also in adverse weather conditions and harsh environments.

In particular, the system is based on an acoustic imaging sensor developed in the PAVIS department of IIT capturing the sound landscape of a scene.

Optic-Acoustic image generated by the DualCam sensor in a scene where a flying drone is in the field-of-view

The acoustic imaging modality can be exploited to enhance the overall ability of a system to detect and interpret events, even when visual information is highly unreliable. For instance, unlike optical or thermal video, sound is not affected by occlusion issues and it is invariant to lighting and adverse weather conditions. For example, when integrated with an existing video-surveillance network, DualCam become an innovative and low-cost detection system capable to support investigation, monitoring, and early warning against threatening events such as a riots, gun shots or drone flights.

Concerning this last applicative scenario, DualCam is a scalable and modular solution that can be tailored to monitor a relatively small airspace (over a public square or around a specific, critical, building) or a wider airspace like that surrounding a stadium, a power plant or even an airport. DualCam is able to continuously monitor the airspace looking for small, incoming threats that are too small for conventional radar to be detected. The system is able to prevent an intrusion by continuously monitoring the surrounding areas of the protected infrastructure. For a better comprehension of the drone localization effectiveness of the audio-video sensor, see the video on the IIT YouTube Channel (https://www.youtube.com/watch?v=7lXsufflhkk) .

 

 

References:

  • A. Zunino, M. Crocco, S. Martelli, A. Trucco, A. Del Bue, V. Murino
    "Seeing the Sound: A New Multimodal Imaging Device for Computer Vision"
    IEEE International Conference on Computer Vision Workshop (ICCVW), 2015 [doi]

  • A. Trucco, F. Traverso, M. Crocco
    "Maximum Constrained Directivity of Oversteered End-Fire Sensor Arrays"
    Sensors, 2015

  • A. Trucco, S. Martelli, M. Crocco
    "Low-Cost Acoustic Cameras for Underwater Wideband Passive Imaging"
    IEEE Journal of Oceanic Engineering, Volume PP, Number 99, Pages 1-9, doi: 10.1109/JOE.2014.2377454, December 2014

  • A. Trucco, M.Crocco
    "Design of an Optimum Superdirective Beamformer Through Generalized Directivity Maximization"
    IEEE Transactions on Signal Processing, Volume 62, Number 23, Pages 6118-6129, doi: 10.1109/TSP.2014.2360819, December 2014

  • A. Trucco, F. Traverso, M. Crocco
    "Broadband performance of superdirective filter-and-sum beamformers steered to endfire"
    The Journal of the Acoustical Society of America, Volume 135, May 2014

  • M. Crocco, A. Trucco
    "Design of superdirective planar arrays with sparse aperiodic layouts for processing broadband signals via 3-D beamforming"
    IEEE Transactions on Audio, Speech and Language Processing, Volume 22, Number 4, Pages 800-815, doi: 10.1109/TASLP.2014.2304635, February 2014

  • F. Traverso, M. Crocco, A. Trucco
    "Design of Frequency-Invariant Robust Beam Patterns by the Oversteering of End-Fire Arrays"
    Signal Processing, Volume 99, Pages 129-135, doi: 10.1016/j.sigpro.2013.12.014, June 2014

  • M. Crocco, A. Trucco
    "Stochastic and Analytic Optimization of Sparse Aperiodic Arrays and Broadband Beamformers with Robust Superdirective Patterns"
    IEEE Transactions on Audio, Speech and Language Processing, Volume 20, Number 9, Pages 2433-2447, doi: 10.1109/TASL.2012.2203808, Nov. 2012

  • M. Crocco, A. Trucco
    "Design of Robust Superdirective Arrays With a Tunable Tradeoff Between Directivity and Frequency-Invariance"
    IEEE Transactions on Signal Processing, Volume 59, Number 5, Pages 2169-2181, doi: 10.1109/TSP.2011.2106780, May 2011

  • A. Trucco, S.Martelli, M. Crocco
    "Passive Underwater I maging Through Optimized Planar Arrays of Hydrophones"
    OCEANS'14 MTS/IEEE, 2014

  • A. Trucco, F. Traverso, M. Crocco
    "Robust Superdirective End-Fire Arrays"
    OCEANS'13 MTS/IEEE, 2013

 

Patents:

  • IT GE2014A000118
    Marco CROCCO, Samuele MARTELLI, Vittorio MURINO, Andrea TRUCCO
    “Metodo Di Tracciamento Di Una Sorgente Acustica Bersaglio”
    Dicembre 2014

  • IT 0001415813 / PCT/IB2014/058466
    Marco CROCCO, Vittorio MURINO, Andrea TRUCCO
    “Metodo Per La Configurazione Di Disposizioni Planari Di Trasduttori Per L’elaborazione Di Segnali A Banda Larga Mediante Beamforming Tridimensionale E Sistemi Di Elaborazione Di Segnali Che Utilizzano Tale Metodo, In Particolare Telecamera Acustica”
    Gennaio 2013