Acoustic Camera

Microphone Arrays and Acoustic Camera

In the context of the acoustic signal processing, the PAVIS team is committed toward the development of innovative sensing systems based on microphone arrays, from short linear antennas for directional sound capture, to complex devices, called acoustic cameras, for the generation of 3-D audio images in real-time.

Both linear arrays producing a single beam and planar arrays producing a grid of multiple beams investigating the 3D space are designed to process extremely wideband signals, providing superdirective performances with low-cost microphones and an embedded processor. This is possible owing to robust beamforming methods that we recently proposed.

All our microphone arrays and acoustic camera are developed at a prototype level and tested into a silent room as well as in real operative conditions.

The microphone arrays developed in PAVIS have been coupled with video cameras, in order to exploit the information given by the two complementary sensing modalities.

For an example of a security application of our audio-video sensor in drone localization, you can see the following video from the IIT YouTube Channel.

 

 

 

References:

  • A. Zunino, M. Crocco, S. Martelli, A. Trucco, A. Del Bue, V. Murino
    "Seeing the Sound: A New Multimodal Imaging Device for Computer Vision"
    IEEE International Conference on Computer Vision Workshop (ICCVW), 2015 [doi]

  • A. Trucco, F. Traverso, M. Crocco
    "Maximum Constrained Directivity of Oversteered End-Fire Sensor Arrays"
    Sensors, 2015

  • A. Trucco, S. Martelli, M. Crocco
    "Low-Cost Acoustic Cameras for Underwater Wideband Passive Imaging"
    IEEE Journal of Oceanic Engineering, Volume PP, Number 99, Pages 1-9, doi: 10.1109/JOE.2014.2377454, December 2014

  • A. Trucco, M.Crocco
    "Design of an Optimum Superdirective Beamformer Through Generalized Directivity Maximization"
    IEEE Transactions on Signal Processing, Volume 62, Number 23, Pages 6118-6129, doi: 10.1109/TSP.2014.2360819, December 2014

  • F. Traverso, M. Crocco, A. Trucco
    "Design of Frequency-Invariant Robust Beam Patterns by the Oversteering of End-Fire Arrays"
    Signal Processing, Volume 99, Pages 129-135, doi: 10.1016/j.sigpro.2013.12.014, June 2014

  • A. Trucco, F. Traverso, M. Crocco
    "Broadband performance of superdirective filter-and-sum beamformers steered to endfire"
    The Journal of the Acoustical Society of America, Volume 135, May 2014

  • M. Crocco, A. Trucco
    "Design of superdirective planar arrays with sparse aperiodic layouts for processing broadband signals via 3-D beamforming"
    IEEE Transactions on Audio, Speech and Language Processing, Volume 22, Number 4, Pages 800-815, doi: 10.1109/TASLP.2014.2304635, February 2014

  • A. Trucco, S.Martelli, M. Crocco
    "Passive Underwater I maging Through Optimized Planar Arrays of Hydrophones"
    OCEANS'14 MTS/IEEE, 2014

  • A. Trucco, F. Traverso, M. Crocco
    "Robust Superdirective End-Fire Arrays"
    OCEANS'13 MTS/IEEE, 2013

  • M. Crocco, A. Trucco
    "Stochastic and Analytic Optimization of Sparse Aperiodic Arrays and Broadband Beamformers with Robust Superdirective Patterns"
    IEEE Transactions on Audio, Speech and Language Processing, Volume 20, Number 9, Pages 2433-2447, doi: 10.1109/TASL.2012.2203808, Nov. 2012

  • M. Crocco, A. Trucco
    "Design of Robust Superdirective Arrays With a Tunable Tradeoff Between Directivity and Frequency-Invariance"
    IEEE Transactions on Signal Processing, Volume 59, Number 5, Pages 2169-2181, doi: 10.1109/TSP.2011.2106780, May 2011

 

Patents:

  • IT GE2014A000118
    Marco CROCCO, Samuele MARTELLI, Vittorio MURINO, Andrea TRUCCO
    “Metodo Di Tracciamento Di Una Sorgente Acustica Bersaglio”
    Dicembre 2014

  • IT 0001415813 / PCT/IB2014/058466
    Marco CROCCO, Vittorio MURINO, Andrea TRUCCO
    “Metodo Per La Configurazione Di Disposizioni Planari Di Trasduttori Per L’elaborazione Di Segnali A Banda Larga Mediante Beamforming Tridimensionale E Sistemi Di Elaborazione Di Segnali Che Utilizzano Tale Metodo, In Particolare Telecamera Acustica”
    Gennaio 2013