Nicki Holighaus
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Nicki Holighaus has a total of 55 co-authors. Here are the top co-authors by number of shared publications:
- Peter Balazs
Acoustics Research Institute, Austrian Academy of Sciences, Vienna, AUSTRIA
12 shared publications - Zdeněk Průša
Acoustics Research Institute, Austrian Academy of Sciences, Vienna, AUSTRIA
10 shared publications - Piotr Majdak
Austrian Academy of Sciences
8 shared publications Christoph Wiesmeyr
6 shared publications- Felix Voigtlaender
Mathematical Institute for Machine Learning and Data Science (MIDS), Catholic University of Eichstätt-Ingolstadt (KU), Ingolstadt, Germany
5 shared publications - Nathanael Perraudin
Swiss Data Science Center (SDSC), Swiss Federal Institute of Technology in Zürich (ETH Zürich), Zürich, Switzerland
5 shared publications
Latest Publications
- Open Access
- 1 June 2026
- Published by Acoustical Society of America (ASA) in The Journal of the Acoustical Society of America
- Vol. 159 (6) , 5578-5598
Prediction of parameters of a pinna model from synthetic geometries using a vision transformer
The acquisition of the human pinna geometry requires elaborate equipment for accurate results. Even then, the results are often corrupted by measurement artifacts. We introduce Mesh2PPM, a framework facilitating the generation of a personalized and artifact-free pinna mesh. Mesh2PPM predicts the parameters of a parametric pinna model based on cubic Bézier curves (BezierPPM) from a pinna mesh via a vision transformer. We evaluated Mesh2PPM with multi-view renderings of synthetic pinna geometries, providing additional depth information, varying the grids of camera views, and jittering the camera views. While added depth information had no practically relevant effect, a grid with 3×3 camera views facilitated the lowest overall prediction errors and best counteracted the detrimental effects of jitter. For this grid, with and without jitter, the median Pompeiu-Hausdorff distances were 1.98 mm and 1.34 mm, respectively, and the root mean square distances were 0.92 mm and 0.52 mm. A refined analysis targeting the perceptually most important pinna regions for sound localization showed that multi-view information particularly improved the prediction of BezierPPM parameters describing the cavum-conchae region. The accuracy achieved indicates the suitability of Mesh2PPM to retrieve BezierPPM parameters from pinna meshes.
- 1 June 2026
- Published by Acoustical Society of America (ASA) in The Journal of the Acoustical Society of America
- Vol. 159 (6) , 5578-5598
Open AccessPrediction of parameters of a pinna model from synthetic geometries using a vision transformer
The acquisition of the human pinna geometry requires elaborate equipment for accurate results. Even then, the results are often corrupted by measurement artifacts. We introduce Mesh2PPM, a framework facilitating the generation of a personalized and artifact-free pinna mesh. Mesh2PPM predicts the parameters of a parametric pinna model based on cubic Bézier curves (BezierPPM) from a pinna mesh via a vision transformer. We evaluated Mesh2PPM with multi-view renderings of synthetic pinna geometries, providing additional depth information, varying the grids of camera views, and jittering the camera views. While added depth information had no practically relevant effect, a grid with 3×3 camera views facilitated the lowest overall prediction errors and best counteracted the detrimental effects of jitter. For this grid, with and without jitter, the median Pompeiu-Hausdorff distances were 1.98 mm and 1.34 mm, respectively, and the root mean square distances were 0.92 mm and 0.52 mm. A refined analysis targeting the perceptually most important pinna regions for sound localization showed that multi-view information particularly improved the prediction of BezierPPM parameters describing the cavum-conchae region. The accuracy achieved indicates the suitability of Mesh2PPM to retrieve BezierPPM parameters from pinna meshes.
- Open Access
SELEBI: Percussion-aware Time Stretching via Selective Magnitude Spectrogram Compression by Nonstationary Gabor Transform
Phase vocoder-based time-stretching is a widely used technique for the time-scale modification of audio signals. However, conventional implementations suffer from ``percussion smearing,'' a well-known artifact that significantly degrades the quality of percussive components. We attribute this artifact to a fundamental time-scale mismatch between the temporally smeared magnitude spectrogram and the localized, newly generated phase. To address this, we propose SELEBI, a signal-adaptive phase vocoder algorithm that significantly reduces percussion smearing while preserving stability and the perfect reconstruction property. Unlike conventional methods that rely on heuristic processing or component separation, our approach leverages the nonstationary Gabor transform. By dynamically adapting analysis window lengths to assign short windows to intervals containing significant energy associated with percussive components, we directly compute a temporally localized magnitude spectrogram from the time-domain signal. This approach ensures greater consistency between the temporal structures of the magnitude and phase. Furthermore, the perfect reconstruction property of the nonstationary Gabor transform guarantees stable, high-fidelity signal synthesis, in contrast to previous heuristic approaches. Experimental results demonstrate that the proposed method effectively mitigates percussion smearing and yields natural sound quality.
Open AccessSELEBI: Percussion-aware Time Stretching via Selective Magnitude Spectrogram Compression by Nonstationary Gabor Transform
Phase vocoder-based time-stretching is a widely used technique for the time-scale modification of audio signals. However, conventional implementations suffer from ``percussion smearing,'' a well-known artifact that significantly degrades the quality of percussive components. We attribute this artifact to a fundamental time-scale mismatch between the temporally smeared magnitude spectrogram and the localized, newly generated phase. To address this, we propose SELEBI, a signal-adaptive phase vocoder algorithm that significantly reduces percussion smearing while preserving stability and the perfect reconstruction property. Unlike conventional methods that rely on heuristic processing or component separation, our approach leverages the nonstationary Gabor transform. By dynamically adapting analysis window lengths to assign short windows to intervals containing significant energy associated with percussive components, we directly compute a temporally localized magnitude spectrogram from the time-domain signal. This approach ensures greater consistency between the temporal structures of the magnitude and phase. Furthermore, the perfect reconstruction property of the nonstationary Gabor transform guarantees stable, high-fidelity signal synthesis, in contrast to previous heuristic approaches. Experimental results demonstrate that the proposed method effectively mitigates percussion smearing and yields natural sound quality.
- 1 January 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Audio, Speech and Language Processing
- Vol. 34, 3802-3816
Training Set Synthesis for Bioacoustic Denoising: A Case Study With Mice
- 1 January 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Audio, Speech and Language Processing
- Vol. 34, 3802-3816
Training Set Synthesis for Bioacoustic Denoising: A Case Study With Mice
- Open Access
- 1 January 2026
- Published by Acoustical Society of Japan in Acoustical Science and Technology
- Vol. 47 (1) , 13-23
On the crossband filter representations of LTI systems: Algorithms and inversion
Since convolution operators characterize linear time-invariant (LTI) systems, convolution is one of the most fundamental operations in acoustic signal processing. Likewise, the analysis and processing of acoustic signals in the time-frequency domain is commonplace. In this context, LTI systems are often approximated with simple time-frequency domain operations, such as channel-wise multiplicative weights or channel-wise convolution. On the other hand, accurate computation of LTI systems in the time-frequency domain usually requires using crossband filters. However, the algorithms for connecting the LTI systems and the corresponding crossband filters have not been well-established, which has hindered their practical applications. In this paper, we introduce and compare several algorithms for computing the crossband filter representation of a given LTI system. Furthermore, we propose an inverse scheme for converting crossband filters into LTI systems, which is proven to recover the correct LTI system from its crossband filter representation. Efficient algorithms for this conversion are presented. We demonstrate numerically that the conversion of crossband filters into LTI systems is faithful: If the crossband filter represents an LTI system, then the conversion recovers the corresponding impulse response, confirming our theoretical result. Finally, we compare the computation time of forward and inverse conversion for all the presented algorithms.
- 1 January 2026
- Published by Acoustical Society of Japan in Acoustical Science and Technology
- Vol. 47 (1) , 13-23
Open AccessOn the crossband filter representations of LTI systems: Algorithms and inversion
Since convolution operators characterize linear time-invariant (LTI) systems, convolution is one of the most fundamental operations in acoustic signal processing. Likewise, the analysis and processing of acoustic signals in the time-frequency domain is commonplace. In this context, LTI systems are often approximated with simple time-frequency domain operations, such as channel-wise multiplicative weights or channel-wise convolution. On the other hand, accurate computation of LTI systems in the time-frequency domain usually requires using crossband filters. However, the algorithms for connecting the LTI systems and the corresponding crossband filters have not been well-established, which has hindered their practical applications. In this paper, we introduce and compare several algorithms for computing the crossband filter representation of a given LTI system. Furthermore, we propose an inverse scheme for converting crossband filters into LTI systems, which is proven to recover the correct LTI system from its crossband filter representation. Efficient algorithms for this conversion are presented. We demonstrate numerically that the conversion of crossband filters into LTI systems is faithful: If the crossband filter represents an LTI system, then the conversion recovers the corresponding impulse response, confirming our theoretical result. Finally, we compare the computation time of forward and inverse conversion for all the presented algorithms.
- Open Access
- 21 February 2025
- Published by Elsevier in Computers in Biology and Medicine
- Vol. 188, 109817
Parametric model of the human pinna based on Bézier curves and concave deformations
- 21 February 2025
- Published by Elsevier in Computers in Biology and Medicine
- Vol. 188, 109817
Open AccessParametric model of the human pinna based on Bézier curves and concave deformations
- Open Access
- 25 October 2024
- Published by Springer Nature in Journal of Fourier Analysis and Applications
- Vol. 30 (6) , 1-87
Coorbit Theory of Warped Time-Frequency Systems in ${\mathbb {R}}^d$Warped time-frequency systems have recently been introduced as a class of structured continuous frames for functions on the real line. Herein, we generalize this framework to the setting of functions of arbitrary dimensionality. After showing that the basic properties of warped time-frequency representations carry over to higher dimensions, we determine conditions on the warping function which guarantee that the associated Gramian is well-localized, so that associated families of coorbit spaces can be constructed. We then show that discrete Banach frame decompositions for these coorbit spaces can be obtained by sampling the continuous warped time-frequency systems. In particular, this implies that sparsity of a given function f in the discrete warped time-frequency dictionary is equivalent to membership of f in the coorbit space. We put special emphasis on the case of radial warping functions, for which the relevant assumptions simplify considerably.
- 25 October 2024
- Published by Springer Nature in Journal of Fourier Analysis and Applications
- Vol. 30 (6) , 1-87
Open AccessCoorbit Theory of Warped Time-Frequency Systems in ${\mathbb {R}}^d$Warped time-frequency systems have recently been introduced as a class of structured continuous frames for functions on the real line. Herein, we generalize this framework to the setting of functions of arbitrary dimensionality. After showing that the basic properties of warped time-frequency representations carry over to higher dimensions, we determine conditions on the warping function which guarantee that the associated Gramian is well-localized, so that associated families of coorbit spaces can be constructed. We then show that discrete Banach frame decompositions for these coorbit spaces can be obtained by sampling the continuous warped time-frequency systems. In particular, this implies that sparsity of a given function f in the discrete warped time-frequency dictionary is equivalent to membership of f in the coorbit space. We put special emphasis on the case of radial warping functions, for which the relevant assumptions simplify considerably.
- Open Access
Smoothness spaces for warped time-frequency representations -- Decomposition spaces and embedding relations
In a recent paper, we have shown that warped time-frequency representations provide a rich framework for the construction and study of smoothness spaces matched to very general phase space geometries obtained by diffeomorphic deformations of $\mathbb{R}^d$. Here, we study these spaces, obtained through the application of general coorbit theory, using the framework of decomposition spaces. This allows us to derive embedding relations between coorbit spaces associated to different warping functions, and relate them to established, important smothness spaces. In particular, we show that we obtain $α$-modulation spaces and spaces of dominating mixed smoothness as special cases and, in contrast, that this is only possible for Besov spaces if $d=1$.Open AccessSmoothness spaces for warped time-frequency representations -- Decomposition spaces and embedding relations
In a recent paper, we have shown that warped time-frequency representations provide a rich framework for the construction and study of smoothness spaces matched to very general phase space geometries obtained by diffeomorphic deformations of $\mathbb{R}^d$. Here, we study these spaces, obtained through the application of general coorbit theory, using the framework of decomposition spaces. This allows us to derive embedding relations between coorbit spaces associated to different warping functions, and relate them to established, important smothness spaces. In particular, we show that we obtain $α$-modulation spaces and spaces of dominating mixed smoothness as special cases and, in contrast, that this is only possible for Besov spaces if $d=1$. - Open AccessCoorbit theory of warped time-frequency systems in $\mathbb{R}^d$Warped time-frequency systems have recently been introduced as a class of structured continuous frames for functions on the real line. Herein, we generalize this framework to the setting of functions of arbitrary dimensionality. After showing that the basic properties of warped time-frequency representations carry over to higher dimensions, we determine conditions on the warping function which guarantee that the associated Gramian is well-localized, so that associated families of coorbit spaces can be constructed. We then show that discrete Banach frame decompositions for these coorbit spaces can be obtained by sampling the continuous warped time-frequency systems. In particular, this implies that sparsity of a given function $f$ in the discrete warped time-frequency dictionary is equivalent to membership of $f$ in the coorbit space. We put special emphasis on the case of radial warping functions, for which the relevant assumptions simplify considerably.Open AccessCoorbit theory of warped time-frequency systems in $\mathbb{R}^d$Warped time-frequency systems have recently been introduced as a class of structured continuous frames for functions on the real line. Herein, we generalize this framework to the setting of functions of arbitrary dimensionality. After showing that the basic properties of warped time-frequency representations carry over to higher dimensions, we determine conditions on the warping function which guarantee that the associated Gramian is well-localized, so that associated families of coorbit spaces can be constructed. We then show that discrete Banach frame decompositions for these coorbit spaces can be obtained by sampling the continuous warped time-frequency systems. In particular, this implies that sparsity of a given function $f$ in the discrete warped time-frequency dictionary is equivalent to membership of $f$ in the coorbit space. We put special emphasis on the case of radial warping functions, for which the relevant assumptions simplify considerably.
- Open Access
Rotated time-frequency lattices are sets of stable sampling for continuous wavelet systems
We provide an example for the generating matrix $A$ of a two-dimensional lattice $Γ= A\mathbb{Z}^2$, such that the following holds: For any sufficiently smooth and localized mother wavelet $ψ$, there is a constant $β(A,ψ)>0$, such that $βΓ\cap (\mathbb{R}\times\mathbb{R}^+)$ is a set of stable sampling for the wavelet system generated by $ψ$, for all $0<β\leq β(A,ψ)$. The result and choice of the generating matrix are loosely inspired by the studies of low discrepancy sequences and uniform distribution modulo $1$. In particular, we estimate the number of lattice points contained in any axis parallel rectangle of fixed area. This estimate is combined with a recent sampling result for continuous wavelet systems, obtained via the oscillation method of general coorbit theory.Open AccessRotated time-frequency lattices are sets of stable sampling for continuous wavelet systems
We provide an example for the generating matrix $A$ of a two-dimensional lattice $Γ= A\mathbb{Z}^2$, such that the following holds: For any sufficiently smooth and localized mother wavelet $ψ$, there is a constant $β(A,ψ)>0$, such that $βΓ\cap (\mathbb{R}\times\mathbb{R}^+)$ is a set of stable sampling for the wavelet system generated by $ψ$, for all $0<β\leq β(A,ψ)$. The result and choice of the generating matrix are loosely inspired by the studies of low discrepancy sequences and uniform distribution modulo $1$. In particular, we estimate the number of lattice points contained in any axis parallel rectangle of fixed area. This estimate is combined with a recent sampling result for continuous wavelet systems, obtained via the oscillation method of general coorbit theory.