Julius Orion Smith
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Julius Orion Smith has a total of 21 co-authors. Here are the top co-authors by number of shared publications:
- Chris Chafe
Stanford University
2 shared publications - Vesa Välimäki
Acoustics Laboratory, Department of Information and Communications Engineering, Aalto University, Espoo, Finland
2 shared publications - Balázs Bank
Budapest Univ Technol & Econ, Dept Measurement & Informat Syst, H-1521 Budapest, Hungary
1 shared publication - Edgar Berdahl
Music, Louisiana State Univ., 102 New Music Bldg., Baton Rouge, LA 70803
1 shared publication - Ge Wang
Center for Computer Research in Music and Acoustics (CCRMA), Stanford University
1 shared publication - Georg Essl
University of Wisconsin – Milwaukee
1 shared publication
Latest Publications
- 5 February 2020
- Published by Audio Engineering Society in Journal of the Audio Engineering Society
- Vol. 68 (1/2) , 78-86
Improved Real-Time Monophonic Pitch Tracking with the Extended Complex Kalman Filter
This paper proposes a real-time, sample-by-sample pitch tracker for monophonic audio signals using the Extended Kalman Filter in the complex domain, called an Extended Complex Kalman Filter (ECKF). It improves upon the algorithm proposed in a previous paper by fixing the issue of slow tracking of rapid note changes. It does so by detecting harmonic change in the signal, and resetting the filter whenever a significant harmonic change is detected. Along with the fundamental frequency, the ECKF...
- 5 February 2020
- Published by Audio Engineering Society in Journal of the Audio Engineering Society
- Vol. 68 (1/2) , 78-86
Improved Real-Time Monophonic Pitch Tracking with the Extended Complex Kalman Filter
This paper proposes a real-time, sample-by-sample pitch tracker for monophonic audio signals using the Extended Kalman Filter in the complex domain, called an Extended Complex Kalman Filter (ECKF). It improves upon the algorithm proposed in a previous paper by fixing the issue of slow tracking of rapid note changes. It does so by detecting harmonic change in the signal, and resetting the filter whenever a significant harmonic change is detected. Along with the fundamental frequency, the ECKF...
- Open Access
- 28 May 2019
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Signal Processing
- Vol. 67 (14) , 3785-3795
Converting Series Biquad Filters Into Delayed Parallel Form: Application to Graphic Equalizers
It is well known that a digital filter transfer function can be converted between the direct form and parallel connections of elementary sections, typically second-order ("biquad") sections. The conversion from direct to parallel form is performed using a partial fraction expansion, which usually requires long division of polynomials when expanding proper and improper transfer functions. This paper focuses on the conversion of a series of biquad sections to the parallel form, and proposes a novel way to implement the partial fraction expansion without the use of long division. Additionally, the resulting structure is the delayed parallel form in which the section gains remain small. The new design and previous methods are compared in a case study on graphic equalizer design. It is shown that the delayed parallel filter uses the same number of operations as the series form during filtering. The conversion of a recently proposed series graphic equalizer into the delayed parallel form leads to an improved parallel graphic equalizer design relative to all known prior approaches. The proposed conversion technique is widely applicable to the design of parallel IIR filters, which are becoming popular as they are well suited to implementation using parallel computers.
- 28 May 2019
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Signal Processing
- Vol. 67 (14) , 3785-3795
Open AccessConverting Series Biquad Filters Into Delayed Parallel Form: Application to Graphic Equalizers
It is well known that a digital filter transfer function can be converted between the direct form and parallel connections of elementary sections, typically second-order ("biquad") sections. The conversion from direct to parallel form is performed using a partial fraction expansion, which usually requires long division of polynomials when expanding proper and improper transfer functions. This paper focuses on the conversion of a series of biquad sections to the parallel form, and proposes a novel way to implement the partial fraction expansion without the use of long division. Additionally, the resulting structure is the delayed parallel form in which the section gains remain small. The new design and previous methods are compared in a case study on graphic equalizer design. It is shown that the delayed parallel filter uses the same number of operations as the series form during filtering. The conversion of a recently proposed series graphic equalizer into the delayed parallel form leads to an improved parallel graphic equalizer design relative to all known prior approaches. The proposed conversion technique is widely applicable to the design of parallel IIR filters, which are becoming popular as they are well suited to implementation using parallel computers.
- Open Access
Neural Style Transfer for Audio Spectograms
There has been fascinating work on creating artistic transformations of images by Gatys. This was revolutionary in how we can in some sense alter the 'style' of an image while generally preserving its 'content'. In our work, we present a method for creating new sounds using a similar approach, treating it as a style-transfer problem, starting from a random-noise input signal and iteratively using back-propagation to optimize the sound to conform to filter-outputs from a pre-trained neural architecture of interest. For demonstration, we investigate two different tasks, resulting in bandwidth expansion/compression, and timbral transfer from singing voice to musical instruments. A feature of our method is that a single architecture can generate these different audio-style-transfer types using the same set of parameters which otherwise require different complex hand-tuned diverse signal processing pipelines.
Open AccessNeural Style Transfer for Audio Spectograms
There has been fascinating work on creating artistic transformations of images by Gatys. This was revolutionary in how we can in some sense alter the 'style' of an image while generally preserving its 'content'. In our work, we present a method for creating new sounds using a similar approach, treating it as a style-transfer problem, starting from a random-noise input signal and iteratively using back-propagation to optimize the sound to conform to filter-outputs from a pre-trained neural architecture of interest. For demonstration, we investigate two different tasks, resulting in bandwidth expansion/compression, and timbral transfer from singing voice to musical instruments. A feature of our method is that a single architecture can generate these different audio-style-transfer types using the same set of parameters which otherwise require different complex hand-tuned diverse signal processing pipelines.
- Open Access
- 19 December 2017
- Published by MDPI AG in Applied Sciences
- Vol. 7 (12) , 1311
Mobile Music, Sensors, Physical Modeling, and Digital Fabrication: Articulating the Augmented Mobile Instrument
Two concepts are presented, extended, and unified in this paper: mobile device augmentation towards musical instruments design and the concept of hybrid instruments. The first consists of using mobile devices at the heart of novel musical instruments. Smartphones and tablets are augmented with passive and active elements that can take part in the production of sound (e.g., resonators, exciter, etc.), add new affordances to the device, or change its global aesthetics and shape. Hybrid instruments combine physical/acoustical and “physically informed” virtual/digital elements. Recent progress in physical modeling of musical instruments and digital fabrication is exploited to treat instrument parts in a multidimensional way, allowing any physical element to be substituted with a virtual one and vice versa (as long as it is physically possible). A wide range of tools to design mobile hybrid instruments is introduced and evaluated. Aesthetic and design considerations when making such instruments are also presented through a series of examples.
- 19 December 2017
- Published by MDPI AG in Applied Sciences
- Vol. 7 (12) , 1311
Open AccessMobile Music, Sensors, Physical Modeling, and Digital Fabrication: Articulating the Augmented Mobile Instrument
Two concepts are presented, extended, and unified in this paper: mobile device augmentation towards musical instruments design and the concept of hybrid instruments. The first consists of using mobile devices at the heart of novel musical instruments. Smartphones and tablets are augmented with passive and active elements that can take part in the production of sound (e.g., resonators, exciter, etc.), add new affordances to the device, or change its global aesthetics and shape. Hybrid instruments combine physical/acoustical and “physically informed” virtual/digital elements. Recent progress in physical modeling of musical instruments and digital fabrication is exploited to treat instrument parts in a multidimensional way, allowing any physical element to be substituted with a virtual one and vice versa (as long as it is physically possible). A wide range of tools to design mobile hybrid instruments is introduced and evaluated. Aesthetic and design considerations when making such instruments are also presented through a series of examples.
- 1 May 2017
- Published by Acoustical Society of America (ASA) in The Journal of the Acoustical Society of America
- Vol. 141 (5_Suppleme) , 3961
Physical model of a drum using an edge-diffraction approach
Physical modeling of musical instruments is of great interest, both due to the interpretation of the parameters that make the model as similar to reality as possible, and because of the faithful sound synthesis. In this paper we will focus on the modeling of percussion instruments and more concretely drums consisting of a vibrating membrane and a rigid body. One recently published physical model [S. Bilbao and C. J. Webb, J. Audio Eng. Soc. 61 (2013) 737-748] uses finite difference time domain schemes to solve both the system of equations describing the dynamics of the membrane, and the influence of the surrounding air. The main drawback of that approach is the growth of computation cost with the scale of the problem. A new approach is suggested here where an edge diffraction-based method [A. Asheim, U. P. Svensson, J. Acoust. Soc. Am. 133 (2013) 3681-3691] is used to compute both the air loading on the surface and the sound radiation. The finite difference time domain method is used in this approach too but only to solve the dynamics of the membrane. The computational complexity is evaluated and results are compared to reference solutions.
- 1 May 2017
- Published by Acoustical Society of America (ASA) in The Journal of the Acoustical Society of America
- Vol. 141 (5_Suppleme) , 3961
Physical model of a drum using an edge-diffraction approach
Physical modeling of musical instruments is of great interest, both due to the interpretation of the parameters that make the model as similar to reality as possible, and because of the faithful sound synthesis. In this paper we will focus on the modeling of percussion instruments and more concretely drums consisting of a vibrating membrane and a rigid body. One recently published physical model [S. Bilbao and C. J. Webb, J. Audio Eng. Soc. 61 (2013) 737-748] uses finite difference time domain schemes to solve both the system of equations describing the dynamics of the membrane, and the influence of the surrounding air. The main drawback of that approach is the growth of computation cost with the scale of the problem. A new approach is suggested here where an edge diffraction-based method [A. Asheim, U. P. Svensson, J. Acoust. Soc. Am. 133 (2013) 3681-3691] is used to compute both the air loading on the surface and the sound radiation. The finite difference time domain method is used in this approach too but only to solve the dynamics of the membrane. The computational complexity is evaluated and results are compared to reference solutions.
- Open Access
- 30 October 2009
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Audio, Speech, and Language Processing
- Vol. 18 (4) , 773-785
Efficient Antialiasing Oscillator Algorithms Using Low-Order Fractional Delay Filters
One of the challenges in virtual analog synthesis is avoiding aliasing when generating classic waveforms such as sawtooth and square wave which have theoretically infinite bandwidth in their ideal forms. The human auditory system renders a certain amount of aliasing inaudible, which allows room for finding cost-effective algorithms. This paper suggests efficient algorithms to reduce the aliasing using low-order fractional delay filters in the framework of bandlimited impulse train (BLIT) synthesis. Examining Lagrange, B-spline interpolators and allpass fractional delay filters, optimized methods will be discussed for generating classic waveforms (sawtooth, square, and triangle). Techniques for generating more complicated harmonics such as pulse width modulation, hard-sync, and super-saw are also presented. The perceptual evaluation is performed by comparing the threshold of hearing and masking curve of oscillators with their aliasing levels. The result shows that the BLIT using the computationally efficient third-order B-spline generates waveforms that are perceptually free of aliasing within practically used fundamental frequencies.
- 30 October 2009
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Audio, Speech, and Language Processing
- Vol. 18 (4) , 773-785
Open AccessEfficient Antialiasing Oscillator Algorithms Using Low-Order Fractional Delay Filters
One of the challenges in virtual analog synthesis is avoiding aliasing when generating classic waveforms such as sawtooth and square wave which have theoretically infinite bandwidth in their ideal forms. The human auditory system renders a certain amount of aliasing inaudible, which allows room for finding cost-effective algorithms. This paper suggests efficient algorithms to reduce the aliasing using low-order fractional delay filters in the framework of bandlimited impulse train (BLIT) synthesis. Examining Lagrange, B-spline interpolators and allpass fractional delay filters, optimized methods will be discussed for generating classic waveforms (sawtooth, square, and triangle). Techniques for generating more complicated harmonics such as pulse width modulation, hard-sync, and super-saw are also presented. The perceptual evaluation is performed by comparing the threshold of hearing and masking curve of oscillators with their aliasing levels. The result shows that the BLIT using the computationally efficient third-order B-spline generates waveforms that are perceptually free of aliasing within practically used fundamental frequencies.
- 1 October 2007
- Published by Institute of Electrical and Electronics Engineers (IEEE) in 2007 IEEE International Conference on Control Applications
- No. 10851992,p. 1336-1341
Inducing Unusual Dynamics in Acoustic Musical Instruments
The dynamic behavior of an acoustic musical instrument can be drastically modified by closing a feedback loop around even a single sensor and actuator. After reviewing proportional-integral-derivative (PID) control, we analyze RMS level-tracking controllers, which induce a stable limit cycle with specified RMS level when an audio effect is placed in the feedback loop. The space of the RMS level-tracking controllers whose error converges exponentially to zero is succinctly described, and this space is augmented to include controllers that support multiple stable equilibria. Next, an adaptive RMS level-tracking controller is developed that can accommodate changing instrument and audio effect parameters. Finally, several example controllers are tested on a simulated vibrating string to demonstrate 1) creating multiple stable equilibria, 2) driving amplitudes of the string harmonics to various targets (for instance to make the string "sing" vowels), and 3) reducing the dynamic range of resonant ring modulation for time-varying effect parameters.
- 1 October 2007
- Published by Institute of Electrical and Electronics Engineers (IEEE) in 2007 IEEE International Conference on Control Applications
- No. 10851992,p. 1336-1341
Inducing Unusual Dynamics in Acoustic Musical Instruments
The dynamic behavior of an acoustic musical instrument can be drastically modified by closing a feedback loop around even a single sensor and actuator. After reviewing proportional-integral-derivative (PID) control, we analyze RMS level-tracking controllers, which induce a stable limit cycle with specified RMS level when an audio effect is placed in the feedback loop. The space of the RMS level-tracking controllers whose error converges exponentially to zero is succinctly described, and this space is augmented to include controllers that support multiple stable equilibria. Next, an adaptive RMS level-tracking controller is developed that can accommodate changing instrument and audio effect parameters. Finally, several example controllers are tested on a simulated vibrating string to demonstrate 1) creating multiple stable equilibria, 2) driving amplitudes of the string harmonics to various targets (for instance to make the string "sing" vowels), and 3) reducing the dynamic range of resonant ring modulation for time-varying effect parameters.
- 1 August 2007
- Published by Institute of Electrical and Electronics Engineers (IEEE) in Midwest Symposium on Circuits and Systems (mwscas)
- No. 15483746,p. 421-422
Efficient time-varying loudness estimation via the hopping Goertzel DFT
The efficient and accurate time-varying measurement of loudness is an important problem in audio and acoustics. In this work, we present an optimization to the multi-resolution spectrogram used in the loudness model of Glasberg and Moore (Jour. Aud. Eng. Soc, 2002). This optimization is based on a modification to the sliding Goertzel DFT algorithm, referred to as the hopping Goertzel DFT. As in Glasberg and Moore's model, multi-resolution spectra are computed at 1 ms intervals, using 6 different bands with spectral resolution inversely proportional to frequency. Initial PC-based tests show a significant efficiency improvement with the hopping Goertzel technique versus the use of parallel FFTs for multi-resolution spectrogram computation.
- 1 August 2007
- Published by Institute of Electrical and Electronics Engineers (IEEE) in Midwest Symposium on Circuits and Systems (mwscas)
- No. 15483746,p. 421-422
Efficient time-varying loudness estimation via the hopping Goertzel DFT
The efficient and accurate time-varying measurement of loudness is an important problem in audio and acoustics. In this work, we present an optimization to the multi-resolution spectrogram used in the loudness model of Glasberg and Moore (Jour. Aud. Eng. Soc, 2002). This optimization is based on a modification to the sliding Goertzel DFT algorithm, referred to as the hopping Goertzel DFT. As in Glasberg and Moore's model, multi-resolution spectra are computed at 1 ms intervals, using 6 different bands with spectral resolution inversely proportional to frequency. Initial PC-based tests show a significant efficiency improvement with the hopping Goertzel technique versus the use of parallel FFTs for multi-resolution spectrogram computation.
- Open Access
On the Equivalence of the Digital Waveguide and Finite Difference Time Domain Schemes
It is known that the digital waveguide (DW) method for solving the wave equation numerically on a grid can be manipulated into the form of the standard finite-difference time-domain (FDTD) method (also known as the ``leapfrog'' recursion). This paper derives a simple rule for going in the other direction, that is, converting the state variables of the FDTD recursion to corresponding wave variables in a DW simulation. Since boundary conditions and initial values are more intuitively transparent in the DW formulation, the simple means of converting back and forth can be useful in initializing and constructing boundaries for FDTD simulations.
Open AccessOn the Equivalence of the Digital Waveguide and Finite Difference Time Domain Schemes
It is known that the digital waveguide (DW) method for solving the wave equation numerically on a grid can be manipulated into the form of the standard finite-difference time-domain (FDTD) method (also known as the ``leapfrog'' recursion). This paper derives a simple rule for going in the other direction, that is, converting the state variables of the FDTD recursion to corresponding wave variables in a DW simulation. Since boundary conditions and initial values are more intuitively transparent in the DW formulation, the simple means of converting back and forth can be useful in initializing and constructing boundaries for FDTD simulations.
- 1 March 2004
- Published by MIT Press in Computer Music Journal
- Vol. 28 (1) , 37-50
Theory of Banded Waveguides
- 1 March 2004
- Published by MIT Press in Computer Music Journal
- Vol. 28 (1) , 37-50
Theory of Banded Waveguides