JSJulius Orion Smith

Julius Orion Smith

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


Julius Orion Smith has a total of 21 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Improved Real-Time Monophonic Pitch Tracking with the Extended Complex Kalman Filter

    by Orchisama Das, Julius O. Smith, Chris Chafe

    This paper proposes a real-time, sample-by-sample pitch tracker for monophonic audio signals using the Extended Kalman Filter in the complex domain, called an Extended Complex Kalman Filter (ECKF). It improves upon the algorithm proposed in a previous paper by fixing the issue of slow tracking of rapid note changes. It does so by detecting harmonic change in the signal, and resetting the filter whenever a significant harmonic change is detected. Along with the fundamental frequency, the ECKF...


  • Open Access

    Converting Series Biquad Filters Into Delayed Parallel Form: Application to Graphic Equalizers

    by Juho Liski, Balazs Bank, Julius O. Smith, Vesa Valimaki

    It is well known that a digital filter transfer function can be converted between the direct form and parallel connections of elementary sections, typically second-order ("biquad") sections. The conversion from direct to parallel form is performed using a partial fraction expansion, which usually requires long division of polynomials when expanding proper and improper transfer functions. This paper focuses on the conversion of a series of biquad sections to the parallel form, and proposes a novel way to implement the partial fraction expansion without the use of long division. Additionally, the resulting structure is the delayed parallel form in which the section gains remain small. The new design and previous methods are compared in a case study on graphic equalizer design. It is shown that the delayed parallel filter uses the same number of operations as the series form during filtering. The conversion of a recently proposed series graphic equalizer into the delayed parallel form leads to an improved parallel graphic equalizer design relative to all known prior approaches. The proposed conversion technique is widely applicable to the design of parallel IIR filters, which are becoming popular as they are well suited to implementation using parallel computers.


  • Open Access

    Neural Style Transfer for Audio Spectograms

    by Prateek Verma, Julius O. Smith

    There has been fascinating work on creating artistic transformations of images by Gatys. This was revolutionary in how we can in some sense alter the 'style' of an image while generally preserving its 'content'. In our work, we present a method for creating new sounds using a similar approach, treating it as a style-transfer problem, starting from a random-noise input signal and iteratively using back-propagation to optimize the sound to conform to filter-outputs from a pre-trained neural architecture of interest. For demonstration, we investigate two different tasks, resulting in bandwidth expansion/compression, and timbral transfer from singing voice to musical instruments. A feature of our method is that a single architecture can generate these different audio-style-transfer types using the same set of parameters which otherwise require different complex hand-tuned diverse signal processing pipelines.

  • Open Access

    Mobile Music, Sensors, Physical Modeling, and Digital Fabrication: Articulating the Augmented Mobile Instrument

    by Romain Michon, Julius Orion Smith, Matthew Wright, Chris Chafe, John Granzow, Ge Wang

    Two concepts are presented, extended, and unified in this paper: mobile device augmentation towards musical instruments design and the concept of hybrid instruments. The first consists of using mobile devices at the heart of novel musical instruments. Smartphones and tablets are augmented with passive and active elements that can take part in the production of sound (e.g., resonators, exciter, etc.), add new affordances to the device, or change its global aesthetics and shape. Hybrid instruments combine physical/acoustical and “physically informed” virtual/digital elements. Recent progress in physical modeling of musical instruments and digital fabrication is exploited to treat instrument parts in a multidimensional way, allowing any physical element to be substituted with a virtual one and vice versa (as long as it is physically possible). A wide range of tools to design mobile hybrid instruments is introduced and evaluated. Aesthetic and design considerations when making such instruments are also presented through a series of examples.


  • Physical model of a drum using an edge-diffraction approach

    by Sara R. Martín Román, U. Peter Svensson, Mark Rau, Julius O. Smith

    Physical modeling of musical instruments is of great interest, both due to the interpretation of the parameters that make the model as similar to reality as possible, and because of the faithful sound synthesis. In this paper we will focus on the modeling of percussion instruments and more concretely drums consisting of a vibrating membrane and a rigid body. One recently published physical model [S. Bilbao and C. J. Webb, J. Audio Eng. Soc. 61 (2013) 737-748] uses finite difference time domain schemes to solve both the system of equations describing the dynamics of the membrane, and the influence of the surrounding air. The main drawback of that approach is the growth of computation cost with the scale of the problem. A new approach is suggested here where an edge diffraction-based method [A. Asheim, U. P. Svensson, J. Acoust. Soc. Am. 133 (2013) 3681-3691] is used to compute both the air loading on the surface and the sound radiation. The finite difference time domain method is used in this approach too but only to solve the dynamics of the membrane. The computational complexity is evaluated and results are compared to reference solutions.

  • Open Access

    Efficient Antialiasing Oscillator Algorithms Using Low-Order Fractional Delay Filters

    by Juhan Nam, Vesa Valimaki, Jonathan S. Abel, Julius O. Smith

    One of the challenges in virtual analog synthesis is avoiding aliasing when generating classic waveforms such as sawtooth and square wave which have theoretically infinite bandwidth in their ideal forms. The human auditory system renders a certain amount of aliasing inaudible, which allows room for finding cost-effective algorithms. This paper suggests efficient algorithms to reduce the aliasing using low-order fractional delay filters in the framework of bandlimited impulse train (BLIT) synthesis. Examining Lagrange, B-spline interpolators and allpass fractional delay filters, optimized methods will be discussed for generating classic waveforms (sawtooth, square, and triangle). Techniques for generating more complicated harmonics such as pulse width modulation, hard-sync, and super-saw are also presented. The perceptual evaluation is performed by comparing the threshold of hearing and masking curve of oscillators with their aliasing levels. The result shows that the BLIT using the computationally efficient third-order B-spline generates waveforms that are perceptually free of aliasing within practically used fundamental frequencies.


  • Inducing Unusual Dynamics in Acoustic Musical Instruments

    by Edgar Berdahl, Julius O. Smith

    The dynamic behavior of an acoustic musical instrument can be drastically modified by closing a feedback loop around even a single sensor and actuator. After reviewing proportional-integral-derivative (PID) control, we analyze RMS level-tracking controllers, which induce a stable limit cycle with specified RMS level when an audio effect is placed in the feedback loop. The space of the RMS level-tracking controllers whose error converges exponentially to zero is succinctly described, and this space is augmented to include controllers that support multiple stable equilibria. Next, an adaptive RMS level-tracking controller is developed that can accommodate changing instrument and audio effect parameters. Finally, several example controllers are tested on a simulated vibrating string to demonstrate 1) creating multiple stable equilibria, 2) driving amplitudes of the string harmonics to various targets (for instance to make the string "sing" vowels), and 3) reducing the dynamic range of resonant ring modulation for time-varying effect parameters.


  • Efficient time-varying loudness estimation via the hopping Goertzel DFT

    by Ryan J. Cassidy, Julius O. Smith

    The efficient and accurate time-varying measurement of loudness is an important problem in audio and acoustics. In this work, we present an optimization to the multi-resolution spectrogram used in the loudness model of Glasberg and Moore (Jour. Aud. Eng. Soc, 2002). This optimization is based on a modification to the sliding Goertzel DFT algorithm, referred to as the hopping Goertzel DFT. As in Glasberg and Moore's model, multi-resolution spectra are computed at 1 ms intervals, using 6 different bands with spectral resolution inversely proportional to frequency. Initial PC-based tests show a significant efficiency improvement with the hopping Goertzel technique versus the use of parallel FFTs for multi-resolution spectrogram computation.


  • Open Access

    On the Equivalence of the Digital Waveguide and Finite Difference Time Domain Schemes

    by Julius O. Smith Iii

    It is known that the digital waveguide (DW) method for solving the wave equation numerically on a grid can be manipulated into the form of the standard finite-difference time-domain (FDTD) method (also known as the ``leapfrog'' recursion). This paper derives a simple rule for going in the other direction, that is, converting the state variables of the FDTD recursion to corresponding wave variables in a DW simulation. Since boundary conditions and initial values are more intuitively transparent in the DW formulation, the simple means of converting back and forth can be useful in initializing and constructing boundaries for FDTD simulations.

  • Theory of Banded Waveguides

    by Georg Essl, Stefania Serafin, Perry R. Cook, Julius O. Smith