Nicolaos-Alexandros Tatlas

We present a custom platform that integrates data from several sensors measuring synchronously different variables of the beehive and wirelessly transmits all measurements to a cloud server. There is a rich literature on beehive monitoring. The choice of our work is not to use ready platforms such as Arduino and Raspberry Pi and to present a low cost and power solution for long term monitoring. We integrate sensors that are not limited to the typical toolbox of beehive monitoring such as gas, vibrations and bee counters. The synchronous sampling of all sensors every 5 min allows us to form a multivariable time series that serves in two ways: (a) it provides immediate alerting in case a measurement exceeds predefined boundaries that are known to characterize a healthy beehive, and (b) based on historical data predict future levels that are correlated with hive’s health. Finally, we demonstrate the benefit of using additional regressors in the prediction of the variables of interest. The database, the code and a video of the vibrational activity of two months are made open to the interested readers.

We present a custom platform that integrates data from several sensors measuring synchronously different variables of the beehive and wirelessly transmits all measurements to a cloud server. There is a rich literature on beehive monitoring. The choice of our work is not to use ready platforms such as Arduino and Raspberry Pi and to present a low cost and power solution for long term monitoring. We integrate sensors that are not limited to the typical toolbox of beehive monitoring such as gas, vibrations and bee counters. The synchronous sampling of all sensors every 5 minutes allows us to form a multivariable timeseries that serves two-ways: a) it provides immediate alerting in case a measurement exceeds predefined boundaries that are known to characterize a healthy beehive, and b) based on historical data predict future levels that are correlated with hive’s health. Finally, we demonstrate the benefit of using additional regressors in the prediction of the variables of interest. The database, the code and a video of the vibrational activity of two months are made open to the interested readers.

Obstructive sleep apnea hypopnea syndrome (OSAHS) is a widespread chronic disease that mostly remains undetected, mainly due to the fact that it is diagnosed via polysomnography, which is a time and resource-intensive procedure. Screening the disease’s symptoms at home could be used as an alternative approach in order to alert individuals that potentially suffer from OSAHS without compromising their everyday routine. Since snoring is usually linked to OSAHS, developing a snore detector is appealing as an enabling technology for screening OSAHS at home using ubiquitous equipment like commodity microphones (included in, e.g., smartphones). In this context, we developed a snore detection tool and herein present our approach and selection of specific sound features that discriminate snoring vs. environmental sounds, as well as the performance of the proposed tool. Furthermore, a real-time snore detector (RTSD) is built upon the snore detection tool and employed in whole-night sleep sound recordings, resulting in a large dataset of snoring sound excerpts that are made freely available to the public. The RTSD may be used either as a stand-alone tool that offers insight concerning an individual’s sleep quality or as an independent component of OSAHS screening applications in future developments.

The most common index for diagnosing Sleep Apnea Syndrome (SAS) is the Apnea-Hypopnea Index (AHI), defined as the average count of apnea/hypopnea events per sleeping hour. Despite its broad use in automated systems for SAS severity estimation, researchers now focus on individual event time detection rather than the insufficient classification of the patient in SAS severity groups. Towards this direction, in this work, we aim at the detection of the exact time location of apnea/hypopnea events. We particularly examine the hypothesis of employing a standard Voice Activity Detection (VAD) algorithm to extract breathing segments during sleep and identify the respiratory events from severely altered breathing amplitude within the event. The algorithm, which is tested only in severe and moderate patients, is applied to recordings from a tracheal and an ambient microphone. It proves good sensitivity for apneas, reaching 81% and 70.4% for the two microphones, respectively, and moderate sensitivity to hypopneas—approx. 50% were identified. The algorithm also presents an adequate estimator of the Mean Apnea Duration index—defined as the average duration of the detected events—for patients with severe or moderate apnea, with mean error 1.7 s and 3.2 s for the two microphones, respectively.

Is there a wood-feeding insect inside a tree or wooden structure? We investigate several ways of how deep learning approaches can massively scan recordings of vibrations stemming from probed trees to infer their infestation state with wood-boring insects that feed and move inside wood. The recordings come from remotely controlled devices that sample the internal soundscape of trees on a 24/7 basis and wirelessly transmit brief recordings of the registered vibrations to a cloud server. We discuss the different sources of vibrations that can be picked up from trees in urban environments and how deep learning methods can focus on those originating from borers. Our goal is to match the problem of the accelerated—due to global trade and climate change— establishment of invasive xylophagus insects by increasing the capacity of inspection agencies. We aim at introducing permanent, cost-effective, automatic monitoring of trees based on deep learning techniques, in commodity entry points as well as in wild, urban and cultivated areas in order to effect large-scale, sustainable pest-risk analysis and management of wood boring insects such as those from the Cerambycidae family (longhorn beetles).

Is there a wood-feeding insect inside a tree or wooden structure? We investigate several ways on how deep learning approaches can massively scan recordings of vibrations stemming from probed trees to infer their infestation state with wood-boring insects that feed and move inside wood. The recordings come from remotely controlled devices that sample the internal soundscape of trees on a 24/7 basis and wirelessly transmit brief recordings of the registered vibrations to a cloud server. We discuss the different sources of vibrations that can be picked up from trees in urban environments and how deep learning methods can focus on those originating from borers. Our goal is to match the problem of the accelerated—due to global trade and climate change— establishment of invasive xylophagus insects by increasing the capacity of inspection agencies. We aim at introducing permanent, cost-effective, automatic monitoring of trees based on deep learning techniques, in commodity entry point as well as in wild, urban and cultivated areas in order to effect large-scale, sustainable pest-risk analysis and management of wood boring insects such as those from the Cerambycidae family (longhorn beetles).

In this work, we present an electronic gate that aims to extract a deeper representational signal of the color characterization of the main body of an insect, namely: a) we record the backscattered light and not the extinction light as commonly done, b) a color sensor analyses backscattered light to individual RGB channels independently to grasp the melanization, microstructural and color features of the wing and body of the insects passing the gate. We present all the necessary details to reproduce the device and we analyze many insects of interest like the bee Apis mellifera and the wasp Polistes gallicus. The electronic gate is attached to the entrance of the beehive and counts foraging activity. The backscattered light intensity can quantify the size of the incoming insect and discern a drone and a worker bee from a queen bee while the color measurements aim to recognize invasive species so that the gate closes and the beekeepers are alerted.

Cultural heritage sites, apart from being the tangible link to a country’s history and culture, actively contribute to the national economy, offering a foundation upon which cultural tourism can develop. This importance at the cultural and economic level, advocates for the need for preservation of cultural heritage sites for the future generations. To this end, advanced monitoring systems harnessing the power of sensors are deployed near the sites to collect data which can fuel systems and processes aimed at protection and preservation. In this paper we present the use of acoustic sensors for safeguarding cultural sites located in rural or urban areas, based on a novel data flow framework. We developed and deployed Wireless Acoustic Sensors Networks that record audio signals, which are transferred to a modular cloud platform to be processed using an efficient deep learning algorithm (f1-score: 0.838) to identify audio sources of interest for each site, taking into account the materials the assets are made of. The extracted information is presented exploiting the designed STORM Audio Signal ontology and then fused with spatiotemporal information using semantic rules. The results of this work give valuable insight to the cultural experts and are publicly available using the Linked Open Data format.

This work introduces a device for long term systematic monitoring of trees against borers. A widely applied way to detect wood-boring insects is to insert a piezoelectric probe with an uncoated waveguide in the tree trunk and listen for locomotion or feeding sounds through headphones. This approach has several shortcomings: (a) frequent manual inspection of trees is costly and impractical to scale to hundreds or thousands of trees, (b) the larvae could be present but inactive during the inspection time and, (c) when the trees are in urban environments the background noise can be significant and can mask the feeble sounds of wood-boring insects even with the use of specialized headphones. We introduce a remotely controlled device that records and wirelessly transmits on a scheduled basis short recordings of the internal vibrations of a tree to a server. The user can listen remotely or process the recording automatically to infer the infestation state of the tree with wood-boring insects that feed or move inside the tree. When integrated within the IoT framework this device can scale up to automatically monitoring the trees of the entire city. The proposed approach led to detection results in field trials of the pests Xylotrechus chinensis (Chevrolat) (Cerambycidae) and Rhynchophorus ferrugineus Olivier (Coleoptera: Curculionidae).

Most reported optical recorders of the wingbeat of insects are based on the so-called extinction light, which is the variation of light in the receiver due to the cast shadow of the insect’s wings and main body. In this type of recording devices, the emitter uses light and is placed opposite to the receiver, which is usually a single (or multiple) photodiode. In this work, we present a different kind of wingbeat sensor and its associated recorder that aims to extract a deeper representational signal of the wingbeat event and color characterization of the main body of the insect, namely: a) we record the backscattered light that is richer in harmonics than the extinction light, b) we use three different spectral bands, i.e., a multispectral approach that aims to grasp the melanization and microstructural and color features of the wing and body of the insects, and c) we average at the receiver’s level the backscattered signal from many LEDs that illuminate the wingbeating insect from multiple orientations and thus offer a smoother and more complete signal than one based on a single snapshot. We present all the necessary details to reproduce the device and we analyze many insects of interest like the bee Apis mellifera, the wasp Polistes gallicus, and some insects whose wingbeating characteristics are pending in the current literature, like Drosophila suzukii and Zaprionus, another member of the drosophilidae family.