Jan Harkes
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Research Interests
Jan Harkes has a total of 25 co-authors. Here are the top co-authors by number of shared publications:
- Mahadev Satyanarayanan
Carnegie Mellon University, Pittsburgh, PA, USA
9 shared publications - Eric Sturzinger
Carnegie Mellon University
3 shared publications - Padmanabhan Pillai
School of Computer Science, Carnegie Mellon University, Pittsburgh, PA, USA
3 shared publications - Ari Granevich
Ben-Gurion University of the Negev
2 shared publications - Gil Goldman
Department of Applied Mathematics Tel Aviv University 69978 Tel Aviv Israel
2 shared publications - James Blakley
Carnegie Mellon Univ
2 shared publications
Latest Publications
- Open Access
- 20 June 2026
- Published by Association for Computing Machinery (ACM)
- p. 418-431
Towards Fast and Fully Automatic Drone Mapping
- 20 June 2026
- Published by Association for Computing Machinery (ACM)
- p. 418-431
Open AccessTowards Fast and Fully Automatic Drone Mapping
- Open Access
- 20 July 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-13
CarbonEdge: Leveraging Mesoscale Spatial Carbon-Intensity Variations for Low Carbon Edge Computing
- 20 July 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-13
Open AccessCarbonEdge: Leveraging Mesoscale Spatial Carbon-Intensity Variations for Low Carbon Edge Computing
- Open Access
- 26 February 2025
- Published by Association for Computing Machinery (ACM)
- p. 31-36
Using Radar for Edge-based Live Learning
This paper describes how a system that performs Live Learning can be modified to use radar rather than visible light. The pipelined and iterative machine learning (ML) workflow of this system can operate at low network bandwidths for selective transmission of rare unlabeled events embedded in high-bandwidth real-time sensor data. While radar offers greater range and can overcome the severe signal attenuation experienced by visible light under conditions such as rain or fog, it poses a number of challenges for ML. This paper describes how these challenges can be overcome for Live Learning, and identifies some future directions for research.
- 26 February 2025
- Published by Association for Computing Machinery (ACM)
- p. 31-36
Open AccessUsing Radar for Edge-based Live Learning
This paper describes how a system that performs Live Learning can be modified to use radar rather than visible light. The pipelined and iterative machine learning (ML) workflow of this system can operate at low network bandwidths for selective transmission of rare unlabeled events embedded in high-bandwidth real-time sensor data. While radar offers greater range and can overcome the severe signal attenuation experienced by visible light under conditions such as rain or fog, it poses a number of challenges for ML. This paper describes how these challenges can be overcome for Live Learning, and identifies some future directions for research.
- Open Access
- 26 February 2025
- Published by Association for Computing Machinery (ACM)
- p. 121
Using Radar for Edge-based Live Learning
- 26 February 2025
- Published by Association for Computing Machinery (ACM)
- p. 121
Open AccessUsing Radar for Edge-based Live Learning
- Open Access
- 17 October 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Emerging Topics in Computing
- Vol. 13 (1) , 34-47
Edge-Based Live Learning for Robot Survival
We introduce survival-critical machine learning (SCML), in which a robot encounters dynamically evolving threats that it recognizes via machine learning (ML), and then neutralizes. We model survivability in SCML, and show the value of the recently developed approach of Live Learning. This edge-based ML technique embodies an iterative human-in-the-loop workflow that concurrently enlarges the training set, trains the next model in a sequence of “best-so-far” models, and performs inferencing for both threat detection and pseudo-labeling. We present experimental results using datasets from the domains of drone surveillance, planetary exploration, and underwater sensing to quantify the effectiveness of Live Learning as a mechanism for SCML.
- 17 October 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Emerging Topics in Computing
- Vol. 13 (1) , 34-47
Open AccessEdge-Based Live Learning for Robot Survival
We introduce survival-critical machine learning (SCML), in which a robot encounters dynamically evolving threats that it recognizes via machine learning (ML), and then neutralizes. We model survivability in SCML, and show the value of the recently developed approach of Live Learning. This edge-based ML technique embodies an iterative human-in-the-loop workflow that concurrently enlarges the training set, trains the next model in a sequence of “best-so-far” models, and performs inferencing for both threat detection and pseudo-labeling. We present experimental results using datasets from the domains of drone surveillance, planetary exploration, and underwater sensing to quantify the effectiveness of Live Learning as a mechanism for SCML.
- Open Access
- 6 December 2023
- Published by Association for Computing Machinery (ACM)
- p. 40-52
Democratizing Drone Autonomy via Edge Computing
Fully autonomous flight by low-cost, lightweight commercial off-the-shelf (COTS) drones could transform many use cases involving real-time computer vision. We show how such autonomy can be achieved using edge computing from a flight platform costing less than $800, and composed of a 320 g COTS drone with a 26 g COTS wearable device as payload. In spite of the extreme austerity of this platform and thermal limits on its LTE transmission, the system is able perform tasks such as detecting and then tracking a target. It is also able to visually navigate around obstacles. Such capabilities are only found on heavier and more expensive drones today.
- 6 December 2023
- Published by Association for Computing Machinery (ACM)
- p. 40-52
Open AccessDemocratizing Drone Autonomy via Edge Computing
Fully autonomous flight by low-cost, lightweight commercial off-the-shelf (COTS) drones could transform many use cases involving real-time computer vision. We show how such autonomy can be achieved using edge computing from a flight platform costing less than $800, and composed of a 320 g COTS drone with a 26 g COTS wearable device as payload. In spite of the extreme austerity of this platform and thermal limits on its LTE transmission, the system is able perform tasks such as detecting and then tracking a target. It is also able to visually navigate around obstacles. Such capabilities are only found on heavier and more expensive drones today.
- Open Access
- 27 June 2023
- Published by Association for Computing Machinery (ACM)
- p. 15-26
Towards Reproducible Execution of Closed-Source Applications from Internet Archives
Olive enables execution of closed-source applications decades after their creation. With appropriate authentication and authorization, anyone on the Internet can execute any archived application with no more effort than a mouse click. User experience is good, even for an interaction-intensive application. Olive uses virtual machine (VM) technology to encapsulate legacy software, including the operating system and all layers above it. If the legacy hardware is already obsolete at curation time, an emulator for it on more modern hardware can be included within the VM image. This paper is an experience report on the decade-long evolution of this concept.
- 27 June 2023
- Published by Association for Computing Machinery (ACM)
- p. 15-26
Open AccessTowards Reproducible Execution of Closed-Source Applications from Internet Archives
Olive enables execution of closed-source applications decades after their creation. With appropriate authentication and authorization, anyone on the Internet can execute any archived application with no more effort than a mouse click. User experience is good, even for an interaction-intensive application. Olive uses virtual machine (VM) technology to encapsulate legacy software, including the operating system and all layers above it. If the legacy hardware is already obsolete at curation time, an emulator for it on more modern hardware can be included within the VM image. This paper is an experience report on the decade-long evolution of this concept.
- Open Access
- 21 July 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Micro
- Vol. 42 (6) , 39-47
Accelerating Silent Witness Storage
We propose hardware acceleration for a new edge computing abstraction called a Silent Witness. This abstraction embodies a severe asymmetry in the ease of write versus read operations. Surveillance data from one or more video cameras is continuously encrypted and recorded, but the decrypting, processing, or transmission of that data only occurs under stringent privacy controls. For the new search workloads of such a system, decode-enabled storage alleviates the scalability bottleneck imposed by frequent decoding of data. Our experiments show throughput improvements up to 3.5x for typical search workloads of a Silent Witness.
- 21 July 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Micro
- Vol. 42 (6) , 39-47
Open AccessAccelerating Silent Witness Storage
We propose hardware acceleration for a new edge computing abstraction called a Silent Witness. This abstraction embodies a severe asymmetry in the ease of write versus read operations. Surveillance data from one or more video cameras is continuously encrypted and recorded, but the decrypting, processing, or transmission of that data only occurs under stringent privacy controls. For the new search workloads of such a system, decode-enabled storage alleviates the scalability bottleneck imposed by frequent decoding of data. Our experiments show throughput improvements up to 3.5x for typical search workloads of a Silent Witness.
- 14 January 2019
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Internet Computing
- Vol. 23 (4) , 35-42
Eureka: Edge-Based Discovery of Training Data for Machine Learning
The generation of high-quality training data has become the key bottleneck in the use of deep learning across many domains. We describe Eureka, an interactive system that leverages edge computing and early discard to greatly improve the productivity of experts in the construction of a labeled data set. Our experimental results show that Eureka reduces the labeling effort needed to construct a training set by two orders of magnitude relative to a brute-force approach.
- 14 January 2019
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Internet Computing
- Vol. 23 (4) , 35-42
Eureka: Edge-Based Discovery of Training Data for Machine Learning
The generation of high-quality training data has become the key bottleneck in the use of deep learning across many domains. We describe Eureka, an interactive system that leverages edge computing and early discard to greatly improve the productivity of experts in the construction of a labeled data set. Our experimental results show that Eureka reduces the labeling effort needed to construct a training set by two orders of magnitude relative to a brute-force approach.