Luca P. Carloni
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Research Subjects
Luca P. Carloni has a total of 161 co-authors. Here are the top co-authors by number of shared publications:
- Davide Giri
Columbia University, New York, NY, USA
8 shared publications - Guy Eichler
Department of Computer Science, Columbia University, New York, USA
6 shared publications - Joseph Zuckerman
Columbia University, New York, NY, USA
6 shared publications - Alberto Sangiovanni Vincentelli
University of California Berkeley
5 shared publications - Gabriele Tombesi
Columbia University, New York, NY, USA
5 shared publications - Giuseppe Di Guglielmo
Fermi National Accelerator Laboratory, Batavia, IL, USA
5 shared publications
Latest Publications
- 21 October 2026
- Published by Springer Nature in Quantum Machine Intelligence
- Vol. 8 (2) , 116
Fast machine learning for quantum control of microwave qudits on edge hardware
- 21 October 2026
- Published by Springer Nature in Quantum Machine Intelligence
- Vol. 8 (2) , 116
Fast machine learning for quantum control of microwave qudits on edge hardware
- 1 May 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Micro
- Vol. 46 (3) , 33-42
A Coherence-Aware Runtime Reconfigurable System on Chip for Efficient Language Model Inference
Generative AI, powered by Transformer-based language models (LMs), such as OpenAI’s ChatGPT, is rapidly generating a new digital landscape. Unfortunately, it is hard to get efficient LM inference by simply scaling up the compute elements, particularly on resource-constrained Edge AI platforms. In this context, we revisit a critical yet often overlooked system component: the memory subsystem. We propose a reconfigurable system-on-chip (SoC) architecture that dynamically modulates the cache-coherence modes to align with the heterogeneous demands of generative LM workloads. Our coherence-aware SoC outperforms a commercial edge GPU by yielding 8.12× higher system efficiency when running the OPT-6.7B model, highlighting the potential of system-level adaptability as a key enabler for efficient and scalable LM inference.
- 1 May 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Micro
- Vol. 46 (3) , 33-42
A Coherence-Aware Runtime Reconfigurable System on Chip for Efficient Language Model Inference
Generative AI, powered by Transformer-based language models (LMs), such as OpenAI’s ChatGPT, is rapidly generating a new digital landscape. Unfortunately, it is hard to get efficient LM inference by simply scaling up the compute elements, particularly on resource-constrained Edge AI platforms. In this context, we revisit a critical yet often overlooked system component: the memory subsystem. We propose a reconfigurable system-on-chip (SoC) architecture that dynamically modulates the cache-coherence modes to align with the heterogeneous demands of generative LM workloads. Our coherence-aware SoC outperforms a commercial edge GPU by yielding 8.12× higher system efficiency when running the OPT-6.7B model, highlighting the potential of system-level adaptability as a key enabler for efficient and scalable LM inference.
- Open Access
- 8 December 2025
- Published by Springer Nature in Nature Electronics
- Vol. 8 (12) , 1272-1288
A wireless subdural-contained brain–computer interface with 65,536 electrodes and 1,024 channels
Electrocorticography uses non-penetrating electrodes embedded in flexible substrates to record electrical activity from the surface of the brain. To use the technology to develop minimally invasive, high-bandwidth brain–computer interfaces, it will be necessary to improve the number of recording channels and the scalability of devices, which could be achieved by merging electrodes and electronics onto a single substrate. Here we report a 50-μm-thick, mechanically flexible micro-electrocorticography brain–computer interface that integrates a 256 × 256 array of electrodes, signal processing, data telemetry and wireless powering on a single complementary metal–oxide–semiconductor substrate. The device contains 65,536 recording electrodes, from which we can simultaneously record a selectable subset of up to 1,024 channels at a given time. Our chip is wirelessly powered, and when implanted below the dura, it can communicate bidirectionally with an external relay station outside the body. We show that the device can provide chronic, reliable recordings for up to two weeks in pigs and up to two months in behaving non-human primates from the somatosensory, motor and visual cortices, decoding brain signals at high spatiotemporal resolution.
- 8 December 2025
- Published by Springer Nature in Nature Electronics
- Vol. 8 (12) , 1272-1288
Open AccessA wireless subdural-contained brain–computer interface with 65,536 electrodes and 1,024 channels
Electrocorticography uses non-penetrating electrodes embedded in flexible substrates to record electrical activity from the surface of the brain. To use the technology to develop minimally invasive, high-bandwidth brain–computer interfaces, it will be necessary to improve the number of recording channels and the scalability of devices, which could be achieved by merging electrodes and electronics onto a single substrate. Here we report a 50-μm-thick, mechanically flexible micro-electrocorticography brain–computer interface that integrates a 256 × 256 array of electrodes, signal processing, data telemetry and wireless powering on a single complementary metal–oxide–semiconductor substrate. The device contains 65,536 recording electrodes, from which we can simultaneously record a selectable subset of up to 1,024 channels at a given time. Our chip is wirelessly powered, and when implanted below the dura, it can communicate bidirectionally with an external relay station outside the body. We show that the device can provide chronic, reliable recordings for up to two weeks in pigs and up to two months in behaving non-human primates from the somatosensory, motor and visual cortices, decoding brain signals at high spatiotemporal resolution.
- Open Access
- 17 October 2025
- Published by Association for Computing Machinery (ACM)
- p. 1672-1689
MINDFUL: Safe, Implantable, Large-Scale Brain-Computer Interfaces from a System-Level Design Perspective
- 17 October 2025
- Published by Association for Computing Machinery (ACM)
- p. 1672-1689
Open AccessMINDFUL: Safe, Implantable, Large-Scale Brain-Computer Interfaces from a System-Level Design Perspective
- 26 September 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Solid-State Circuits
- Vol. 61 (5) , 2276-2294
EPOCHS-1: A 12 nm Highly Heterogeneous Open-Source SoC With Distributed Coin-Based Power Management and Integrated Hybrid Voltage Regulation
We present EPOCHS-1, a 12 nm, 64 mm2 system-on-chip (SoC) with a high degree of heterogeneity. It features four Linux-SMP-capable RISC-V cores, 14 different types of accelerators, a distributed memory hierarchy, and various peripherals. EPOCHS-1’s memory hierarchy has the flexibility to support a diverse set of accelerators and can scale to support complex applications with 34% and 25% reduction in latency and energy, respectively. A subset of the SoC’s 23 power and 35 clock domains is regulated with a fully-decentralized power-allocation scheme and hybrid unified voltage and frequency scaling (HUVFS) that combines an in-package switched regulator with a per-tile low dropout (LDO). Combined, these techniques achieve up to a $1.57\times $ speedup versus a centralized power management baseline. Designed with an agile methodology, EPOCHS-1 is based on an open-source SoC architecture and features only open-source components, either third-party or newly designed, thus enabling design reuse for future research projects.
- 26 September 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Solid-State Circuits
- Vol. 61 (5) , 2276-2294
EPOCHS-1: A 12 nm Highly Heterogeneous Open-Source SoC With Distributed Coin-Based Power Management and Integrated Hybrid Voltage Regulation
We present EPOCHS-1, a 12 nm, 64 mm2 system-on-chip (SoC) with a high degree of heterogeneity. It features four Linux-SMP-capable RISC-V cores, 14 different types of accelerators, a distributed memory hierarchy, and various peripherals. EPOCHS-1’s memory hierarchy has the flexibility to support a diverse set of accelerators and can scale to support complex applications with 34% and 25% reduction in latency and energy, respectively. A subset of the SoC’s 23 power and 35 clock domains is regulated with a fully-decentralized power-allocation scheme and hybrid unified voltage and frequency scaling (HUVFS) that combines an in-package switched regulator with a per-tile low dropout (LDO). Combined, these techniques achieve up to a $1.57\times $ speedup versus a centralized power management baseline. Designed with an agile methodology, EPOCHS-1 is based on an open-source SoC architecture and features only open-source components, either third-party or newly designed, thus enabling design reuse for future research projects.
- Open Access
- 26 September 2025
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Embedded Computing Systems
- Vol. 24 (5s) , 1-27
FLIP2M: Flexible Intra-layer Parallelism and Inter-layer Pipelining for Multi-model AR/VR Workloads
Tiled accelerator architectures provide opportunities to optimize the performance of multi-model augmented and virtual reality (AR/VR) applications through intra-layer parallelism and inter-layer pipelining. However, balancing these two strategies is a difficult task that demands a flexible architecture to deploy models and an optimization approach, that is, capable of selecting an optimal strategy from an enormous mapping space. This article presents FLIP2M, a holistic solution for mapping multi-model AR/VR workloads on tiled architectures. FLIP2M consists of (1) FLIP, an acceleration fabric that supports a wide variety of optimizations through flexible on-chip communication, and (2) OASIS, an optimization framework based on dynamic and constraint programming, that is, capable of selecting an efficient strategy for mapping multi-model workloads onto FLIP. We demonstrate FLIP2M on an FPGA prototype of FLIP that features 36 accelerators and 7 DDR4 controllers. Using OASIS-generated mappings for three different multi-model AR/VR workloads, FLIP2M achieves up to 1.94× improvement in latency, 1.37× in energy, and 2.59× in energy-delay product relative to a FLIP baseline without intra-layer resource allocation flexibility and inter-layer pipelining.
- 26 September 2025
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Embedded Computing Systems
- Vol. 24 (5s) , 1-27
Open AccessFLIP2M: Flexible Intra-layer Parallelism and Inter-layer Pipelining for Multi-model AR/VR Workloads
Tiled accelerator architectures provide opportunities to optimize the performance of multi-model augmented and virtual reality (AR/VR) applications through intra-layer parallelism and inter-layer pipelining. However, balancing these two strategies is a difficult task that demands a flexible architecture to deploy models and an optimization approach, that is, capable of selecting an optimal strategy from an enormous mapping space. This article presents FLIP2M, a holistic solution for mapping multi-model AR/VR workloads on tiled architectures. FLIP2M consists of (1) FLIP, an acceleration fabric that supports a wide variety of optimizations through flexible on-chip communication, and (2) OASIS, an optimization framework based on dynamic and constraint programming, that is, capable of selecting an efficient strategy for mapping multi-model workloads onto FLIP. We demonstrate FLIP2M on an FPGA prototype of FLIP that features 36 accelerators and 7 DDR4 controllers. Using OASIS-generated mappings for three different multi-model AR/VR workloads, FLIP2M achieves up to 1.94× improvement in latency, 1.37× in energy, and 2.59× in energy-delay product relative to a FLIP baseline without intra-layer resource allocation flexibility and inter-layer pipelining.
- Open Access
- 5 September 2025
- Published by Universitatsbibliothek der Ruhr-Universitat Bochum in IACR Transactions on Cryptographic Hardware and Embedded Systems
- Vol. 2025 (4) , 317-340
BASTION: A Framework for Secure Third-Party IP Integration in NoC-based SoC Platforms
Modern System-on-Chip (SoC) architectures are a complex mix of processors, accelerators, memories, and I/O controllers interconnected by on-chip communication networks. Given the complexity of the computation and the requirements mandated in modern applications, several of these IPs are often outsourced as third-party modules. The integration of third-party modules, however, has been demonstrated to raise severe system-level security concerns – undiscovered vulnerabilities, incorrect firmware configurations, malicious code, and hardware trojans undetected in such IPs can produce leaks of confidential information and compromise the integrity of critical components. These challenges are further intensified when the communication infrastructure lacks robust mechanisms to supervise and monitor the interactions of third-party IPs with the rest of the system. Thus, runtime monitoring and supervising of third-party IPs is a crucial aspect for the system-level security of the entire SoC – the computing modules integrated in the SoC and their communication must behave securely. This paper presents Bastion, an open-source framework designed to support the secure integration of third-party IP modules into SoC architectures based on network-on-chip (NoC) communications, with a focus on providing robust security guarantees for NoC-based open-source hardware platforms. Unlike most previous works, which either focus on design or verification, we address the challenge of securely integrating third-party IPs in NoC-based platforms through a holistic design and verification framework based on three pillars: (i) a high-performance security socket that can be seamlessly integrated into NoC tiles; (ii) secure configuration and management of the security sockets via a Hardware Root of Trust; and (iii) an ad-hoc property-based security verification framework to ensure secure system operation. Bastion is integrated on the popular open-source ESP framework and validated through simulations and FPGA emulation of realistic SoCs. By explicitly targeting open-source platforms and releasing the entire project as open-source, we aim to democratize access to robustly secure application-specific SoC platforms for critical applications and foster further advancements in this domain.
- 5 September 2025
- Published by Universitatsbibliothek der Ruhr-Universitat Bochum in IACR Transactions on Cryptographic Hardware and Embedded Systems
- Vol. 2025 (4) , 317-340
Open AccessBASTION: A Framework for Secure Third-Party IP Integration in NoC-based SoC Platforms
Modern System-on-Chip (SoC) architectures are a complex mix of processors, accelerators, memories, and I/O controllers interconnected by on-chip communication networks. Given the complexity of the computation and the requirements mandated in modern applications, several of these IPs are often outsourced as third-party modules. The integration of third-party modules, however, has been demonstrated to raise severe system-level security concerns – undiscovered vulnerabilities, incorrect firmware configurations, malicious code, and hardware trojans undetected in such IPs can produce leaks of confidential information and compromise the integrity of critical components. These challenges are further intensified when the communication infrastructure lacks robust mechanisms to supervise and monitor the interactions of third-party IPs with the rest of the system. Thus, runtime monitoring and supervising of third-party IPs is a crucial aspect for the system-level security of the entire SoC – the computing modules integrated in the SoC and their communication must behave securely. This paper presents Bastion, an open-source framework designed to support the secure integration of third-party IP modules into SoC architectures based on network-on-chip (NoC) communications, with a focus on providing robust security guarantees for NoC-based open-source hardware platforms. Unlike most previous works, which either focus on design or verification, we address the challenge of securely integrating third-party IPs in NoC-based platforms through a holistic design and verification framework based on three pillars: (i) a high-performance security socket that can be seamlessly integrated into NoC tiles; (ii) secure configuration and management of the security sockets via a Hardware Root of Trust; and (iii) an ad-hoc property-based security verification framework to ensure secure system operation. Bastion is integrated on the popular open-source ESP framework and validated through simulations and FPGA emulation of realistic SoCs. By explicitly targeting open-source platforms and releasing the entire project as open-source, we aim to democratize access to robustly secure application-specific SoC platforms for critical applications and foster further advancements in this domain.
- Open Access
SLDB: An End-To-End Heterogeneous System-on-Chip Benchmark Suite for LLM-Aided Design
Over the last few years, Large Language Models (LLMs) have emerged as a valuable tool for Electronic Design Automation (EDA). State-of-the-art research in LLM-aided design has demonstrated the ability of LLMs to generate syntactically correct RTL code, showcasing encouraging prospects for integrating AI into the hardware design process. A key enabler of these advancements is the availability of high-quality benchmarks to evaluate new approaches. However, existing datasets and benchmarks fall short of system-level design, as they focus primarily on component-level information and low-complexity designs. To address this gap, we introduce the System-Level Design Benchmark (SLDB), a dataset tailored for evaluating LLMs in system-level integration and configuration tasks. SLDB includes a curated benchmark suite of 10 baseline SoC designs, whose components can be combined into an exponential number of distinct tile-based SoCs through a synthetic library. The dataset provides full SoC configurations, accelerator integration code, communication parameters, and accelerator-aware system configurations, along with testing-application code, compatible with the ESP platform[1].
Open AccessSLDB: An End-To-End Heterogeneous System-on-Chip Benchmark Suite for LLM-Aided Design
Over the last few years, Large Language Models (LLMs) have emerged as a valuable tool for Electronic Design Automation (EDA). State-of-the-art research in LLM-aided design has demonstrated the ability of LLMs to generate syntactically correct RTL code, showcasing encouraging prospects for integrating AI into the hardware design process. A key enabler of these advancements is the availability of high-quality benchmarks to evaluate new approaches. However, existing datasets and benchmarks fall short of system-level design, as they focus primarily on component-level information and low-complexity designs. To address this gap, we introduce the System-Level Design Benchmark (SLDB), a dataset tailored for evaluating LLMs in system-level integration and configuration tasks. SLDB includes a curated benchmark suite of 10 baseline SoC designs, whose components can be combined into an exponential number of distinct tile-based SoCs through a synthetic library. The dataset provides full SoC configurations, accelerator integration code, communication parameters, and accelerator-aware system configurations, along with testing-application code, compatible with the ESP platform[1].
- Open Access
- 21 June 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-9
Teaching Collaborative SoC Engineering with HLS-Based Accelerator Design and Agile System-Level Integration
- 21 June 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-9
Open AccessTeaching Collaborative SoC Engineering with HLS-Based Accelerator Design and Agile System-Level Integration
- Open Access
Fast Machine Learning for Quantum Control of Microwave Qudits on Edge Hardware
Quantum optimal control is a promising approach to improve the accuracy of quantum gates, but it relies on complex algorithms to determine the best control settings. CPU or GPU-based approaches often have delays that are too long to be applied in practice. It is paramount to have systems with extremely low delays to quickly and with high fidelity adjust quantum hardware settings, where fidelity is defined as overlap with a target quantum state. Here, we utilize machine learning (ML) models to determine control-pulse parameters for preparing Selective Number-dependent Arbitrary Phase (SNAP) gates in microwave cavity qudits, which are multi-level quantum systems that serve as elementary computation units for quantum computing. The methodology involves data generation using classical optimization techniques, ML model development, design space exploration, and quantization for hardware implementation. Our results demonstrate the efficacy of the proposed approach, with optimized models achieving low gate trace infidelity near $10^{-3}$ and efficient utilization of programmable logic resources.Open AccessFast Machine Learning for Quantum Control of Microwave Qudits on Edge Hardware
Quantum optimal control is a promising approach to improve the accuracy of quantum gates, but it relies on complex algorithms to determine the best control settings. CPU or GPU-based approaches often have delays that are too long to be applied in practice. It is paramount to have systems with extremely low delays to quickly and with high fidelity adjust quantum hardware settings, where fidelity is defined as overlap with a target quantum state. Here, we utilize machine learning (ML) models to determine control-pulse parameters for preparing Selective Number-dependent Arbitrary Phase (SNAP) gates in microwave cavity qudits, which are multi-level quantum systems that serve as elementary computation units for quantum computing. The methodology involves data generation using classical optimization techniques, ML model development, design space exploration, and quantization for hardware implementation. Our results demonstrate the efficacy of the proposed approach, with optimized models achieving low gate trace infidelity near $10^{-3}$ and efficient utilization of programmable logic resources.