Trusted LLM Inference on the Edge with Smart Contracts
Authors:
- 27 May 2024
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-7
Abstract
In this era, significant transformations in industries and tool utilization are driven by AI/Large Language Models (LLMs) and advancements in Machine Learning. There’s a growing emphasis on MLOps for managing and deploying these AI models, along with a focus on distributed inferences. Concurrently, the imperative for secure on-chain computation is escalating. Our paper introduces an innovative framework that integrates blockchain technology, particularly the Cosmos SDK, to facilitate distributed AI inferences on edge devices. This system, built on WebAssembly (WASM), enables interchain communication and deployment of WASM modules executing AI inferences across multiple blockchain nodes. We critically assess this system’s safety, scalability, and model security, with a special focus on its portability and engine-model agnostic deployment on edge devices.Keywords
This publication has 16 references indexed in Scilit:
- ESCM: An Efficient and Secure Communication Mechanism for UAV NetworksIEEE Transactions on Network and Service Management, 2024
- DHTee: Decentralized Infrastructure for Heterogeneous TEEs2023
- DeFaaS: Decentralized Function-as-a-Service for Emerging dApps and Web32023
- Blockchain Systems, Technologies, and Applications: A Methodology PerspectiveIEEE Communications Surveys & Tutorials, 2022
- Introduction to the WebGPU API2022
- The Robots Are Coming: Exploring the Implications of OpenAI Codex on Introductory Programming2022
- Privacy preserving event based transaction system in a decentralized environment2021
- Lessons Learned from Blockchain Applications of Trusted Execution Environments and Implications for Future Research2021
- On Conditional Cryptocurrency With Privacy2021
- Decentralizing Privacy: Using Blockchain to Protect Personal Data2015