Kaihang Zhang
Kaihang Zhang has a total of 5 co-authors. Here are the top co-authors by number of shared publications:
- Jianwei Yin
School of Software Technology, Zhejiang University, Ningbo, China
1 shared publication - Wei Ni
ZHEJIANG UNIVERSITY, CN and CITY UNIVERSITY of HONG KONG, Hong Kong
1 shared publication - Xiangyu Zhao
City University of Hong Kong, Kowloon Tong, Hong Kong
1 shared publication - Xiaoye Miao
Center for Data Science, Zhejiang University, Hangzhou, China
1 shared publication - Yangyang Wu
School of Software Technology, Zhejiang University, Ningbo, China
1 shared publication
Latest Publications
- Open Access
- 5 July 2024
- Published by Association for Computing Machinery (ACM)
- p. 100-105
IterClean: An Iterative Data Cleaning Framework with Large Language Models
In the era of generative artificial intelligence, the accuracy of data is paramount. Erroneous data often leads to faulty outcomes and economic detriments. Previous cleaning methods employ a sequential detect-repair paradigm, leaving over half of the errors unsolved in real scenarios. We introduce IterClean, an iterative data cleaning framework leveraging large language models (LLMs). Utilizing an iterative mechanism, the framework employs a two-step process: data labeling and iterative data cleaning. With few labeled data, IterClean leverages an iterative cleaning process involving an error detector, an error verifier, and an error repairer to significantly enhance the cleaning performance. Extensive experiments across four datasets demonstrate that, IterClean achieves an F1 score that is up to three times higher than the best state-of-the-art approaches requiring only 5 labeled tuples.
- 5 July 2024
- Published by Association for Computing Machinery (ACM)
- p. 100-105
Open AccessIterClean: An Iterative Data Cleaning Framework with Large Language Models
In the era of generative artificial intelligence, the accuracy of data is paramount. Erroneous data often leads to faulty outcomes and economic detriments. Previous cleaning methods employ a sequential detect-repair paradigm, leaving over half of the errors unsolved in real scenarios. We introduce IterClean, an iterative data cleaning framework leveraging large language models (LLMs). Utilizing an iterative mechanism, the framework employs a two-step process: data labeling and iterative data cleaning. With few labeled data, IterClean leverages an iterative cleaning process involving an error detector, an error verifier, and an error repairer to significantly enhance the cleaning performance. Extensive experiments across four datasets demonstrate that, IterClean achieves an F1 score that is up to three times higher than the best state-of-the-art approaches requiring only 5 labeled tuples.