ValuePilot: A Two-Phase Framework for Value-Driven Decision-Making
Preprint
Abstract
Despite recent advances in artificial intelligence (AI), it poses challenges to ensure personalized decision-making in tasks that are not considered in training datasets. To address this issue, we propose ValuePilot, a two-phase value-driven decision-making framework comprising a dataset generation toolkit DGT and a decision-making module DMM trained on the generated data. DGT is capable of generating scenarios based on value dimensions and closely mirroring real-world tasks, with automated filtering techniques and human curation to ensure the validity of the dataset. In the generated dataset, DMM learns to recognize the inherent values of scenarios, computes action feasibility and navigates the trade-offs between multiple value dimensions to make personalized decisions. Extensive experiments demonstrate that, given human value preferences, our DMM most closely aligns with human decisions, outperforming Claude-3.5-Sonnet, Gemini-2-flash, Llama-3.1-405b and GPT-4o. This research is a preliminary exploration of value-driven decision-making. We hope it will stimulate interest in value-driven decision-making and personalized decision-making within the community.Keywords
All Related Versions
This publication has 22 references indexed in Scilit:
- AI models collapse when trained on recursively generated dataNature, 2024
- When large language models meet personalization: perspectives of challenges and opportunitiesWorld Wide Web, 2024
- Generalizing to Unseen Domains: A Survey on Domain GeneralizationIEEE Transactions on Knowledge and Data Engineering, 2022
- Defining and conceptualising energy policy failure: The when, where, why, and howEnergy Policy, 2022
- On the Effectiveness of Adapter-based Tuning for Pretrained Language Model Adaptation2021
- Zero-Shot Learning—A Comprehensive Evaluation of the Good, the Bad and the UglyIEEE Transactions on Pattern Analysis and Machine Intelligence, 2018
- Designing AI systems that obey our laws and valuesCommunications of the ACM, 2016
- Research Priorities for Robust and Beneficial Artificial IntelligenceAI Magazine, 2015
- AlternationJournal of the ACM, 1981
- A theory of human motivation.Psychological Review, 1943