Know Your Needs Better: Towards Structured Understanding of Marketer Demands with Analogical Reasoning Augmented LLMs
Preprint
Abstract
In this paper, we explore a new way for user targeting, where non-expert marketers could select their target users solely given demands in natural language form. The key to this issue is how to transform natural languages into practical structured logical languages, i.e., the structured understanding of marketer demands. Considering the impressive natural language processing ability of large language models (LLMs), we try to leverage LLMs to solve this issue. Past research indicates that the reasoning ability of LLMs can be effectively enhanced through chain-of-thought (CoT) prompting. But existing methods still have some limitations: (1) Previous methods either use simple "Let's think step by step" spells or provide fixed examples in demonstrations without considering compatibility between prompts and questions, making LLMs ineffective in some complex reasoning tasks such as structured language transformation. (2) Previous methods are often implemented in closed-source models or excessively large models, which is not suitable in industrial practical scenarios. Based on these, we propose ARALLM (i.e., Analogical Reasoning Augmented Large Language Models) consisting of two modules: Analogical Reasoning based Prompting and Reasoning-Augmented Multi-Task Model Distillation.Keywords
All Related Versions
This publication has 8 references indexed in Scilit:
- Harnessing the Power of Large Language Models for Natural Language to First-Order Logic Translation2024
- Few-shot Text-to-SQL Translation using Structure and Content Prompt LearningProceedings of the ACM on Management of Data, 2023
- Who Would be Interested in Services? An Entity Graph Learning System for User Targeting2023
- Distilling Step-by-Step! Outperforming Larger Language Models with Less Training Data and Smaller Model Sizes2023
- Learning To Retrieve Prompts for In-Context Learning2022
- LGESQL: Line Graph Enhanced Text-to-SQL Model with Mixed Local and Non-Local Relations2021
- RAT-SQL: Relation-Aware Schema Encoding and Linking for Text-to-SQL Parsers2020
- Structure-mapping: A theoretical framework for analogyCognitive Science, 1983