Comparative analysis of BERT and FastText representations on crowdfunding campaign success prediction
Author:
Open Access
- 11 September 2024
- journal article
- research article
- Published by PeerJ in PeerJ Computer Science
- Vol. 10, e2316
Abstract
Crowdfunding has become a popular financing method, attracting investors, businesses, and entrepreneurs. However, many campaigns fail to secure funding, making it crucial to reduce participation risks using artificial intelligence (AI). This study investigates the effectiveness of advanced AI techniques in predicting the success of crowdfunding campaigns on Kickstarter by analyzing campaign blurbs. We compare the performance of two widely used text representation models, bidirectional encoder representations from transformers (BERT) and FastText, in conjunction with long-short term memory (LSTM) and gradient boosting machine (GBM) classifiers. Our analysis involves preprocessing campaign blurbs, extracting features using BERT and FastText, and evaluating the predictive performance of these features with LSTM and GBM models. All experimental results show that BERT representations significantly outperform FastText, with the highest accuracy of 0.745 achieved using a fine-tuned BERT model combined with LSTM. These findings highlight the importance of using deep contextual embeddings and the benefits of fine-tuning pre-trained models for domain-specific applications. The results are benchmarked against existing methods, demonstrating the superiority of our approach. This study provides valuable insights for improving predictive models in the crowdfunding domain, offering practical implications for campaign creators and investors.Keywords
This publication has 26 references indexed in Scilit:
- A supervised deep learning-based sentiment analysis by the implementation of Word2Vec and GloVe Embedding techniquesMultimedia Tools and Applications, 2024
- AIPs-SnTCN: Predicting Anti-Inflammatory Peptides Using fastText and Transformer Encoder-Based Hybrid Word Embedding with Self-Normalized Temporal Convolutional NetworksJournal of Chemical Information and Modeling, 2023
- The time-varying effects of rhetorical signals in crowdfunding campaignsJournal of the Academy of Marketing Science, 2023
- Impact of convolutional neural network and FastText embedding on text classificationMultimedia Tools and Applications, 2022
- The merits of a sentiment analysis of antecedent comments for the prediction of online fundraising outcomesTechnological Forecasting and Social Change, 2022
- Emotional Intensity-based Success Prediction Model for Crowdfunded CampaignsInformation Processing & Management, 2021
- “Fund me, I am fabulous!” Do narcissistic entrepreneurs succeed or fail in crowdfunding?Personality and Individual Differences, 2020
- Prediction of fundraising outcomes for crowdfunding projects based on deep learning: a multimodel comparative studySoft Computing, 2020
- Predicting outcomes in crowdfunding campaigns with textual, visual, and linguistic signalsSmall Business Economics, 2019
- The economics of crowdfunding platformsInformation Economics and Policy, 2015