Shrey Gupta
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Research Subjects
Shrey Gupta has a total of 19 co-authors. Here are the top co-authors by number of shared publications:
- Anmol Agarwal
International Institute of Information Technology, Hyderabad, India
4 shared publications - Ponnurangam Kumaraguru
International Institute of Information Technology
4 shared publications - Pratyush Priyadarshi
International Institute of Information Technology, Hyderabad, India
3 shared publications - Joseph Reagle
Northeastern University, Boston, MA, USA
2 shared publications - Kiran Garimella
Rutgers University, New Brunswick, USA
2 shared publications - Manas Gaur
CSEE, University of Maryland, Baltimore County, Baltimore, USA
2 shared publications
Latest Publications
- Open Access
- 24 August 2024
- Published by Association for Computing Machinery (ACM)
- p. 4752-4763
Television Discourse Decoded: Comprehensive Multimodal Analytics at Scale
In this paper, we tackle the complex task of analyzing televised debates, with a focus on a prime time news debate show from India. Previous methods, which often relied solely on text, fall short in capturing the multimodal essence of these debates [27]. To address this gap, we introduce a comprehensive automated toolkit that employs advanced computer vision and speech-to-text techniques for large-scale multimedia analysis. Utilizing state-of-the-art computer vision algorithms and speech-to-text methods, we transcribe, diarize, and analyze thousands of YouTube videos of a prime-time television debate show in India. These debates are a central part of Indian media but have been criticized for compromised journalistic integrity and excessive dramatization [18]. Our toolkit provides concrete metrics to assess bias and incivility, capturing a comprehensive multimedia perspective that includes text, audio utterances, and video frames. Our findings reveal significant biases in topic selection and panelist representation, along with alarming levels of incivility. This work offers a scalable, automated approach for future research in multimedia analysis, with profound implications for the quality of public discourse and democratic debate. To catalyze further research in this area, we also release the code, dataset collected and supplemental pdf.1
- 24 August 2024
- Published by Association for Computing Machinery (ACM)
- p. 4752-4763
Open AccessTelevision Discourse Decoded: Comprehensive Multimodal Analytics at Scale
In this paper, we tackle the complex task of analyzing televised debates, with a focus on a prime time news debate show from India. Previous methods, which often relied solely on text, fall short in capturing the multimodal essence of these debates [27]. To address this gap, we introduce a comprehensive automated toolkit that employs advanced computer vision and speech-to-text techniques for large-scale multimedia analysis. Utilizing state-of-the-art computer vision algorithms and speech-to-text methods, we transcribe, diarize, and analyze thousands of YouTube videos of a prime-time television debate show in India. These debates are a central part of Indian media but have been criticized for compromised journalistic integrity and excessive dramatization [18]. Our toolkit provides concrete metrics to assess bias and incivility, capturing a comprehensive multimedia perspective that includes text, audio utterances, and video frames. Our findings reveal significant biases in topic selection and panelist representation, along with alarming levels of incivility. This work offers a scalable, automated approach for future research in multimedia analysis, with profound implications for the quality of public discourse and democratic debate. To catalyze further research in this area, we also release the code, dataset collected and supplemental pdf.1
- Open Access
Towards Effective Paraphrasing for Information Disguise
Information Disguise (ID), a part of computational ethics in Natural Language Processing (NLP), is concerned with best practices of textual paraphrasing to prevent the non-consensual use of authors' posts on the Internet. Research on ID becomes important when authors' written online communication pertains to sensitive domains, e.g., mental health. Over time, researchers have utilized AI-based automated word spinners (e.g., SpinRewriter, WordAI) for paraphrasing content. However, these tools fail to satisfy the purpose of ID as their paraphrased content still leads to the source when queried on search engines. There is limited prior work on judging the effectiveness of paraphrasing methods for ID on search engines or their proxies, neural retriever (NeurIR) models. We propose a framework where, for a given sentence from an author's post, we perform iterative perturbation on the sentence in the direction of paraphrasing with an attempt to confuse the search mechanism of a NeurIR system when the sentence is queried on it. Our experiments involve the subreddit 'r/AmItheAsshole' as the source of public content and Dense Passage Retriever as a NeurIR system-based proxy for search engines. Our work introduces a novel method of phrase-importance rankings using perplexity scores and involves multi-level phrase substitutions via beam search. Our multi-phrase substitution scheme succeeds in disguising sentences 82% of the time and hence takes an essential step towards enabling researchers to disguise sensitive content effectively before making it public. We also release the code of our approach.
Open AccessTowards Effective Paraphrasing for Information Disguise
Information Disguise (ID), a part of computational ethics in Natural Language Processing (NLP), is concerned with best practices of textual paraphrasing to prevent the non-consensual use of authors' posts on the Internet. Research on ID becomes important when authors' written online communication pertains to sensitive domains, e.g., mental health. Over time, researchers have utilized AI-based automated word spinners (e.g., SpinRewriter, WordAI) for paraphrasing content. However, these tools fail to satisfy the purpose of ID as their paraphrased content still leads to the source when queried on search engines. There is limited prior work on judging the effectiveness of paraphrasing methods for ID on search engines or their proxies, neural retriever (NeurIR) models. We propose a framework where, for a given sentence from an author's post, we perform iterative perturbation on the sentence in the direction of paraphrasing with an attempt to confuse the search mechanism of a NeurIR system when the sentence is queried on it. Our experiments involve the subreddit 'r/AmItheAsshole' as the source of public content and Dense Passage Retriever as a NeurIR system-based proxy for search engines. Our work introduces a novel method of phrase-importance rankings using perplexity scores and involves multi-level phrase substitutions via beam search. Our multi-phrase substitution scheme succeeds in disguising sentences 82% of the time and hence takes an essential step towards enabling researchers to disguise sensitive content effectively before making it public. We also release the code of our approach.
- Open Access
- 21 October 2023
- Published by Association for Computing Machinery (ACM)
- p. 3923-3927
Hateful Comment Detection and Hate Target Type Prediction for Video Comments
With the widespread increase in hateful content on the web, hate detection has become more crucial than ever. Although vast literature exists on hate detection from text, images and videos, interestingly, there has been no previous work on hateful comment detection (HCD) from video pages. HCD is critical for comment moderation and for flagging controversial videos. Comments are often short, contextual and convoluted making the problem challenging. Toward solving this problem, we contribute a dataset, HateComments, consisting of 2071 comments for 401 videos obtained from two popular video sharing platforms. We investigate two related tasks: binary HCD and 4-class multi-label hate target-type prediction (HTP). We systematically explore the importance of various forms of context for effective HCD. Our initial experiments show that our best method which leverages rich video context (like description, transcript and visual input) leads to an HCD accuracy of ~78.6% and an ROC AUC score of ~0.61 for HTP. Code and data is at https://drive.google.com/file/d/1EUbWDUokv1CYkWKlwByUC6yIuBGUw2MN/.
- 21 October 2023
- Published by Association for Computing Machinery (ACM)
- p. 3923-3927
Open AccessHateful Comment Detection and Hate Target Type Prediction for Video Comments
With the widespread increase in hateful content on the web, hate detection has become more crucial than ever. Although vast literature exists on hate detection from text, images and videos, interestingly, there has been no previous work on hateful comment detection (HCD) from video pages. HCD is critical for comment moderation and for flagging controversial videos. Comments are often short, contextual and convoluted making the problem challenging. Toward solving this problem, we contribute a dataset, HateComments, consisting of 2071 comments for 401 videos obtained from two popular video sharing platforms. We investigate two related tasks: binary HCD and 4-class multi-label hate target-type prediction (HTP). We systematically explore the importance of various forms of context for effective HCD. Our initial experiments show that our best method which leverages rich video context (like description, transcript and visual input) leads to an HCD accuracy of ~78.6% and an ROC AUC score of ~0.61 for HTP. Code and data is at https://drive.google.com/file/d/1EUbWDUokv1CYkWKlwByUC6yIuBGUw2MN/.
- 17 March 2023
- Published by Springer Nature
- p. 331-340
Towards Effective Paraphrasing for Information Disguise
- 17 March 2023
- Published by Springer Nature
- p. 331-340
Towards Effective Paraphrasing for Information Disguise
- Open Access
- 27 June 2022
- Published by Association for Computing Machinery (ACM)
- p. 1-13
Diagnosing Data from ICTs to Provide Focused Assistance in Agricultural Adoptions
In the last two decades, Information and Communication Technologies (ICTs) have played a pivotal role in empowering rural populations in India by making knowledge more accessible. Digital Green is one such ICT that employs a participatory approach with smallholder farmers to produce instructional agricultural videos that encompass content specific to them. With the help of human mediators, they disseminate these videos to farmers using projectors to improve the adoption of agricultural practices. Digital Green’s web-based data tracker (CoCo) stores the attendance and adoption logs of millions of farmers, the videos screened to them and their demographic information. In our work, we leverage this data for a period of ten years between 2010-2020 across five states in India where Digital Green is most active and use it to conduct a holistic evaluation of the ICT. First, we find disparities in the adoption rates of farmers, following which we use statistical tests to identify the different factors that lead to these disparities as well as gender-based inequalities. We find that farmers with higher adoption rates adopt videos of shorter duration and belong to smaller villages. Second, to provide assistance to farmers facing challenges, we model the adoption of practices from a video as a prediction problem and experiment with different model architectures. Our classifier achieves accuracies ranging from 79% to 90% across the five states, demonstrating its potential for assisting future ethnographic investigations. Third, we use SHAP values in conjunction with our model for explaining the impact of various network, content and demographic features on adoption. Our research finds that farmers greatly benefit from past adopters of a video from their group and village. We also discover that videos with a low content-specificity benefit some farmers more than others. Next, we highlight the implications of our findings by translating them into recommendations for providing focused assistance, community building, video screening, revisiting participatory approach and mitigating inequalities. Lastly, we conclude with a discussion on how our work can assist future investigations into the lived experiences of farmers.
- 27 June 2022
- Published by Association for Computing Machinery (ACM)
- p. 1-13
Open AccessDiagnosing Data from ICTs to Provide Focused Assistance in Agricultural Adoptions
In the last two decades, Information and Communication Technologies (ICTs) have played a pivotal role in empowering rural populations in India by making knowledge more accessible. Digital Green is one such ICT that employs a participatory approach with smallholder farmers to produce instructional agricultural videos that encompass content specific to them. With the help of human mediators, they disseminate these videos to farmers using projectors to improve the adoption of agricultural practices. Digital Green’s web-based data tracker (CoCo) stores the attendance and adoption logs of millions of farmers, the videos screened to them and their demographic information. In our work, we leverage this data for a period of ten years between 2010-2020 across five states in India where Digital Green is most active and use it to conduct a holistic evaluation of the ICT. First, we find disparities in the adoption rates of farmers, following which we use statistical tests to identify the different factors that lead to these disparities as well as gender-based inequalities. We find that farmers with higher adoption rates adopt videos of shorter duration and belong to smaller villages. Second, to provide assistance to farmers facing challenges, we model the adoption of practices from a video as a prediction problem and experiment with different model architectures. Our classifier achieves accuracies ranging from 79% to 90% across the five states, demonstrating its potential for assisting future ethnographic investigations. Third, we use SHAP values in conjunction with our model for explaining the impact of various network, content and demographic features on adoption. Our research finds that farmers greatly benefit from past adopters of a video from their group and village. We also discover that videos with a low content-specificity benefit some farmers more than others. Next, we highlight the implications of our findings by translating them into recommendations for providing focused assistance, community building, video screening, revisiting participatory approach and mitigating inequalities. Lastly, we conclude with a discussion on how our work can assist future investigations into the lived experiences of farmers.
- Open Access
ISTRBoost: Importance Sampling Transfer Regression using Boosting
Current Instance Transfer Learning (ITL) methodologies use domain adaptation and sub-space transformation to achieve successful transfer learning. However, these methodologies, in their processes, sometimes overfit on the target dataset or suffer from negative transfer if the test dataset has a high variance. Boosting methodologies have been shown to reduce the risk of overfitting by iteratively re-weighing instances with high-residual. However, this balance is usually achieved with parameter optimization, as well as reducing the skewness in weights produced due to the size of the source dataset. While the former can be achieved, the latter is more challenging and can lead to negative transfer. We introduce a simpler and more robust fix to this problem by building upon the popular boosting ITL regression methodology, two-stage TrAdaBoost.R2. Our methodology,~\us{}, is a boosting and random-forest based ensemble methodology that utilizes importance sampling to reduce the skewness due to the source dataset. We show that~\us{}~performs better than competitive transfer learning methodologies $63\%$ of the time. It also displays consistency in its performance over diverse datasets with varying complexities, as opposed to the sporadic results observed for other transfer learning methodologies.Open AccessISTRBoost: Importance Sampling Transfer Regression using Boosting
Current Instance Transfer Learning (ITL) methodologies use domain adaptation and sub-space transformation to achieve successful transfer learning. However, these methodologies, in their processes, sometimes overfit on the target dataset or suffer from negative transfer if the test dataset has a high variance. Boosting methodologies have been shown to reduce the risk of overfitting by iteratively re-weighing instances with high-residual. However, this balance is usually achieved with parameter optimization, as well as reducing the skewness in weights produced due to the size of the source dataset. While the former can be achieved, the latter is more challenging and can lead to negative transfer. We introduce a simpler and more robust fix to this problem by building upon the popular boosting ITL regression methodology, two-stage TrAdaBoost.R2. Our methodology,~\us{}, is a boosting and random-forest based ensemble methodology that utilizes importance sampling to reduce the skewness due to the source dataset. We show that~\us{}~performs better than competitive transfer learning methodologies $63\%$ of the time. It also displays consistency in its performance over diverse datasets with varying complexities, as opposed to the sporadic results observed for other transfer learning methodologies.