Performance of Data Model over Computational Power in CDP Platforms
- 15 December 2024
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 3729-3734
Abstract
In the era of big data, optimizing the performance of data models is critical to harnessing the full potential of computational power in Customer Data Platforms (CDP). This paper investigates the relationship between data model performance and computational resources within CDP environments, with a specific focus on the comparative analysis of star schema and snowflake schema. Our study examines scalability, efficiency, and processing speed across these two schema designs. We conduct a comprehensive analysis using various data models and computational configurations to identify key performance bottlenecks and their underlying causes. The study employs benchmark datasets and real-world scenarios to evaluate the impacts of different schema structures, indexing strategies, and resource allocation techniques on overall system performance. The findings reveal significant insights into how optimized data models, particularly star and snowflake schemas, can enhance computational efficiency, reduce latency, and improve throughput in CDP environments. Furthermore, we propose best practices and optimization strategies that can be adopted by data engineers and architects to achieve superior performance in large-scale data environments. This research contributes to the ongoing efforts in big data optimization, offering practical guidelines to maximize resource utilization and elevate the performance of data-intensive applications.Keywords
This publication has 9 references indexed in Scilit:
- A Performance Analysis of Hybrid and Columnar Cloud Databases for Efficient Schema Design in Distributed Data Warehouse as a ServiceData, 2024
- The applications of machine learning techniques in medical data processing based on distributed computing and the Internet of ThingsComputer Methods and Programs in Biomedicine, 2023
- A Survey on Data-driven Performance Tuning for Big Data Analytics PlatformsBig Data Research, 2021
- Logical Schema Design that Quantifies Update Inefficiency and Join Efficiency2021
- Spark-based Cloud Data Analytics using Multi-Objective Optimization2021
- Comparative Analysis of the Normalization Techniques in the Context of MCDM ProblemsDecision Making: Applications in Management and Engineering, 2021
- Spark SQL2015
- Big Data with Cloud Computing: an insight on the computing environment,MapReduce, and programming frameworksWIREs Data Mining and Knowledge Discovery, 2014
- Denormalization effects on performance of RDBMS2005