Retracted March 9, 2026: Heterogeneous Big Data Parallel Computing Optimization Model using MPI/OpenMP Hybrid and Sensor Networks
Open Access
- 9 August 2022
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Sensor Networks
Abstract
For the heterogeneous big data parallel computing model, two levels of parallelism between nodes are not considered, resulting in low efficiency of heterogeneous big data parallel computing and bandwidth to send and receive information, high communication overhead, long model running time and small computational volume. In the paper, we propose an optimization model of heterogeneous big data parallel computing based on a hybrid Multi Point Interface (MPI)/Open Multi-Processing (OpenMP) and Sensor Networks. First, the processor characteristics of heterogeneous big data architecture is analyzed, the parallel tasks among processors are divided, collect the heterogeneous big data to be computed and cluster them, and use the processing results as the input items of the model. Then, a parallel load balancing mechanism is established to optimally divide the parallel computing load of heterogeneous big data, and a parallel computing optimization program is written by combining the hybrid programming mode of MPI and OpenMP and using the hybrid MPI/OpenMP, and finally, the parallel computing optimization of heterogeneous big data is realized by optimizing the parallel communication and determining the model parameters. The results show that the proposed model has a communication bandwidth of 510Mbps, a computational volume of 1.16GB, a model runtime of 24s, and an improved network bandwidth utilization of 93%, which can effectively reduce the communication overhead, and improve the efficiency of parallel computing and bandwidth sending and receiving information in sensor networks, and shorten the model running time.Keywords
This publication has 15 references indexed in Scilit:
- Bi-Objective Optimization of Data-Parallel Applications on Heterogeneous HPC Platforms for Performance and Energy Through Workload DistributionIEEE Transactions on Parallel and Distributed Systems, 2020
- clusterCL: comprehensive support for multi-kernel data-parallel applications in heterogeneous asymmetric clustersThe Journal of Supercomputing, 2020
- An Efficient Directory Entry Lookup Cache With Prefix-Awareness for Mobile DevicesIEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, 2020
- A branch-and-bound approach to scheduling of data-parallel tasks on multi-core architecturesInternational Journal of Embedded Systems, 2020
- A Hierarchical Data-Partitioning Algorithm for Performance Optimization of Data-Parallel Applications on Heterogeneous Multi-Accelerator NUMA NodesIEEE Access, 2019
- A Distributed Approach for High-Dimensionality Heterogeneous Data ReductionIEEE Access, 2019
- Degree-of-Node Task Scheduling of Fine-Grained Parallel Programs on Heterogeneous SystemsJournal of Computer Science and Technology, 2019
- Parallel island based Memetic Algorithm with Lin–Kernighan local search for a real-life Two-Echelon Heterogeneous Vehicle Routing Problem based on Brazilian wholesale companiesApplied Soft Computing, 2019
- Load balancing in a heterogeneous world: CPU-Xeon Phi co-execution of data-parallel kernelsThe Journal of Supercomputing, 2018
- A Web services vulnerability testing approach based on combinatorial mutation and SOAP message mutationService Oriented Computing and Applications, 2013