Realistic Large-Scale Online Network Simulation
Authors:
- 1 August 2006
- journal article
- research article
- Published by SAGE Publications in The International Journal of High Performance Computing Applications
- Vol. 20 (3) , 383-399
Abstract
Large-scale network simulation is an important technique for studying the dynamic behavior of networks, network protocols, and emerging classes of distributed applications (e.g. Grid, peer-to-peer, etc.) Large scale and realism are two critical requirements for network simulations of Grid application studies. Our work here extends previous efforts in three key ways. First, we study networks 100 times larger than in our previous studies (20000 routers). Second, at this scale, we study realistic network structures (100 ASs, BGP4 and OSPF routing) versus flat OSPF routing. Finally, we describe and evaluate a new profile-based load-balancing approach called hierarchical profile-based load balance. Our extensive large-scale experiments with profile-based load balance (PROF) on flat-routed (OSPF) networks show that PROF outperforms several other techniques based on topology and static application information. However, these results and those for multi-AS networks motivate our invention of a new hierarchical technique (HPROF) which clusters network nodes to achieve a desired minimum link latency (MLL), a key determinant of simulation parallelism, then applies the graph partitioner. HPROF explicitly controls the trade-off between simulation efficiency and available parallelism, producing robust and superior performance for large-scale networks, including both single-AS and multi-AS networks. HPROF can improve load imbalance by 40%, and reduce the simulation time by about 50% in our 20000 router simulations executed on 128-node clusters. The parallel efficiency achieved by these simulations is over 40%, providing substantial capabilities for simulating large networks. In summary, these advances demonstrate that realistic large-scale network simulation for networks of 20000 routers (comparable to a large Tier-1 ISP network such as AT&T) can be accomplished with our system. To demonstrate the capabilities of our simulation tool, we simulate a large-scale Denial-of-Service attack in a large-scale network with 10000 routers organized as 40 Autonomous Systems. The simulation includes over 400 live application processes, the DoS attack and application entities, and generates aggregate traffic of over 6 Gbps.Keywords
This publication has 9 references indexed in Scilit:
- Applying parallel discrete event simulation to network emulation2002
- Programming environments for high-performance Grid computing: the Albatross projectFuture Generation Computer Systems, 2002
- Numerical Libraries and the GridThe International Journal of High Performance Computing Applications, 2001
- Graph partitioning models for parallel computingParallel Computing, 2000
- A random graph model for massive graphs2000
- Advances in network simulationComputer, 2000
- The MicroGrid: a Scientific Tool for Modeling Computational Grids2000
- Modeling Internet topologyIEEE Communications Magazine, 1997
- Predicting software reliabilityPhilosophical Transactions of the Royal Society of London. Series A, Mathematical and Physical Sciences, 1989