Realistic Large-Scale Online Network Simulation
Authors:
- 1 April 2005
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
Abstract
Large-scale network simulation is an important technique for studying the dynamic behavior of networks, network protocols, and emerging classes of distributed application (e.g. Grid, peer-to-peer, etc.) Large-scale and realism are two critical requirements for network simulations of Grid application studies. Our work here extends previous efforts in three key ways. First, we study networks 100x larger than in our previous studies (20,000 routers). Second, at this scale, we study realistic network struct ures (100 AS’s, BGP4 and OSPF routing) versus flat OSPF routing. Finally, we describe and evaluate a new profile-based load-balancing approach called hierarchical profile-based load balance. Our extensive large-scale experiments with profile-based load balance (PROF) on flat-routed (OSPF) networks show that PROF outperforms several other techniques based on topology and static application information. However, these results and those for multi-AS networks motivate our invention of a new hierarchical technique (HPROF) which clusters network nodes to achieve a desired minimum link latency (MLL), a key determinant of simulation parallelism, then applies the graph partitioner. HPROF explicitly controls the tradeoff between simulation efficiency and available parallelism, producing robust and superior performance for large-scale networks, including both single-AS and multi-AS networks. HPROF can improve load imbalance by 40%, and reduce the simulation time by about 50% in our 20,000 router simulations executed on 128-node clusters. The parallel efficiency achieved by these simulations is over 40%, providing substantial capabilities for simulating large networks. In summary, these advances demonstrate that realistic large-scale network simulation for networks of 20,000 routers (comparable to a large Tier-1 ISP network like AT&T) can be accomplished with our system.Keywords
This publication has 23 references indexed in Scilit:
- Toward scaling network emulation using topology partitioning2004
- Validating and Scaling the MicroGrid: A Scientific Instrument for Grid DynamicsJournal of Grid Computing, 2004
- Characterizing the Internet hierarchy from multiple vantage points2003
- Learning not to share [large-scale discrete event simulation]2002
- Applying parallel discrete event simulation to network emulation2002
- Programming environments for high-performance Grid computing: the Albatross projectFuture Generation Computer Systems, 2002
- Graph partitioning models for parallel computingParallel Computing, 2000
- A random graph model for massive graphs2000
- The MicroGrid: A Scientific Tool for Modeling Computational GridsScientific Programming, 2000
- Scotch: A software package for static mapping by dual recursive bipartitioning of process and architecture graphs1996