SSSusan M. Sanchez

Susan M. Sanchez

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article

Previous Organizations / Institutes

The organizations / institutes from the scholar's other articles in the past ten years


Susan M. Sanchez has a total of 28 co-authors. Here are the top co-authors by number of shared publications:

  • Mary L. McDonald

    SEED Center for Data Farming, Operations Research Department, Naval Postgraduate School, Monterey, California 93943

    2 shared publications
  • Paul J. Sanchez

    Operations Research Department Naval Postgraduate School Monterey California USA

    2 shared publications
  • Paul J. Sanchez

    SEED Center for Data Farming, Operations Research Department, Naval Postgraduate School, Monterey, California 93943

    2 shared publications
  • Stephen C. Upton

    SEED Center for Data Farming, Operations Research Department, Naval Postgraduate School, Monterey, California 93943

    2 shared publications
  • Thomas W. Lucas

    SEED Center for Data Farming, Operations Research Department, Naval Postgraduate School, Monterey, California 93943

    2 shared publications
  • Brian L. Morgan

    Operations Research Department, Naval Postgraduate School, Monterey, California 93943

    1 shared publication

Latest Publications

  • Open Access

    Data Farming the Parameters of Simulation-Optimization Solvers

    by Sara Shashaani, David Eckman, Susan Sanchez

    The performance of a simulation-optimization algorithm, a.k.a. a solver, depends on its parameter settings. Much of the research to date has focused on how a solver’s parameters affect its convergence and other asymptotic behavior. While these results are important for providing a theoretical understanding of a solver, they can be of limited utility to a user who must set up and run the solver on a particular problem. When running a solver in practice, good finite-time performance is paramount. In this article, we explore the relationship between a solver’s parameter settings and its finite-time performance by adopting a data farming approach. The approach involves conducting and analyzing the outputs of a designed experiment wherein the factors are the solver’s parameters and the responses are assorted performance metrics measuring the solver’s speed and solution quality over time. We demonstrate this approach with a study of the ASTRO-DF solver when solving a stochastic activity network problem and an inventory control problem. Through these examples, we show that how some of the solver’s parameters are set greatly affects its ability to achieve rapid, reliable progress and gain insights into the solver’s inner workings. We discuss the implications of using this framework for tuning solver parameters, as well as for addressing related questions of interest to solver specialists and generalists.


  • Open Access

    Sensitivity analysis of hybrid microgrids with application to deployed military units

    by Daniel Reich, Susan M. Sanchez

    We introduce a framework for applying sensitivity analysis to a set of potential hybrid microgrid design options, from which a decision maker can select the most preferred one. In contrast to optimization‐centric models that define an objective and produce a single solution, our goal is to empower the decision maker by providing both a range of options and accessible information that enables the decision maker to easily assess their relative upsides and downsides. Moreover, our decoupled approach allows our framework to be paired with any existing model capable of generating a set of potential hybrid microgrid designs. We introduce metrics for computing risk, stemming from power deficits, over a variety of scenarios relating to weather conditions, power demand fluctuations, and extended time horizons. These factors which are inherently uncertain are all important in military operational contexts. By introducing a design of experiments method for sensitivity analysis, we are able to implement parallel processing and maintain computational tractability.


  • Gradient‐based criteria for sequential experiment design

    by Collin B. Erickson, Bruce E. Ankenman, Matthew Plumlee, Susan M. Sanchez

    Computer experiments are often used as inexpensive alternatives to real‐world experiments. Statistical metamodels of the computer model's input‐output behavior can be constructed to serve as approximations of the response surface of the real‐world system. The suitability of a metamodel depends in part on its intended use. While decision makers may want to understand the entire response surface, they may be particularly keen on finding interesting regions of the design space, such as where the gradient is steep. We present an adaptive, value‐enhanced batch sequential algorithm that samples more heavily in such areas while still providing an understanding of the entire surface. The design points within each batch can be run in parallel to leverage modern multi‐core computing assets. We illustrate our approach for deterministic computer models, but it has potential for stochastic simulation models as well.


  • Open Access

    Data Farming

    by Susan M. Sanchez

    Data farming is a descriptive metaphor that captures the notion of generating data purposefully to maximize the information “yield” from simulation models. Large-scale designed experiments let us grow the simulation output efficiently and effectively. We can explore massive input spaces, uncover interesting features of complex simulation response surfaces, and explicitly identify cause-and-effect relationships. Data farming has been used in the defense community over the past two decades, and has resulted in quantum leaps in the breadth, depth, and timeliness of the insights yielded by simulation models. In this article, we provide an overview of current data farming capabilities and their relationship to emerging techniques in data science and analytics. We use graphics to motivate insight into some of the benefits of a data farming approach. Finally, we share some thoughts about opportunities and challenges for further improving the state of the art, and transforming the state of the practice, in the data farming domain.


  • Orthogonal second‐order space‐filling designs with insights from simulation experiments to support test planning

    by Paul J. Sanchez, Susan M. Sanchez

    Frequency‐based designs are presented for exploring large numbers of factors in simulation experiments. This approach yields completely orthogonal full second‐order space‐filling designs. We describe how they are generated, explore their space‐filling properties, and compare their performance to other designs of similar sizes. We illustrate their use for test planning on a simulation model of a live counter‐IED (improved explosive device) test event and present some ideas about ways in which simulation experiments can be used to support planning for live tests.


  • Improving U.S. Navy Campaign Analyses with Big Data

    by Brian L. Morgan, Harrison C. Schramm, Jr. Jerry R. Smith, Thomas W. Lucas, Mary L. McDonald, Paul J. Sánchez, Susan M. Sanchez, Stephen C. Upton

    Decisions and investments made today determine the assets and capabilities of the U.S. Navy for decades to come. The nation has many options about how best to equip, organize, supply, maintain, train, and employ our naval forces. These decisions involve large sums of money and impact our national security. Navy leadership uses simulation-based campaign analysis to measure risk for these investment options. Campaign simulations, such as the Synthetic Theater Operations Research Model (STORM), are complex models that generate enormous amounts of data. Finding causal threads and consistent trends within campaign analysis is inherently a big data problem. We outline the business and technical approach used to quantify the various investment risks for senior decision makers. Specifically, we present the managerial approach and controls used to generate studies that withstand scrutiny and maintain a strict study timeline. We then describe STORMMiner, a suite of automated postprocessing tools developed to support campaign analysis, and provide illustrative results from a notional STORM training scenario. This new approach has yielded tangible benefits. It substantially reduces the time and cost of campaign analysis studies, reveals insights that were previously difficult for analysts to detect, and improves the testing and vetting of the study. Consequently, the resulting risk assessment and recommendations are more useful to leadership. The managerial approach has also improved cooperation and coordination between the Navy and its analytic partners.


  • Sliced Full Factorial-Based Latin Hypercube Designs as a Framework for a Batch Sequential Design Algorithm

    by Weitao Duan, Bruce E. Ankenman, Susan M. Sanchez, Paul J. Sanchez

    When fitting complex models, such as finite element or discrete event simulations, the experiment design should exhibit desirable properties of both projectivity and orthogonality. To reduce experimental effort, sequential design strategies allow experimenters to collect data only until some measure of prediction precision is reached. In this article, we present a batch sequential experiment design method that uses sliced full factorial-based Latin hypercube designs (sFFLHDs), which are an extension to the concept of sliced orthogonal array-based Latin hypercube designs (OALHDs). At all stages of the sequential design, good univariate stratification is achieved. The structure of the FFLHDs also tends to produce uniformity in higher dimensions, especially at certain stages of the design. We show that our batch sequential design approach has good sampling and fitting qualities through both empirical studies and theoretical arguments. Supplementary materials are available online.


  • A data farmer's almanac

    by Susan M. Sanchez

    Summary form only given. An almanac conveys practical advice in the form of useful facts, advice, and forecasts. Data farming encapsulates the notion of purposeful data generation from simulation models. It uses large-scale designed experiments to facilitate growing simulation output in an efficient and effective fashion, and enables us to explore massive input spaces, uncover interesting features of complex response surfaces, and explicitly identify cause-and-effect relationships. In this presentation, I will weave the two halves of the title together as I recount some key concepts and developments in simulation experimentation, along with experiences and advice drawn from my own data-farming journey.


  • Open Access

    A Robust Design Approach to Cost Estimation: Solar Energy for Marine Corps Expeditionary Operations

    by Susan M. Sanchez, Matthew M. Morse, Stephen C. Upton, Mary L. McDonald, Daniel A. Nussbaum