Defense and Aerospace Test and Analysis Workshop

March 31 – April 2, 2020

Waterford at Springfield, VA


Workshop Overview

     The Defense and Aerospace Test and Analysis (DATA) Workshop is the result of a multi-organization collaboration with the Director of Operational Test & Evaluation (DOT&E) within the Office of the Secretary of Defense, National Aeronautics and Space Administration (NASA), the Institute for Defense Analyses (IDA), and the Section on Statistics in Defense and National Security (SDNS) of the American Statistical Association (ASA). The workshop is strategically designed to strengthen the community by applying rigorous statistical approaches to test design and data analysis in the fields of defense and aerospace.
     The three-day workshop will showcase a combination of applied problems, unique methodological approaches, and tutorials from leading academics.
     Our goal is to facilitate collaboration among all involved, including other government agencies.

Progress and Challenges in Program Evaluation

     The Department of Defense (DoD) and NASA develop and acquire some of the world’s most sophisticated technological systems. In cooperation with these organizations, we face challenges in ensuring that these systems undergo testing and evaluation (T&E) that is both adequate and efficient prior to their use in the field.
     Sessions with this theme will feature case study examples highlighting advancements in T&E methodologies that we have made as a community.
     Topics covered may include modeling and simulation validation, uncertainty quantification, experimental design usage, Bayesian analysis, among others. Sessions will also discuss the current challenges and areas in the field that require more research.

Machine Learning and Artificial Intelligence

     With the future of automation trending towards using machine learning (ML) and artificial intelligence (AI), we aim to provide resources, set precedent, and inspire innovation in these fields.
     Sessions with this theme will discuss how we can quantify confidence that ML and/or AI algorithms function as intended. To do this we explore whether the functions are free of vulnerabilities that are either intentionally or unintentionally integrated as part of the data or algorithm.
     Topics covered may include testing and evaluation (T&E) metrics and methods for AI algorithms, T&E metrics and methods for cyber-physical systems with AI algorithms, threat portrayal for ML/AI algorithms, and robust ML/AI algorithm design.

Cybersecurity and Software Test & Evaluation

     The number of known cyber-attacks has been steadily increasing over the past ten years, exposing millions of data records. With the help of leading minds in the cyber field, we work to not only to discover new ways of identifying these attacks, but also ways to counter future attacks.
     Sessions with this theme will discuss metrics and test methodologies for testing cyber-physical systems with an emphasis on characterizing cyber resiliency.
     Topics covered may include identifying cybersecurity threats (IP and non-IP) across critical operational missions, development and testing secure architectures, identifying critical system components that enable attack vectors, developing and testing countermeasures to cyber-attacks, and testing methods for cyber-physical systems that include machine learning algorithms.

Modeling the Human-System Interaction

     Mission outcomes are heavily determined by how effectively operators interact with systems under operational conditions as decided by their objective performance and their perceived performance. In order to effectively interpret these systems, we analytically observe team dynamics to predict how changing operating conditions will affect the dynamic and therefore productivity.
     Sessions with this theme will discuss methods used to collect and model the quality of human-system interaction and its impact on operational performance.
     Topics covered will include survey development/test design, statistical methods for surveys, scale validation, and network analysis.

Science Applications of Test and Evaluation

     Scientists use a variety of tools to perform analyses within their areas of expertise. Our goal is to demonstrate knowledge of how to improve analyses that they already perform and to introduce new tools to increase analysis efficiency.
     Sessions with this theme will cover simulation, prediction, uncertainty quantification, and inference for physical and physical-statistical modeling of geophysical processes.
     Topics covered may include Earth Science problems (e.g. ice sheet evolution models, atmospheric and ocean processes, the carbon cycle, land surface processes, natural hazards), astronomy and cosmology (e.g. exoplanet detection, galactic formation, cosmic microwave background), and planetary science (e.g. planetary atmospheres, formation).

Mark Your Calendar

    • Registration Now Open
    • Contributed Abstract Submission Closes: January 31, 2020
    • Notification of Contributed Abstract Acceptance: February 14, 2020
    • Registration Closes: March 20, 2020
    • DATAWorks: March 31 – April 2, 2020

Participate in the Program

Invited Abstract Submission

Click Here for Full Agenda

Agenda Summary

Tuesday, March 31
8:30 AM – 5:00 PM

Workshop check-in begins at 8:00 AM

Categorical Data Analysis

Chris Franck, Virginia Tech

Introduction to Machine Learning: Classification Algorithms

Martin Skarzynski, DATA SOCIETY

Network Analysis

Doug Steinley, University of Missouri

Software Testing

Erin Lanus, Virginia Tech

Surrogates: Gaussian Process Modeling, Design, Optimization, and Calibration

Robert “Bobby” Gramacy, Virginia Tech

Wednesday, April 1
8:30 AM – 5:00 PM

Workshop check-in begins at 8:00 AM


Morning Keynote

Breakout & Mini-Tutorial Sessions

Lunch Keynote

Breakout & Mini-Tutorial Sessions

Poster Session & Evening Reception


Thursday, April 2
8:30 AM – 5:00 PM

Workshop check-in begins at 8:00 AM


Morning Keynote

Breakout & Mini-Tutorial Sessions

Lunch Keynote

Breakout & Mini-Tutorial Sessions


Click for All Speakers
Keynote Speakers

Short Course Instructors
Spotlight Speakers


Waterford at Springfield

DATAWorks 2020 will be held in Springfield, VA at the Waterford at Springfield (6715 Commerce St, Springfield, VA 22150). The Waterford is an event and conference center, but not a hotel. However, there are many hotels close by the Waterford at Springfield.


Local Hotel Options


Room blocks have been reserved at the following hotels at the government rate. First come, first served bases. 30 days prior to the workshop unbooked rooms will be released and no longer available at a guaranteed rate.

Courtyard Springfield (0.1 mile)
6710 Commerce St, Springfield, VA 22150
Book a room at the Courtyard Springfield for DATAWorks

Hilton (0.4 mile)
6550 Loisdale Rd, Springfield, VA 22150
• Shuttle provided
Book a room at the Hilton Springfield for DATAWorks

Holiday Inn Express (0.5 mile)
6401 Brandon Avenue, Springfield, Virginia 22150
• Room block provided till 2/19/2018
• Shuttle provided
Book a room at the Holiday Inn Express for DATAWorks


Homewood Suites (0.7 mile)
7010 Old Keene Mill Rd, Springfield, VA 22150
Book a room at the Homewood Suites for DATAWorks

TownePlace Suites by Marriot  (0.5 mile)
6245 Brandon Ave, Springfield, VA 22150
• Shuttle provided
Book a room at the TownePlace Suites for DATAWorks