DATAWorks 2023 Agenda Day 3

April 27th Agenda

Audience Legend

  •  1 

    Everyone.

    These talks should be accessible to everyone regardless technical background.

  •  2 

    Practitioners.

    These talks might include case studies with some discussion of methods and coding, but largely accessible to a non-technical audience.

  •  3 

    Technical Experts.

    These talks will likely delve into technical details of methods and analytical computations and are primarily aimed at practitioners advancing the state of the art.

7:30 AM – 8:30 AM

Check-in

8:30 AM – 8:40 AM

Room A+B

Virtual Session

Opening Remarks

Bram Lillard

(IDA)


8:40 AM – 9:20 AM

Room A+B

Virtual Session

Keynote 3

The Honorable Christine Fox

(Johns Hopkins University Applied Physics Laboratory)


9:30 AM – 10:30 AM

Room A+B

Featured Panel: AI Assurance
Session Chair: Chad Bieber
  • Laura Freeman (Virginia Tech National Security Institute)

    Materials URL:

  • Alec Banks (Defence Science and Technology Laboratory)

  • Josh Poore (Applied Research Laboratory for Intelligence and Security, University of Maryland)

  • John Stogoski (Software Engineering Institute, Carnegie Mellon University)

10:30 AM – 10:50 AM

Break

10:50 AM – 12:20 PM: Parallel Sessions

Room A

Virtual Session
Session 4A: Transforming T&E to Assess Modern DoD Systems
Session Chair: Kristen Alexander, DOT&E
  •  1 

    DOT&E Strategic Initiatives, Policy, and Emerging Technologies (SIPET) Mission Brief

    Jeremy Werner (DOT&E)

    Materials:

  •  1 

    T&E as a Continuum

    Orlando Flores (OUSD(R&E))

    Materials:

  •  1 

    NASEM Range Capabilities Study and T&E of Multi-Domain Operations

    Hans Miller (MITRE)

    Materials:

Room B

Virtual Session
Session 4B: Artificial Intelligence Methods & Current Initiatives
Session Chair: Brian Vickers, IDA
  •  1 

    Gaps in DoD National Artificial Intelligence Test and Evaluation Infrastructure Capabilities

    Rachel Haga (IDA)

  •  2 

    Assurance of Responsible AI/ML in the DOD Personnel Space

    John Dennis (IDA)

    Materials:

  •  2 

    CDAO Joint AI Test Infrastructure Capability

    David Jin (MITRE)

    Materials:

Room C

Session 4C: Applications of Machine Learning and Uncertainty Quantification
Session Chair: Jonathan Rathsam, NASA Langley Research Center
  •  1 

    Advanced Automated Machine Learning System for Cybersecurity

    Himanshu Dayaram Upadhyay (Florida International University)

  •  2 

    Uncertainty Aware Machine Learning for Accelerators

    Malachi Schram (Thomas Jefferson National Accelerator Facility)

    Materials:

  •  2 

    Well-Calibrated Uncertainty Quantification for Language Models in the Nuclear Domain

    Karl Pazdernik (Pacific Northwest National Laboratory)

    Materials:

Room D

Spotlight on Data Literacy
Session Chair: Matthew Avery, IDA
  •  1 

    Data Literacy Within the Department of Defense

    Nicholas Clark (United States Military Academy)

    Materials:

Room E

Virtual Session
Mini-Tutorial 4
Session Chair: Gina Sigler, STAT COE
  •  1 

    An Overview of Methods, Tools, and Test Capabilities for T&E of Autonomous Systems

    Leonard Truett and Charlie Middleton (STAT COE)

    Materials:

12:20 PM – 1:30 PM

Lunch

1:30 PM – 3:00 PM: Parallel Sessions

Room A

Virtual Session
Session 5A: Methods and Tools at National Labs
Session Chair: Karl Pazdernik, Pacific Northwest National Laboratory
  •  2 

    Test and Evaluation Methods for Authorship Attribution and Privacy Preservation

    Emily Saldanha (Pacific Northwest National Laboratory)

    Materials:

  •  2 

    Tools for Assessing Machine Learning Models’ Performance in Real-World Settings

    Carianne Martinez (Sandia National Laboratories)

    Materials:

  •  2 

    Perspectives on T&E of ML for Assuring Reliability in Safety-Critical Applications

    Pradeep Ramuhalli (Oak Ridge National Laboratory)

Room B

Virtual Session
Session 5B: Applications of Bayesian Statisics
Session Chair: Victoria Sieck, STAT COE
  •  3 

    A Bayesian Decision Theory Framework for Test & Evaluation

    James Ferry (Metron, Inc.)

    Materials:

  •  2 

    Saving hardware, labor, and time using Bayesian adaptive design of experiments

    Daniel Ries (Sandia National Laboratories)

    Materials:

  •  2 

    Uncertainty Quantification of High Heat Microbial Reduction for NASA Planetary Protection

    Michael DiNicola (Jet Propulsion Laboratory, California Institute of Technology)

    Materials:

Room C

Session 5C: Methods and Tools for T&E
Session Chair: Sam McGregor, AFOTEC
  •  2 

    Confidence Intervals for Derringer and Suich Desirability Function Optimal Points

    Peter Calhoun (HQ AFOTEC)

    Materials:

  •  1 

    Skyborg Data Pipeline

    Alexander Malburg (AFOTEC/EX)

    Materials:

  •  2 

    Circular Error Probable and an Example with Multilevel Effects

    Jacob Warren (Marine Corps Operational Test and Evaluation Activity)

    Materials:

Room E

Virtual Session
Mini-Tutorial 5
Session Chair: John Haman, IDA
  •  1 

    The Automaton General-Purpose Data Intelligence Platform

    Jeremy Werner (DOT&E)

3:00 PM – 3:20 PM

Break

3:20 PM – 4:20 PM: Parallel Sessions

Room A

Virtual Session
Session 6A: Tools for Decision-Making and Data Management
Session Chair: Tyler Lesthaeghe, University of Dayton Research Institute
  •  3 

    User-Friendly Decision Tools

    Clifford Bridges (IDA)

    Materials:

  •  1 

    Seamlessly Integrated Materials Labs at AFRL

    Lauren Ferguson (Air Force Research Laboratory)

    Materials:

Room B

Virtual Session
Session 6B: Methods for DoD System Supply Chain and Performance Estimation
Session Chair: Margaret Zientek, IDA
  •  3 

    Applications of Network Methods for Supply Chain Review

    Zed Fashena (IDA)

    Materials:

  •  1 

    Predicting Aircraft Load Capacity Using Regional Climate Data

    Abraham Holland (IDA)

    Materials:

Room C

Session 6C: Statistical Methods for Ranking and Functional Data Types
Session Chair: Elise Roberts, JHU/APL
  •  2 

    An Introduction to Ranking Data and a Case Study of a National Survey of First Responders

    Adam Pintar (National Institute of Standards and Technology)

    Materials:

  •  3 

    Estimating Sparsely and Irregularly Observed Multivariate Functional Data

    Maximillian Chen (Johns Hopkins University Applied Physics Laboratory)

    Materials:

Room E

Virtual Session
Mini-Tutorial 6
Session Chair: Elizabeth Gregory, NASA Langley Research Center
  •  2 

    An Introduction to Uncertainty Quantification for Modeling & Simulation

    James Warner (NASA Langley Research Center)

    Materials:

4:20 PM – 4:40 PM

Room A+B

Virtual Session

Awards

Army Wilks Award

Wilks Award Winner to Be Announced

ASA SDNS Student Poster Awards

Student Winners to be Announced

DATAWorks Distinguished Leadership Award

Winner To Be Announced

4:40 PM – 4:50 PM

Room A+B

Virtual Session

Closing Remarks

General Norty Schwartz

(U.S. Air Force, retired / Institute for Defense Analyses)