DOD STTR 24.B Annual

Active
No
Status
Open
Release Date
April 17th, 2024
Open Date
May 15th, 2024
Due Date(s)
June 12th, 2024
Close Date
June 12th, 2024
Topic No.
MDA24B-T005

Topic

Using Cognitive Digital Twin Framework for Autonomous Target Discrimination

Agency

Department of DefenseN/A

Program

Type: STTRPhase: Phase IYear: 2024

Summary

The Department of Defense (DOD) is seeking proposals for the Small Business Innovation Research (SBIR) Phase I program. The specific topic of the solicitation is "Using Cognitive Digital Twin Framework for Autonomous Target Discrimination". The research aims to develop a novel method for fusion of heterogeneous multi-sensor information to characterize and understand the environment, identify high-interest objects, and support intelligent decision-making. The technology falls under the OUSD (R&E) critical technology areas of Trusted AI and Autonomy, Advanced Computing and Software, Integrated Sensing and Cyber, and Emerging Threat Reduction. The research will address challenges in handling differences in sensor resolution, coverage, and limited viewing geometry, as well as the uncertainty of observed data. The project will involve the development of a cognitive digital twin prototype for fusion, classification, and decision-making. The research will be conducted in two phases, with Phase I focusing on proof of principle and Phase II refining and implementing designs. The topic has both military and commercial applications, including advanced assistance systems and autonomous vehicle development. The solicitation is open for proposals until June 12, 2024. For more information, visit the SBIR topic link or the solicitation agency website.

Description

OUSD (R&E) CRITICAL TECHNOLOGY AREA(S): Trusted AI and Autonomy; Advanced Computing and Software; Integrated Sensing and Cyber; Emerging Threat Reduction

 

The technology within this topic is restricted under the International Traffic in Arms Regulation (ITAR), 22 CFR Parts 120-130, which controls the export and import of defense-related material and services, including export of sensitive technical data, or the Export Administration Regulation (EAR), 15 CFR Parts 730-774, which controls dual use items. Offerors must disclose any proposed use of foreign nationals (FNs), their country(ies) of origin, the type of visa or work permit possessed, and the statement of work (SOW) tasks intended for accomplishment by the FN(s) in accordance with the Announcement. Offerors are advised foreign nationals proposed to perform on this topic may be restricted due to the technical data under US Export Control Laws.

 

OBJECTIVE: Seek the Cognitive Digital Twin technology to develop a novel method for fusion of heterogeneous multi-sensor information to characterize and understand environment, identify high interest objects, and support intelligent decision-making.

 

DESCRIPTION: To protect the United States and allies from current ballistic missiles and preparing to defend against future increasingly more complex threats, the BMDS assigned the high priority to advance current architecture models to incorporate novel methodologies and techniques.  This architecture model advancement can be also performed in the commercial domain and the obtained results transferred to military applications.

 

One of the most critical characteristics of many military and commercial assets is its ability to utilize all the available information from deployed sensors and the state-of-the art Machine Learning (ML) and Artificial Intelligence (AI) algorithms to perform their important functions as scene characterization and understanding, target selection and decision-making.  To boost quality of these tasks, an autonomous system needs to be designed and developed that employs an information fusion scheme with contextual adaptation, a time-evolving ML/AI discrimination of high priority objects, and fire engagement decision-making procedures derived from estimated classification confidence.

 

Current machine learning approaches to information fusion and decision-making in both military and commercial often have no means of properly handling differences in sensor resolution and coverage, disparate phenomenology, and limited viewing geometry, as well as the inherent uncertainty of the collection of observed data or/and of exploiting the available higher level contextual information on the threat evolution and environment.

 

Due to the development of new-generation information and digitalization technologies, more data can be collected, which in turn require better ways for the deep application of these data.  As a result, the concept of Digital Twin (DT) has aroused much attention and is developing rapidly.  DT is typically described as consisting of a physical system, its virtual replica, and the data connections between them.  It is increasingly being explored as a means of describing and improving the performance of physical systems through leveraging various computational techniques including ML and AI algorithms.  The advantage of DT over simulations is that it creates an active virtual environment capable of involving several simulations, utilizing real-time data and a two-way flow of information between the twin and the data sensors.  The DT technology becoming increasingly prevalent in many fields, including the autonomous systems industry.

 

Characterizing and identification of incurring military or commercial objects in complex environments using diverse sensing has a number of significant challenges.  Typically, data may be sparse, collection times are limited, a priori information is incomplete and/or may be in error, additionally, unexpected events and objects may appear.  Though DT technology can support many of the necessary integration and correlation procedures, it needs to fuse all available data with information and knowledge related to the scene characterization and target identification.  Hence, it becomes necessary to augment the DT with cognitive capabilities.  Semantic technologies such as ontology and knowledge graphs could provide potential solutions by empowering DTs with reasoning abilities.

 

The Cognitive Digital Twin (CDT) concept has been recently proposed which reveals a promising evolution of the current DT concept towards a more intelligent, comprehensive and full lifecycle representation of complex systems.  It is intended to harness a high level of intelligence that can replicate human cognitive processes and execute conscious actions autonomously, with minimal or no human intervention.  The CDT structure provides an excellent framework to greatly improve the effectiveness of autonomous system actions.  The novel fusion and decision-making system structured as a cognitive digital twin can be suitably integrated with relevant digital twins developed by many developers via its capabilities of communication, analytics, and cognition.  Consequently, it will perfectly support development and evolution of capabilities for autonomous systems.

 

A CDT based fusion system would replace and/or improve legacy and current approaches like Dempster-Schafer theory, rule-based expert systems, Bayesian networks, probabilistic relational models, etc.

In summary, the successful proposal will address all the technical challenges in designing and developing an onboard CDT based fusion and decision-making system including:

  1. Appropriate handling differences in sensor resolution and coverage, disparate phenomenology, and limited viewing geometry, as well as the inherent uncertainty of the collection of observed data;

  2. Exploiting the available higher level contextual information on the threat evolution and scenery;

  3. Optimizing real-time data collection and minimizing the required data transmission;

  4. A time-evolving, adaptive ML/AI important entities identification algorithms providing class probabilities of high priority items as well as dealing with absence of information on some objects;

  5. Commitment decision-making procedures derived from estimated classification confidence and contextual reasoning;

  6. Supporting future evolution of capabilities of autonomous systems in complex and evolving environments.

 

PHASE I: Demonstrate proof of principle with a cognitive digital twin prototype for an innovative fusion, classification, and decision-making concept.  Utilizing surrogate objects generation, their data, and contextual information, conceptualize, develop, and model near real-time solutions that satisfy the problem objectives and requirements.

 

PHASE II: Using realistic, relevant threat data, refine and implement designs from Phase I.  Validate concept with available test data.

 

PHASE III DUAL USE APPLICATIONS: The topic has numerous military and commercial applications, where fusion of available time-evolving information can assist with scene description and its understanding to support optimal decision-making, e.g., advanced assistance systems and autonomous vehicle development.

 

REFERENCES:

Li, Luning, et al. "Digital twin in aerospace industry: A gentle introduction." IEEE Access 10 (2021): 9543-9562.
Hossain, S M Mostaq, et al. “A New Era of Mobility: Exploring Digital Twin Applications in Autonomous Vehicular Systems.” 2023 IEEE World AI IoT Congress IEEE, (2023): 493-499.
Eirinakis, Pavlos, et al. "Enhancing cognition for digital twins." 2020 IEEE International Conference on Engineering, Technology and Innovation (ICE/ITMC) IEEE, (2020): 1-7.
Sahlab, Nada, et al. "Extending the Intelligent Digital Twin with a context modeling service: A decision support use case." Procedia CIRP 107 (2022): 463-468.
Maurer, Donald E., et al. "Sensor fusion architectures for ballistic missile defense." Johns Hopkins APL technical digest 27.1 (2006): 19-31.
Domingos, Pedro and Richardson, Matthew. "Markov logic: A unifying framework for statistical relational learning." Statistical Relational Learning (2007): 339-344.

 

KEYWORDS: Target Discrimination; Remote Sensing; Information Fusion; Digital Twin; Cognitive Process; Machine Learning; Artificial Intelligence; Autonomous System; Decision-making

Similar Opportunities

DOD SBIR 24.4 Annual - AI-Enhanced TPS Development and Sustainment
Department of Defense
The Department of Defense (DOD) is seeking proposals for the topic of "AI-Enhanced TPS Development and Sustainment" as part of their SBIR program. The objective of this project is to develop an organic capability for field-level maintenance and repair of weapon system electronics, reducing supply chain latency and screening electronic components for No Evidence of Failure (NEOF) at the source. The goal is to achieve faster weapon system repairs, shorter component Turn-Around-Times (TAT), high equipment Operational Availability (Ao), and high unit readiness at lower life-cycle costs. The project will apply Artificial Intelligence (AI) and Model-Based Systems Engineering (MBSE) to improve the development, operation, and sustainment of Test Program Sets (TPS) for electronic components of weapon systems. Phase I proposals are accepted with a budget of up to $250,000 for a 6-month period of performance. Phase II will involve TPS hardware and software prototype development, critical design, test, integration, verification, validation, and acceptance. Phase III will focus on dual-use applications such as sensor integration in mobile platforms with AI-assisted guided diagnostics. The project has potential applications across all Army commodities, ground, air, missile, and C5ISR. The solicitation is open until March 31, 2025. For more information, visit the [SBIR topic link](https://www.sbir.gov/node/2651293) or the [solicitation agency website](https://www.defensesbirsttr.mil/SBIR-STTR/Opportunities/).
DOD SBIR 24.4 Annual - Open Topic for Persistent Experimentation
Department of Defense
The Department of Defense (DOD) is seeking proposals for an open topic on persistent experimentation. The U.S. Army, under the Office of the Under Secretary of Defense for Research and Engineering (OUSD (R&E)), is specifically interested in novel, disruptive concepts and technology solutions with dual-use capabilities. The goal is to address the Army's current needs and future concepts by experimenting, refining, and advancing technology solutions in operationally relevant environments. The Army encourages participation in its persistent experimentation events to mature and test the technology. Proposals should align with specific experimentation events and demonstrate potential for commercial applications. The phase I of the project will only accept Direct to Phase II (DP2) proposals, which should provide documentation of scientific and technical merit, feasibility, and potential commercial applications. DP2 awardees are expected to produce a prototype solution ready for field demonstration and deliver a technology transition and commercialization plan. Phase III focuses on the maturation of the technology to TRL 6/7 and further development and commercialization. The keywords for this solicitation include Human-Machine Integration (HMI), autonomy, artificial intelligence (AI), logistics, ground systems, air systems, robotics, sensors, and electromagnetic warfare (EW). The solicitation is open until March 31, 2025. For more information, visit the [solicitation link](https://www.sbir.gov/node/2603059).
DOD SBIR 24.4 Annual - Robust Computer Vision for Better Object Detection with Limited Training Data
Department of Defense
The Department of Defense (DOD) is seeking proposals for the topic "Robust Computer Vision for Better Object Detection with Limited Training Data" as part of their SBIR 24.4 Annual solicitation. The goal of this topic is to experiment with innovative AI/ML approaches to object identification and imagery scene analysis. The increasing availability of digital imagery requires automated methods to process and analyze vast amounts of multi-modal data efficiently. One critical application is the identification of objects of interest (OoI) within imagery data or the scene generated by the imagery, which can provide valuable insights and facilitate decision-making processes in various fields such as military intelligence, environmental monitoring, transportation management, and security surveillance. The solicitation is open for Direct to Phase II (DP2) proposals with a cost of up to $2,000,000 for an 18-month period of performance. Proposers interested in submitting a DP2 proposal must provide documentation to substantiate that the scientific and technical merit and feasibility equivalent to a Phase I project has been met. The focus of this SBIR topic is robust AI/ML object detection techniques for computer vision that do not rely on extensive availability of labeled training data. The use of foundational knowledge and methods, such as handcrafted features, evolutionary algorithms, and newer techniques based on transformers, can be leveraged for this topic without requiring a feasibility study. During DP2, firms should develop and implement novel or hybrid AI/ML models for object detection that do not rely on extensive training data and train models in Project Linchpin's AI Unclassified Operations Environment using Linchpin data for DOD use cases. The Phase III dual-use applications include autonomy, retail, public safety, traffic management, enhanced security, and agriculture. Computer vision solutions in the private sector encompass a wide range of applications, and companies like Amazon, Google, and Microsoft offer cloud-based object detection and recognition services. The solicitation is open until March 31, 2025. For more information and to submit a proposal, visit the DOD SBIR website: [link](https://www.defensesbirsttr.mil/SBIR-STTR/Opportunities/).
DOD SBIR 24.4 Annual - xTechScalable AI
Department of Defense
The Department of Defense (DOD) is seeking proposals for the topic "xTechScalable AI" as part of the SBIR program. The Army branch is specifically interested in novel and disruptive concepts and technology solutions that can address the vulnerabilities of current machine learning pipelines and models. The goal is to develop comprehensive security models capable of defending against universal AI threat vectors. The Army is prioritizing proposals that focus on systematic testing and evaluation methods, trusted and secure validation and verification strategies, continuous monitoring capabilities, improved transparency and assurance of code and data, and improved telemetry capabilities. The Army will use the xTechScalable AI prize competition to identify small businesses that meet the criteria for award, and only winners of the competition will be eligible to submit a proposal under this topic. The project will have three phases: Phase I involves submitting a Direct to Phase II (DP2) proposal, Phase II involves producing prototype solutions for evaluation by soldiers, and Phase III involves completing the maturation of the technology and producing prototypes for further development and commercialization. The deadline for proposal submission is March 31, 2025. For more information and to submit a proposal, visit the solicitation agency's website at [solicitation_agency_url].