DOD SBIR 24.4 Annual

Active
Yes
Status
Open
Release Date
October 3rd, 2023
Open Date
October 3rd, 2023
Due Date(s)
March 31st, 2025
Close Date
March 31st, 2025
Topic No.
OSD244-001

Topic

Chief Digital and Artificial Intelligence Office (CDAO) Data Mesh Reference Design (REFDES)

Agency

Department of DefenseN/A

Program

Type: SBIRPhase: BOTHYear: 2024

Summary

The Department of Defense (DOD) is seeking proposals for the Chief Digital and Artificial Intelligence Office (CDAO) Data Mesh Reference Design (REFDES). The objective is to make all data across the Department of Defense seamlessly interoperable while retaining federated control, hosting, and ownership. The DOD aims to establish a set of software services that allow data users to discover, access, and consume DoD data products via self-service API. The data access must support attribute-based access control (ABAC) and operate in a zero-trust environment. The program consists of three phases: Phase I involves creating a formal REFDES, Phase II focuses on building a Minimum Viable Product (MVP) version of the design, and Phase III involves delivering a full production capability. The REFDES must address key concepts such as VAULTIS compliance, services communication model and framework, data templating, dynamic attribution association, automated notification services, cybersecurity, and zero trust support. The resulting data mesh will support interoperability for applications in both battlefield and boardroom settings. The solicitation is open until March 31, 2025. For more information, visit the SBIR topic link or the solicitation agency website.

Description

OUSD (R&E) CRITICAL TECHNOLOGY AREA(S): Advanced Computing and Software; Integrated Network Systems-of-Systems

 

OBJECTIVE: To break the Department of Defense (DoD) enterprise data out of stovepipes created for single use cases, and to make all data seamlessly interoperable across the department, while retaining federated control, hosting, and ownership.

 

DESCRIPTION:

The Department aims to establish a set of software services to allow data users across the Department of Defense (DoD) enterprise to discover DoD data products, understand their structure and meaning, seamlessly negotiate access, and consume them via self-service API. Per DoD rulemaking, data access must support attribute-based access control (ABAC) and operate in a zero-trust environment.

 

The Department has determined that data sharing models with a unified schema and single system of record (sometimes called a “Data Warehouse”) or even semi-unstructured data in a single system of record (“Data Lake”) are not good operational fits for the Department’s requirements. A closer analogue is a “Data Mesh” as described in Dehghani (2022).1

 

This program consists of three phases, described in the sections below. First, however, a few descriptions.

 

Peer-Cooperative Microservices Each unique microservice is able to communicate with all other similar/identical microservices to form a specific community.

 

Services vs. Microservices The rest of this document will reference services and microservices as “services”, however it recognizes the distinction between them. Larger applications, built on a single code base, typically consist of a client-side UI, a database, and a server-side application. These are Services. On the other hand microservices are built for a fully distributed system to accomplish a single feature or business logic. Instead of exchanging data within the same code base, microservices communicate with an API.

 

The DoD has identified 15 core functional capabilities that an enterprise data mesh at the Department must have:

UIDs: Tools to describe how data transforms and flows as it is transported from source to destination across the entire data lifecycle. Data versioning for tracking data and models as they change. [A prototype of this is available, accompanied by a whitepaper describing its recommended structure]
Semantic Services: Tools to promote sharing, collaboration, and reuse of data models and ontologies; alias re-referencing to build a canonical controlled vocabulary. [A prototype of this is available, accompanied by a whitepaper describing its recommended structure]
Federated Data Catalog: Virtually federated catalog enabling defense-wide visibility of data and interfaces through pointers to DOD assets and services. [Multiple instantiations exist]
Data and Metadata Profiles (xBOMs): Managed service providing attribution and characteristics that describe the meaning and intended use for data, metadata, algorithms, hardware, software, and data objects. [A whitepaper describing its structure and the recommended schema are available]
Policy Access Control: Tools for ensuring proper access restrictions and identity verification for all consumers and producers in the data mesh.
Digital Policy Administration: Policy administration points feeding enforcement points enabling managed data access across environments.
Data Exchange Management: Handles and routes requests via any exchange method (e.g., API, cloud storage location, access-denied environments) to appropriate services.
Data Product Search: Tool for fast, relatable, and semantically congruent searching of all data products. Provides intuitive result finding for ingenuity and novel discovery of data products.
Data Mesh Pub/Sub: Systems of producers and consumers given by asynchronous service-to-service communication.
Mesh Performance Analytics: Track the flow and usage of data across the mesh. Flow monitoring and alerting.
Data Product Lifecycle Management: Submits data products for registration to the domain and enterprise catalogs. Updates/maintains/revokes registration as necessary. Manage recalled data products. Provide recall and other data product-associated notifications to data product consumers.
Data Security Classification: Tools and policy for proper marking of all types of sensitive data across the DoD. Includes an approach to handling escalation of classification due to data aggregation.
Quality Management Services: Tools for properly computing quality metrics on data and marking the data appropriately with its quality level.
Mediation Hub Services: Managed service for coordinating automated translation capabilities from data producer schemas and contexts to those of consumers, for immediate use without further transformation. The managed service consumes structured metadata about the schema and content of the producer data, available on the Mesh (e.g. from its xBOMs), and the target information about the consumer’s schema and context, and then sends the producer provided data to one or more translation services as required to return the translated data to the consumer. Implementation of specific translation services is outside the scope of this proposal; the Mediation Hub only coordinates their use and manages the mapping of producer to consumer and the required metadata.
Mesh Instrumentation Tools: Behavior analytic data stream analytics to allow performance optimization and asset value determination.

 

Multiple of these services are thought to be available by off the shelf (COTS) software products. In all cases, the Department is interested in keeping the resulting mesh services modular, with clear interfaces and clear separation of concerns.

 

PHASE I: The output of Phase I is a formal REFDES consisting of a composition of textual documentation and visual images as is appropriate to convey all concepts and their interoperability. It is required to use DoD-approved architecture tool and document creation software (e.g., Cameo). For any hybrid COTS/GOTS (Commercial Off-the-Shelf, Government Off-the-Shelf) or COTS service the REFDES must include the interoperability approach with all other services. Describe the enterprise interoperability services to promote a uniform pattern-based communication among all services and data. It is required to use DoD-approved architecture tool and document creation software and to be in accordance with (IAW) the DoD CIO Reference Design guidance[2].  A separate output, for Phase I performers that proposed an option, is a program plan that includes a detailed Phase I option plan that bridges to your level 3 breakdown structure for the Phase II effort.

 

The required REFDES must address the key concepts identified in the provided outline. Any deviations from this outline must be approved by the federal government lead. The complete REFDES must clearly articulate how all services will achieve both service-level communication interoperability and data interoperability. The end product shall enable any developer to design, develop, and implement any or all of the services independent of any other developer while ensuring full interoperability among all delivered capability. It should be accompanied by a time phased roadmap for service evolution.  

 

The REFDES outline is below.

Reference Design Outline

Introduction

Background

Purpose

Scope

Document Overview

Assumptions and Principles

Assumptions

Principles

Capability Concepts

Key Terms and Conceptual Model

Lifecycle Management

Management Environment

Organization

Process

Technology

Governance

Ecosystem

Planning

Production Services

Operations

External Systems

Tools and Activities

Planning Tools and Activities

Develop

Build

Test

Release and Deliver

Production Operation Tools and Activities

Deploy

Operate

Monitor

Sustain

Support

Security

Deployment

Operation

Monitoring

Acronym Table

Glossary

References

 

Key concepts for Data Mesh componentry shall at a minimum include:

		Visible, Accessible, Understandable, Linked, Trustworthy, Interoperable, and Secure (VAULTIS) compliance
		Services communication model and framework
		Data Templating 
			
				Machine-readability 
				Machine-comprehensibility
			
		
		Dynamic Attribution association
		Automated notification services
		Cybersecurity and Zero Trust support
	

 

The REFDES concept of operations (CONOPS) should consider the provided information describing service, COTS, GOTS, and the implementation model. (Figure 3)

 

The DoD-supplied information papers found in the References section provide the minimally-acceptable architecture and REFDES concepts. The strong default is for these to be individual services. Any deviation from the specified approaches shall be approved by the Government.

 

Figure 3

 

PHASE II: In Phase II, participants will create a Minimum Viable Product (MVP) version of the chosen design, building complete enough versions of the systems in the selected Reference Design(s) to demonstrate that they can achieve the DoD’s final objective. The Phase II deliverables provide foundational understanding or capability basis for Phase III. Phase II should include viable proof of concept (POC) matured to MVP 1 for each of the 15 services demonstrably, independently, and cooperatively as a mesh component.

 

PHASE III DUAL USE APPLICATIONS: In Phase III, participants will create the balance of the required services and deliver a full production capability that meets all requirements for infrastructure compliance while delivering the end-using community the advantages outlined in VAULTIS. The fully operating data mesh that achieves full data interoperability with minimal to no human intervention for specific data exchange. The resulting mesh will support interoperability for applications both in the battlefield (e.g., Coalition Joint All Domain Command and Control (CJADC2), military exercises) and the boardroom (e.g., dashboarding, regular reporting).

 

REFERENCES:

https://www.oreilly.com/library/view/data-mesh/9781492092384/ 
https://dodcio.defense.gov/Portals/0/Documents/Library/DoD%20Enterprise%20DevSecOps-Pathway%20to%20a%20Reference%20Design_DoD-CIO_20211018.pdf
https://aws.amazon.com/compare/the-difference-between-monolithic-and-microservices-architecture/ 
Data Mesh Reference Architecture (DMRA) paper: https://media.defense.gov/2024/Mar/15/2003414274/-1/-1/1/dmra_paper.PDF 
Unique Identifier (UID) Whitepaper: https://media.defense.gov/2024/Mar/15/2003414275/-1/-1/1/unique_identifier_wp.PDF 
Canonical Controlled Vocabulary (CCV) Whitepaper: https://media.defense.gov/2024/Mar/15/2003414273/-1/-1/1/canonical_controlled_VOC_wp.PDF 
eXtensible Bill of Material ([x]BOM) paper: https://media.defense.gov/2024/Mar/15/2003414075/-1/-1/1/xBOM_paper.PDF 

 

KEYWORDS:  Microservices; Data Mesh; Data Interoperability; Data Sharing Capability; VAULTIS

Similar Opportunities

DOD SBIR 24.4 Annual
Department of Defense
The Department of Defense (DOD) is seeking proposals for the topic "xTechScalable AI" as part of the SBIR program. The Army branch is specifically interested in novel and disruptive concepts and technology solutions that can address the vulnerabilities of current machine learning pipelines and models. The goal is to develop comprehensive security models capable of defending against universal AI threat vectors. The Army is prioritizing proposals that focus on systematic testing and evaluation methods, trusted and secure validation and verification strategies, continuous monitoring capabilities, improved transparency and assurance of code and data, and improved telemetry capabilities. The Army will use the xTechScalable AI prize competition to identify small businesses that meet the criteria for award, and only winners of the competition will be eligible to submit a proposal under this topic. The project will have three phases: Phase I involves submitting a Direct to Phase II (DP2) proposal, Phase II involves producing prototype solutions for evaluation by soldiers, and Phase III involves completing the maturation of the technology and producing prototypes for further development and commercialization. The deadline for proposal submission is March 31, 2025. For more information and to submit a proposal, visit the solicitation agency's website at [solicitation_agency_url].
DOD SBIR 24.4 Annual
Department of Defense
The Department of Defense (DOD) is seeking proposals for the xTech Search 8 SBIR Finalist Open Topic Competition. The objective of this solicitation is to find novel and disruptive concepts and technology solutions with dual-use capabilities that can address the Army's current needs and apply to current Army concepts. The technology areas of interest include Electronics, Human Systems, and Sensors. The Army is particularly interested in technologies related to Artificial Intelligence/Machine Learning, Advanced Materials, Advanced Manufacturing, Autonomy, Cyber, Human Performance, Immersive, Network Technologies, Position, Navigation and Timing (PNT), Power, Software Modernization, and Sensors. The Phase I of the project requires a feasibility study and concept plans, while Phase II involves producing prototype solutions that can be easily operated by soldiers. Phase III focuses on the maturation of the technology and its transition to TRL 6/7, as well as further development and commercialization. The solicitation is open until March 31, 2025. For more information, visit the [solicitation agency website](https://www.defensesbirsttr.mil/SBIR-STTR/Opportunities/).
DOD SBIR 24.4 Annual
Department of Defense
The Department of Defense (DOD) is seeking proposals for the Proliferated Warfighter Space Architecture (PWSA) Advanced Capability Development Open Topic. The Space Development Agency (SDA) is looking for novel architecture concepts, systems, technologies, and capabilities that enable leap-ahead improvements for future tranches of currently planned PWSA capability layers or address emerging warfighter needs. The research areas include trusted AI and autonomy, advanced computing and software, integrated sensing and cyber, hypersonics, microelectronics, integrated network systems-of-systems, space technology, renewable energy generation and storage, advanced infrastructure, and advanced manufacturing. The solicitation is open for Phase II proposals only, and proposers must demonstrate the scientific and technical merit and feasibility of their projects. The research will support the development of the PWSA, a resilient military sensing and data transport capability in Low Earth Orbit (LEO). The solicitation provides specific themes and focus areas for potential deliverables, such as integrating commercial sensing to the transport layer, developing optical inter-satellite link (OISL) technology, advancing cyber and networking capabilities, and increasing power for spacecraft bus. The Phase III applications of the research include improving low Earth orbit communication systems and space-based processing for effective distribution of sensor data. The proposal submission deadline is March 31, 2025. For more information and to access the proposal template, visit the DOD SBIR website.
DOD SBIR 24.4 Annual
Department of Defense
The Department of Defense (DOD) is seeking proposals for an open topic on persistent experimentation. The U.S. Army, under the Office of the Under Secretary of Defense for Research and Engineering (OUSD (R&E)), is specifically interested in novel, disruptive concepts and technology solutions with dual-use capabilities. The goal is to address the Army's current needs and future concepts by experimenting, refining, and advancing technology solutions in operationally relevant environments. The Army encourages participation in its persistent experimentation events to mature and test the technology. Proposals should align with specific experimentation events and demonstrate potential for commercial applications. The phase I of the project will only accept Direct to Phase II (DP2) proposals, which should provide documentation of scientific and technical merit, feasibility, and potential commercial applications. DP2 awardees are expected to produce a prototype solution ready for field demonstration and deliver a technology transition and commercialization plan. Phase III focuses on the maturation of the technology to TRL 6/7 and further development and commercialization. The keywords for this solicitation include Human-Machine Integration (HMI), autonomy, artificial intelligence (AI), logistics, ground systems, air systems, robotics, sensors, and electromagnetic warfare (EW). The solicitation is open until March 31, 2025. For more information, visit the [solicitation link](https://www.sbir.gov/node/2603059).