Finding Guaranteed RL Control for Satellite Systems
ID: SF24B-T007Type: Phase I
Overview

Topic

Finding Guaranteed RL Control for Satellite Systems

Agency

Department of DefenseN/A

Program

Type: STTRPhase: Phase IYear: 2024

Topic Link

https://www.sbir.gov/node/2605997

Additional Information

https://www.defensesbirsttr.mil/SBIR-STTR/Opportunities/
Timeline
  1. 1
    Release Apr 17, 2024 12:00 AM
  2. 2
    Open May 15, 2024 12:00 AM
  3. 3
    Next Submission Due Jun 12, 2024 12:00 AM
  4. 4
    Close Jun 12, 2024 12:00 AM
Description

The Department of Defense (DOD) is seeking proposals for the Small Business Innovation Research (SBIR) Phase I program. The specific topic of the solicitation is "Finding Guaranteed RL Control for Satellite Systems" and is under the branch of the Air Force. The objective of this topic is to discover and design machine learning or reinforcement learning architectures for use within a satellite control context that can provide guaranteed closed-loop behavior in a nonlinear controls context.

Machine learning and reinforcement learning techniques have shown their usefulness in creating control schemes for vehicles, but their lack of guaranteed safety is a drawback. This topic aims to explore whether certain control structures, activation functions, and training results for machine/reinforcement learning controllers exist that can provide formal guarantees for a satellite's behavior.

In Phase I, awardees will conduct a comprehensive review of current research in machine/reinforcement learning techniques and compile the requirements for a satellite controller. They will also devise a test plan to demonstrate the use of control systems using machine/reinforcement learning techniques.

In Phase II, awardees will design the theorems and control structures to illustrate the type of machine learning-based models and training approaches that can provide provable stability guarantees. These control systems will be implemented on multiple vehicles, including a representative satellite, to showcase their adherence to theoretical guarantees.

In Phase III, awardees will integrate the proposed control algorithms with satellite software in cooperation with satellite software manufacturers and military satellite system developers. They will demonstrate the performance of the control system on board a satellite and evaluate transition opportunities for utilization in approved Government civilian applications.

The project duration and funding specifics are not provided in the document. For more information and to submit proposals, interested parties can visit the SBIR topic link: SBIR Topic Link.

Files
No associated files provided.
Similar Opportunities
DOD SBIR 24.4 Annual - Proliferated Warfighter Space Architecture (PWSA) Advanced Capability Development Open Topic
Active
Department of Defense
The Department of Defense (DOD) is seeking proposals for the Proliferated Warfighter Space Architecture (PWSA) Advanced Capability Development Open Topic. The Space Development Agency (SDA) is looking for novel architecture concepts, systems, technologies, and capabilities that enable leap-ahead improvements for future tranches of currently planned PWSA capability layers or address emerging warfighter needs. The research areas include trusted AI and autonomy, advanced computing and software, integrated sensing and cyber, hypersonics, microelectronics, integrated network systems-of-systems, space technology, renewable energy generation and storage, advanced infrastructure, and advanced manufacturing. The solicitation is open for Phase II proposals only, and proposers must demonstrate the scientific and technical merit and feasibility of their projects. The research will support the development of the PWSA, a resilient military sensing and data transport capability in Low Earth Orbit (LEO). The solicitation provides specific themes and focus areas for potential deliverables, such as integrating commercial sensing to the transport layer, developing optical inter-satellite link (OISL) technology, advancing cyber and networking capabilities, and increasing power for spacecraft bus. The Phase III applications of the research include improving low Earth orbit communication systems and space-based processing for effective distribution of sensor data. The proposal submission deadline is March 31, 2025. For more information and to access the proposal template, visit the DOD SBIR website.
DOD SBIR 24.4 Annual - Artificial Intelligence/ Machine Learning (AI/ML) Focused Open Topic
Active
Department of Defense
The Department of Defense (DOD) is seeking proposals for an Artificial Intelligence/Machine Learning (AI/ML) Focused Open Topic. The purpose of this open topic is to bring potentially valuable small business innovations to the Army and expand the relevance of the Army SBIR program to firms who do not normally compete for SBIR awards. The topic accepts both Phase I and Direct to Phase II submissions. Phase I proposals are accepted for a cost up to $250,000 for a 6-month period of performance, while Direct to Phase II proposals are accepted for a cost up to $2,000,000 for a 24-month period of performance. The research areas of focus include synthetic data generation, data validation and verification, AI risk mitigation, large language models, retrieval augmented generation, and collaborative AI technologies. Phase I submissions require a 5-page technical volume, an 8-slide commercialization plan, and a statement of work outlining deliverables. Phase II submissions require a 10-page technical volume, a 5-page feasibility documentation, an 8-slide commercialization plan, and a statement of work. During Phase II, firms must produce prototype solutions that are practical and feasible to operate in edge and austere environments. Phase III focuses on the maturation of the technology to TRL 6/7 and the production of prototypes to support further development and commercialization. The Army will evaluate each product in a realistic field environment and provide solutions to stakeholders for further evaluation. The submission deadline is March 31, 2025. For more information, visit the [solicitation link](https://www.sbir.gov/node/2651299).
DOD SBIR 24.4 Annual - Novel Positioning, Navigation, and Timing (PNT) Signal Classification Techniques
Active
Department of Defense
The Department of Defense (DOD) is seeking proposals for a novel positioning, navigation, and timing (PNT) signal classification techniques. The purpose of this solicitation is to develop the capability to classify signals in real-time that impact navigation systems. The goal is to better understand the type(s) of signal(s) experienced in relevant environments to apply mitigation techniques before harm can be done. The research will focus on improving performance, cost savings, and expanding the application of the technology sensor solution set to include additional Army aviation assets. The project will involve developing adaptive learning techniques using AI/Machine Learning (ML) algorithms to perform PNT signal classification. The proposed solution aims to build upon the progress made in AI/ML signal classification and move towards real-time signal classification. The project will have a Phase I and Phase II, with Phase II requiring the development of two antenna systems capable of detecting and classifying interference signals in real-time. The project also aims to make the antenna design portable to support upgrading antenna systems and providing support to other antenna systems in the same environment. The anticipated duration of the project is until March 31, 2025. For more information and to submit proposals, visit the DOD SBIR website.
DOD SBIR 24.4 Annual - Novel Positioning, Navigation, and Timing (PNT) Signal Classification Techniques
Active
Department of Defense
The Department of Defense (DOD) is seeking proposals for a novel positioning, navigation, and timing (PNT) signal classification techniques. The purpose of this solicitation is to develop the capability to classify signals in real-time that impact navigation systems. The goal is to better understand the type of signals experienced in relevant environments to apply appropriate mitigation techniques. The current navigation systems depend on radio frequency (RF) signals that can be influenced by various interference sources. The challenge is to quickly understand the signal characteristics to react and mitigate negative impacts. The proposed solution aims to build upon AI/Machine Learning (ML) algorithm technologies to perform PNT signal classification in real-time. The project will involve developing two antenna systems capable of detecting and classifying interference signals, collecting relevant signals for training the AI/ML solution, and demonstrating the ability to detect and identify signal types in a relevant environment. The project will have a Phase I and Phase II, with Phase II focusing on the development and demonstration of the antenna systems. The anticipated duration of the project is until March 31, 2025. For more information and to submit proposals, visit the DOD SBIR website.
DOD SBIR 24.4 Annual - xTechScalable AI 2
Active
Department of Defense
The Department of Defense (DOD) is seeking proposals for the xTechScalable AI 2 topic. This solicitation focuses on two main areas: 1. Scalable Tools for Automated AI Risk Management and Algorithmic Analysis: The Army is looking for automated tools to evaluate and mitigate risk against an AI Risk Management Framework (RMF) to ensure trusted and validated AI models. The tools should be able to evaluate multiple dimensions of AI risk, classify and quantify AI risk, and propose mitigation options. The Army is particularly interested in tools that can accept risk-related inputs from multiple data sources and modalities and have standardized evaluation methods and mitigation strategies. 2. Scalable Techniques for Robust Testing and Evaluation (T&E) of AI Operations Pipelines: The Army needs a robust and automated T&E approach for AI Operations Pipelines. This includes evaluating data integrity, data labeling methodologies, and model training. The Army is interested in tools that can identify and evaluate data integrity, assess the quality and accuracy of labels applied to training datasets, and evaluate model performance in terms of resource consumption, robustness, scalability, and privacy and security. The Phase I proposals can receive up to $250,000 for a 6-month period, while Direct to Phase II proposals can receive up to $2,000,000 for an 18-month period. Phase II involves producing prototype solutions that will be evaluated by soldiers, and Phase III focuses on maturing the technology and producing prototypes for further development and commercialization. The xTechScalable AI 2 prize competition will be used to identify small businesses eligible to submit proposals under this topic. The full solicitation can be found at [this link](https://www.defensesbirsttr.mil/SBIR-STTR/Opportunities/).