DOD SBIR 24.1 BAA

Active
No
Status
Closed
Release Date
November 29th, 2023
Open Date
January 3rd, 2024
Due Date(s)
February 21st, 2024
Close Date
February 21st, 2024
Topic No.
N241-067

Topic

Common Software Platform for Learning-based Robots

Agency

Department of DefenseN/A

Program

Type: SBIRPhase: BOTHYear: 2024

Summary

The Department of Defense (DOD) is seeking proposals for a common software platform for learning-based robots. The objective is to develop an open-source platform that can be widely used to incorporate artificial intelligence (AI) skills, such as perception and manipulation, for robots that learn. The platform should facilitate the transfer of research in robotics into application products in a short time. The absence of a common software platform has created a gap between robot learning research and deployment. The proposed platform would build a mid-level AI layer with state-of-the-art perception, locomotion, and manipulation skills. The goal is to abstract low-level robotic skills so that developers do not need robotics expertise and can focus on creative applications. The project will have a Phase I feasibility study, Phase II prototype development, and Phase III testing and partnering for commercial and DoD applications. The technology could be used in sectors such as medical robotics, warehousing, and delivery, enabling versatile robots capable of performing maintenance and service tasks.

Description

OUSD (R&E) CRITICAL TECHNOLOGY AREA(S): Advanced Computing and Software; Trusted AI and Autonomy

 

OBJECTIVE: Develop an open-source common software platform that is independent of robotics hardware and can be widely used to incorporate artificial intelligence (AI) skills, such as perception and manipulation, for robots that learn to facilitate transfer of research in robotics into application products in a short time.

 

DESCRIPTION: In recent years, significant advances in AI have been made from image recognition to generation, from large-scale language models to dialogues, and from locomotion to diverse manipulation. A key feature of this advancement has been the rapid transfer of technology—transition time from fundamental research to deployment is unusually short, typically taking only a couple of months. Examples include Jasper AI (for fast content generation), Stability AI (image generation), Photoshop, Hugging Face (natural language understanding), and others. Interestingly, while advances in computer vision (CV) and natural language processing (NLP) have shown this rapid deployment, AI research in robotics has seen little transition to application products and across a very narrow segment of table-top grasping. Most other robotic products, either for defense or consumer, service or industry domain, still exploit and rely on classical control-theoretic and optimization-based approaches and have difficulty with machine learning (ML) and generalization. In learning-based control, assessing safety and performance limits are still challenging. A common software platform will enable expedited research in these issues.

The absence of a common software platform has created an increasing gap between robot learning research and deployment. One of the key reasons is the lack of infrastructure and software platforms for reproducibility and fast transfer of robot learning technology. Robotics hardware vary across tasks in their capabilities and do not enjoy independence in hardware variability, unlike CV or NLP. Hence, as a result, it has become a standard practice in robotics companies to proceed full stack from hardware to software. This not only lengthens the development cycle, but also results in most robotics companies needing to develop their own AI infrastructure and expertise, which makes it difficult to keep up with cutting-edge advances in research.

 

The above issue has created a unique opportunity. ONR is seeking development of a common software platform for the rapid technology transfer of data-driven robotic algorithms. Such a software platform would go beyond current platforms such as the Robot Operating System (ROS) framework, which focuses on resource scheduling and communication but does not focus on AI capabilities, or Mission Oriented Operating Suite Interval Programming (MOOS-IvP) with similar capabilities. The proposed software platform would build a mid-level AI layer with state-of-the-art perception, locomotion, and manipulation skills. The goal is to abstract low-level robotic skills so that the developers do not need robotics expertise and can focus on the creative applications of the robots. Ideally, this platform could be shared by different robotics companies allowing them to focus better on their application vertical with faster iteration cycles while having a way to easily incorporate the latest algorithmic developments in robot learning. Selected references related to certain skills such as manipulation and locomotion are included below.

 

PHASE I: Design and demonstrate the feasibility of a shared platform for efficient transfer and implementations of data-driven robotic algorithms. Validate the platform's ability to meet key parameters on a custom reference hardware which is to be scaled to multiple platforms in Phase II. The key parameters to be met in Phase I: 90% success rate on simple terrain locomotion, 80% on complex rough terrain locomotion, 85% success rate for point to point navigation for both legged and wheeled robots, 70% grasping rate for at least a selection of 50 everyday objects. Produce detailed design specifications and capabilities descriptions for Phase II prototype development.

 

PHASE II: Develop and deliver a deployable prototype of the platform, including perception and action capabilities such as locomotion, navigation, and targeted class-conditioned manipulation. Validate the prototype's ability to run on multiple hardware configurations such as Franka robotic arm, UR5 arm, X-arm as well as legged robot with arms and wheeled robot with arms in home and warehouse settings. The key parameters to be met at this stage are: work on multiple hardware including a total of at least 5 different commercial hardware platforms across tasks, more than 98% success rate on simple terrain locomotion, more than 95% success rate on rough terrain locomotion, 95% accuracy of point to point navigation, 75% grasping rate for at least a selection of 100 everyday objects. In parallel, produce a detailed Phase III plan for partnering for commercial as well as DoD applications.

 

PHASE III DUAL USE APPLICATIONS: Perform additional experiments in a variety of situations and environments. Begin testing with external partners.

 

This technology could be used in commercial sectors such as medical robotics, warehousing, and delivery, for developing versatile robots capable of performing maintenance, service robots at home or work places, and other tasks.

 

REFERENCES:

https://www.ros.org
https://oceanai.mit.edu/moos-ivp/pmwiki/pmwiki.php
A. Agarwal, et al. Legged Locomotion in Challenging Terrains using Egocentric Vision. CoRL 2022.
Z. Cao, et al. Reconstructing hand-object interactions in the wild. ICCV 2021.
T. Chen, et al. Visual dexterity: In-hand dexterous manipulation from depth. ICML Workshop 2023.
S. Pandian, et al. Dexterous Imitation Made Easy: A Learning-Based Framework for Efficient Dexterous Manipulation. ICRA 2023.
L. Pinto and A. Gupta. Supersizing Self-supervision: Learning to Grasp from 50K Tries and 700 Robot Hours. ICRA 2016. 
A. Simeonov, et al. Neural descriptor fields: Se (3)-equivariant object representations for manipulation. ICRA 2022.

 

KEYWORDS: Software platform, robot manipulation, robot perception, robot Artificial Intelligence skills, learning robots

 

Similar Opportunities

DOD SBIR 24.4 Annual
Department of Defense
The Department of Defense (DOD) is seeking proposals for the xTech Search 8 SBIR Finalist Open Topic Competition. The objective of this solicitation is to find novel and disruptive concepts and technology solutions with dual-use capabilities that can address the Army's current needs and apply to current Army concepts. The technology areas of interest include Electronics, Human Systems, and Sensors. The Army is particularly interested in technologies related to Artificial Intelligence/Machine Learning, Advanced Materials, Advanced Manufacturing, Autonomy, Cyber, Human Performance, Immersive, Network Technologies, Position, Navigation and Timing (PNT), Power, Software Modernization, and Sensors. The Phase I of the project requires a feasibility study and concept plans, while Phase II involves producing prototype solutions that can be easily operated by soldiers. Phase III focuses on the maturation of the technology and its transition to TRL 6/7, as well as further development and commercialization. The solicitation is open until March 31, 2025. For more information, visit the [solicitation agency website](https://www.defensesbirsttr.mil/SBIR-STTR/Opportunities/).
DOD SBIR 24.4 Annual
Department of Defense
The Department of Defense (DOD) is seeking proposals for the topic "xTechScalable AI" as part of the SBIR program. The Army branch is specifically interested in novel and disruptive concepts and technology solutions that can address the vulnerabilities of current machine learning pipelines and models. The goal is to develop comprehensive security models capable of defending against universal AI threat vectors. The Army is prioritizing proposals that focus on systematic testing and evaluation methods, trusted and secure validation and verification strategies, continuous monitoring capabilities, improved transparency and assurance of code and data, and improved telemetry capabilities. The Army will use the xTechScalable AI prize competition to identify small businesses that meet the criteria for award, and only winners of the competition will be eligible to submit a proposal under this topic. The project will have three phases: Phase I involves submitting a Direct to Phase II (DP2) proposal, Phase II involves producing prototype solutions for evaluation by soldiers, and Phase III involves completing the maturation of the technology and producing prototypes for further development and commercialization. The deadline for proposal submission is March 31, 2025. For more information and to submit a proposal, visit the solicitation agency's website at [solicitation_agency_url].