The Department of Defense (DOD) is seeking proposals for the development of an algorithm to build accurate georegistered orthomosaic images from full motion video (FMV) by leveraging a combination of the video stream and Key-Length-Value (KLV) metadata stream. The objective is to improve the accuracy of orthomosaic images generated from FMV, which is a critical component of intelligence, surveillance, and reconnaissance (ISR) operations. The algorithm should be able to handle typical FMV collection use cases, including changing zoom levels, imaging modalities, rapid slewing, on-screen display obscuring pixels, and occasional data corruption. The algorithm should effectively fuse information from the KLV metadata, on-screen metadata, and video sources to construct the most accurate georegistered orthomosaic. Optical Character Recognition (OCR) algorithms are recommended to extract metadata values directly from the images when KLV metadata is absent but on-screen metadata is available. The resulting mosaic should feature distinct output layers for each modality within the input FMV. The algorithm should also address the challenges of orthorectification in nonplanar terrain by deriving or updating a higher resolution Digital Elevation Model (DEM) directly from the video stream. The proposal should demonstrate existing capabilities for working with KLV metadata, video mosaic construction, OCR applied to imagery, and orthorectification. The project will be implemented in two phases, with Phase I focusing on a feasibility study and Phase II involving the implementation of a prototype system. The technology developed in this project will have applications in the government and commercial sectors, including national security, targeting, intelligence, urban planning, environmental monitoring, and search and rescue. The proposal submission deadline is June 12, 2024. For more information, visit the solicitation link.