DEVELOP EVALUATIONS AND BENCHMARKS FOR ASSESSING CYBER CAPABILITIES OF AI MODELS
ID: CAW-AISI-0002Type: Sources Sought
Overview

Buyer

COMMERCE, DEPARTMENT OFNATIONAL INSTITUTE OF STANDARDS AND TECHNOLOGYDEPT OF COMMERCE NISTGAITHERSBURG, MD, 20899, USA

NAICS

Other Scientific and Technical Consulting Services (541690)

PSC

SUPPORT- PROFESSIONAL: OTHER (R499)

Original Source

https://sam.gov/opp/b94348fbd44b4e02b293feb244b10ee6/view
Timeline
    Description

    The Department of Commerce, specifically the National Institute of Standards and Technology (NIST), is conducting market research to identify potential sources for a contract aimed at developing evaluations and benchmarks for assessing the cyber capabilities of artificial intelligence (AI) models. This initiative is part of a broader effort to establish guidelines for the safe and secure use of AI, as mandated by Executive Order 14110, which emphasizes the need to evaluate AI models that could pose risks to national security and public safety through offensive cyber operations. Interested parties are invited to submit their capabilities related to specific tasks, including the development of benchmarks for automated evaluations and the creation of synthetic environments for testing AI models, with responses due by January 31, 2025, at 3:30 PM Eastern Time. For further inquiries, potential respondents can contact Carol A. Wood at carol.wood@nist.gov or by phone at 301-975-8172.

    Point(s) of Contact
    Carol A. Wood
    (301) 975-8172
    (301) 975-6273
    carol.wood@nist.gov
    Files
    No associated files provided.
    Lifecycle
    Title
    Type
    DEVELOP EVALUATIONS AND BENCHMARKS FOR ASSESSING CYBER CAPABILITIES OF AI MODELS
    Currently viewing
    Sources Sought
    Similar Opportunities
    Sources Sought Notice for Computer-Based Testing for the Cryptographic Validation Program
    Commerce, Department Of
    The Department of Commerce, specifically the National Institute of Standards and Technology (NIST), is conducting a Sources Sought Notice to identify potential sources for computer-based testing services related to its Cryptographic Validation Program (CVP). The primary objective is to find a contractor capable of publishing, administering, and maintaining competency exams for testers at NVLAP accredited laboratories, ensuring secure testing locations and ID verification capabilities. This initiative is crucial for validating cryptographic modules and algorithms, which are essential for maintaining national security standards. Interested parties should submit their responses, including company details and capabilities, to the primary contact, Lauren P. Roller, at lauren.roller@nist.gov by January 22, 2025, as this notice is for market research purposes and does not guarantee a contract award.
    Operation and Maintenance of BIRDS NEST IE4B API
    Commerce, Department Of
    The Department of Commerce, through the National Institute of Standards and Technology (NIST), is seeking to negotiate a sole source contract for the operation and maintenance of the BIRDS NEST - Impact Estimator for Buildings (IE4B) API with the Athena Sustainable Materials Institute (ASMI). This procurement aims to ensure the continuous functionality and availability of a web-based tool that evaluates the sustainability performance of building designs, with a contract duration of 12 months starting around March 31, 2025, and the possibility of two additional one-year extensions. The operation of this API is critical for advancing sustainability in high-performance buildings, emphasizing the importance of reliable assessment tools in federal initiatives focused on energy efficiency and environmental responsibility. Interested parties who believe they can fulfill the requirements are encouraged to respond in writing by January 17, 2025, and must register in the System for Award Management (SAM) to participate; for further inquiries, contact Jennifer Lohmeier at jennifer.lohmeier@nist.gov or call 301-975-6289.
    STANDARDS DEVELOPMENT LICENSED PLATFORM SUBSCRIPTION
    Commerce, Department Of
    The National Institute of Standards and Technology (NIST) is conducting a Sources Sought Notice to identify qualified sources for a customized online standards development platform licensed subscription. The platform is required to facilitate the management of standards document development processes, including features for committee participation, discussion tracking, voting mechanisms, document commenting, editing, and archiving. This initiative is crucial for enhancing collaboration among various stakeholders involved in standards development, ensuring efficient and effective document management. Interested vendors must submit detailed capability statements and relevant information to Randy E. Schroyer at randy.schroyer@nist.gov by the specified response date, with no formal solicitation documents currently available.
    The CISA Future Forward Series: Risk Analysis in the Age of Artificial Intelligence (AI)
    Homeland Security, Department Of
    Special Notice: HOMELAND SECURITY, DEPARTMENT OF is hosting the CISA Future Forward Series: Risk Analysis in the Age of Artificial Intelligence (AI). This series aims to engage with industry and explore innovative capabilities. The upcoming event on January 29, 2024, will feature a panel from the National Risk Management Center (NRMC) discussing topics such as Information and Communication Technology (ICT) Supply Chain Risk Management, artificial intelligence within NRMC, and National Infrastructure Simulation Analysis Center (NISAC). The event will be virtual and held via Microsoft Teams Webinar. Please note that this notice is not a request for proposals or quotes, and CISA will not assume liability for any costs incurred by attendees. For more information, contact cisaindustryengagement@cisa.dhs.gov.
    FOUNDATIONS OF TRUSTED SYSTEMS
    Dept Of Defense
    The Department of the Air Force is announcing a Broad Agency Announcement (BAA) titled "Foundations of Trusted Systems," aimed at fostering innovative research in secure and resilient hardware and software for Command, Control, Communications, Computers, and Intelligence (C4I) and Cyber technologies. The initiative seeks to establish trusted foundations for information processing systems, with a focus on areas such as trusted computational systems, assured software, and the integration of Artificial Intelligence (AI). This BAA is critical for enhancing national security and is open until December 4, 2028, with an estimated funding amount of approximately $99.9 million, where individual project awards typically range from $100,000 to $5 million over a 36-month period. Interested parties should submit white papers and direct inquiries to Esteban Garcia at esteban.garcia.1@us.af.mil or Amber Buckley at amber.buckley@us.af.mil for contractual questions.
    Strategic Planning, Operational Test & Evaluation, and Architecture Evaluation
    Homeland Security, Department Of
    The Department of Homeland Security's Cybersecurity and Infrastructure Security Agency (CISA) is seeking qualified firms to support Strategic Planning, Operational Test & Evaluation, and Architecture Evaluation within its Cybersecurity Division. The primary objectives include enhancing national cyber defense and resilience through effective integration of systems, conducting research and development, and providing engineering expertise to support CISA's cybersecurity initiatives. This opportunity is critical for advancing the nation’s cybersecurity posture and involves a five-year contract that emphasizes compliance with security regulations and the necessity for contractor personnel to hold appropriate security clearances. Interested parties must submit their capabilities statements electronically by January 21, 2025, and can participate in an optional Industry Day to learn more and provide input. For further inquiries, contact Hannah Moussa at hannah.moussa@cisa.dhs.gov or call 202-568-4157.
    The CISA Future Forward Series: Discussion on CISA's AI Roadmap and AI Security Initiative
    Homeland Security, Department Of
    Special Notice: HOMELAND SECURITY, DEPARTMENT OF - CISA CONTRACTING ACTIVITY The Cybersecurity and Infrastructure Security Agency (CISA) is hosting an industry engagement event to discuss CISA's Artificial Intelligence (AI) Roadmap and Security Initiative. The event will focus on understanding the benefits and risks of AI and ensuring the preparedness of critical infrastructure owners and operators. CISA has developed an AI Roadmap aligned with the national AI strategy to enhance cybersecurity capabilities, protect AI systems from cyber-based threats, and deter malicious use of AI capabilities. The event will be virtual and held on Tuesday, March 26, 2024, from 1:30 to 2:30 pm ET. Please note that this event does not involve specific procurement actions or details. For more information, contact CISAIndustryEngagement@cisa.dhs.gov.
    Exhibit Space at 2025 IEEE International Conference on Robotics & Automation
    Commerce, Department Of
    The National Institute of Standards and Technology (NIST) intends to negotiate a sole source contract for exhibit space at the 2025 IEEE International Conference on Robotics & Automation, scheduled to take place in Atlanta, Georgia from May 19 to 23, 2025. NIST requires a 400 square foot island exhibit booth, which will include access to a post-conference delegate list, exhibitor personnel passes, WiFi in the exhibit hall, and listing in the conference materials. This procurement is essential for NIST to promote its mission of advancing measurement science and technology, as the conference only permits exhibit rentals through its organizer, IEEE, making them the sole source for this requirement. Interested parties may submit their capabilities in writing to Lauren P. Roller at lauren.roller@nist.gov by October 15, 2024, at 10:00 AM Eastern Time.
    NSF Regional Innovations Engines Program Evaluation
    National Science Foundation
    The National Science Foundation (NSF) is soliciting proposals for an external evaluation team to assess the impact of its Regional Innovation Engines Program. The primary objective of this procurement is to conduct a comprehensive evaluation that will inform programmatic decisions, enhance understanding of regional innovation ecosystems, and determine the overall success of the program. This evaluation is crucial as it supports NSF's mission to foster multidisciplinary research and address regional challenges, with significant funding allocated to create sustainable innovation ecosystems. Interested contractors should submit their quotes electronically, adhering to specified guidelines and deadlines, with the anticipated contract start date set for April 16, 2025. For further inquiries, potential bidders can contact Alyssa Todaro at atodaro@nsf.gov.
    ARTIFICIAL INTELLIGENCE AND NEXT GENERATION DISTRIBUTED COMMAND AND CONTROL
    Dept Of Defense
    The Department of the Air Force is seeking proposals for research and development under the Broad Agency Announcement (BAA) FA8750-23-S-7006, focused on advancing Artificial Intelligence (AI) and Next Generation Distributed Command and Control (C2) capabilities. The initiative aims to enhance decision-making and operational agility in military operations through innovative AI applications, addressing challenges such as real-time adaptation of AI models in dynamic battlefield conditions. With an estimated funding of approximately $99 million available until August 30, 2028, interested parties are encouraged to submit white papers by specified deadlines, with awards typically ranging from $200,000 to $20 million for successful proposals. For further inquiries, contact Mr. Gennady Staskevich at gennady.staskevich@us.af.mil or Ms. Amber Buckley at amber.buckley@us.af.mil.