Sources Sought: Evaluation-Driven Artificial Intelligence (AI) Development and Delivery Support for Mission-Critical Data Workflows

Summary (Newest Update)

Background The Office of Naval Intelligence (ONI) is seeking evaluation-driven, mission-aligned artificial intelligence (AI) applications and systems to enhance analyst workflows in areas critical to national security. This Sources Sought announcement aims to identify potential sources capable of providing support and expertise for this initiative, which builds upon previous work conducted under SBIR Phase III FA259520D0001. Work Details The Contractor will deliver a phased AI program focusing on the following objectives: 1. Production and Delivery: - Further model development including data collection, model training, and preliminary validation to ensure alignment with ONI requirements. - Establish a model evaluation score based on benchmarks provided by ONI. - Develop cold-start evaluators using large-language models and heuristic rules for initial performance assessment. - Extend the model to handle new data types and operational conditions. - Provide finalized deployment packages with documentation and onboarding guidance for seamless integration into ONI's environment, including a labeling rubric. - Ensure outputs are production-ready by coordinating with stakeholders for long-term sustainment and transition into operational use, along with a detailed transition roadmap for maintenance and support post-deployment. - Design and build mission-aligned data ingestion pipelines, vet data sources, perform validation checks, and comply with data security regulations. 2. Support: - Provide integration and testing support for AI systems on government-designated platforms. - Offer training support for government personnel in operating and maintaining AI systems. - Supply technical data support including necessary drawings, documents, and specifications for AI systems. - Ensure repair and maintenance support to keep all AI systems operational.