PARAGRAPH TITLE

52.215-16 Contract Award -- Alternate II OCT 1995
52.247-47 Evaluation - Fob Origin APR 1994
52.217-5 Evaluation Of Options JUL 1990

SECTION M-2. EVALUATION CRITERIA

1.0 GENERAL INFORMATION

This section describes the General Considerations, order of importance, and Evaluation Criteria that the Government will consider in evaluating the Offeror's capabilities and proposals submitted in response to this solicitation. The General Considerations are intended to confirm the Offeror's capabilities and response to the business arrangements contained in the solicitation. The Evaluation Criteria are intended to show the scope of the evaluation to be performed on proposals submitted in response to the Request for Proposal (RFP). Section L-2 of the RFP, Proposal Preparation Instructions (PPI), defines the proposal elements and data required from each Offeror for this evaluation.

a. Basis for Contract Award. This will be a competitive source selection conducted in accordance with FAR 15.6, AFFARS Appendix AA and applicable supplements. Adequate price competition is anticipated for this acquisition. The Government will award one contract for the Airborne Laser PDRR Program. The Government will determine which responsible Offeror with the necessary technical, management, and facility capabilities necessary to fulfill the requirements of the contract at acceptable risk can accomplish the objectives and requirements set forth in this RFP. In making this determination, the Source Selection Authority will conduct an integrated assessment to determine which proposal provides the best value to the Government using the criteria set forth in Section M. Cost is a significant factor, and the Government will select the Offeror that provides the "Best Value" to the Government. The Government reserves the right to make no award at all depending upon the quality of the proposals and the availability of contract funds and reserves the right to award a contract to other than the low price offer after consideration of all factors.

An evaluation will be made of each Offeror's proposal volumes and the data submitted under the Concept Design contracts and these results will be used in determining the source to be selected. The source selection will be based upon an integrated assessment of the areas in Section M, Evaluation Criteria and General Considerations, with General Considerations the least important. The order of importance of Areas and factors is discussed below.

The PDRR contract cost and most probable life cycle cost (MPLCC) will contribute substantially to the source selection decision. Offerors have been directed to perform technical-cost tradeoffs to achieve a balance which reflects and permits the cost effective pursuit of high quality technical performance and supportability. The basis of the proposed cost must be consistent with all other elements of the proposal. An Offeror who submits an unrealistically low PDRR or MPLCC cost proposal may be viewed as lacking understanding of the Government's desired objective.

b. Areas and Factors. The evaluation will be broken down into the following areas and factors.

AREA A Technical Design
Factor 1 Integrated ABL
Factor 2 Beam Control/Fire Control
Factor 3 Laser
Factor 4 Battle Management, Command, Control, Computers,
Communications, and Intelligence (BMC4I)
Factor 5 Aircraft
Factor 6 Ground Facility

AREA B System Management Approach
Factor 1 System Management
Factor 2 System Test and Evaluation

AREA C. Cost and Schedule
PDRR Contract Cost
Most Probable Schedule
Most Probable Life Cycle Cost

Relative Importance. Areas A, B, and C are in descending order of importance with Area A being most important and Area C least important. In all three Areas, the factors are listed in descending order of importance. All subfactors in any Area are of equal importance.

c. Area Evaluations. The Technical Design and Systems Management Approach areas will be rated in three manners: a color/adjectival rating with a narrative assessment, a proposal risk rating, and a performance risk rating. Each of the factors and subfactors in Areas A and B will be assigned a color/adjectival rating and a proposal risk rating which are given equal consideration. A performance risk rating will be assigned at the area level. The color/adjectival and proposal risk are not assigned at the area level. In Areas A and B, equal consideration is given to the area performance risk, the proposal risk, and color/adjectival ratings in making the integrated source selection decision. All factors and subfactors will be evaluated using the standards in Attachment 8 of the RFP.

(1) Color/Adjectival Rating. The color/adjectival rating depicts how well the Offeror's proposal meets the evaluation standards and solicitation requirements. See AFFARS Appendix AA, paragraph AA-304 for definitions of colors. Color/adjectival rating will be assigned at the factor and subfactor level for Areas A and B.

(2) Proposal Risk. The proposal risk rating for Area A is an assessment of the adequacy of the identification and prioritization by the Offeror of the key risk areas in his design and an assessment of the probability that the design will lead to a PDRR ABL which meets the Government's objectives and requirements. The proposal risk rating for Area B is an assessment of the extent to which the Offeror's approach buys down risk in all key areas, incrementally providing increasing confidence in successful completion as the effort progresses; and the probability that the Offeror's approach will lead to a PDRR ABL which meets the Government's objectives and requirements within the cost and schedule constraints of the program. See AFFARS Appendix AA, paragraph AA-305 for risk definitions. Proposal risk will be assigned at the factor and subfactor level for Areas A and B.

(3) Performance Risk. The performance risk rating assesses the probability of the Offeror successfully accomplishing the proposed effort based on the Offeror's demonstrated present and past performance. The evaluation of the Offeror's current and past performance will be conducted by a Performance Risk Analysis Group (PRAG), which will make use of data on the Offeror's current and past performance to assess the probability that the Offeror can successfully accomplish the requirements of the proposed effort. When assessing past/present performance risk, the Government will use performance data in all areas as described below. Present and past performance will be evaluated using a structured risk assessment. The Government will consider the scope of the effort, the Offeror's level of responsibility (e.g., prime, team partner, major/minor subcontractor), and the phases of the program to which the Offeror contributed (e.g., Concept Design, PDRR, EMD, Production, and Operations and Support). Offerors are to note that, in evaluating past performance, the Government will use both data provided by the Offeror and data obtained from other sources such as the Contractor Performance Rating System (CPARS), data from the Defense Contract Management Command, responses to current/past performance questionnaires, etc. See AFFARS Appendix AA , paragraph AA-305 for risk definitions. Performance risk will be assessed at the area level for all three areas.

2.0 EVALUATION OF AREA A: TECHNICAL DESIGN

This area assesses the technical validity of the Offeror's design of the proposed PDRR system, subsystems, and components. The most relevant documents for evaluating this area are the CoDR1 data package, with any updates to be provided at CoDR2, the Technical Baseline Measures (TBMs), Rationale Document, the Offeror's Proposal, Government System Simulations, and System Specifications based on PDRR TRD Requirements. Each standard in Area A will be used to evaluate the PDRR design. Scalability and traceability to the EMD system design and requirements captured in the ABL EMD TRD will also be evaluated. Where PDRR subsystems or components are not identical to the planned EMD configuration, justification of the differences will be evaluated. The evaluation of this area for all factors and subfactors will include hardware/software requirements analysis and flowdown from the PDRR and EMD TRD to the system, segments, subsystems, and components. The appropriateness, maturity, and fidelity of the models, codes, and databases used in system simulations and design analyses, the extent to which the models/codes are anchored to experimental data, and the scope (depth and breadth) of the design analyses and trade studies for determining system, segment, subsystem, and component parameters will also be evaluated. A key element of the evaluation will be the robustness of the design. The flexibility of the design for efficient implementation of adjunct missions and advanced technology improvements will also be evaluated.

a. Factors

(1) Integrated ABL. This factor includes the requirements and expected performance of the integrated weapon system, which consists of the aircraft, laser, beam control/fire control, BMC4I, and ground facility. It also includes the residual operational capability of the PDRR ABL and integration of specialty engineering disciplines into system design. In addition, it includes how affordability as a key element in managing Cost as an Independent Variable (CAIV) has been used in system trade studies leading to the PDRR and EMD designs.

(2) Beam Control/Fire Control. This factor includes the beam control and fire control system design. The evaluation of this factor will include five equally weighted subfactors: Integrated Beam Control/Fire Control, Precision Tracking and Pointing, Wavefront Correction, Optical Systems, and Fire Control.

(3) Laser. This factor includes the laser system and subsystems; design, fabrication, and testing of a flight-weighted module; experiments performed to validate important performance parameters and design concepts; and descriptions of the oxygen generator, nozzle, cavity, and pressure recovery system flow fields and density maps resulting from modeling efforts or experiments.

(4) BMC4I. This factor includes the PDRR and EMD BMC4I system designs, including implementation of an open systems architecture, maturity of the system design, theater integration, surveillance, mission and battle management, human/system integration, decision aids (including assessment of atmospheric conditions), and interoperability.

(5) Aircraft. This factor includes the trade studies, design, analysis, modeling, simulation, and test that demonstrates validity of Offeror's design. Design emphasis is on the aircraft TBMs, external disturbance to the beam control system, aircraft integration, and the proposed aircraft modifications, such as the aerial refueling design, the turret/beam director design, laser exhaust interface to aircraft, basic crew accommodations, and consideration and inclusion of appropriate specialty engineering functions.

(6) Ground Facility. This factor includes specific aspects of the facility design including location; facilities for fueling, hardware and software integration, testing, training, and storage; facility modifications; the pressure recovery system, unique laboratories, utilities; security; risk drivers; environmental, and safety requirements.

3.0 EVALUATION OF AREA B: SYSTEM MANAGEMENT APPROACH

The assessment in this area deals with the Offeror's system management approach to the development of the Airborne Laser, including the approach for demonstrating design performance of the proposed PDRR system, subsystem, and components; providing residual operational capability; and the PDRR Phase II preparations for EMD. The most relevant documents for evaluating this area are the Integrated Task and Management Plan (ITAMP), System/Segment Specification, any available B-Specifications, Work Breakdown Structure (WBS), Software Development Plan (SDP), Software Development Capability Evaluation, the initial Integrated Master Schedule (IMS), Key Processes, Risk Assessment, Target Option, and available test planning documentation. In each Area B standard, the proposed tasks, events, or significant accomplishments must ensure scalability and traceability of the PDRR system to the EMD system. Where PDRR subsystems or components are not identical to the planned EMD configuration, explanations of differences, plans for transition to EMD, and risk mitigation, accomplished during PDRR Phase II, to ensure a smooth transition to EMD will be evaluated. The evaluation of this area for all factors and subfactors will include evidence that the Offeror takes ownership of the performance of the entire ABL system; showing how the subsystems will be developed, checked out, and integrated to provide a system with acceptable performance; and the extent to which the Offeror's approach provides an appropriate, affordable balance between rigorous design and incremental verification. The evaluation of each factor and subfactor will include the Offeror's approach to cost/performance optimization, and innovative approaches to designing affordability into the system.

a. Factors

(1) System Management. This factor includes the proposed plans and processes the Offeror will apply to provide a PDRR ABL weapon system that meets the Government's cost, schedule, and performance objectives. The evaluation of this factor will include seven equally weighted subfactors: Program Management, Technical Management, Beam Control/Fire Control, Laser, BMC4I, Aircraft, and Ground Facility. Program Management includes the proposed approach for the overall task development, above the individual IPT level, as reflected in the ITAMP/IMS and the Integrated Product Development. Technical Management includes systems engineering, models and simulations, system integration, computer resources, and the specialty engineering disciplines as they are applied to the overall integration of the IPTs and the individual IPTs that are not called out in other subfactors. It also includes affordability as part of requirement and cost trade in the ITAMP and incorporating affordability thresholds and objectives. The individual IPTs (Beam Control/Fire Control, Laser, BMC4I, Aircraft, and Ground Facility) include the approach to developing each subsystem incorporating IPT management; task development as reflected in the ITAMP/IMS; integration of models and simulations into system design, hardware fabrication and checkout, aircraft design approach, aircraft certification, and computer hardware and software development.

(2) System Test and Evaluation. This factor includes the Offeror's proposed management and technical approach to the development, integration and performance verification of the PDRR ABL and subsystems to provide a realistic demonstration and reduce risk of the EMD ABL. The evaluation will include the test objectives, requirements verification, overall test approach, the test schedule, the test force organization and manning requirements, and test resource requirements.

4.0 EVALUATION OF AREA C: COST AND SCHEDULE

a. PDRR Cost. The PDRR Contract Cost will be evaluated for realism, reasonableness, and completeness as defined in AFFARS Appendix AA, Paragraph AA-309. As part of the evaluation of the PDRR Cost, the Government will develop a Most Probable Cost (MPC) of the Offeror's proposed approach. The MPC will be based on the Offeror's proposed cost modified as necessary by the Government cost team. In addition to the contractor performed effort, the MPC will include, Government Furnished Property (GFP), base support, and allowance for risk may also be included.

b. Most Probable Schedule (MPS). The Government will develop a most probable schedule (MPS) based upon a schedule risk assessment (SRA), which will be conducted as follows:

(1) The Government will conduct a SRA which evaluates the program schedule risk based upon a multi-functional evaluation (e.g., engineering, logistics, manufacturing, etc.) of the Offeror's proposed major program milestones and critical activities as portrayed in the Integrated Master Schedule (IMS). The Offeror's IMS will be used as the foundation for determining the probability of meeting the proposed schedule dates. The Offeror's ability to meet specific schedule milestones will be evaluated at various probability levels based on the SRA. Assessment criteria to be used during the schedule analysis are:

(a) Realism - The scope of work and ranges of time are compatible (i.e., duration).

(b) Reasonableness - The scheduling methodology is acceptable (i.e., logic).

(c) Completeness - The schedule is responsive in addressing all RFP requirements.

(2) The Government will use appropriate schedule estimating techniques to perform the SRA.

c. Most Probable Life Cycle Cost (MPLCC). The Government will develop a MPLCC using the most appropriate estimating techniques, as determined by the Cost Panel, for this type of effort. The Offeror's LCCE will be assessed for reasonableness of methodology, completeness in addressing all requirements, and the relationship between LCCE and affordability processes. The government MPLCC will be the sum of estimated costs for the following phases:

(1) Cost of the Airborne Laser program includes the price of development, production, operation and support.

(2) Other Government Costs (OGC). OGC is usually a percentage of the contract cost the Government budgets for engineering changes; Government labor, ODC, and travel; and GFE/GFP. However, other items may also need to be estimated depending on the specifics of the Offeror's proposal.

(3) An allowance for risk may be included in the MPLCC based upon the evaluations conducted by the Cost-to-the-Government, Technical, Management, and other Panels. The Government will use appropriate risk analysis techniques to perform the MPLCC cost risk assessment.

5.0 GENERAL CONSIDERATIONS

General Considerations may include both proposal and other data (defined as data not submitted as part of the proposal). General Considerations, listed in descending order of importance, are as follows:

(1) Proposed Contractual Terms and Conditions.

(2) Proposed Goals and Commitments. Proposed goals and commitments for subcontracting and/or teaming with Small Disadvantaged Business, Small Business, Historically Black Colleges or Universities, and Minority Institutions, as provided in the Offeror's proposal.

(3) In-Plant Reviews. During the source selection, the Government may perform in-plant reviews to determine the Offeror's capability to successfully accomplish the program.

(4) Facilities. The Offeror must have or be able to obtain a facility clearance and appropriate personnel clearances up to the TOP SECRET level.