Norma INTE/ISO 22301:2015

A. Military Utility Determination

CONCLUSIONS

JMMES is not yet mature. Considerable additional development of algorithms and TTP are needed before JMMES will be ready for operational use. These developments should be accomplished before additional operational demonstrations and assessment. The testing that has been done to date can be used as a baseline, so that new tests can concentrate on improvements and should provide testing efficiencies.

JMMES has numerous potential benefits including its multi-mission capabilities, symbiotic pairing with another sensor, and the utilization of "proven detection algorithms" to minimize costs and development time.

OVERARCHING RESULTS

• Integration of the JMMES multi-spectral and multi-sensor suite in a common turret is successful.

• Algorithms for the Mission Areas are immature. There are problems with algorithm performance.

• The system has inherent search capabilities limitations, mainly because of its small observational footprint. Most scenarios resulted in visual detections before JMMES detection (all except night Land SAR). For this reason it may have greater potential to function as a complementary sensor for other search systems, e.g. to visually identify a radar contact.

• The concept for executing multiple missions on the same flight has significant benefit.

Theoretically all EO sensors can provide multi-mission capabilities and whether it is operationally useful depends on the algorithms available. Because of mission algorithm deficiencies (a limited number of operational modes), it was not possible to fully run realistic multiple mission tests (transition between modes rarely occurs), so this utility remains an untested potential.

• As currently configured, operator workload for system operation is too high. Many operator -executed functions need to be automated. Also, operations that must be performed by separate controllers should be merged into a single human-system interface.

AMPLIFYING INFORMATION

• Five of eight originally planned mission areas were assessed (ASW, SUW, MIO, SAR, MCM).

CIED missions were flown; however, collected data were used for algorithm development only.

CCCD and ICD were not conducted as a suitable venue was not available.

• Reliability. System crashes and resets for various and often unknown reasons were commonplace.

• The footprint limitations listed above, are significant weaknesses in SAR and SUW and an important restriction to localization in ASW.

26

• Algorithms.

o JMMES was designed to exploit “proven advanced algorithms” from other operational systems. However, the results were not always effective.

o Some algorithms were immature/not fully ready for the ODs (SAR and CIED). The MCM algorithm was limited to post trial use.

o Contact reports frequently listed duplicate/redundant contacts.

o Often, even with direct overflights of targets, auto-detects were not accomplished.

• JMMES does not have a true tracking capability, but instead tracking is accomplished through a series of individual auto-detects. There is a tracking capability using Audio Video Tracker (AVT). Maritime Video Verification of Identity (MVIVID) has a tracking capability, but was not shown to be effective. Auto -track and more reliable auto-detect capabilities would provide significant benefit to JMMES.

• MVIVID tactics, techniques, and procedures (TTP) are immature. Because of the need for the operator to input manual points, it took too long to start MVIVID searches and information was already time-late. Search/detection using JMMES took much too long. In SUW, for example, the same thing can be done for a broad area with a single radar sweep in less than a second.

• GUI.

o JMMES has an excellent search coverage map for the operator.

o A JMMES display is needed for the pilot.

o When the JMMES Operator types a user comment it appears in the middle of screen obscuring most fields and displays. The comment display needs to be relocated.

• Sun glint was a problem during several missions.

• Unintended results (twilight scenarios)

o Following a night Land SAR mission, a night Land MCM capability was demonstrated using thermal contrast.

o Night MSAR was accomplished using the ASW processor (previously only used for Day MSAR).

27

B. Transition, DOTMLPF, CONOP and TTP Recommendations

Transition

• Software emphasis is key – algorithms, HSI, etc. Additional development is needed.

• Reliability. System crashes and resets for various and often unknown reasons were commonplace. Improvements will come from analysis of software.

• As currently configured, operator workload for system operation is too high. Many operator executed functions need to be automated. Also, operations that must be performed by separate controllers should be merged into a single human-system interface.

DOTMLPF

• Doctrine

o Increased flexibility in prosecuting multiple missions o Reduction of technical and operational manuals

• Organization

o Potential limited reduction in organization size at the tactical level

• Training

o Potential reduction in training needs by reducing the number of systems needed to accomplish multiple missions

• Materiel

o Likely to gain personnel reductions and improved logistics support with JMMES system o Reduction in number of systems supported if JMMES can replace other systems

• Leadership and Education

o Likely to assist leadership in improved prosecution of ISR

• Personnel

o May lead to some reduction of personnel due to elimination of redundant systems

• Facilities

o Potential reduction in overall support facilities required by eliminating unique mission equipment.

CONOPS

• Review phenomenology to influence CONOPs to optimize use of the system.

• Use JMMES in conjunction with other sensors, e.g. radar, acoustics, visual for improved identification of targets.

• As currently configured, operator workload for system operation is too high. Many operator executed functions need to be automated. Also, operations that must be performed by separate controllers should be merged into a single human-system interface.

28 Tactics, Techniques, and Procedures (TTP)

• Prosecutions of targets are likely to be more timely with multi-mission equipment.

• Prosecutions are likely to be more effective as proficiency improves using a standard system.

• Procedures can likely be simplified when using only one system to accomplish multiple tasks.

• Risk assessment is important to be done – altitude of preferred operations vs. vulnerability to target weapons; covertness vs. effectiveness, etc.

29

V. Acronyms