Key Performance Indicators

Flare

This metric is the best area of Imatest support of IEEE 2020-2024.

Method A

Similar to ISO 18844 but potentially within a hemisphere to support wider field

• Chart: 2020-2024 requires more black patches than the 18844 method C chart. These patches can be arranged within on a dome to help with wide FOV testing.

• We support the P2020 flare method A from the calculation side, although dot proximity could lead to some issues if the dots are too close together.

Method B

This is what Imatest’s stray light (flare) solution aims to solve, as we think the second method is a more comprehensive test. Our stray light solution contains a collimated LED source, a Motorized Gimbal, as well as flexible software analysis. Our solution can be configured to support the second method of the IEEE 2020-2024 standard.

Geometry

We support geometric calibration validation as a test lab service. We have a partner Furonteer that offers production level geometric calibration machines.

• Geometric calibration is not (and will not be part) of the standard. 

• Geometric calibration validation is a part of the standard. For some calibration models, we can do this as a service.

Noise

We support some of the metrics within the P2020 noise standard, and plan to update Imatest software to support the rest of the metrics in the medium term.

• Imatest supports basic means and standard deviations, similar to the standard.

• We do not support "Raw Video" which may be required for some of the temporal analysis.

Dynamic Range

To support IEEE 2020-2024 calculation, we will ensure we have the right chart patterns, which may be new patterns, as our software already has the necessary calculations available. 

• Many members of IEEE P2020 used the contrast resolution chart.

• Additional analysis code to support the standard will be added in the medium term.

SFR

The charts for SFR are a slanted square surrounded by registration marks and tonal patches, so local linearity and magnification can be obtained. Imatest does not yet produce this target.

• IEEE 2020 SFR calculation uses “ISO 12233:2024" slanted edge calculation.

• Our gamma calculation may be superior to the local linearity calculations, especially in the cases of extreme non-uniformity.

Flicker

We currently sell hardware to test flicker per P2020 in the form of a flickering light box, but our software does not yet support the calculations. See http://imatest.com/imaging/flicker/

In lieu of software support, we could perform flicker analysis for you on a consulting basis within the context of our lab services, contact labservices@imatest.com.

Contrast Performance Indicator (CPI)

Our contrast resolution and HDR charts can be utilized to capture images that can support this standard, and we have some capability to support multi-image analysis that we can expand upon if needed.

• Contrast Transfer Accuracy (CTA) was formerly known as CDP “Contrast Detection Probability”.

• Contrast Signal to Noise Ratio is based upon this paper by Robin Jenkins presented at Electronic Imaging in 2021, the permission to use this NVIDIA patent has supposedly been granted.

• We released a CDP calculation in Imatest 5.1 based on an early draft, which is not IEEE 2020 CTA. We will have to update things to get compliant.

Related links

• Purchase the standard: https://www.techstreet.com/ieee/standards/ieee-p2020?gateway_code=ieee&vendor_id=6765&product_id=2505612

• Imatest’s standard page: https://www.imatest.com/imaging/ieee-2020/