Problem

Intelligence, reconnaissance, and surveillance (ISR) is central for gathering and processing information taken from weather on a battlefield, a police stakeout, or any other commercial situation. Although collecting information in the visible spectrum can be helpful, it leaves untold amounts of information still ungathered, especially in low-light or nighttime scenarios. Failing to amass necessary data may lead to mission failures, poor target identification, monetary losses, and even fatalities.

Solution

Through the use of polarization enhanced thermal imaging sensors, information will no longer be sparse. Polaris’s eTherm® will detect anything from power lines to disturbed earth. With this new, higher level of intelligence gathering, applications could range from flight planning to IED detection.

Background

Surveillance typically involves monitoring the behavior of targets (people, vehicles, etc.) for the purposes of managing or protecting particular interests while reconnaissance focuses on obtaining information about threats by visual observation and detection. In general, surveillance refers to remote monitoring while reconnaissance refers to sending a team of scouts to gather information. Polaris’s eTherm® technology is a practical method to improve solutions for both surveillance and reconnaissance applications. It overlays the polarization data on top of the thermal imagery to make it even easier to see detected objects. The goal of eTherm® is to improve the performance of electro-optic and infrared optical sensors. This is particularly useful to help improve target detection range by reducing surrounding clutter. This technique is robust in all parts of the day/night cycle and against a variety of natural backgrounds (sky, dirt, sand, grass, bushes, trees, etc.). Check out the different use-cases below.

In the figure to the left, a tank has driven away from the observer near the center of the screen. It has reached thermal equilibrium and appears washed out in the standard thermal image. Now, hover over or click on the image to see how polarization reveals the tank’s position. Notice that you can also see the tank’s tracks, which are otherwise missing from the thermal image.

In the figure to the right, a truck is sitting out in a field. It has reached thermal equilibrium and appears washed out in the standard thermal image similar to the tank. Now, hover over or click on each image to see how polarization reveals the truck’s position. Notice that you can also see the tank’s tracks, which are otherwise missing from the thermal image.

While these examples primarily focus on military vehicles and applications, the principles are transferable to the commercial sector as well. With the advances of autonomous vehicles, drones, and mobile devices, polarization is an attractive solution to help solve problems with detecting vehicles in otherwise challenging scenarios. See the navigation and safety pages for more information regarding commercial vehicle detection applications.

The maritime environment presents its own set of challenges and opportunities. Targets of interest are not always easily discernible to the human eye and even less so to a computer algorithm. Even when a target has been identified, gathering actionable intelligence as to the height above water, ship length, and general identifying features can be challenging as shown in the figure above. By using our eTherm® technology, the targets are readily located and even silhouetted, facilitating automated target detection, recognition, and identification as shown in the figure upon hover. Using a simple adaptive threshold on the eTherm imagery, Polaris was able to detect and outline the boat, the boat engine, and a person standing in the boat. Additionally, another vessel is seen behind the first boat against the tree line. These images were taken in good visibility conditions.

Polarization allows you to see the world differently during the day and night, and it is useful for detecting man-made objects against natural clutter. In the image to the left, a park scene is observed from an aerial platform. In the scene, there a number of metal plates which have been camouflaged. The data product shown is what you would see from a standard thermal camera. It is nearly impossible to determine the number and location of the metal plates. How many do you see? Hover over or click on the image to find a strong negative contrast signature for the five metal plates. In addition, a dynamic threshold and a segmentation algorithm have been applied to highlight these threats to the user. This sensing modality is robust against camouflage, canopy obscuration, and shadows.

We have found that real-world operators like to have a fused dataset to help visualize the world. Polaris has developed VectorColor which works by fusing both the thermal (or visible) image and the eTherm data product with the standard data product given in black/white. Notice how when you hover over or click this next image how the color is added to the black and white scene. The thermal content is still available along with the highlighted targets. Both eTherm® and VectorColor were developed by Polaris primarily for military threat detection. However, there are many commercial applications which may make use of these solutions. The areas of navigation (detecting obstacles in the roadway), surveillance, and security are specific business areas which Polaris is expanding its eTherm® and VectorColor technologies.

Another military application for eTherm is weapons and projectiles. eTherm can improve the signal-to-noise ratio of these objects, enhancing detection likelihood and range. For instance, note the image sequence to the left of a missile cone imaged using a traditional EO/IR imaging system. The top image is taken from a standard visible camera while the middle image is taken using a standard infrared thermal camera. It is clear that the cone will generate a good signature due to its shape and emitted heat. However, the eTherm image provides a view which enhances the standard thermal image, providing information about the geometry of the object, its orientation, and its perspective to the viewer.

Remember, eTherm does not replace the traditional thermal imager, but instead it adds additional information that can augment and upgrade the observer’s knowledge of the weapon being observed. This knowledge can be used to advance beyond current detection, tracking, and recognition (matching) algorithms.

In many missile and projectile detection scenarios, engagement timelines are short, thus acquisition range is a critical parameter. The sooner one decides to engage the threat, the more time you have to act, thus improving probability of success. One key contribution of eTherm is the ability to distinguish between plume and hardbody. To a thermal imager, the plume will dominate the signature and it is difficult to distinguish between plume and body. However, eTherm will mostly ignore the unpolarized plume while presenting the geometry of the hardbody as an added contrast mechanism.