Imaging Components, Systems, and Processing

Processing and fusion of passively acquired, millimeter and terahertz images of the human body

[+] Author Affiliations
Li Tian, Weiqi Jin, Yi Cai

Beijing Institute of Technology, Ministry of Education, Key Laboratory of Photoelectronic Imaging Technology and System, School of Optoelectronics, Beijing, China

Yanchun Shen

Capital Normal University, Ministry of Education, Key Laboratory of Terahertz Optoelectronics, Physics Department, Beijing, China

Tangshan University, Intelligence and Information Engineering College, Hebei, Tangshan, China

Guozhong Zhao

Capital Normal University, Ministry of Education, Key Laboratory of Terahertz Optoelectronics, Physics Department, Beijing, China

Opt. Eng. 56(4), 043102 (Apr 07, 2017). doi:10.1117/1.OE.56.4.043102
History: Received December 30, 2016; Accepted March 15, 2017
Text Size: A A A

Open Access Open Access

Abstract.  A passive, millimeter wave (MMW) and terahertz (THz) dual-band imaging system composed of 94 and 250 GHz single-element detectors was used to investigate preprocessing and fusion algorithms for dual-band images. Subsequently, an MMW and THz image preprocessing and fusion integrated algorithm (MMW-THz IPFIA) was developed. In the algorithm, a block-matching and three-dimensional filtering denoising algorithm is employed to filter noise, an adaptive histogram equalization algorithm to enhance images, an intensity-based registration algorithm to register images, and a wavelet-based image fusion algorithm to fuse the preprocessed images. The performance of the algorithm was analyzed by calculating the SNR and information entropy of the actual images. This algorithm effectively reduces the image noise and improves the level of detail in the images. Since the algorithm improves the performance of the investigated imaging system, it should support practical technological applications. Because the system responds to blackbody radiation, its improvement is quantified herein using the static performance parameter commonly employed for thermal imaging systems, namely, the minimum detectable temperature difference (MDTD). An experiment was conducted in which the system’s MDTD was measured before and after applying the MMW-THz IPFIA, verifying the improved performance that can be realized through its application.

Figures in this Article

The frequency range of a millimeter wave (MMW) is 30 to 300 GHz.1 The frequency range of terahertz (THz) is normally 100 GHz to 10 THz.2 The wavelength of MMW is longer; it has higher atmospheric transmittance, and in the process of propagation, poor environmental conditions have less impact on it.1 The frequency of THz is higher; it has higher spatial resolution or longer depth of field when the spatial resolution is consistent.2 Therefore, the images of the two bands may contain different information. Since the human body radiates MMW and THz waves, the two bands are often used for human body security imaging. Compared with commonly used MMW or THz single-band imaging systems, MMW and THz dual-band imaging systems can acquire more information because the images obtained using image fusion algorithms contain more accurate descriptions of the scene than single-band images could.35

In our investigation, we employed an MMW and THz dual-band passive human-body security imaging system composed of 94 and 250 GHz single-element detectors to study MMW and THz dual-band image preprocessing and fusion algorithms.6,7 We developed an algorithm called the MMW and THz image preprocessing and fusion integrated algorithm (MMW-THz IPFIA), which is proposed herein. The MMW-THz IPFIA consists of denoising, enhancement, registration, and fusion algorithms and yields fused images that contain most of the information from the corresponding dual-band images, improves the probability of detection, and enhances the performance of the dual-band imaging system. The effectiveness of the algorithm is analyzed by using image signal-to-noise ratio (SNR) and information entropy.810 The performance improvement provided by the MMW-THz IPFIA to the system is also demonstrated in this report. Because the system responds to blackbody radiation, the commonly used thermal imaging system performance evaluation parameter—the minimum detectable temperature difference (MDTD)—was employed to analyze the system’s performance. Finally, we performed an experiment in which the MDTD was measured both before and after applying the MMW-THz IPFIA to obtain objective, quantitative evidence of the improvements it yields.

Figure 1 depicts a schematic diagram of a MMW and THz dual-band passive human-body security imaging system, which is composed of a plane mirror, trihedral focusing scanning mirror, reflector, beam splitter, 94-GHz single-element detector, and 250-GHz single-element detector. The plane mirror collects the MMW and THz radiation emitted by the human body as it is swept along the direction perpendicular to the image plane to conduct a line scan. The trihedral focusing scanning mirror focuses the target radiation on the reflector and rotates along the direction parallel to the image plane to perform a column scan. The reflector reflects the radiation to the beam splitter. The beam splitter is an optical element with a semitransparent, semireflective characteristic, and it can divide the radiation into two beams: the transmitted beam and the reflected beam. The transmitted beam and the reflected beam can be captured by the 94- and 250-GHz detectors, respectively, and used to form image signals and create dual-band images.

Graphic Jump Location
Fig. 1
F1 :

Schematic diagram of the THz dual-band imaging system.

As shown in Fig. 2(a), the images obtained by the 94 and 250 GHz detectors depict a test subject hiding a steel ruler in front of the abdomen. Figures 2(b) and 2(c) present similarly generated images of the subject with a THz attenuator in front of the left side of the chest and with papers hidden within the subject’s clothes, respectively. In these original images, there is significant noise, the resolution and contrast are low, and affine problems are obvious. Thus, it is necessary to preprocess such images by performing denoising, enhancement, and registration before fusing them to obtain high SNRs, high contrast, and rich details in the resulting fused images.

Graphic Jump Location
Fig. 2
F2 :

Pairs of dual-band THz human-body security images obtained with 94 GHz (left) and 250 GHz (right) detectors: (a) a steel ruler hidden in front of the abdomen, (b) a THz splitter hidden in front of the left side of the chest, and (c) papers hidden in front of the chest.

In this report, we propose an MMW-THz IPFIA, which can be used to preprocess and fuse MMW and THz dual-band human-body images.

Millimeter Wave-Terahertz Image Preprocessing and Fusion Integrated Algorithm

The MMW-THz IPFIA employs a block matching and three-dimensional (BM3D) filtering denoising algorithm, a contrast-limited adaptive histogram-equalization (CLAHE) enhancement algorithm, a mutual information based registration algorithm, and a wavelet transform-based image-fusion algorithm.

Block matching and three-dimension

The BM3D algorithm, a three-dimensional (3-D) transform-domain filtering algorithm based on block matching, is one of the most effective image denoising algorithms currently in use. Figure 3 presents the structure of the BM3D algorithm, which consists of two steps: basic estimation and final denoising.11,12

Graphic Jump Location
Fig. 3
F3 :

Structure and flow of operations in the BM3D algorithm.

Basic estimation: Obtaining a basic estimate requires three steps.

  1. Block matching and grouping: By sliding a window with dimensions of N1×N1 matching a certain step length, divide Image I into several blocks. Assume that P is the currently selected block; ND is the search diameter; Q is the sliding block in the search region; and sP and sQ, which represent the locations of the blocks, are the values of the pixels in the top left corners or the centers of blocks P and Q, respectively. Then the distance between the two blocks is DPQ=sPsQ2/N12. If an appropriate distance threshold τ is selected, where DPQ<τ, then Q is the similarity block of P. In addition, the set of the similarity blocks of P forms a 3-D matrix SP, where SP={QI|DPQ<τ}.
  2. 3-D Transform Domain Denoising: First, arrange the elements of SP in order of the size of DPQ. Next, perform a one-dimensional (1-D) Haar wavelet transfer τ3D between the blocks and a two-dimensional (2-D) Bior wavelet hard-threshold filtering within the block. Then the transform coefficient of the hard threshold filtering is r, which can be modulated by Display Formula
    r(x)={0|x|σλ3Dx|x|>σλ3D.(1)
    After performing that operation, write the denoised information back to the original position in the image by conducting an interblock inverse transformation. The 3-D transform denoising equation is as follows: Display Formula
    RP=τ3D1[r(τ3DSP)].(2)
    In Eq. (1), x is the numeric of SP in the matrix, λ3D is the hard threshold shrinkage parameter, σ is the estimated standard deviation of the noise, and RP is the denoised 3-D image of the block matrix.
  3. Aggregation: After step (2) has been completed, an estimate will have been performed for every block and element in the image, and the similarity block set of P, SP, will have changed to RP. In RP, NP is the number of nonzero coefficient blocks, ωP is the basic estimated weight of P, and the equation used to calculate ωP is as follows: Display Formula
    ωP={1NPNP11NP=0.(3)

Because the step length of the sliding window may be less than its size, the blocks may overlap. Thus, an element i may appear in different blocks. Estimating the value of R for the i’th element requires reassessing the overlapping blocks by using the weighted average as follows: Display Formula

R(i)=SPωpOSPRPOSPωpOSPxO,(4)
where O represents any image block containing element i in SP and RPQ is the estimator of O after denoising. In addition, Display Formula
RPO={RPOiO0iO(5)
and Display Formula
xO={1iO0iO.(6)

The final denoising process involves three steps.

  1. Block matching and grouping: Match and group the denoised images obtained from the basic estimate, generating a new 3-D matrix SP2.
  2. Joint Wiener filtering denoising: Transform SP and SP2 by applying a 3-D transformation κ3D (2-D DCT cosine transform and 1-D Haar wavelet transform). Use SP to perform Wiener filtering of SP2 to obtain the final weight estimate ω. Write the estimator of every pixel back to the original position by applying the interblock inverse transformation: Display Formula
    ω=|r(κ3DSP2)|2|r(κ3DSP2)|2+σ2.(7)
  3. Aggregation: Re-estimate the overlapped blocks and obtain the result by calculating the weighted average: Display Formula
    RP_final(i)=SPωOSPRPOSPωOSPxO,  iI.(8)

Image enhancement

Image enhancement technology can improve the visibility of barely observable targets and enhance the level of detail of the information acquired. Some small targets and detailed texture features occupy relatively few pixels in MMW and THz images. Thus, they occupy smaller portions of the images’ grayscales. In the proposed method, weak target loss during the fusion process is avoided since a CLAHE algorithm is used to enhance the denoised images.13,14

The CLAHE algorithm, a classic image enhancement algorithm, involves four steps.

  1. Blocking: Use a sliding window to pass over the image. The grayscale of the image is [0,L1]. Acquire a series of local image sub-blocks with dimensions of m×n.
  2. Calculate the probability of grayscale k, pr(rk)=nk/N, and obtain the normalized histogram and probability distribution function (PDF) of every sub-block. In the preceding equation, 0rk1 represents the k’th grayscale, nk is the number of pixels in grayscale rk, N=m×n is the number of pixels in the sub-block, and k=0,1,2,,L1, where L is the gray level.
  3. As depicted in Fig. 4, for the PDF of each sub-block, set a threshold: PDFth. The part of the PDF that is larger than PDFth is the intercepted portion, the lower and upper limits of the grayscale of the intercepted portion are kl and kh, respectively. If the total number of the gray level in the sub-block is sL, when the grayscale is kth[kl,kh], the PDF corresponding to kth is divided into sL copies, that is, PDFave=PDFkth/sL, then PDFave is added to the PDF corresponding to each grayscale in the sub-block. The PDF below PDFth is increased, and the PDF above PDFth is reduced.
  4. Transform the contrast-limited histogram of each sub-block, map the elements of the original grayscale rk onto grayscale sk, where Display Formula
    sk=j=0kpr(rj)=j=0knjN(9)
    stretch and disperse the high gray levels, and compress and combine the low gray levels, thereby obtaining an enhanced image with a reasonable contrast distribution and obvious texture details.

Graphic Jump Location
Fig. 4
F4 :

Contrast-limited adaptive histograms: (a) original histogram and (b) contrast-limited adaptive histogram.

Image registration

The MMW and THz dual-band, passive human-body security imaging system employed in this investigation uses two different detectors to capture dual-band images. Variations in the detector parameters lead to geometric deviation problems, such as translation, scaling, and rotation between images. It is necessary to correct such geometric deviations to register images. In this study, we employed a mutual-information-based method to register the images, since otherwise the grayscale details in the dual-band images would be minimal and the characteristics of the images would not be obvious.15,16

The mutual-information-based registration method utilizes mutual information to conduct similarity measurements and image registration, and includes the following four basic components:

  1. A feature space consisting of the gray values of the images;
  2. A search space for global translation, rotation, and scaling;
  3. Similarity measurements of mutual information: Mutual information is used to assess the correlation between the information provided by two systems. In the system employed in this study, although the two images in each set were obtained by different detectors, they were based on the same scene information. Thus, when the spatial positions of the two images in a set are identical, the value of the information that one image provides about the other, that is, the mutual information, was maximized. Algorithms typically use the generalized distance between the joint probability distribution and separate probability distributions to estimate the mutual information. Here, this relation is as follows: Display Formula
    I(A,B)=a,bPAB(a,b)logPAB(a,b)PA(a)PB(b).(10)
    For images A and B, the corresponding pixel gray values are a and b, respectively, which are linked by a coordinate transformation. The joint distribution PAB(a,b) can be calculated using the normalized joint grayscale histogram h(a,b). Thus, Display Formula
    PAB(a,b)=h(a,b)a,bh(a,b).(11)
    The marginal probability distributions are PA(a)=bPAB(a,b) and PB(b)=aPAB(a,b).
  4. A search strategy employing the (1 + 1) evolution strategy algorithm [(1 + 1) ES]: This algorithm is a numerical optimization algorithm for solving continuous search spaces that was proposed in the 1960s by German mathematicians, Rechenberg and Schwefel, and occupies an important position in research dedicated to and applications of evolution strategy.17,18

Each generation in (1 + 1), ES consists of only two individuals: a parent and an offspring. The offspring is generated through a mutation of the parent; the better of the parent and offspring is chosen as the next generation’s parent. This process can be summarized by the following four steps:

  1. Randomly generate an initial individual ς0S as the parent, where k=0;
  2. Generate an offspring by performing the mutation ηk=ξk+Zk, where Zk is a continuous random vector;
  3. If f(ηk)>f(ξk) and ηkS, then make ξk+1=ηk; otherwise, make ξk+1=ξk, and let k=k+1;
  4. If the algorithm termination conditions are not met, return to Step (2).

Image fusion

Image fusion involves integrating information from two or more source images to obtain a new image that can present the scene exactly, entirely, and reliably. Compared with the prefusion images, a fused image contains more information, more details, and greater clarity. Thus, the potential target detection rate is greater. The wavelet-transform-based fusion method takes full advantage of the wavelet’s multiresolution analysis capabilities by dividing the original image into a series of subimages with different spatial resolutions and frequency domain features. The subimages reflect the local characteristics of the original image. In this method, the subimages are fused according to certain rules, the multiscale description of the fused image is formed, and, finally, the fused image is obtained by performing inverse-wavelet-transform reconstruction. Figure 5 presents a schematic diagram of the steps of the fusion algorithm.19,20

Graphic Jump Location
Fig. 5
F5 :

Schematic diagram of the image fusion algorithm based on the wavelet transform.

The wavelet base used in this research is the simplest Haar wavelet base: Display Formula

Ψ(x)={10<x<1/211/2<x<10x(0,1).(12)

The original image is decomposed by performing a three-level discrete wavelet transform. The image characteristics are acquired using different resolutions, and after Eq. (13) is employed to complete the computation of the weighted average of the wavelet coefficient, the fused image is obtained: Display Formula

C(i,j)=wA(i,j)A(i,j)+wB(i,j)B(i,j),wA(i,j)+wB(i,j)=1.(13)

Algorithm Evaluation and Verification
Objective evaluation parameters

We use SNR (SNR is a measure of the strength relationship between the signal and the noise) and the information entropy (the larger the value, the richer the details contained in the image) to analyze the performance of the algorithm.

Signal-to-noise ratio

For an image I, it is first divided into several sub-blocks by sliding a window with dimensions of w×w on it. Then the local mean and the local variance of the sub-bocks are calculated.9 Suppose that the central pixel of a block is (i,j), the local mean μI(i,j) and the local variance σI2(i,j) are as follows: Display Formula

μI(i,j)=1(2w+1)2k=wwl=wwI(i+k,j+l),(14)
Display Formula
σI2(i,j)=1(2w+1)2k=wwl=ww[I(i+k,j+l)μI(i,j)]2.(15)

The maximum value of the local variance is selected as the signal variance of the image: Display Formula

s=max[σI2(i,j)].(16)

A flat area without significant changes in the grayscale of the image is selected, and the mean of the local variance of the flat area is taken as the noise variance of the image:8,9Display Formula

n=mean[σQ2(i,j)].(17)

The SNR of the image is as follows: Display Formula

SNR=10log10(s/n)=10log10{max[σI2(i,j)]/mean[σQ2(i,j)]}.(18)

Information entropy

For an image I, the information entropy is as follows: Display Formula

En=i=0l1p(i)log2p(i),(19)
where En is the information entropy; l is total number of the gray levels in the image; p(i) is the ratio of the number of pixels in grayscale i to the total number of pixels in image.10

Algorithm verification
Subjective verification

In this section, indicators of the effectiveness of applying the MMW-THz IPFIA to the images depicted in Fig. 2 are discussed. Figures 678 correspond to Figs. 2(a)2(c), respectively. From left to right in Figs. 68, the profiles are presented in three groups. The first and second groups of four images, which were acquired using the 94 and 250 GHz detectors, respectively, each include the original, denoised, enhanced, and registered images, from left to right. The image on the far right in each figure is the final fused image.

Graphic Jump Location
Fig. 6
F6 :

Processed and fused images corresponding to Fig. 2(a), in which the subject was concealing a steel ruler.

Graphic Jump Location
Fig. 7
F7 :

Processed and fused images corresponding to Fig. 2(b), in which the subject was imaged with a THz splitter.

Graphic Jump Location
Fig. 8
F8 :

Processed and fused images corresponding to Fig. 2(c), in which the subject was concealing papers at the chest.

The processed images display reduced noise, improved detail contrast, and effective affine problem correction. The features of the two-band image pairs are synthesized in the fused images, which contain more detail. The probability of detection and capabilities of the dual-band passive THz human-body security imaging system are improved by applying the MMW-THz IPFIA.

Objective verification

According to Eqs. (14)–(18), the SNR of the original image and the fused image are calculated first. The size of the sliding window is w=5. The rows of the flat area are [10 25] and the columns are [30 50] (as shown in Figs. 68, the area in the red lines is the flat area). The grayscale distribution of the selected area in the fused images is flat. It does not contain edges or significant changes. Moreover, in this area, there is only noise in the original images, and the grayscale distribution is also flat.

Table 1 shows that the values of SNR of the fused image are several times larger than that of the original image. This indicates that the noise in the image is obviously reduced.

Table Grahic Jump Location
Table 1SNRs of the original image and the fused image.

Table 2 shows the values of information entropy of the original image and the fused image. The values are increased by 1 basically (for 8-bit digital images, the maximum of the information entropy is 8). This indicates that the detail information contained in the image is enhanced effectively.

Table Grahic Jump Location
Table 2Information entropy of the original image and the fused image.

The two parameters fully illustrate that the algorithm can effectively reduce the noise and improve the level of detail in the images. The fused image contains more details than the original image, thus it can describe the scene more precisely.

MDTD is an important parameter for evaluating the performances of thermal imaging systems. It can reflect a system's thermal sensitivity characteristics and spatial resolutions. Furthermore, the MDTD does not restrict the duration of the observation. The MDTD can be measured as soon as the position of a square or circular blackbody target in the image displayed on the screen starts to become identifiable, as illustrated in Fig. 9, and equals the temperature difference between the blackbody and background.

The imaging target of the MMW-THz dual band passive human-body security imaging system is the scene at room temperature, therefore, the evaluation of the system performance can be objectively carried out by using the measurement method similar to the thermal imaging system MDTD.

The components of the experimental system designed to measure the MDTD are depicted in Fig. 10. Given that the environmental temperature was 20°C, both the 94 and 250 GHz subsystem unit detectors were 10 mm in size. The focal length of the system was 300 mm; the aperture diameter was 200 mm; the imaging object distance was 1.7 m; the imaging range of the object was 2  m(high)×0.8  m(width); and the sample spacing was 10 mm. By calculating the optical diffraction limit, the minimum resolvable sizes of the optical system of the 250 GHz subsystem and the 94-GHz subsystem are 2.196 and 5.84 mm, respectively. They are smaller than the size of the detector, therefore, the spatial resolution of the imaging system is mainly affected by the size of the detector.

Graphic Jump Location
Fig. 10
F10 :

Measurement system components: from the up left to the low right are: (a) imaging system, (b) blackbody controller (c) blackbody and target, (d) 94 GHz detector and (e) 250 GHz detector.

Since the imaging object distance was 1.7 m, and the MDTD measurement targets were designed to be circular and to range in diameter from 60 to 130 mm in 10-mm increments, the spatial angular frequency is presented in Table 3. Images of the 60- and 100-mm-diameter targets are illustrated in Fig. 11 as examples. The measured MDTD curve is shown in Fig. 12.

Table Grahic Jump Location
Table 3Spatial angular frequencies of the targets f (cyc/mrad).
Graphic Jump Location
Fig. 11
F11 :

Images of the (a) 60-mm-diameter and (b) 100-mm-diameter targets.

The curve shown in Fig. 12 can be used to compare the original MDTDs with those after preprocessing with the 94 GHz and 250 GHz subsystems. In principle, for the same spatial angular frequency, the smaller the MDTD, the higher the system detection rate. In each case, the MDTD is reduced by preprocessing, indicating that the detection performance of the system is improved. Under identical conditions, the MDTD of the 94-GHz subsystem is larger than that of the 250-GHz subsystem in both the original and processed systems. Thus, the MDTD of the system processed by using MMW-THz IPFIA lies between those of the processed 94- and 250-GHz subsystems, that is, MDTD250  GHz_after<MDTDsystem<MDTD94  GHz_after. In addition, the MDTDs obtained using the proposed algorithm are smaller and are favorable compared with those obtained using the two original subsystems. This outcome, attributable to the difference between the performances of the two subsystems, demonstrates that the final MDTD is related to the proportions of the subsystem images in the fused images. These results quantitatively demonstrate that the detection performance of the system is improved by applying the MMW-THz IPFIA.

In this article, a comprehensive algorithm, MMW-THz IPFIA, was proposed for use in MMW and THz dual-band passive human-body security imaging systems. This algorithm, which consists of denoising, enhancement, registration, and fusion algorithms, can be employed to generate fused images while preserving most of the details present in the original dual-band images. The performance of the algorithm was analyzed by calculating the SNR and information entropy of the original images and fused images. The result indicated that the resulting fused images exhibited less noise, greater detail, and more information than the single-band images did.

We used a test method similar to the MDTD of the thermal imaging system to objectively verify the performance improvement of the system provided by applying the MMW-THz IPFIA. The result indicated that the MDTD performance has been improved. Thus, the performance of the system can be improved by employing the MMW-THz IPFIA.

Since the denoising, enhancement, registration, and fusion algorithms for MMW and THz images cannot yet be employed in real-time processing, the objectives of the next phase of research will be to integrate these processes with hardware systems and to achieve real-time fusion of dual-band images to support efficient security monitoring using MMW and THz dual-band, passive human-body security imaging systems.

This work is supported by the project of National Science Foundation of China (Grant No. 61171051).

Appleby  R., and Anderton  R. N., “Millimeter-wave and submillimeter-wave imaging for security and surveillance,” Proc. IEEE. 95, , 1683 –1690 (2007).CrossRef
Xu  J. Z., and Zhang  X. C., Terahertz Science Technology and Application. , pp. 1 ,  Peking University Press ,  Beijing, China  (2007).
Zhang  Z., and Blum  R. S., “A categorization of multiscale-decomposition-based image fusion schemes with a performance study for a digital camera application,” Proc. IEEE. 87, , 1315 –1326 (1999).CrossRef
Poh  C.  et al., “Review article multisensor image fusion in remote sensing: concepts, methods and applications,” Int. J. Remote Sens.. 9, , 823 –854 (1998).CrossRef
Pajares  G., and De La Cruz  J. M., “A wavelet-based image fusion tutorial,” Pattern Recognit.. 37, , 1855 –1872 (2004).CrossRef
Luukanen  A.  et al., “Real-time passive terahertz imaging system for standoff concealed weapons imaging,” Proc. SPIE. 7670, , 767004  (2010). 0277-786X CrossRef
Mann  C.  et al., “First demonstration of a vehicle mounted 250 GHz real time passive imager,” Proc. SPIE. 7311, , 73110Q  (2009). 0277-786X CrossRef
Lagendijk  R. L., and Biemond  J., Iterative Identification and Restoration of Images. ,  Kluwer Academic Publishers ,  The Netherlands  (1991).
Zhou  M. Y., Deconvolution and Signal Recovery. , pp 186 –188,  Nation Defense Industry Press ,  Beijing, China  (1900).
Lau  W. L.  et al., “Comparison of image data fusion techniques using entropy and INI,” in  22nd Asian Conf. on Remote Sensing ,  Singapore  (2001).
Dabov  K.  et al., “Image denoising with block-matching and 3D filtering,” Proc. SPIE. 6064, , 354  (2006).CrossRef
Dabov  K.  et al., “Image denoising by sparse 3-D transform-domain collaborative filtering,” IEEE Trans. Image Process.. 16, (8 ), 2080 –2095 (2007). 1057-7149 CrossRef
Pizer  S. M.  et al., “Contrast-limited adaptive histogram equalization: speed and effectiveness,” in  Proc. First Conf. on Visualization in Biomedical Computing , pp. 337 –345 (1990).CrossRef
Wang  Y.  et al., “Image enhancement based on equal area dualistic sub-image histogram equalization method,” IEEE Trans. Consum. Electron.. 45, , 68 –75 (1999).CrossRef
Zitová  B., and Flusser  J., “Image registration methods: a survey,” Image Vis. Comput.. 21, (11 ), 977 –1000 (2003).CrossRef
Maintz  J. B. A., and Viergever  M. A., “A survey of medical image registration,” Med. Image Anal.. 2, (1 ), 1 –36 (1998).CrossRef
Beyer  H.-G., “Toward a theory of evolution strategies: some asymptotical results from the (1, +λ)-theory,” Evol. Comput.. 1, (2 ), 165 –188 (1993).CrossRef
Arnold  D. V., and Beyer  H. G., “Local performance of the (1 + 1)-ES in a noisy environment,” IEEE Trans. Evol. Comput.. 6, , 30 –41 (2002).CrossRef
Dasarathy  B. V., “Guest editorial: special section on sensor fusion 1996,” Opt. Eng.. 35, , 601 –602 (1996).CrossRef
Mallat  S. G., “Multifrequency channel decompositions of images and wavelet models,” IEEE Trans. Acoust. Speech Signal Process.. 37, , 2091 –2110 (1990).CrossRef

Li Tian is a doctoral student at Beijing Institute of Technology in China. Her current research interests include THz imaging theory, THz imaging systems, and THz image processing.

Weiqi Jin is a professor at Beijing Institute of Technology in China. His current research interests include night vision and infrared imaging technology, photoelectric image processing, photoelectric detection and instrumentation.

© The Authors. Published by SPIE under a Creative Commons Attribution 3.0 Unported License. Distribution or reproduction of this work in whole or in part requires full attribution of the original publication, including its DOI.

Citation

Li Tian ; Yanchun Shen ; Weiqi Jin ; Guozhong Zhao and Yi Cai
"Processing and fusion of passively acquired, millimeter and terahertz images of the human body", Opt. Eng. 56(4), 043102 (Apr 07, 2017). ; http://dx.doi.org/10.1117/1.OE.56.4.043102


Figures

Graphic Jump Location
Fig. 1
F1 :

Schematic diagram of the THz dual-band imaging system.

Graphic Jump Location
Fig. 2
F2 :

Pairs of dual-band THz human-body security images obtained with 94 GHz (left) and 250 GHz (right) detectors: (a) a steel ruler hidden in front of the abdomen, (b) a THz splitter hidden in front of the left side of the chest, and (c) papers hidden in front of the chest.

Graphic Jump Location
Fig. 3
F3 :

Structure and flow of operations in the BM3D algorithm.

Graphic Jump Location
Fig. 4
F4 :

Contrast-limited adaptive histograms: (a) original histogram and (b) contrast-limited adaptive histogram.

Graphic Jump Location
Fig. 5
F5 :

Schematic diagram of the image fusion algorithm based on the wavelet transform.

Graphic Jump Location
Fig. 6
F6 :

Processed and fused images corresponding to Fig. 2(a), in which the subject was concealing a steel ruler.

Graphic Jump Location
Fig. 7
F7 :

Processed and fused images corresponding to Fig. 2(b), in which the subject was imaged with a THz splitter.

Graphic Jump Location
Fig. 8
F8 :

Processed and fused images corresponding to Fig. 2(c), in which the subject was concealing papers at the chest.

Graphic Jump Location
Fig. 10
F10 :

Measurement system components: from the up left to the low right are: (a) imaging system, (b) blackbody controller (c) blackbody and target, (d) 94 GHz detector and (e) 250 GHz detector.

Graphic Jump Location
Fig. 11
F11 :

Images of the (a) 60-mm-diameter and (b) 100-mm-diameter targets.

Tables

Table Grahic Jump Location
Table 1SNRs of the original image and the fused image.
Table Grahic Jump Location
Table 2Information entropy of the original image and the fused image.
Table Grahic Jump Location
Table 3Spatial angular frequencies of the targets f (cyc/mrad).

References

Appleby  R., and Anderton  R. N., “Millimeter-wave and submillimeter-wave imaging for security and surveillance,” Proc. IEEE. 95, , 1683 –1690 (2007).CrossRef
Xu  J. Z., and Zhang  X. C., Terahertz Science Technology and Application. , pp. 1 ,  Peking University Press ,  Beijing, China  (2007).
Zhang  Z., and Blum  R. S., “A categorization of multiscale-decomposition-based image fusion schemes with a performance study for a digital camera application,” Proc. IEEE. 87, , 1315 –1326 (1999).CrossRef
Poh  C.  et al., “Review article multisensor image fusion in remote sensing: concepts, methods and applications,” Int. J. Remote Sens.. 9, , 823 –854 (1998).CrossRef
Pajares  G., and De La Cruz  J. M., “A wavelet-based image fusion tutorial,” Pattern Recognit.. 37, , 1855 –1872 (2004).CrossRef
Luukanen  A.  et al., “Real-time passive terahertz imaging system for standoff concealed weapons imaging,” Proc. SPIE. 7670, , 767004  (2010). 0277-786X CrossRef
Mann  C.  et al., “First demonstration of a vehicle mounted 250 GHz real time passive imager,” Proc. SPIE. 7311, , 73110Q  (2009). 0277-786X CrossRef
Lagendijk  R. L., and Biemond  J., Iterative Identification and Restoration of Images. ,  Kluwer Academic Publishers ,  The Netherlands  (1991).
Zhou  M. Y., Deconvolution and Signal Recovery. , pp 186 –188,  Nation Defense Industry Press ,  Beijing, China  (1900).
Lau  W. L.  et al., “Comparison of image data fusion techniques using entropy and INI,” in  22nd Asian Conf. on Remote Sensing ,  Singapore  (2001).
Dabov  K.  et al., “Image denoising with block-matching and 3D filtering,” Proc. SPIE. 6064, , 354  (2006).CrossRef
Dabov  K.  et al., “Image denoising by sparse 3-D transform-domain collaborative filtering,” IEEE Trans. Image Process.. 16, (8 ), 2080 –2095 (2007). 1057-7149 CrossRef
Pizer  S. M.  et al., “Contrast-limited adaptive histogram equalization: speed and effectiveness,” in  Proc. First Conf. on Visualization in Biomedical Computing , pp. 337 –345 (1990).CrossRef
Wang  Y.  et al., “Image enhancement based on equal area dualistic sub-image histogram equalization method,” IEEE Trans. Consum. Electron.. 45, , 68 –75 (1999).CrossRef
Zitová  B., and Flusser  J., “Image registration methods: a survey,” Image Vis. Comput.. 21, (11 ), 977 –1000 (2003).CrossRef
Maintz  J. B. A., and Viergever  M. A., “A survey of medical image registration,” Med. Image Anal.. 2, (1 ), 1 –36 (1998).CrossRef
Beyer  H.-G., “Toward a theory of evolution strategies: some asymptotical results from the (1, +λ)-theory,” Evol. Comput.. 1, (2 ), 165 –188 (1993).CrossRef
Arnold  D. V., and Beyer  H. G., “Local performance of the (1 + 1)-ES in a noisy environment,” IEEE Trans. Evol. Comput.. 6, , 30 –41 (2002).CrossRef
Dasarathy  B. V., “Guest editorial: special section on sensor fusion 1996,” Opt. Eng.. 35, , 601 –602 (1996).CrossRef
Mallat  S. G., “Multifrequency channel decompositions of images and wavelet models,” IEEE Trans. Acoust. Speech Signal Process.. 37, , 2091 –2110 (1990).CrossRef

Some tools below are only available to our subscribers or users with an online account.

Related Content

Customize your page view by dragging & repositioning the boxes below.

Related Book Chapters

Topic Collections

Advertisement


 

  • Don't have an account?
  • Subscribe to the SPIE Digital Library
  • Create a FREE account to sign up for Digital Library content alerts and gain access to institutional subscriptions remotely.
Access This Article
Sign in or Create a personal account to Buy this article ($20 for members, $25 for non-members).
Access This Proceeding
Sign in or Create a personal account to Buy this article ($15 for members, $18 for non-members).
Access This Chapter

Access to SPIE eBooks is limited to subscribing institutions and is not available as part of a personal subscription. Print or electronic versions of individual SPIE books may be purchased via SPIE.org.