Digital Image Processing

What is Image Processing? z

z

Image processing is a subclass of signal processing concerned specifically with pictures. Improve image quality for human perception and/or computer interpretation. Image

Image Processing

Better Image

1

Several fields deal with images z z

z

Computer Graphics : the creation of images. Image Processing : the enhancement or other manipulation of the image – the result of which is usually another images. Computer Vision: the analysis of image content.

Several fields deal with images Input/output

Image

Description

Image

Image Processing

Computer Vision

Description

Computer Graphics

AI

Computer vision, image processing and computer graphics often work together to produce amazing results

2

2 Principal application areas 1. Improvement of pictorial information for human interpretation 2. Processing of image data for storage, transmission, and representation for autonomous machine perception

Ex. of fields that use DIP z

Categorize by image sources 9Radiation from the Electromagnetic spectrum 9Acoustic 9Ultrasonic 9Electronic (in the form of electron beams used in electron microscopy) 9Computer (synthetic images used for modeling and visualization)

3

Radiation from EM spectrum

z

z

EM waves = a stream of massless (proton) particles, each traveling in a wavelike pattern and moving at the speed of light. Spectral bands are grouped by energy per photon 9 Gamma rays, X-rays, Ultraviolet, Visible, Infrared, Microwaves, Radio waves

Gamma-Ray Imaging z

Nuclear Image 9 (a) Bone scan 9 (b) PET (Positron emission tomography) image

z

Astronomical Observations. 9 (c) Cygnus Loop

z

Nuclear Reaction 9 (d) Gamma radiation from a reactor valve

4

X-ray Imaging z

Medical diagnostics 9 (a) chest X-ray (familiar) 9 (b) aortic angiogram 9 (c) head CT

z

Industrial imaging 9 (d) Circuit board

z

Astronomy 9 (e) Cygnus Loop

Imaging in Ultraviolet Band z z z

Lithography Industrial inspection Microscopy (fluorescence) 9 (a) Normal corn 9 (b) Smut corn

z z z

Lasers Biological imaging Astronomical observations 9 (c) Cygnus Loop

5

Imaging in Visible and Infrared Bands z z

Astronomy Light microscopy (pharmaceutical) 9 (a) taxol (anticancer agent) 9 (b) cholesterol

z

Microinspection to materials characterization 9 9 9 9

(c) Microprocessor (d) Nickel oxide thin film (e) Surface of audio CD (f ) Organic superconductor

6

Remote sensing : Weather observation and prediction Multispectral image of Hurricane Andrew from satellites using sensors in the visible and infrared bands

7

Industry : visual spectrum

(automated visual inspection of manufactured goods) z z z

z

z

z

(a). A circuit board: inspect them for missing parts (b) Pill container: look for missing pills (c) Bottles : look for bottles that are not filled up to an acceptable level (d) Bubbles in clear-plastic product : detect unacceptable number of air pockets (e) Cereal : inspection for color and the presence of anomalies such as burned flake. (f) Image of replacement lens for human eye : inspection of damaged or incorrectly manufactured implants

Law enforcement : visual spectrum z

z

z

(a). Thumb print: automated search of a database for a potential matches (b). Paper currency : automated counting / reading of the serial number for tracking and identifying bills (c) and (d) Automated license plate reading

8

Imaging in Microwave Band z

z z

Imaging radar : the only way to explore inaccessible regions of the Earth’s surface Radar image of mountains in southeast Tibet Note the clarity and detail of the image, unencumbered by clouds or other atmospheric conditions that normally interfere with images in the visual band.

Imaging in Radio Band z

Medicine 9Magnetic resonance image (MRI) : 2D picture of a section of the patient (any plane): (a) knee (b) spine

z

Astronomy

9

Acoustic Imaging z

Geological applications : use sound in the low end of the sound spectrum (hundred of Hz) 9 Mineral and oil exploration

Cross-sectional image of a seismic model. The arrow points to a hydrocarbon (oil and/or gas) trap (bright spots)

Ultrasound Imaging z z

Manufacturing Medicine 9(a) Baby 9(b) Another view of baby 9(c) Thyroids 9(d) Muscle layers showing lesion

10

Generated images by Computer z

Fractals : an iterative reproduction of a basic pattern according to some mathematical rules 9 (a) and (b)

z

3-D computer modeling 9 (c) and (d)

3 types of computerized process z

Low-level : input, output are images 9 Primitive operations such as image preprocessing to reduce noise, contrast enhancement, and image sharpening

z

Mid-level : inputs may be images, outputs are attributes extracted from those images 9 Segmentation 9 Description of objects 9 Classification of individual objects

z

High-level : 9 Image analysis

11

Fundamental steps

Domain problem

Image Acquisition z

z

An image is captured by a sensor (such as a monochrome or color TV camera) and digitized. If the output of the camera or sensor is not already in digital form, an analogtodigital converter digitizes it.

12

Camera z

Camera consists of 2 parts 9 A lens that collects the appropriate type of radiation emitted from the object of interest and that forms an image of the real object 9 a semiconductor device – so called charged coupled device or CCD which converts the irradiance at the image plan into an electrical signal.

Frame Grabber z

Frame grabber only needs circuits to digitize the electrical signal from the imaging sensor to store the image in the memory (RAM) of the computer.

13

Image Enhancement z

To bring out detail is obscured, or simply to highlight certain features of interest in an image.

Image Restoration z z

Improving the appearance of an image Tend to be based on mathematical or probabilistic models of image degradation

Distorted Image

Restored Image

14

Color Image Processing z

z

Gaining in importance because of the significant increase in the use of digital images over the Internet However, our lecture is limited to graylevel image processing

Wavelets z

z

Foundation for representing images in various degrees of resolution. Used in image data compression and pyramidal representation (images are subdivided successively into smaller regions)

15

Compression z

z

Reducing the storage required to save an image or the bandwidth required to transmit it. Ex. JPEG (Joint Photographic Experts Group) image compression standard.

Morphological processing z

Tools for extracting image components that are useful in the representation and description of shape.

16

Image Segmentation z

z z

z

computer tries to separate objects separate objects from the image background from the image background. It is one of the most difficult tasks in DIP. A rugged segmentation procedure brings the process a long way toward successful solution of an image problem. Output of the segmentation stage is raw pixel data, constituting either the boundary of a region or all the points in the region itself.

Representation & Description z

z

z

Representation make a decision whether the data should be represented as a boundary or as a complete region. Boundary representation focus on external shape characteristics, such as corners and inflections.` Region representation focus on internal properties, such as texture or skeleton shape.

17

Representation & Description Representation + Description transform raw data Connected component 1 hole

Connected component 2 holes

a form suitable for the Recognition processing

Recognition & Interpretation z

z

Recognition the process that assigns a label to an object based on the information provided by its descriptors. Interpretation assigning meaning to an ensemble of recognized objects.

18

Knowledge base z

z

a problem domain detailing regions of an image where the information of interest is known to be located. Help to limit the search

Not all the processes are Needed. Ex. Postal Code Problem

19