JOURNAL OF COMPUTER SCIENCE AND ENGINEERING, VOLUME 1, ISSUE 2, JUNE 2010 7

User-centered Public Transport Departure and Arrival System using Automated Image Recognition Mohd Helmy Abd Wahab, Noor Liyana Abdul Karim, Herdawatie Abdul Kadir, Ayob Johari, Ariffin Abdul Mutalib, Rahmat Sanudin, Roslina Mohd Sidek, Noraziah Ahmad Abstract—This paper reports on an ongoing study, which solves a problem in notifying passengers about bus schedule at the bus station. This system is called Public Transport Departure and Arrival System (PTDAS), incorporating image recognition through a digital camera which is programmed with MATLAB for automated input module. It starts with analyzing a number of previous works of bus scheduling as the basis of the study. The development methodology of the PTDAS is the core of this paper which comes next together, and described at length. Some testing together with the results is discussed in the following section. This paper ends by addressing the potential implementation of the proposed system. Index Terms— Image recognition, bus scheduling, user-centered application

——————————  ——————————

1 INTRODUCTION

T

he rapid growth in the field of information and communication technology has made information dissemination become important. Notifying the passengers regarding any status is one of the functions of information dissemination. Currently, public transport passengers gather information about the travel information on printed tickets. On the tickets, passengers are provided with information including destination, time, plate number, and seat. While, additional information regarding the bus detail such as passenger capacity, delayed time, and platform change are not mentioned in the ticket but the information is available at the particular authorized counter. This scenario is different from flight departure and arrival system, in which passengers access complete information including destination, seat number, date, time, and flight on the printed ticket. In addition to the printed ticket, announcement regarding departure and arriving time are displayed at the terminal screens. This could notify passengers to be ready at particular gates in advanced before departure. This study maps the system that is provided in airports into bus station, which provides bus departure and arrival time to passengers. This system is useful to passengers to notify about the delay. The scenario is similar to the system in the airport. An added component to the pro-

posed system is that it utilizes image recognition technology. This study is carried out in a state in Malaysia, and is aimed at achieving the objectives as stated in the following section. The objective of the study is to develop a system that notifies passengers about bus departure and arrival schedule called Public Transport Departure and Arrival System. This system utilizes an image recognition module for input. Data are stored in a database. This study also tests the system in terms of functionality and display. For the purposes of this study the scope is limited to single-row character bus plate only, and tested for implementation in Johor. In addition, this paper focuses on the development and functional testing part starting with the system architecture.

2 SYSTEM ARCHITECTURE The architecture of PTDAS is provided in illustration in Figure 1. Detailed explanation is provided next.

————————————————

Corresponding Author Mohd Helmy Abd Wahab is with the Department of Computer Engineering, Universiti Tun Hussein Onn Malaysia, 86400 Batu Pahat, Johor, Malaysia. © 2010 JCSE http://sites.google.com/site/jcseuk/

8

Figure 1: Architecture of the PTDAS When a bus arrives at the terminal, a USB camera will capture the bus plate number, using image recognition technology and transmits the signals to a processor. The data at the same time is sent to the database. Further, data in the database is retrieved automatically for display on the LCD screens for passengers view. Any updated data will automatically be visible on the LCD screens no notify the passengers. There are a number of studies on bus scheduling carried out previously. Jinrong, Jilin and Taido [1] developed a smart bus station in which the system responds upon user request. The system displays bus information in real time and the bus receives a message from the host machine telling the bus that it has been called. In contrast to user request, Tanaka et al. [2] developed a system in which an identification number (ID) is assigned to every bus. The system works when a Traffic Controller (TC) receives the ID information from roadside infrared beacon. TC can monitor the speed and operation of the non-stop traveling of a bus to the next bus stop. Every direction from TC is represented in difference color and it is displayed in display unit inside the bus. Besides that, Nektarios et al. [3] developed a system which utilizes the wireless technology. The system uses radio frequency (RF) to transmit and receive the information which consists of bus schedule, timing, and routing across city to pedestrian PDA or smart phone. Meanwhile, a GPS-based system has been implemented for TCDE Director [4] project. The real-time bus arrival information is displayed on a solar power. The primary goal of this project is to inform passengers about bus arrival information in real-time. Also, Choi et al. [6] developed another project that utilizes GPS technology. This location-aware smart bus guide system was targeted for use in Seoul city. It displays bus stops on the map nearby user's current location and shows bus line information at the chosen bus stop.

In addition, a similar study has been developed by Maclean and Dailey [5]. Their system uses wireless internet service to access real-time transit information. The system notifies estimated departure times for a large transit fleet by way of internet-enabled mobile devices. WAPbased wireless communication technology was used in the project. Another, Stuart and Daniel [7] developed a system that informs about real-time transit vehicle on mobile device. The information about arrival and departure times for buses at user-selectable geographic locations within a transit region is sent to the user mobile phone. From the pervious works, every project has a special design to fulfill specific purposes. Overall, the systems were targeted to improve the current implementation in bus scheduling. To achieve the objectives listed previously, the activities as discussed in the methodology section have been performed

3

METHODOLOGY

There are five activities in developing the PTDAS, including the testing. Each activity is explained in different sections.

A. Plate Number Recognition PTDAS gets inputs from digital cameras, which capture the bus plate numbers. A module for image recognition is developed and embedded in the camera using MATLAB. For administrator view, a human-oriented interface was developed utilizing graphical user interface (GUI). In the GUI the components involved include a box for previewing live video and 2 push buttons. The push buttons are used to capture images and save image directory. Figure 2 illustrates process for capturing the image number plate bus, while Figure 3 depicts a snapshot of the GUI.

Preview live video Capture image Store image in MATLAB

Figure 2: Block diagram process in GUI below

9

Figure 5: Block diagram for preparing the input to Neural Network

C. Database Design

Figure 3: The GUI for administrator use Next, the detailed description about the image recognition follows. B.

Develop image processing using MATLAB

This phase describes the process to analyze images and recognize the plate number. This process uses image acquisition and image processing tools in MATLAB. First, images are converted into binary using threshold. In this study, small components which are less than 90 pixels were removed, leaving the characters and other components. After that, small objects were removed; this leaves only characters in the bus plate. Then this study gives horizontal motion to the images, which resulting all characters in the bus plate seen like a rectangle object. The rectangle is detected and resumed with Neural Network steps. Figure 4 illustrates the process in preparing the input to Neural Network, which is displayed in a GUI panel as shown in Figure 5. Begin

Image resizing

Testing character connection

Remove unnecessary components

End

Generating results (complete bus plate)

Test the neural network

Input in neural network

Microsoft Access 2003 is used for the database. The logical and physical parts of the database are represented in different entity relationship diagrams (ERD). ERD (logical) contains identified elements in every component in company, bus, and destinations; while, the ERD (physical) relates among company, bus, and destination. Between company and bus there is 1 to many, in which a company can explore more than 1 bus in some situation; while, bus and destination has many to many relationship, in which 1 bus can also go to more than 1 destination. Both ERDs are illustrated in Figure 6.

(i) ERD (logical)

(ii) ERD (physical)

Figure 4: Block diagram for preparing the input to Neural Network

Figure 6: ERD (logical) and ERD (physical) block diagrams

Having designed and developed the image recognition module and database, the PTDAS could be developed, integrating the two modules.

10

D. Development of PTDAS There are two displays in PTDAS, at the administrator’s machine, and on LCD screen, which is automatically updated every 5 seconds. In Figure 7 flow of process is illustrated. The prototype is developed using Visual Basic 6.0.

Start (Input plate number) Change password

Login

Edit Bus Information

General Display End

Figure 7: Functional model of PTDAS The prototype has been tested part by part including its compression. There are four modules visible to the users; (1) capturing bus plate number, (2) recognizing image, (3) converting the plate number into text file, and finally (4) running the system to appear the information. Figure 8 illustrates all the four modules in the prototype.

Capture Plate Number

This section is divided into 2 different categories i.e. plate number detection, and arrival and departure display.

A. Plate number detection Plate number detection is one of the most important to ensure the system works properly. There are three issues need to be considered during image capture. a)

Distance

The distance of camera and the plate number must be in range between 2 to 4 meters. Images taken within this range reflect are clear enough and easy to recognize. Table 1 differentiates results the output taken within or without distance. Figure 9 illustrates an image taken within arrange 2 to 4 meters. In this specification the result is exactly same with the bus plate number while Figure 10 depicts an image taken out of the range specified. The result of Figure 11 will be either “System can’t detect plate number”, or “not enough input argument”. Table 1: Analysis for distance

Criteria Distance Image Format Dimension Type of camera: Digital Camera Location Output

2-4 meters 3 meters JPEG 640X480

> 4 meters 7 meters JPEG 640X480

2 Mega pixel

2 Mega pixel

BP Bus terminal Ok

BP Bus terminal Error

Recognize Plate Number Convert To Text File Run the System

Figure 8: Integrated modules in PTDAS E.

Test

Figure 9: Image in distance 2-4 meters

The tests were carried out iteratively. Each step was tested. However this paper focuses to describe about the test at the end of the study, which was to ensure the PTDAS can serve the purpose. The procedure and results of the tests are described in the following section.

4

TEST AND RESULTS Figure 10: Images in distance over 4 meters

11

b) Lighting conditions Lighting condition plays an important role to ensure the image taken is clear. In accordance, the type of the camera used determines the quality of images. An image was taken using digital camera with high resolution and the image was found clearer than those of web camera. Figure 11 (i) and (ii) depict the differences of the images.

(i) Image in dimension 640X480 pixels

(i) Image from a digital camera

(ii) Images in dimensions 3056X2292 Figure 11: Samples of images in different dimensions

B. Arrival and Departure Display

(ii) Image from a PC camera Figure 11: Images from digital camera and PC camera

c)

Dimension of captured image

The image dimension is also important. In this study, this could lead to an error and produce undesired output. Table 2 lists the results the images taken. Figure 11(i) shows an image taken using right dimension 640X480 pixels while Figure 11(ii) shows an image taken out of the dimension specification (i.e. 3056X2292 pixels). The result of (i) was “OK” and (ii) was “not enough input argument”. Table 2: Different dimension and the output Criteria 640X480 Other Angle of camera Directly to bus Directly to bus plate (180º) plate (180º) Distance 2-4 meters 2-4 meters Image Format JPEG JPEG Type of camera: 2 Mega pixel 2 Mega pixel Camera Digital Location UTHM Bus UTHM Bus terterminal minal Output Ok Error

Each image captured by the camera was processed by the recognition system and was stored in the database in the form of a text file. Thus the arrival and departure system use the text file, loading the plate number into the system to be used by the administrator to display the next destination on the LCD screens. Three aspects are discussed in this paper with regards to security features. The system needs to be tested on several criteria, as discussed in the following.

a) Authentication As a safety protection, PTDAS allows only authorized administrator to access into the system. The administrator is provided with an id and a password, which is input into the input fields as indicated in Figure 12.

Figure 12: Authentication window

12

b) Error handler Figure 13 illustrates a shot for “insert plate number” form. The result after recognizing the plate number and the plate number will be forward to the database as shown in Figure 14. To end using the system just click exit button. Table 3 lists the results for the “insert plate number” form. If number at the free box is uncompleted or wrongly inserted, appropriate error messages will be displayed telling correct action should have been performed.

ing alphabets and numbers. If different format of search is input, PTDAS will display an error. In addition, specific for “Add Form”, PTDAS will detect error also if the form is not fully filled. Table 4: Test of conditions with result

Input

Characters

Bilangan_Tempat Duduk Jenis Bas

No_Plat_Bas

Add

Results

30-44 50 If < 30 or > 44 Single Double JLD877 877 JLD 877JLD Full form Empty

Ok Ok Error Ok Ok Ok Error Error Error Ok Error

Figure 13: Form insert input number plate from text file Table 3: Result for module test

Input

Respond

JLD877 877 JLD 77JLD

Ok Error Error Error

The administrators can choose either to display the schedule or to access more information about a particular bus and update the information as seen in Table 4 and Figure 15.

Figure 15: Bus Information Figure 16 illustrates the bus schedule. The administrators can add information related with the bus destination.

Figure15 : Main Menu

Figure 16: Bus scheduling system Figure 14: Input for plate number. Table 4 displays the errors of some conditional tests. PTDAS caters for busses with seats between 30 and 50. Errors will be the results for searches for seat number out of the limit. In addition, single and double-decker busses are catered, so any search for the type will be fine. Currently, the plate number must be inserted in full, contain-

c)

Information displayed

The last form will be the display of the bus schedule on LCD screens. The schedule contains information including the destination, bus plate number, platform, departure time, and date. Samples of displays on administrators’ machine and LCD screens are provided in Figure 17.

13

munications, Networking and Mobile Computing, WiCOM ’07, 21-25 September 2007,Beijing, Chine. pp. 5488-5491. [7] Christian Bucanac. (1999). “ The V-Model”. Availbale:http://www.bucanac.com/documents/The_VModel.pdf. (Retreived: 11 March 2009).

(i) Display for the administrator

Mohd Helmy Abd Wahab is with Department of Computer Engineering, Faculty of Electrical and Electronic Engineering, Universiti Tun Hussein Onn Malaysia (UTHM). He obtained a bachelor in information technology at Universiti Utara Malaysia and Master of Science in Intelligent System from the same University in 2002 and 2004 respectively. He has published more than 100 papers in various international conferences and journals. He has interest in intelligent system and mobile computing. He is a member of IEEE and International Association of Engineers (IAENg Noor Liyana Abdul Karim is an undergraduate student in electrical and electronic engineering at Universiti Tun Hussein Onn Malaysia in area of Communication Engineering.

(ii) Display on LCD screens updated every 5 seconds Figure 17: Information display on screens

4

CONCLUSION

This paper reports on an ongoing study on the development of an automated bus scheduling system specifically in the departure and arrival information. Digital camera, MATLAB, Ms Access, and Visual Basic were used in developing the system. This pilot project has shown potential advantages. It can help passengers in always being updated about the bus schedule in the bus station. Large bus stations can benefit most from this system because it helps passengers being notified for any delay of change of information such as bus platform

REFERENCES [1] Jinrong, J., Yilin, Z. and Taida, L. (2007). “Smart Bus Station Sign”. Nios II Embedded Processor Design Contest Outstanding Designs 2007. Available:http://www.altera.com/literature/dc/2007/t3a.pdf. (Retrieved:17 February 2009). [2] Tanaka, R., Takeuchi, K., Masuyama, Y. and Maeoka, A. “Trial Operation of A New Public Transportation Priority System Using Infrared Beacons For Two-Way Communication”. Available: http:// www.utms.or.jp/japanese/inter/paper/paper01.pdf. (Retrieved:17 February 2009). [3] TERP Synthesis 48 . “Real-Time Bus Arrival Information Systems”. Available:http://onlinepubs.trb.org/Onlinepubs/tcrp/tcrp_syn_48c7.pdf. (Retrieved: 2 April 2009). [4] Hyun Lim Soon,Y.P., Seong, J.K and Wan,H.C. (2003). “FPGA implementation of image watermarking algorithm for a digital camera”. IEEE Pacific Rim Conference Communications, Computers and signal Processing, PACRIM on 28-30 Aug. 2003. Vol2, pp. 1000- 1003. [5] Awtar, S., Siti Zarina, Chessda, U., Lee, C.K., Mohd Hakimi, Mohd Shamian, Herdawati dan Siti Idruza. (2008). “Microprocessor & Microcontroller”. 1st Universiti Tun Hussein Onn Malaysia. [6] Huang, Z. dan Liu, X. (2007). “ Designing Guidable Bus Transit Database for Chinese Cities”. International Conference on Wireless com-

Herdawatie Abdul Kadir received the B.Eng and M.Eng degree in Electrical and Electronic Engineering from Universiti Teknologi Malaysia in 2001 and 2005. She is currently a lecturer at Universiti Tun Hussein Onn Malaysia. Her current research interests include realtime nonlinear control and integrated design of mechatronic systems. Ariffin Abdul Mutalib has obtained a bachelor degree in Information Technology (IT) from Universiti Utara Malaysia (UUM) in 1999. He then continued his study at master level in Heriot-Watt University, Scotland. He finished his Master in Interactive Multimedia study in a year (2001). With those qualifications, he teaches at the Faculty of IT, Universiti Utara Malaysia as a lecturer until current. His research interests are in area of Web Application, HCI, IT, and Multimedia. Rahmat Sanudin received the B. Eng degree from Universiti Tenaga Nasional and M. Eng degree from Universiti Tekonologi Malaysia in 2001 and 2006 respectively, both in electrical and electronic engineering. He is a member of Faculty of Electrical and Electronic Engineering, Universiti Tun Hussein Onn Malaysia since 2006. Prior to current post, he was an R&D engineer in JVC Electronics (M) from 2001 to 2003. His research interests include digital IC design and semiconductor device. Roslina Mohd Sidek is with Department of Software Engineering, Faculty of Computer Systems & Software Engineering, Universiti Malaysia Pahang (UMP). She obtained a bachelor in Computer Science at Universiti Teknologi Malaysia in 1998 and Master of Science in Software Engineering from tUniversiti Putra Malaysia in 2005. She has published papers in various international conferences and journals. She has interest in formal specification and any issues related to quality software. She is a member of an International Association of Engineers (IAENG). Contact her at [email protected] Ayob Johari is a Professor at Department of Communication Engineering, Universiti Tun Hussein Onn Malaysia and he received Bachelor in Electrical and Electronic Engineering from University of Aberdeen, Scotland, UK and master in Electronic Coomunication from University of Cardiff, UK in 1981 and 1987 respectively. He is currently a member of IET his research interest in communication engineering and mobile computing. Noraziah Ahmad received Ph.D in Database from University Malaysia Terengganu (UMT) in 2007. She has published more than 80 papers in the journals and conference proceedings. Currently, she is the Senior Lecturer at Faculty of Computer Systems & Software Engineering, University Malaysia Pahang. In addition to serving as international program committee member and reviewers in many conferences, she is currently an editorial board members of the International Journal of Engineering and Technology (IJET), Interna-

14

tional Journal of Web Application (IJWA); a member of IEEE Computer Society, International Association of Engineers (IAENG), World Academy of Science Engineering and Technology (WASET), Malaysian National Computer Confederation (MNCC) and Senior member of International Association of Computer Science and Information Technology (IACSIT). She is also an advisory board of The Society of Digital Informatics and Wireless Communications (SDIWC). Her current research interests include distributed database systems, distributed systems, data grid, knowledge management infrastructures and biofeedback.