Today’s mobile phones do not allow for fast input of data found on physical objects. The user must manually key in information, which is a tedious process. Furthermore, it is not possible to get the user to enter binary data - binary data that can translate to active content like games and so forth. However, newer mobile phones include a camera. This camera is able to output images, which can subsequently be analyzed automatically. SINTEF developed in 2001 a system that allowed hundreds of 8-bit bytes to be input into the camera, using a single user-captured image as input.

The system is based on using a specially crafted two-dimensional barcode, which is printed on the desired objects. The image analysis software developed by SINTEF recognizes this barcode, and its content is subsequently input to the mobile phone. This makes it possible for the user to e.g. scan a business card with a printed barcode, and get the information automatically into his contact list. The system thus enhances the user’s mobile experience by making the mobile phone able to interact with physical objects in the “real” world.

Special care had to be taken to ensure that the barcode could be correctly decoded even in the presence of dust, inkblots and scratches, and to cope with the effects cheap cameras present. The system was implemented on a PDA for demonstration purposes, and captures images, decodes them and presents the result to the user.

We view this camera-based system as a first demonstration of how mobile phones' cameras can be used for doing actual analysis of the captured images.This SINTEF-developed solution combines advanced sensor signal analysis with mobile solution development, and can thus extend the use of mobile phones, and open up for new context-sensitive mobile services.

Read more about other bar code projects SINTEF has been involved in.

For further information please contact Jens T Thielemann.

User capturing a code found on a CD cover.

Screen shot of application