DE102007048987A1 - Mobile telephone and operating method therefor, as well as data processing network for mobile phones and operating methods for such a data processing network - Google Patents

Abstract

The present invention relates to a mobile telephone having moving picture recording means, memory means and data processing means adapted to record and store moving picture sequences, the data processing means being a) from a moving picture sequence of a bar code of a product or a service by analyzing the moving picture sequence using histogram B) use the barcode to make or obtain an identification of the associated product or service; and c) by means of the identification of the product or service, price information on the product or service of at least one supplier of the product or service. Furthermore, the invention relates to a corresponding operating method for such a mobile telephone. Furthermore, the invention relates to a data processing network for such mobile telephones and to central data processing devices, the central data processing devices containing and being designed to price information about the product or service of at least one provider of the product or service based on the identification of the product or service be determined and transmitted to the mobile phone. In addition, the invention also relates to ...

Description

The The present invention relates to mobile phones according to the preamble of claim 1 and method of operation therefor as well as data processing networks for mobile phones and operating procedures for such Data processing network according to the generic terms the corresponding independent claims.

nowadays Mobile phones are equipped with a variety of functions, the access to the user of the mobile phone among others allow different data. In particular, are out In practice, mobile phones have become known that have Internet access provide. With such a mobile phone, the user, when making purchases in real stores wants to, for the products that interest him, more information and in particular to receive prices from other providers while on the move, and he can even go online with suitable providers on the internet products order or book services, for example, if the products there or benefits are cheaper than in the business in which the mobile phone user has just received the award.

at Such devices and procedures is disadvantageous in that it only the option gives the product or the power over to identify a designation entered by the keyboard and a corresponding search routine generally on the Internet or in certain Search engines perform. This holds, among other things, firstly the danger that not really identical products or services compared with each other, so that no true price comparison or the result of the product / performance comparison just is wrong. Also is a corresponding search in the shop in the designed for desktop PCs and notebooks Internet right elaborate and impractical and therefore not on site or not with feasible results feasible. Sometimes there is identically named products, such as cameras, computers but also household appliances, which have different specifications and services. Second, only providers that have one are considered Third, only one purchase with shipping is possible, which has the disadvantage that immediately needed products and services are not available in this way.

From the US 2005/0011957 A1 For example, a system and method for decoding and analyzing barcodes using a mobile phone is known. Thus, the disadvantage can be remedied that a product identification for the search is possible only by means of a keyboard input and thereby disregard any product differences. To "translate" the barcode, this system and method requires a relational database maintained in an external server, from which the product data is sent to the mobile phone, which in turn is available to a search engine. This preserves the remaining previously explained disadvantages.

It is an object of the present invention, devices and methods to create a consumer while shopping mobile while finding cheapest Support prices and providers.

This The aim is with a mobile phone according to claim 1 and one and Data processing network therefor according to claim 32 and a Operating method for such a mobile phone after the Claim 17 and an operating method for a corresponding Data processing network according to claim 41 achieved.

• – aus einer Bewegtbildsequenz eines Strichcodes eines Produktes oder einer Dienstleistung durch Analyse der Bewegtbildsequenz unter Verwendung von Histogramm-Funktionen ein Einzelbild von dem Strichcode zu erstellen,
• – anhand des Strichcodes eine Identifizierung des zugehörigen Produktes oder der zugehörigen Dienstleistung durchzuführen oder zu beschaffen, und
• – mittels der Identifizierung des Produktes oder der Dienstleistung Preisinformationen zu dem Produkt oder der Dienstleistung von wenigstens einem Anbieter des Produktes oder der Dienstleistung zu beschaffen.

According to the invention, there is thus provided a mobile telephone comprising moving picture recording means, memory means and data processing means adapted to record and store moving picture sequences, the data processing means being arranged

• To create a frame from the bar code from a moving picture sequence of a bar code of a product or service by analyzing the moving picture sequence using histogram functions;
• - Carry out or obtain an identification of the associated product or service from the barcode, and
• - by means of the identification of the product or service, to obtain pricing information on the product or service from at least one supplier of the product or service.

Preferably can be further provided that the data processing facilities designed are the analysis of the moving picture sequence using histogram functions and / or creating the frame of the barcode in real time during perform the recording of the moving picture sequence, or that the data processing devices are designed, the analysis the motion picture sequence using histogram functions and / or the creation of the frame from the bar code to a perform in the memory devices stored moving picture sequence.

A Another preferred embodiment is that the alignment auxiliary equipment are provided to help the user and the location to give the detection of the bar code.

Further it is preferred if the moving picture recording devices are designed for recording color image motion picture sequences, and that conversion means for a conversion of Color image motion picture sequence into a grayscale moving picture sequence are included.

Yet another preferably further development is that further Setting means for adjusting the moving picture recording means are included in the prevailing ambient light, in particular for optimizing the recording of a motion picture sequence in terms of brightness and / or contrast.

• – eine linienbasierte Analyse von Hintergrundmaterial, insbesondere hinter eingeblendeten Scan-Linien, und/oder
• – ein Nachschärfen eines Scan-Linien-Bereiches, und/oder
• – eine Generierung von Unschärfemasken zur Kantenfindung in einem Scan-Linien-Bereich, und/oder
• – eine Drehung eines Scan-Linien-Bereiches zur Kantenfindung.

It is also preferred if the data processing devices are designed to perform image enhancement measures for image optimization, in particular in the context of the analysis of the moving image sequence

• A line-based analysis of background material, in particular behind displayed scan lines, and / or
• - Re-sharpening a scan line area, and / or
• A generation of blur masks for edge finding in a scan line area, and / or
• A rotation of a scan line area for edge detection.

Especially the data processing devices can be designed in the frame the analysis of the moving picture sequence an analysis of the pixels behind Scan lines for generating a weighted result within the scan lines to make a distortion of the frame from the barcode to check. It can preferably continue be provided that the data processing equipment designed are, upon detection of a distortion of the frame of the Barcode to move the scan lines or lines horizontally, until equally weighted results are obtained.

Farther a preferred embodiment is that the data processing devices are designed to perform a decoding of the bar code, especially Code 39, Code 39 Full ASCII, Code 128, DataMatrix, EAN-8, EAN-13, ISBN, Interleave 2 of 5, JAN-8, JAN-13, Optical Intelligence 2D, PDF417, QR, RSS-14, RSS-14E, RSS-14L, UPC-A, UPC-E, and that Preferably, the data processing devices are further designed are to carry out a validation of the determined code.

It may also be provided with preference that voice input devices are provided and the data processing means for speech recognition are designed to capture number codes and / or product names and from this an identification of the associated product or to perform the associated service or to get.

A Another preferred embodiment is that the data processing devices designed for character recognition in a single frame, the one of a moving picture sequence has been obtained for number codes and / or Enter product names and from this an identification of the associated Product or associated service or to obtain.

at Another preferred embodiment provides that location information determination devices and / or facilities for obtaining location information are included, and that the data processing equipment designed are, with the inclusion of location information pricing information to the product or service of at least one supplier of the Procure product or service.

Especially the data processing devices can be designed to get pricing information about the product or service from at least to procure two suppliers of the product or service. In this case, further display devices may contain and the data processing devices are designed to provide price information to the product or service of at least two suppliers of the product or service via the display devices display. Alternatively or additionally Input and / or selection means to be included in order to the pricing information on the product or service of at least two providers of the product or service at least one additional function, in particular concerning information to the product or service, ordering the product or service or purchase of the product or service.

• – aus einer Bewegtbildsequenz eines Strichcodes eines Produktes oder einer Dienstleistung durch Analyse der Bewegtbildsequenz unter Verwendung von Histogramm-Funktionen ein Einzelbild von dem Strichcode erstellt wird,
• – anhand des Strichcodes eine Identifizierung des zugehörigen Produktes oder der zugehörigen Dienstleistung durchgeführt oder beschafft wird, und
• – mittels der Identifizierung des Produktes oder der Dienstleistung Preisinformationen zu dem Produkt oder der Dienstleistung von wenigstens einem Anbieter des Produktes oder der Dienstleistung beschafft werden.

The object according to the invention is also achieved by an operating method for a mobile telephone, with moving picture recording devices, memory devices and data processing devices, which are designed for recording and storing moving picture sequences, wherein by means of the data processing devices

• A frame of the bar code is created from a moving picture sequence of a bar code of a product or service by analyzing the moving picture sequence using histogram functions,
• - Using the bar code identification of the associated product or service is performed or procured, and
• By means of the identification of the product or the service, obtain price information on the product or service from at least one supplier of the product or service.

In Training thereof may be provided with preference that means the data processing means under the analysis of the moving picture sequence Use of histogram functions and / or the creation of the Single frame of the barcode in real time during the Recording the moving picture sequence is performed. alternative it is preferred if by means of the data processing means the analysis of the moving picture sequence using histogram functions and / or the creation of the single image from the barcode from an in the memory devices stored moving image sequence takes place.

Yet Another preferred development is that with the Motion picture recording devices Color picture moving picture sequences be recorded, and that by means of conversion facilities converted a color picture moving picture sequence into a gray scale moving picture sequence becomes.

Further For example, it is preferable if a setting of the moving picture recording devices takes place on the prevailing ambient light, in particular for Optimizing the recording of a moving picture sequence in terms of Brightness and / or contrast.

• – eine linienbasierte Analyse von Hintergrundmaterial, insbesondere hinter eingeblendeten Scan-Linien, und/oder
• – ein Nachschärfen eines Scan-Linien-Bereiches, und/oder
• – eine Generierung von Unschärfemasken zur Kantenfindung in einem Scan-Linien-Bereich, und/oder
• – eine Drehung eines Scan-Linien-Bereiches zur Kantenfindung.

It can furthermore be provided with preference that image processing measures are carried out by means of the data processing devices for image optimization, in particular within the framework of the analysis of the moving image sequence

• A line-based analysis of background material, in particular behind displayed scan lines, and / or
• - Re-sharpening a scan line area, and / or
• A generation of blur masks for edge finding in a scan line area, and / or
• A rotation of a scan line area for edge detection.

Especially can by means of the data processing facilities in the context of the analysis the motion picture sequence an analysis of the pixels behind scan lines to generate a weighted result within the scan lines done to a distortion of the frame of the barcode to check. In further development of this can preferably be provided that by means of the data processing equipment upon detecting a distortion of the frame from the bar code move the scan lines or lines horizontally until they are equally weighted Results are obtained.

at In another preferred embodiment, by means of the data processing means a decoding of the bar code are executed, in particular according to Code39, Code 39 Full ASCII, Code 128, DataMatrix, EAN-8, EAN-13, ISBN, Interleave 2 of 5, JAN-8, JAN-13, Optical Intelligence 2D, PDF417, QR, RSS-14, RSS-14E, RSS-14L, UPC-A, UPC-E, and will continue preferably further by means of the data processing devices a validation of the determined code is performed.

It may also be provided with preference that means Speech input devices and designed for speech recognition data processing equipment Number codes and / or product names are recorded and from this a Identification of the associated product or its associated Service is performed or procured.

Especially can by means of the data processing means a character recognition take place in a single frame, the one from a moving picture sequence was obtained to capture number codes and / or product names and from this an identification of the associated product or to perform the associated service or to get.

Yet Another preferred development is that location information by means of location information determination devices and / or Facilities for obtaining location information obtained and that by means of the data processing facilities under Inclusion of location information pricing information to the Product or service of at least one supplier of the Procured product or service.

Furthermore, it can be provided with preference that price information about the product or the service of at least two providers of the product or the service is procured by means of the data processing devices. In this case, provision may in particular also be made for price information on the product or the service of at least two providers of the product or the service to be displayed on display devices by means of the data processing devices. Alternatively or additionally, a further development is preferably possible by means of input and / or selection means based on the price information on the product or service of at least two suppliers of the product or service at least one more function in particular information on the product or service, ordering the product or service or purchase of the product or service performed becomes.

Further becomes the object of the invention with a data processing network for mobile phones, in particular as described above in preferred and advantageous embodiments are given, and with central Data processing facilities achieved, the central data processing facilities Provider price database facilities are included and designed to based on the identification of the product or service Price information about the product or service of at least to identify a supplier of the product or service and to the mobile phone.

In Further development of this can be provided with preference that the central Data processing facilities are designed based on the one of Mobile phone transmitted barcodes an identification of the associated product or the associated hearing aid Service and return to the mobile phone to convey. Alternatively or additionally it prefers when the provider price database facilities designed are based on the identification of the product or service Price information about the product or service of at least to identify two suppliers of the product or service and to the mobile phone.

Yet another preferred embodiment is that the central Data processing facilities are designed location information of a mobile phone and to the provider price database facilities to convey. It can be provided with preference further be that the central data processing equipment designed are based on the identification of the product or service Price information about the product or service of the Provider of the product or service to determine where the mobile phone according to the location information and automatically to the mobile phone.

A Another preferred embodiment is obtained by the fact that the central data processing facilities product information database facilities are included and designed based on the identification of the product or service product information about the product or the service of at least one supplier of the product or the service and transmit it to the mobile phone.

at yet another preferred development may be provided that the central data processing devices are designed various individual databases and systems from different providers and possibly with their own formats to get. In particular, the central Data processing equipment contain processing equipment, those from the various individual databases and systems from different suppliers and possibly each own formats a database abstract for a compilation, Evaluation and transmission of price information and / or If necessary, product information in a single format and system, which Database abstract directly or indirectly for transmission the mobile phone is used.

Furthermore can be further developed to the effect that the central Data processing facilities are designed to make a reservation or a check for a product or service under automatic assignment to the user of the mobile phone.

The The aim of the invention is also achieved by an operating method for a data processing network, in particular as described in above preferred and advantageous embodiments is given, wherein by means of provider price database facilities of the central data processing facilities the identification of the product or service pricing information to the product or service of at least one supplier of the product or service and transmitted to the mobile phone become.

A preferred development is that by means of the central Data processing devices based on the transmitted from a mobile phone Barcodes an identification of the associated product or the associated service and to the Mobile phone is transmitted back. alternative or additionally may be provided with preference by means of provider price database facilities based on the identification of the Product or service Price information about the product or the service of at least two suppliers of the product or service and transmitted to the mobile phone become.

Still another preferred embodiment provides that location information of a mobile telephone is determined by means of the central data processing devices and transmitted to the provider price database facilities. Insbeson Furthermore, by means of the central data processing devices on the basis of the identification of the product or the service, price information on the product or service can be determined by the provider of the product or service, where the mobile phone is according to the location information, and automatically transmitted to the mobile phone become.

It is also preferred when using means in the central data processing facilities contained product information database facilities based on the Identification of the product or service Product information to the product or service of at least one supplier of the product or service and transmitted to the mobile phone become.

at a further preferred embodiment can be provided that by means of the central data processing means of various individual databases and systems of different Providers and possibly with their own formats are procured. In this case, it can also be provided in particular that by means of in processing facilities contained in the central data processing facilities the various individual databases and systems from different providers and possibly with their own formats a database abstract for a compilation, evaluation and transmission of pricing information and / or product information, if applicable is created in a single format and system, which database abstract directly or indirectly for transmission to the mobile phone serves.

Yet Another preferably further development is that by means of the central data processing facilities a reservation or a check for a product or service executed under automatic assignment to the user of the mobile phone becomes.

Further preferred and / or advantageous embodiments of the invention and their individual aspects emerge from the claims and their combinations as well as the entire application documents.

The Invention will become apparent from exemplary embodiments below with reference to the drawing, by way of example only explained in the

1 FIG. 2 shows a schematic view of an initial procedure of a method according to the invention for operating a mobile telephone and a data processing network in order to assist a consumer in the most favorable acquisition of a product,

2 in a schematic view to the procedure of 1 subsequent process of obtaining favorable prices for the product,

3 in a schematic view, a continuation of the procedure according to the 2 to provide consumer action alternatives,

4 in a schematic view a representation on the display of the mobile phone at the start of the procedure according to the 1 shows,

5 in a schematic view a representation on the display of the mobile phone as a result of the method according to the 2 shows

6 in a schematic view, a continuation of the procedure according to the 3 represents a first action alternative,

7 in a schematic view a representation on the display of the mobile phone as a result of the action alternative according to the 6 shows,

8th in a schematic view, a continuation of the procedure according to the 3 represents a second action alternative,

9 in a schematic view a representation on the display of the mobile phone as a result of the action alternative according to the 8th shows,

10 in a schematic view, a continuation of the procedure according to the 3 represents a third alternative action,

11 in a schematic view a representation on the display of the mobile phone as a result of the action alternative according to the 10 shows,

12 schematically illustrates a first measure for using a moving image of a bar code,

13 schematically illustrates a second measure for using a moving image of a barcode,

14 schematically illustrates a characteristic of a moving image of a bar code used in accordance with the invention,

15 schematically a third measure to use a moving image of a bar code shows

16 schematically illustrates a fourth measure for using a moving image of a barcode,

17 schematically illustrates a fifth measure for using a moving image of a bar code,

18 schematically illustrates a sixth measure for using a moving image of a bar code, and

19 schematically illustrates the inventive result of the use of a moving image of a bar code.

Based described below and illustrated in the drawings Exemplary embodiments and applications of the invention merely explained in more detail by way of example, d. H. it is not on these examples of implementation and application or to the combinations of features within this execution and application examples limited. Process and device features arise analogously also from device or process descriptions.

Separate Features that are related to a specific embodiment indicate and / or represented are not on this embodiment or the combination with the other features of this embodiment limited, but may, within the limits of what is technically possible, with any other variants, even if they are in the present Documents are not treated separately.

Same Reference signs in the individual figures and figures of the drawing denote the same or similar or the same or similar acting components. Based on the illustrations in the drawing Such features are also clear, not with reference numerals regardless of whether such features are described below are or not. On the other hand, features that are present in the present Description included but not visible in the drawing or are readily understandable to one skilled in the art.

One essential part of an inventive Mobile phones is the capture of a product / article with it. The detection takes place within the scope of the invention Optically, mobile phones through an integrated camera, with the one to the product / article associated bar code is detected. Alternatively, in other aspects of the invention, the detection of a product / article also by entering the below the barcode directly to the product / article printed article number the numeric keypad of a mobile phone. They are further preferred alternatives, the detection of a product / article by means of a speech recognition software on an inventive Mobile phone or by reading an RFID chip contained in the product by means of a mobile phone according to the invention make. In this respect, the present invention relates accordingly equipped mobile phones and their associated operating methods for capturing a product / article with it.

To the optical detection of the bar code or bar code by the Mobile phone is the decoding of the bar code, for example in the mobile phone by a software installed in the mobile phone and it will receive an article number. A client application takes care of it on the mobile phone for detection and further processing the data. The article number will be transferred from the mobile phone a suitable data connection, such. As GPRS or UMTS, automated sent to the database server. Alternatively, the decoding can also be done of the barcode first in the database server or in another appropriate one central data processing device done, albeit larger Transfer data in the form of image information of the barcode Need to become.

Of the Database server receives or retrieves the sent ones Article codes or the sent article number from the mobile phone and carries out a price and product search for this Articles on the Internet or a special database.

The Search results are stored by the database server in a for the mobile phone suitable format prepared and then sent to the mobile phone, where it is then output on the display become. Thus, the user can by reading the Barcodes or barcodes extensive information about a product, like comparable products, pricing information, reviews or Internet links to information or online shops with ordering options to be provided.

Also can through partnerships with online stores through the mobile Device directly an order process z. B. at the cheapest Providers are triggered as it is as a single operation already is possible with previously known in practice mobile phones.

Within the scope of the invention, however, an inclusion of location information is now provided. Such a "localization" takes place, for example, via a collaboration with the mobile service provider who provides the mobile phone with special Procedures, such as indented cells, can locate. For this purpose, suitable devices which are known per se and are not the subject of the present invention are used to generate the required data at the mobile radio provider, which in turn are used as the location information in the method according to the invention and the associated inventive devices. Thus, it is not only possible to include data directly in relation to the store in which the user is currently located, but also geographically close shops can be identified and their prices for an identical or comparable product can be provided. This has the significant advantage that a purchase of the product is immediately possible, and to the most favorable local conditions.

A another way to locate the mobile phone than through the "Cell-ID", ie the mobile service provider, is in use from GPS, the satellite-based location. This technique is already known in practice in the meantime and implemented so that the appropriate technology is not here needs to be explained further. In the context of the present Invention is the z. B. this way obtained location information used for the mobile phone to determine the whereabouts of the User in a particular store or shop determine, so that the price data of this supplier directly from identification of the shop or business can, without a z. B. manual input would be required.

In the 1 schematically the flow of a product detection process and the facilities provided for this purpose in the context of the invention are shown. The technical process is exemplified below for the optical recognition of a barcode by means of a mobile phone 1 with integrated camera 100 described, wherein in the 1 also a detection of an RFID chip contained in the product is symbolized, including the mobile phone 1 then possibly equipped with a correspondingly suitable detector (not shown) is capable of.

The unique barcode or barcode 101 Any product is made by simply scanning by means of the mobile phone 1 with digital camera 100 read. For this purpose, first one on the mobile phone 1 installed, for example, Java based client application started.

It is sufficient barcode or barcode 101 in the from the camera 100 visible area by the application in the display 2 of the mobile phone 1 is displayed to position. The exact positioning is preferably supported by the representation of auxiliary lines and possibly by insertion of distance arrows in the absence of autofocus. It may also be provided an electronic support, by means of an optimal or at least sufficient positional accuracy of the bar code or bar code 101 in the display 2 automatically detected and "frozen" or saved for further processing. Recognizing the barcode or barcode 101 is from the mobile phone 1 advantageously confirmed by an acoustic signal.

In addition, the price of the scanned product valid in the respective shop can be entered by the user via a GUI (Graphical User Interphase, an input mask described in more detail below). The input can be simplified by a pre-selection of the relevant shops, which are based on geographic information 108 the mobile service provider in whose network is the mobile phone 1 and querying corresponding addresses in a database.

The course of the process according to 1 is like this:
The barcode or barcode 101 is using the camera 100 of the mobile phone 1 recorded, preferably as a moving picture. Then done in one step 102 a recognition of the barcode or barcode 101 by moving image analysis. Alternatively, the product detection may also be performed by means of a suitable detector or sensor (not shown) in the mobile telephone 1 by reading the information in an RFID chip 3 be assigned to a single product (step 103 ). Then you can enter the current price of the product (step 104 ). As explained above, this price information can also be obtained by location analysis by means of geodata (for example Cell-ID or GPS) and obtaining the price data for the current location from a provider price database and in the mobile telephone 1 to be provided. Anyway, with manual entry of the price this will then according to the step 105 in the form of EAN code and price to a database server (see 2 ) transmitted. If the price belonging to the selected product is automatically obtained from a supplier price database, an indication is shown on the display 2 of the mobile phone 1 advantageous so that the user has the security that the data is also correct. In principle, however, the price data can also be transmitted to the mobile phone 1 already further processed and / or used and only in a later step together with further information from the same provider price database, if necessary after linking with other databases to the mobile phone 1 be transmitted.

In the 2 are exemplary further steps of the method for finding a cheap the product price.

After the step 105 takes place by using data transmission over, for example, a UMTS connection, GPRS connection, WAP connection, SMS transmission, WLAN connection, LAN connection or WiMAX connection 106 if necessary, including geographic information or location information (for example Cell-ID or GPS) of the mobile phone 1 according to the step 108 a product search in connected database servers, as by the step 110 is clarified. These and other transmission technologies may be varied and combined according to availability and / or requirement. The identified product then takes place in the step 111 a price search or a price update especially in a database abstract. Since the required and available information from different individual databases and systems are read out by different providers and each with their own formats, such a database abstract for the price database is provided as a kind of abstraction level, so that a compilation, evaluation and transmission in a single format and system is enabled. After that, in the price database in one step 112 providers are first sought, which is then linked to retail databases via their database abstracts according to the step 113 the prices in databases of retail providers 1 to n (steps 114 to 115 ). Additionally, databases of online providers can also be found 1 to n according to steps 116 to 117 be queried. The price database may also advantageously be distributed among multiple redundant systems, and depending on the number or volume of concurrent requests from multiple users, the requests will be distributed among these multiple systems or servers, referred to as a load balanced or load balanced database.

With the data received the retail provider 1 to n and possibly the online provider 1 until n is now in step 118 the cheapest price determined. Based on the recognized barcode is thus on the connected database servers (step 112 ) determines a list of the cheapest providers (step 118 ), which may be online stores on the Internet or regional stores. The prices available in the database are either linked to other databases by retail providers (steps 114 . 115 ), through online providers (steps 116 . 117 ) or by submitting users (step 105 ) provided.

A list generated on the basis of this information is provided by a web server for the requesting device, ie the mobile phone 1 prepared and transmitted to this. Preferably, then, then, as in the step 119 is specified, generating a list of the cheapest provider, which list in one step 120 a web server for price information to the mobile phone 1 and thus the user is made available. The transmission to the mobile phone 1 takes place again by means of a UMTS connection, GPRS connection, WAP connection, SMS transmission, WLAN connection, LAN connection or WiMAX connection 121 , This then leads to the step 122 in which on the display 2 of the mobile phone 1 a response page is displayed, which shows a price list and advantageously also offers opportunities for action, such as additional information and, for example, test results from institutes or other buyers of the product (step 123 ), Instant Reservation (Step 137 ) and Buy It Now (step 148 ), like in the 3 is shown in more detail.

In the 4 is an exemplary illustration of an input mask 4 shown for a product price. The 5 illustrates an example of a price information list 5 as a result of the step 122 , The edited information will be on the display 2 of the mobile phone 1 clear and easy to read.

In addition, the user is now offered additional options, such as through the examples in the 6 . 8th and 10 and the display display examples in the 7 . 9 and 11 as an example: Display additional product information according to the step 123 in the 3 and 6 and the product information display 6 according to the 7 :
Selecting this option will provide the user with detailed information about the requested product. For this purpose are connected via appropriate databases in steps 127 to 132 z. As technical white papers, test reports, etc. preferably prepared suitably in one step 133 to the mobile phone 1 transmitted and on its display 2 represented as the steps 125 . 133 and 134 illustrate in detail by way of example, and what according to the step 135 leads to the answer page, of which an example in the 7 is shown.

Reserve immediately according to the step 137 in the 3 and 8th and the product reservation display 7 according to the 9 :
With this option, the desired product can be reserved for purchase in a retail store. The reservation can be made either via the affiliated inventory management system of the store according to the steps 140 to 144 or by phone by calling a stored telephone number. In the case of automated reservation via retail store databases, the customer will receive a confirmation on their mobile phone (step 147 ).

Buy now according to the step 148 in the 3 and 10 and the instant buy ad 8th according to the 11 :
By selecting this item, the user has the option of purchasing the product directly from the desired provider via the online connection of his telephone. For this purpose, the order is sent directly to the shop systems connected to a web server (steps 151 to 157 ) of an online shop or a retail store. The identification can z. B. are based on the mobile phone number of the customer. The billing and payment can by invoice, credit card or with appropriate partnership between the shop and the provider on the mobile phone bill, including but also for. B. via online payment systems, such as Paypal or the like, are handled. After positive feedback from the connected billing systems in the step 152 the customer receives an order confirmation on his mobile phone 1 according to the steps 158 to 160 ,

Since over 30 years have become barcodes for the identification of Enforced products. At point of sale (POS), these are used for used the automatic pricing, with special laser scanner or laser-based scanner cash registers. Mobile devices, such as mobile phones or portable computers (PDAs), have been used in the past mainly for inventory purposes retrofitted with laser scanners to facilitate this work. The disadvantage of laser-based scanners is the high power consumption and the additional cost to the manufacturer of the terminals arise for the obstruction.

• Prozessorgeschwindigkeit: Die in den mobilen Endgeräten verbauten Prozessoren reichen von ihrer Geschwindigkeit nicht an die in Computern oder Laptops verbauten Prozessoren heran. Deshalb ist eine komplette Echtzeit-Bildanalyse fast unmöglich.
• Batteriespeisung: Mobile Endgeräte erhalten den Strom im Normalfall aus Akkus; auch aus diesem Grund muss die CPU-Leistung für die Erkennung begrenzt werden.
• Beleuchtung der Bilder: Die meisten mobilen Geräte haben keinen eingebauten Blitz oder keine eingebaute andere Beleuchtungsquelle, so dass das dargstellte Bildmaterial mit Umgebungslicht auskommen muss, was die Differenzierung von Hell und Dunkel in einem Einzelbild erschwert.
• Verzerrung/Verdrehung/Verwacklung: Der Endkunde kann einen Barcode schwer ohne Verzerrungen aufnehmen. Auch sind digitale Bildstabilisatoren in Mobiltelefonen hardwaremäßig nicht verbaut.
• Schärfe des Bildes: Die in mobilen Endgeräten verbauten Objektive sind selten mit Auto-Fokus versehen sondern haben eine fixe Brennweite. Entstehende Unschärfe bei Nahaufnahmen ist also normal.

Nowadays many mobile phones are equipped with integrated cameras. These can be integrated at very low cost and enable end-users to use electronic value added services such as Mobile Messaging Service (MMS) or simply to take snapshots. The quality of these cameras has increased significantly in recent years due to the increasingly favorable, based on CMOS technology image sensors and now also allows the decoding of barcodes through camera images. Nevertheless, barcode recognition via camera images in mobile devices raises the following problems in particular:

• Processor Speed: Processors built into mobile devices do not match their speed with processors built into computers or laptops. Therefore, a complete real-time image analysis is almost impossible.
• Battery supply: Mobile devices normally receive the power from batteries; for this reason too, the CPU performance for detection must be limited.
• Illumination of images: Most mobile devices do not have a built-in flash or built-in other source of illumination, so the pictured material needs to manage ambient light, making it difficult to differentiate between light and dark in a single frame.
• Distortion / Twisting / Blurring: The end user can record a barcode hard without distortion. Also digital image stabilizers are not installed in mobile phones in hardware.
• Sharpness of the picture: The lenses installed in mobile devices are rarely provided with auto-focus but have a fixed focal length. Resulting blur at close-ups is so normal.

The Problems described here are due to a mobile phone according to the solved present invention.

The mobile phone 1 (please refer 1 ) generally includes moving image recording devices, memory devices, and data processing devices adapted to record and store motion picture sequences, and is equipped such that horizontal scan line guides are superimposed on the camera image or other alignment aids are provided to assist the end user for the location and the capture of the barcode to give, as the representation in the 12 clarified. It is essential in the present invention that a moving image of the barcode or barcode 101 (please refer 1 ) with the camera 100 (please refer 1 ) is recorded, and not as in the prior art, for example according to the US 2005/0011957 A1 a single fixed photo.

• – aus einer Bewegtbildsequenz eines Strichcodes eines Produktes oder einer Dienstleistung durch Analyse der Bewegtbildsequenz unter Verwendung von Histogramm-Funktionen ein Einzelbild von dem Strichcode zu erstellen,
• – anhand des Strichcodes eine Identifizierung des zugehörigen Produktes oder der zugehörigen Dienstleistung durchzuführen oder zu beschaffen, und
• – mittels der Identifizierung des Produktes oder der Dienstleistung Preisinformationen zu dem Produkt oder der Dienstleistung von wenigstens einem Anbieter des Produktes oder der Dienstleistung zu beschaffen.

The data processing devices are designed to be

• To create a frame from the bar code from a moving picture sequence of a bar code of a product or service by analyzing the moving picture sequence using histogram functions;
• - Carry out or obtain an identification of the associated product or service from the barcode, and
• - by means of the identification of the product or service, to obtain pricing information on the product or service from at least one supplier of the product or service.

To the data processing devices can do the analysis the motion picture sequence using histogram functions and / or the creation of the frame from the bar code in real time while recording the motion picture sequence or off a moving picture sequence stored in the memory means carry out.

Furthermore includes the equipment of the mobile phone 1 Facilities for converting the color video stream of which in the 12 only a snapshot is shown in grayscale; the obtained "black and white film" is in the 13 also symbolized by a snapshot. Because of the presentation possibilities in the available documents are differences between the representations in the 12 and 13 unrecognizable and it is necessary to add the information in writing to the fact that the situation in the 12 a colored representation on the display 2 of the mobile phone 1 is. Generally speaking, the moving picture recording means are adapted to record color picture moving picture sequences, and the moving picture recording means are conversion means for converting a color picture moving picture sequence to a gray scale moving picture sequence.

As mentioned, it is essential in the present invention that no image analysis but an analysis of a complete video stream using histogram functions (Equalized Histogram, Overall Histogram) is performed, also to the image sensors to the prevailing ambient light to be able to adjust (brightness / Contrast). These are suitable devices in the mobile phone 1 contain. Symbolic for the process are the representations in the 14 ,

Furthermore, in order to ensure low processor utilization and to save power, a line-based analysis of the background material (behind the displayed scan lines or lines) is again carried out with appropriate mobile device facilities 1 , By means of these devices, a re-sharpening of the entire scan line area according to the 15 , This is followed by a generation of unsharp masks for edge detection starting with the state in the 16 , As the 17 clarifies, for the required rotation of the scan line area, an edge determination is performed and then takes place according to the 18 re-sharpening the rotated scan line area.

This is followed by an analysis of the pixels behind the scan lines or lines. Weighted results within the scan lines (eg 50 out of 100) mean an undistorted image. With a distorted image, the scan lines are shifted horizontally to get equally weighted results. Finally, a decoding according to, inter alia, Code39, Code 39 Full ASCII, Code 128, DataMatrix, EAN-8, EAN-13, ISBN, interleave2 of 5, JAN-8, JAN-13, Optical Intelligence 2D, PDF417, QR, RSS 14, RSS-14E, RSS-14L, UPC-A, UPC-E and validates the codes: If the checksums are correct, the barcode is recognized, for which the 19 stands.

A further procedural possibility for Product recognition is in addition to a voice input, for example, the Number codes belonging to a barcode or barcode, the optical detection of this number code and the text recognition, so that then the corresponding information was generated and to further Use in the method according to the invention is available.

The Invention is based on the embodiments in the description and shown in the drawing merely by way of example and not but includes all variations, modifications, Substitutions and combinations that the skilled person the present Documents in particular in the context of the claim and the general representations in the introduction to this description and the description of the Refer to exemplary embodiments and with his expert Knowledge and the state of the art. Especially are all individual features and design options the invention and its embodiments combined.

QUOTES INCLUDE IN THE DESCRIPTION

This list The documents listed by the applicant have been automated generated and is solely for better information recorded by the reader. The list is not part of the German Patent or utility model application. The DPMA takes over no liability for any errors or omissions.

Cited patent literature

• US 2005/0011957 A1 [0004, 0089]

Claims (49)

A mobile telephone comprising moving picture recording means, memory means and data processing means adapted to record and store moving picture sequences, characterized in that the data processing means are adapted from a moving picture sequence of a bar code of a product or service by analysis of the moving picture sequence using histogram functions Create a single image of the barcode, - perform or obtain identification of the associated product or service from the barcode, and - by identifying the product or service, provide pricing information on the product or service of at least one supplier of the product or service Procure service. Mobile telephone according to claim 1, characterized that the data processing devices are designed, the analysis the motion picture sequence using histogram functions and / or the creation of the frame from the bar code in real time during the recording of the motion picture sequence. Mobile telephone according to claim 1, characterized that the data processing devices are designed, the analysis the motion picture sequence using histogram functions and / or the creation of the frame from the bar code to a perform in the memory devices stored moving picture sequence. Mobile telephone according to one of the preceding claims, characterized in that alignment auxiliary devices are provided are to help the user with the location and capture of the To give barcodes. Mobile telephone according to one of the preceding claims, characterized in that the moving picture recording means are designed to record color image motion picture sequences, and that conversion means for converting a Color image motion picture sequence into a grayscale moving picture sequence are included. Mobile telephone according to one of the preceding claims, characterized in that further adjusting means for a setting of the moving picture recording devices on the prevailing ambient light are included, especially for optimization the recording of a motion picture sequence in terms of brightness and / or contrast. Mobile telephone according to one of the preceding claims, thereby in that the data processing devices are designed to perform image enhancement measures for image optimization, in particular in the context of the analysis of the moving picture sequence - one line-based analysis of background material, especially behind displayed scan lines, and / or - a resharpening a scan line area, and / or - a generation of blur masks for edge finding in a scan line area, and or A rotation of a scan line area for edge detection. Mobile telephone according to one of the preceding claims, characterized in that the data processing means are designed as part of the analysis of the moving picture sequence an analysis the pixels behind scan lines to produce a weighted result within the scan lines to avoid distortion of the frame of to check the barcode. Mobile telephone according to claim 8, characterized that the data processing devices are designed, upon detection a distortion of the frame from the barcode the scan lines move horizontally until equal weighted results are obtained become. Mobile telephone according to one of the preceding claims, characterized in that the data processing means are designed to perform a decoding of the bar code, especially Code 39, Code 39 Full ASCII, Code 128, DataMatrix, EAN-8, EAN-13, ISBN, Interleave 2 of 5, JAN-8, JAN-13, Optical Intelligence 2D, PDF417, QR, RSS-14, RSS-14E, RSS-14L, UPC-A, UPC-E, and that Preferably, the data processing devices are further designed are to carry out a validation of the determined code. Mobile telephone according to one of the preceding claims, characterized in that voice input devices are provided are and the data processing equipment for speech recognition are designed to capture number codes and / or product names and from this an identification of the associated product or the associated service or to obtain. Mobile phone according to one of the preceding Claims, characterized in that the data processing means are adapted for character recognition in a frame obtained from one of a moving picture sequence to detect number codes and / or product names and to perform or obtain therefrom an identification of the associated product or the associated service. Mobile telephone according to one of the preceding claims, characterized in that location information detecting means and / or facilities for obtaining location information are included, and that the data processing equipment designed are pricing information, including location information too the product or service of at least one supplier of the product or service. Mobile telephone according to one of the preceding claims, characterized in that the data processing means are designed to provide pricing information about the product or service from at least two suppliers of the product or service to get. Mobile telephone according to claim 14, characterized that display devices are included, and that the data processing devices designed are pricing information about the product or service from at least two suppliers of the product or service to display the display devices. Mobile telephone according to claim 14 or 15, characterized that input and / or selection means are included in order to the pricing information on the product or service of at least two providers of the product or service at least one additional function, in particular concerning information to the product or service, ordering the product or service or purchase of the product or service perform. Operating procedure for a mobile phone, with moving picture recording devices, memory devices and data processing equipment for recording and storing are designed by moving picture sequences, characterized, that by means of the data processing equipment - out a moving picture sequence of a bar code of a product or a Service by analyzing the moving picture sequence using Histogram functions create a frame of the barcode becomes, - Identification based on the barcode of the associated product or its associated Service is performed or procured, and - by means of the identification of the product or service pricing information to the product or service of at least one supplier of the product or service. Operating procedure for a mobile phone according to claim 17, characterized in that by means of the data processing means the analysis of the moving picture sequence using histogram functions and / or the creation of the frame from the bar code in real time during the recording of the moving picture sequence. Operating procedure for a mobile phone according to claim 17, characterized in that by means of the data processing means the analysis of the moving picture sequence using histogram functions and / or the creation of the frame from the bar code a moving picture sequence stored in the memory means he follows. Operating procedure for a mobile phone according to one of claims 17 to 19, characterized in that with the moving picture recording means, color picture moving picture sequences be recorded, and that by means of conversion facilities a color picture moving picture sequence into a gray scale moving picture sequence is converted. Operating procedure for a mobile phone according to one of claims 17 to 20, characterized that a setting of the moving picture recording means on the prevailing ambient light takes place, in particular for optimization the recording of a motion picture sequence in terms of brightness and / or contrast. Operating procedure for a mobile phone according to one of claims 17 to 21, characterized, that by means of the data processing devices for image optimization Image editing activities are carried out, in particular in the context of the analysis of the moving picture sequence - one line-based analysis of background material, especially behind displayed scan lines, and / or - a resharpening a scan line area, and / or - a generation of blur masks for edge finding in a scan line area, and or A rotation of a scan line area for edge detection. Operating method for a mobile telephone according to one of claims 17 to 22, characterized gekenn characterized in that by means of the data processing means in the context of the analysis of the moving image sequence, an analysis of the pixels behind scan lines to generate a weighted result within the scan lines is carried out to check a distortion of the frame from the bar code. Operating procedure for a mobile phone according to claim 23, characterized in that by means of the data processing means upon detecting a distortion of the frame from the bar code The scan lines will shift horizontally until they are the same Results are obtained. Operating procedure for a mobile phone according to one of claims 17 to 24, characterized that by means of the data processing means a decoding the bar code is executed, in particular Code 39, Code 39 Full ASCII, Code 128, DataMatrix, EAN-8, EAN-13, ISBN, Interleave2 of 5, JAN-8, JAN-13, 2D Optical Intelligence, PDF417, QR, RSS-14, RSS-14E, RSS-14L, UPC-A, UPC-E, and preferably by means of data processing equipment Furthermore, a validation of the determined code is performed becomes. Operating procedure for a mobile phone according to one of claims 17 to 25, characterized that by means of speech input devices and for speech recognition designed data processing equipment number codes and / or product names be detected and from this an identification of the associated Product or associated service or procured. Operating procedure for a mobile phone according to one of claims 17 to 26, characterized that means of the data processing means a character recognition takes place in a single frame, which consists of one of a moving picture sequence was obtained to capture number codes and / or product names and from this an identification of the associated product or the associated service or to obtain. Operating procedure for a mobile phone according to one of claims 17 to 27, characterized that location information using location information detection facilities and / or facilities for obtaining location information and that by means of the data processing equipment taking into account the location information pricing information to the product or service of at least one supplier of the product or service. Operating procedure for a mobile phone according to one of claims 17 to 28, characterized that by the data processing facilities price information to the product or service of at least two suppliers of the Procured product or service. Operating procedure for a mobile phone according to claim 29, characterized in that by means of the data processing means Price information about the product or service of at least two providers of the product or service to display devices are displayed. Operating procedure for a mobile phone according to claim 29 or 30, characterized in that by means of input and / or selection means based on the price information for the Product or service of at least two suppliers of the Product or service at least one more feature in particular concerning information on the product or service, ordering of the product or service or purchase of the product or the service is being performed. Data processing network for mobile phones according to one of claims 1 to 16, and with central data processing devices, characterized in that the central data processing means Provider price database facilities are included and designed to based on the identification of the product or service pricing information to the product or service of at least one supplier of the product or service and to the mobile phone to convey. Data processing network for mobile phones, according to claim 32, characterized in that the central data processing means designed are based on the transmitted from a mobile phone barcode an identification of the associated product or the to perform and to provide the associated service to transmit the mobile phone back. Data processing network for mobile phones, according to claim 32 or 33, characterized in that the provider price database facilities are based on the identification of the product or the Service Price information about the product or service from at least two suppliers of the product or service be determined and transmitted to the mobile phone. Data processing network for mobile phones A ne, according to any one of claims 32 to 34, characterized in that the central data processing means are adapted to determine location information of a mobile phone and transmit it to the provider price database facilities. Data processing network for mobile phones, according to claim 35, characterized in that the central data processing means designed are based on the identification of the product or service Price information about the product or service of the Provider of the product or service to determine where the mobile phone according to the location information and automatically to the mobile phone. Data processing network for mobile phones, according to one of claims 32 to 36, characterized that the central data processing facilities product information database facilities are included and designed based on the identification of the product or service product information about the product or the service of at least one supplier of the product or the service and transmit it to the mobile phone. Data processing network for mobile phones, according to one of claims 32 to 37, characterized that the central data processing facilities are designed from various individual databases and systems from different providers and possibly with their own formats to get. Data processing network for mobile phones, according to claim 38, characterized in that the central data processing means processing means included, from the various individual databases and systems from different vendors and possibly each one own formats a database abstract for a compilation, Evaluation and transmission of price information and / or If necessary, product information in a single format and system, which Database abstract directly or indirectly for transmission to the mobile phone. Data processing network for mobile phones, according to one of claims 32 to 39, characterized that the central data processing facilities are designed a reservation or checkout for a product or a service with automatic assignment to the user of the mobile phone. Operating procedure for a data processing network according to one of claims 32 to 40, characterized that by means of provider price database facilities of the central Data processing equipment based on the identification of the product or the service price information about the product or the Service of at least one supplier of the product or determined the service and transmitted to the mobile phone become. Operating procedure for a data processing network, according to claim 41, characterized in that by means of the central Data processing devices based on the transmitted from a mobile phone Barcodes an identification of the associated product or the associated service and to the Mobile phone is transmitted back. Operating procedure for a data processing network, according to claim 41 or 42, characterized in that by means of Provider price database facilities based on the identification of the Product or service Price information about the product or the service of at least two suppliers of the product or service and transmitted to the mobile phone become. Operating procedure for a data processing network, according to one of claims 41 to 43, characterized that by means of the central data processing facilities location information a mobile phone and transmitted to the provider price database facilities become. Operating procedure for a data processing network, according to claim 44, characterized in that by means of the central Data processing equipment based on the identification of the product or the service price information about the product or the Service provided by the supplier of the product or service be determined where the mobile phone according to the location information located and automatically transmitted to the mobile phone become. Operating procedure for a data processing network, according to one of claims 41 to 45, characterized by means of product information database devices contained in the central data processing devices based on the identification of the product or service Product information about the product or service of at least one supplier of the product or service determined and transmitted to the mobile phone. Operating method for a data processing network, according to one of claims 41 to 46, characterized in that by means of the central Data processing equipment from different individual databases and systems from different providers and possibly with their own formats are procured. Operating procedure for a data processing network, according to claim 47, characterized in that means by in the central Data processing equipment contained processing facilities from the various individual databases and Systems from different providers and possibly each with their own Formats a database abstract for a compilation, Evaluation and transmission of price information and / or If necessary, product information is created in a single format and system is, which database abstract directly or indirectly for transmission to the mobile phone. Operating procedure for a data processing network, according to one of claims 41 to 48, characterized that by means of the central data processing means a Reservation or purchase for a product or a service under automatic assignment to the user of the Mobile phones is running.