WO1996003719A1 - Expenditure categorization and tracking system - Google Patents

Expenditure categorization and tracking system Download PDF

Info

Publication number
WO1996003719A1
WO1996003719A1 PCT/US1995/010386 US9510386W WO9603719A1 WO 1996003719 A1 WO1996003719 A1 WO 1996003719A1 US 9510386 W US9510386 W US 9510386W WO 9603719 A1 WO9603719 A1 WO 9603719A1
Authority
WO
WIPO (PCT)
Prior art keywords
icon
check
expenditure
bank
printed
Prior art date
Application number
PCT/US1995/010386
Other languages
French (fr)
Inventor
Todd M. Kunkler
Daniel R. Davidson
Scott J. Sanner
Original Assignee
Ontrack Management Systems, Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US08/281,441 external-priority patent/US5740271A/en
Application filed by Ontrack Management Systems, Inc. filed Critical Ontrack Management Systems, Inc.
Priority to AU34062/95A priority Critical patent/AU693597B2/en
Publication of WO1996003719A1 publication Critical patent/WO1996003719A1/en

Links

Classifications

    • GPHYSICS
    • G07CHECKING-DEVICES
    • G07FCOIN-FREED OR LIKE APPARATUS
    • G07F9/00Details other than those peculiar to special kinds or types of apparatus
    • G07F9/10Casings or parts thereof, e.g. with means for heating or cooling
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q20/00Payment architectures, schemes or protocols
    • G06Q20/04Payment circuits
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q20/00Payment architectures, schemes or protocols
    • G06Q20/04Payment circuits
    • G06Q20/042Payment circuits characterized in that the payment protocol involves at least one cheque
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q40/00Finance; Insurance; Tax strategies; Processing of corporate or income taxes
    • G06Q40/02Banking, e.g. interest calculation or account maintenance
    • GPHYSICS
    • G07CHECKING-DEVICES
    • G07DHANDLING OF COINS OR VALUABLE PAPERS, e.g. TESTING, SORTING BY DENOMINATIONS, COUNTING, DISPENSING, CHANGING OR DEPOSITING
    • G07D7/00Testing specially adapted to determine the identity or genuineness of valuable papers or for segregating those which are unacceptable, e.g. banknotes that are alien to a currency
    • G07D7/004Testing specially adapted to determine the identity or genuineness of valuable papers or for segregating those which are unacceptable, e.g. banknotes that are alien to a currency using digital security elements, e.g. information coded on a magnetic thread or strip
    • G07D7/0047Testing specially adapted to determine the identity or genuineness of valuable papers or for segregating those which are unacceptable, e.g. banknotes that are alien to a currency using digital security elements, e.g. information coded on a magnetic thread or strip using checkcodes, e.g. coded numbers derived from serial number and denomination
    • GPHYSICS
    • G07CHECKING-DEVICES
    • G07GREGISTERING THE RECEIPT OF CASH, VALUABLES, OR TOKENS
    • G07G5/00Receipt-giving machines

Definitions

  • This invention relates to expenditure tracking systems and, more particularly, to an improved automated expenditure tracking system comprising a novel method and apparatus for automatically tracking check expenditures and deposits using printed bank checks having a plurality of graphic icons disposed thereon representative of particular expenditure categories.
  • ATM Automated Teller Machines
  • POS Point Of Sale terminals
  • EFT Electronic Funds Transfer
  • the information can be manipulated electronic ⁇ ally to generate various types of account statements, expend- iture charts and the like, which can be accessed by the user via a video display monitor, an attached printer or magnetic disk storage media.
  • Deposits and other transactions are handled in a similar fashion by the user's manually entering the raw data from the deposit slip, transaction receipt or the like, into the computer.
  • a significant drawback of these types of computer accounting software programs is that they require the bank customer or user to enter into the computer "raw" data from each check transaction occurring within a given transaction period.
  • This data may, for instance, be entered by the bank customer from his returned checks or from a separate ledger book in which check transactions are routinely entered and recorded. Inputting this data may require a considerable expenditure of time and effort where, for instance, the bank customer has made hundreds of individual check transactions during a given transaction period.
  • MICR MICR decoder
  • a drawback of these types of expenditure tracking systems is that they are not well suited for individual and small business.
  • the numbers used to represent expenditure categories are not easily identifiable by customers as representing any particular type of expenditure. Rather, in order to record the appropriate category number a customer is required to refer to a separ ⁇ ately recorded index or legend of accounts in order to match each number with its corresponding expenditure category.
  • This cross-referencing of expenditure categories is highly incon ⁇ venient where, for instance, the customer does not have convenient reference to the recorded legend at the time the check is made out and the transaction executed. In such cases the customer either guesses, or he simply does not record the expense at all. This can cause undesirable inaccuracies in the expenditure tracking system. Numbered expenditure categ ⁇ ories are simply not sufficiently intuitive or descriptive to allow the use of these types of expenditure tracking systems by the general banking public.
  • the present invention comprises, in one embodiment, a printed bank check having a plurality of easily recognizable graphic icons disposed thereon representative of predetermined expenditure categories.
  • Each icon is adapted to be marked by a customer and machine-read in order to track and record individual check transactions.
  • each icon consists of an ergonomically designed pictorial representation of a particular object or idea which is familiar to the customer and which is associated with each type of expenditure. Additional expenditure information may optionally be provided on the back of each check in order, for instance, to allow a bank customer to allocate a single check transaction between one or more expenditure categories or to record one or more deposits, as desired.
  • the present invention provides a novel printed graphic icon for enhancing the detectability of a mark made thereon.
  • the icon is provided with a defined marking area intended to receive a customer's mark.
  • the periphery of the intended marking area is defined by a dark outer portion forming an outline or inverted silhouette of the icon design. Shading, highlighting, and other details are provided within the inverted silhouette area using a light colored ink and/or tones, defining a relatively light inner portion. These details aesthetically enhance the icon design and provide improved recognition of the icon by a customer.
  • the light inner portion of the icon is selected to be below the threshold detection level of a scanner or other device used to scan the icon design into a computer imaging system such that only extraneous marks made by a bank customer appear as dark areas within a pixel image of the intended marking area.
  • the present invention provides a printed graphic icon adapted to be invisible to a scanner, yet readily recognizable to the human eye.
  • the icon is defined by an outer portion forming an outline or inverted silhouette of a desired icon design. Shading, highlighting, and other details of the icon design are provided in an inner icon portion within the inverted silhouette. These details aesthetically enhance the icon design to provide improved human recognition thereof.
  • Both the outer and inner icon portions are printed or screened using a suitable "drop-out" ink having a light absorptivity that is below a defined threshold detection level of a scanner such that any extraneous marks made on the icon will appear as dark contiguous pixels within a bi-level pixel image of the icon.
  • "drop-out" icons may be enclosed within, a thin, black frame so that when scanned the resulting pixel image will reveal only the icon frame and any marks made therein.
  • the present invention provides a novel method for detecting the presence of a mark placed over a printed graphic icon as provided in accordance with the present invention.
  • the icon is scanned via a scanner or other device into a computer imaging system to produce a bi-level black and white pixel image of the icon.
  • a mask having a size and shape corresponding to the dark outer portions of the icon design is placed over the pixel image of the icon such that it masks the entire pixel image outside of the intended marking area of the icon.
  • a mark is detected if more than a predetermined number of contiguous dark pixels are detected within the remaining pixel image, corresponding to the intended marking area of the icon.
  • the present invention provides a novel method for detecting the presence of a mark placed over one of a number of printed graphic icons provided in an array.
  • the icon array is scanned via a scanner or other device into a computer imaging system.
  • the computer registers the icon array on an x-y grid by recognizing and locating a target comprising one or more predetermined reference lines.
  • a mark is detected in a particular icon location if more than a predetermined number of contiguous dark pixels are detected within a portion of the pixel image corresponding to the x-y location of the particular icon.
  • the present invention comprises a system and method for automatically tracking expenditures using pictorial icons at the point of sale/payment represen ⁇ ting expenditure categories which can be marked or otherwise activated by a customer to indicate a particular expenditure category.
  • a bank customer selects the icon or icons which apply to the particular transaction for which the expenditure transaction is made. This information is recorded in a cumulative transaction record.
  • the transaction record is organized into a statement of expenditures broken down by expenditure category and amount which may be provided to the bank customer in the form of an end-of-month expenditure statement or electronic data downloaded via modem or other means to a home or business computer.
  • the present invention comprises a system and method for processing bank checks of the type adapted to be marked by a bank customer to indicate a selected expenditure category corresponding to a particular check expenditure.
  • Basic check transaction information such as the account number and the dollar amount of each bank check, is decoded using a MICR decoder.
  • Checks are then scanned in substantially rapid succession to generate a series of binary data representative of a pixel image thereof.
  • An central processor manipulates the binary data to detect in each of a plurality of predetermining intended marking areas on the check the presence or absence of one or more marks indicative of particular expenditure categories selected by a bank customer.
  • Transaction information is then recorded in a cumulative transaction record in association with each selected expenditure category corresponding to each particular check transaction. Periodically, the transaction record is organized into a statement of expenditures broken down by expenditure category and amount which may be provided to the bank customer in the form of an end-of-month expenditure statement or electronic data downloaded via modem or other means to a home or business computer.
  • the present invention comprises a novel expenditure statement in which a pixel image of each payee name recorded on a bank check is reproduced directly on the expenditure statement in association with corresponding transaction information, such as customer's account number, check transaction number and the dollar amount of the check.
  • FIGURE 1 is a view of the front side of a printed bank check having features of the present invention
  • FIGURE 2 is a view of the back side of a printed bank check having optional features in accordance with the present invention
  • FIGURE 3 is an enlarged view of the icon array 28 shown in FIGURE 1 illustrating in more detail a number of possible graphic icon designs that may be provided on a printed bank check in accordance with the present invention
  • FIGURE 4 is an enlarged view of one embodiment of a printed icon having features of the present invention.
  • FIGURE 5 is an enlarged view of an alternative embodiment of a printed icon having features of the present invention, illustrating in more detail how the icon may be marked by a bank customer to indicate a selected expenditure category;
  • FIGURE 6 is a schematic diagram of an automated check expenditure tracking system having features of the present invention
  • FIGURE 7 is a front view of an expenditure statement of the type generated by a check expenditure tracking system of the type shown in FIGURE 6, and having features of the present invention
  • FIGURE 8 is a more detailed schematic diagram of the check expenditure tracking system of FIGURE 6;
  • FIGURE 9 is a more detailed schematic diagram of the image processing sub-routine 117 of FIGURE 8.
  • FIGURE 10 is a more detailed schematic diagram of the check amount capture sub-routine 118 of FIGURE 8.
  • FIGURE 11 is a more detailed schematic diagram of the amount verification sub-routine 120 of FIGURE 8;
  • FIGURE 12 is a more detailed schematic diagram of the payee box capture sub-routine 122 of FIGURE 8;
  • FIGURE 13 is a more detailed schematic diagram of the icon array capture sub-routine 124 of FIGURE 8;
  • FIGURE 14 is a more detailed schematic diagram of the mark detection sub-routine 126 of FIGURE 8.
  • FIGURE 15 is a more detailed schematic diagram of the transaction update sub-routine 121 of FIGURE 8.
  • FIGURE 16 is an enlarged view of the icon array of FIGURE 3 illustrating in more detail the preferred shading of the various icons;
  • FIGURE 17 is a view of the icon array of FIGURE 16 shown in actual preferred size
  • FIGURE 18 is an enlarged view of an alternative embodiment of a printed icon array having features of the present invention.
  • FIGURE 19 is an enlarged view of another alternative embodiment of a printed icon array particularly suited for business use;
  • FIGURE 20 is a detailed view of a personal-sized printed bank check having features in accordance with the present invention, showing the preferred location of the icon array;
  • FIGURE 21 is a detailed view of a business-sized printed bank check having features in accordance with the present invention, showing the preferred location of the icon array;
  • FIGURE 22 is an enlarged view of an alternative embodiment of a printed graphic icon having features in accordance with the present invention, showing how the icon appears to the human eye (FIGURE 22A) and to a bi-level scanner (FIGURE 22B) ;
  • FIGURE 23 is an enlarged view of another alternative embodiment of a printed graphic icon having features in accordance with the present invention, showing how the icon appears to the human eye (FIGURE 23A) and to a bi-level scanner (FIGURE 23B) ; and
  • FIGURE 24 is a detailed schematic diagram of an alternative mark detection sub-routine 126' which may be substituted for the subroutine 126 of FIGURE 8.
  • FIGURE 1 is a view of the front side of a printed bank check 8 having features of the present invention.
  • the check generally comprises a substrate 10 upon which is printed a plurality of boxes, lines, and spaces 12-24 for entering customary check-transaction information.
  • An array of graphic icons 28 is provided for recording one or more expenditure categories which correspond to the particular transaction being made, as will be described in more detail later.
  • MICR code 26 contains machine readable information consisting of the bank routing number, customer account number, and the check transaction number. The dollar amount of the check may also be recorded in MICR code (not shown) on the check by a payee bank when the check is cashed or deposited by the payee.
  • MICR code 26 is used primarily in automated check clearing houses to route the check and charge it against the proper payor bank. It is also used by the payor bank to automatically credit and debit individual customer accounts and to periodically generate a statement of accounts identifying each customer's transactions by check transaction number along with the remaining balance of the customer's account.
  • the size and weight of the check substrate 10 may be varied as desired, but preferably conforms to one of several well-known banking industry standards. For instance, a 24# weight 70 x 6 150 mm rectangular substrate 10 is convenient for personal use. A 24# weight 3 75 mm x 210 mm check substrate 10 is convenient for certain business and professional use. For relatively high volume or computer controlled check writing it may be further convenient to provide multiple checks printed on a single perforated substrate that is particularly adapted for use with a computer controlled printer. Alternatively, it will be readily apparent to persons skilled in the art that virtually an infinite number of shapes and sizes of substrates 10 may be used, as desired, while still enjoying the benefits of the present invention herein disclosed.
  • the check substrate 10 may be further provided with a security pattern or other design disposed thereon for discouraging fraudulent reproduction of checks or providing an aesthetic or ornamental check design.
  • a security pattern or other design disposed thereon for discouraging fraudulent reproduction of checks or providing an aesthetic or ornamental check design.
  • the check substrate 10 illustrated in FIGURE 1 has been lightly printed with the mark "OnTRACKTM” in a repeating pattern covering substantially the entire front side of the substrate 10. It will be readily apparent to those skilled in the art that a wide variety of optional background designs may be used, as desired, while still enjoying the benefits of the present invention herein disclosed.
  • a plurality of boxes, lines, and spaces 12-24 are provided on the front side of the substrate 10 for entering customary check-transaction information.
  • the current day and month may be entered on line 12, the year on line 14.
  • the payee's name may be entered in the payee box 16.
  • the dollar amount of the check may be entered in arabic numerals in the amount box 18 and written out in long-hand on the verification line 20.
  • the maker of the check signs on line 22. Notes or other extraneous information may be recorded on an optionally provided memo line 24.
  • the payee box 16 is preferably adapted to be electron ⁇ ically scanned into a computer imaging system or other device such that the text image within the box 16 can be captured in pixel form and reproduced, as desired, in an expenditure statement or other accounting statement provided to a bank customer.
  • the particular size and shape of the payee box 16 may be varied, as desired, to provide a convenient area for recording the payee's name.
  • the payee box 16 is preferably at least minimally sufficient to accommodate both hand-written and typed payee designations.
  • a payee box having a height of 8 mm and a length of 75 mm for instance, provides a convenient size for most check-writing purposes. Other payee box dimensions may be used, as desired, while still enjoying the benefits of the present invention herein disclosed.
  • the outer frame comprising the payee box 16 is preferably of relatively uniform line thickness and density.
  • it may be screened using a half-tone printing technique or other means, as desired, in order to lighten the outer frame. In this manner, when the check 8 is scanned into a computer imaging system the outline image of the payee box 16 can be filtered out using threshold imaging, as will be described in more detail later.
  • the amount box 18 is similarly adapted to be electron ⁇ ically scanned so that the text image within the box 18 may be captured in pixel form.
  • a handwritten or typed dollar amount in the amount box 18 may be verified against the dollar amount contained in the MICR code 26 using a modified optical character recognition ("OCR") technique, as will be described in more detail later.
  • OCR optical character recognition
  • the size and shape of the amount box 18 can be varied, as desired, but is preferably at least minimally sufficient to accommodate both hand-written and typed dollar amounts.
  • An amount box 18 having a height of about 6 mm and a length of about 25 mm provides a convenient size for most check-writing purposes.
  • a larger or smaller amount box 18 may be provided, as desired, while still enjoying the benefits of the present invention herein disclosed.
  • the outer frame comprising the amount box 18 is preferably of relatively uniform line thickness and density.
  • it may be screened using a half-tone printing technique or other means, as desired, in order to lighten the outer frame such that the outline image of the amount box 18 can be filtered out using threshold imaging, as will be described in more detail later.
  • An array of twenty-one unique graphic icons 28 is provided on the left-most side of the check, as shown. It will be appreciated that each of the individual graphic icons in the icon array 28 represents a particular category or type of expenditure, such as, for instance, automotive expenses, groceries, meals, etc. A customer desiring to record a particular check expenditure marks the icon (or icons) in the icon array 28 that correspond to the particular expense for which the check payment is being made. The expenditure category information is thereby permanently recorded on the check itself at the time the transaction is made.
  • One or more optional icon boxes such as the circular box 30, may also be provided, as desired, to further characterize a given check expenditure as being, for instance, either tax deductible or reimbursable. Such optional boxes may be located immediately adjacent to the icon array 28, as shown, or, alternatively, at any convenient location on the check substrate 10 that would not encroach on other zones of the check that preferably conform to banking industry standards. Any such optional icon boxes 30 may be provided with or without a corresponding icon design or text description, as desired.
  • the icon array 28 and any optional icon boxes 30 are preferably adapted to be scanned into a computer imaging system or other device so that the image can be processed in order to ascertain which icon(s), if any, have been marked.
  • This information is then recorded in association with other information representative of the particular check trans ⁇ action, such as the customer account number, check transaction number and dollar amount of the check.
  • a bank or processing center periodically organizes this recorded information into a statement of expenditures or an accounting broken down by expenditure category, check transaction number and amount. Preferably, this is in the form of a monthly expenditure statement provided to the bank customer. Alternatively, it may be a statement of year-to-date expenditures, or any other breakdown of expenditures that a bank customer may find convenient or helpful for purposes of budgeting or financial planning. In this manner, it will be appreciated that each check expenditure made using a printed bank check in accord ⁇ ance with the present invention may be automatically tracked and recorded, as will be described in more detail later.
  • a customer desiring to purchase groceries at a grocery store might write out a check for $50 to pay for the groceries, marking an icon on the check picturing a grocery cart or other indicia representative of grocery expenses.
  • the payor bank, a check clearing house or a designated processing center scans each check to deter ⁇ mine selected expenditure categories and records this information in association with other basic information identifying the transaction. This may be done either before or after the check is paid and canceled, as desired.
  • customers may wish to allocate or "split" the transaction between two or more discrete expenditure categories. If, for example, the customer attends an educational luncheon which he pays for using a single check, the customer may wish to split the check expenditure between meal expenses and educational expenses. The customer may do this by placing an "X" or other mark on each icon in the icon array 28 that is applicable. The check expenditure would then be automatically allocated equally among each expenditure category indicated.
  • an optional feature of the present invention is to provide on the back of a bank check as shown in FIGURE 1 a plurality of optional lines and boxes, as illustrated in FIGURE 2, for distributing a single check transaction between multiple expenditure categories.
  • FIGURE 2 is a view of the back side of a printed bank check 8 having this optional feature in accordance with the present invention.
  • An empty space is preferably provided in the area immediately to the right of the endorsement line 31 in order to accommodate bank processing information which may be subsequently printed on the back of the check.
  • a second array of twenty-one icons 32 corresponding to the icon array 28 shown in FIGURE 1. These icons in the array 32 may or may not be provided with corresponding graphic icon designs, as desired, depending upon the additional printing expenses involved.
  • each icon box in the icon array 32 has a unique icon position number or letter assoc ⁇ iated with it, as shown, corresponding to each particular expenditure category represented pictorially by corresponding icons in the icon array 28 shown on the front of the check.
  • the customer marks the box 34 indicating "split check" and enters the appropriate icon position numbers in the column of boxes 36 provided.
  • the customer enters in the corresponding spaces 37 the dollar amount portion of the check transaction which is to be allocated to that particular expenditure category. This is repeated for each different expenditure category desired. The total is then added up and entered in the space 38 provided. This total will usually correspond to the amount recorded on the front of the check.
  • split-check information may be recorded on any subsequent check used to pay for goods and/or services, as desired, provided that the check transaction to be split is sufficiently identified by date and dollar amount, as provided in the spaces 43 and 38, respectively.
  • This feature is convenient, for instance, for hurried transactions where the bank customer does not have time or otherwise forgets to record check-split information on the back of a particular check.
  • this feature allows the bank customer to record split-check information on any subsequent check, as desired, and the information will be automatically entered by the expenditure tracking system.
  • optional spaces may be provided on the back of the check for indicating the check transaction number of the particular check to be split. This is usually not necessary, however, since it is usually possible to identify the intended split-check according to transaction date and dollar amount.
  • Check deposits are handled in a similar fashion in that the back of any particular check may be used to record various deposits which the bank customer has previously made. Accordingly, an array of optional deposit icons 40 is provided on the back of the check, as shown, and assigned a unique letter or number designating the source of deposited funds. Again, these icons in the array 40 may or may not be provided with corresponding graphic icon designs, as desired, depending upon the additional printing expenses involved and the desirability of using graphic images to designate the source of funds deposited.
  • the customer marks the box 42 indicating that a deposit is being recorded. He then enters the appropriate deposit icon letter(s) in the column of boxes 34, designating the source of deposited funds, and enters the dollar amount of each check being deposited in the corres ⁇ ponding spaces 37 provided. The day, month and year of the deposit is entered in the boxes 43 provided.
  • the back of the check, itself may be used as deposit slip.
  • the back of the check is adapted to be scanned and processed substantially in the same manner as with the front of the check.
  • Specialized OCR software such as that available from Visionshape ® of Orange, CA, is used to analyze and/or read the hand-written letters or numbers entered in the boxes 36 and dollar amounts entered in the corresponding spaces 37.
  • these portions of the check may be processed and read manually by visual inspection of the back of the check itself or a pixel image thereof, as desired.
  • a bank customer using a printed bank check in accordance with the present invention can track his monthly expenditures without having to perform any secondary data entry steps. All of the expenditure category information may be recorded by the bank customer on the check, itself, contemporaneously with the check transaction.
  • expenditure tracking information may be downloaded directly from a bank or processing center, as desired, via modem or other means to a home or business computer for use with other accounting or expenditure tracking software.
  • a bank customer can have the flexibility of using his favorite computer accounting program to budget and monitor expenditures without having to perform secondary data entry of check transactions.
  • a wallet-size reference card showing icons and superimposed numbers may be further provided for later account adjustments using a telephone or computer network system, as desired, or for manually annotating receipts of petty cash expenditures.
  • FIGURE 3 is an enlarged view of the icon array 28 shown in FIGURE 1, illustrating in more detail a number of different possible graphic icon designs that may be provided on a printed bank check in accordance with the present invention.
  • bank checks having different types or numbers of icons may be provided, as desired, to suit the needs of particular customers according to whether, for instance, the customer is an individual, household, or business.
  • customers will be able to choose from a predetermined selection of custom graphic icons, which are then arranged on a bank check, as desired.
  • Certain bank customers will find it convenient to design their own icon array 28 when it is necessary or desirable, for instance, to indicate special or unusual expenditures peculiar to that individual bank customer.
  • a variety of graphic icon designs may be used on a printed bank check to represent any particular group of expenditure categories in accordance with the present invention herein disclosed.
  • a conventional 70 mm x 150 mm bank check can support an icon array 28 having a height "H" of about 50 mm and a width "W" of about 25 mm without encroaching into other zones of the check that preferably conform to banking industry standards, as illustrated in FIGURE 1.
  • icon array 28 may be used, as desired, while still enjoying the benefits of the present invention.
  • the size and shape of individual icons within the icon array 28 may also be varied, as desired, but are preferably no smaller than about 5 mm x 5 mm in order to ensure ease of recognition by bank customers.
  • the number of icons in the icon array 28 may be varied, as desired, while still enjoying the benefits of the present invention.
  • icon rows are separated by a vertical clear space S v of about 0.85 mm and icon columns are separated by a horizontal clear space S h of about 2.3 mm. It will be appreciated that these clear spaces provide a buffer for marks which may extend beyond a particular icon box.
  • a wider horizontal clear space S h separating each column of icons in the icon array 28 is preferred in order to provide additional room for compensating any horizontal image distortion caused by horizontal feeding of checks through a high-speed scanner, as will be described in more detail later.
  • the icon array 28 shown in FIGURE 3 is typical for individuals and household bank customers. While the individ ⁇ ual icons shown in FIGURE 3 are particularly suited for indicating corresponding expenditure categories, as will be described below, it will be readily understood by those persons skilled in the art that a wide variety of other icon designs may be used, as desired, to indicate the same or similar expenditure categories while still enjoying the benefits of the present invention. A brief description of the icons shown in FIGURE 3 is provided below for purposes of illustration only.
  • icon 45 illustrates a sun setting behind the front end of an auto ⁇ mobile.
  • This icon design may correspond, for instance, to automotive expenditures, such as routine maintenance, oil changes, gasoline, etc. Alternatively, any other image associated with automotive expenses may be used to represent such expenditures, such as an oil can, a gas pump, or the like.
  • icon 46 illustrates a basket-type grocery cart with wheels. This icon design may correspond, for instance, to expenditures made for groceries, laundry detergent and other items typically purchased at a grocery store. Alternatively, any other image associated with groceries or grocery stores may be used, such as a loaf of bread, a can of soda, etc., to represent such expenditures.
  • icon 47 shows a short-sleeve sports shirt. This may correspond, for instance, to expenditures made for purchasing and cleaning of clothing. Alternatively, separate icons may be used to represent expenditures for clothes purchases and for cleaning services, as desired.
  • icon 48 shows a gift box wrapped with a bow.
  • This icon design may correspond, for instance, to expenditures made for gifts and presents. Alternatively, any other image associated with gift giving, such as a birthday cake, a Christmas tree, etc., may be used to represent such expenditures.
  • icon 49 shows a cross. This icon design may correspond, for instance, to expenditures made for medical services. Alternatively, any other image associated with medical services, such as a doctor, nurse, stethoscope, etc., may be used to represent such expenditures.
  • icon 50 shows a picture of a capitol building superimposed on a large "T" . This icon design may correspond, for instance, to expenditures made for income taxes or FICA withholdings. Alternatively, any other image associated with payment of taxes or social security, such as a representative tax form, tax collector, Uncle Sam, etc., may be used to represent such expenditures.
  • icon 51 shows a small house having a window and a door.
  • This icon design may correspond, for instance, to housing expenditures, such as a mortgage or rent payments. Alternatively, any other image associated with housing expenditures, such as a deed, a bank, a landlord, etc., may be used to indicate such expenditures.
  • icon 52 shows a hammer extending into a circular background. This may correspond, for instance, to expenditures made for routine home maintenance, home improve- ments, tools, etc. Alternatively, any other image associated with home maintenance and improvements, such as a paint brush, handyman, etc., may be used to indicate such expenditures.
  • icon 53 shows a lamp on a table in front of a picture frame.
  • This icon design may correspond, for instance, to expenditures made for home furnishings, household decorating expenses and the like.
  • any other image associated with furniture or home decorating such as a lounge recliner, wall paper, carpeting, etc., may be used to represent such expenditures.
  • icon 54 shows a tele ⁇ phone. This icon design may correspond, for instance, to expenditures made for phone services. Alternatively, separate icons may be used, as desired, to indicate both local and long distance as well as cellular phone expenses.
  • icon 55 shows an electrical plug of the type found on small electrical appliances. This icon design may correspond, for instance, to expenditures made for electricity or electrical service. Alternatively, any other image associated with electricity or electrical service, such as an electrical socket, a lightning bolt, or the like, may be used, as desired, to represent such expenditures.
  • icon 56 shows a charge or credit card having a circle design, a magnetic strip and a charge number. This icon design may correspond, for instance, to expenditures made for credit card or charge cards. Alternatively, the front of an actual credit or charge card, such as a VisaTM or MastercardTM, may be used to indicate such expenditures.
  • icon 57 shows a set of eating utensils.
  • This icon design may correspond, for instance, to expenditures made for meals or restaurant services. Alternatively, any other image associated with restaurant services, such as a waitress, maitre d' or the like, may be used to represent such expenditures.
  • icon 58 shows a cap and tassel of the type used in graduation commencement ceremonies. This icon design may correspond, for instance, to expenditures made for educational purposes, such as college tuition, seminars, and similar expenditures. Alternatively, any other image associated with educational expenses, such as books, calculators, computers and the like, may be used, as desired, to represent such expenditures.
  • icon 59 shows a theater mask.
  • This icon design may correspond, for instance to entertainment expenses such as movies, theater, comedy clubs and the like.
  • entertainment expenses such as movies, theater, comedy clubs and the like.
  • any other image associated with entertainment such as a movie projector, a circus big-top, a martini, etc., may be used to represent such expenditures, as desired.
  • icon 60 shows an open hand extending into a light circular background.
  • This icon design may correspond, for instance, to expenditures made for charitable purposes.
  • any other image associated with charity or charity fund-raisers such as a homeless person,shriners cap or a United Way symbol, may be used to represent such expenditures, as desired.
  • icon 61 shows an airplane ascending into the sunset.
  • This icon design may correspond, for instance, to expenditures for travel, such as air travel, cruises, trains, etc.
  • any other image associated with traveling or vacations such as a cruise ship, a train, a map or the like, may be used, as desired, to represent such expenditures.
  • icon 62 shows a large dollar sign within a light circular background.
  • This icon design may correspond, for instance, to expenditures made for investment purposes.
  • any other image associated with investments such as a diamond, a ticker tape machine, etc., may be used to represent such expenditures, as desired.
  • the bottom row of icons 63-65 are special function icons provided for added check-writing flexibility.
  • the two "star" icons 63 and 64 are user-definable icons. Icon 63 is a dark star and icon 64 is a light star, as shown. These icons may correspond, for instance, to a particular type of expenditure transaction that does not readily fall within one of the other expenditure categories indicated. These may be expenditures peculiar to a particular bank customer or they may be unusual, one-time-only expenses such as, for example, wedding expenses or legal expenses. Alternatively, any other symbol, such as letters, numbers, etc. may be used to indicate these user- definable expenditure categories.
  • icon 65 shows a toggle switch.
  • This icon design may be used, for instance, in a similar fashion to a function key (i.e., SHIFT/ALT/CTRL) on a computer keypad, to indicate an extended or alternative list of icon expenditure category choices which may be recorded on a separate card or known to the bank customer personally.
  • a function key i.e., SHIFT/ALT/CTRL
  • an unmarked toggle icon 65 may indicated household expenditures
  • a marked toggle icon may indicate business expenditures, each according to its own particular icon array, as desired.
  • the toggle icon 65 may be used to indicate, for example, whether the check expenditure was made by the husband or wife in the case of a jointly held checking account. For instance, checks with the toggle icon 65 marked may indicate that the particular check expenditure was made by the husband.
  • An unmarked toggle icon 65 may indicate that the check expenditure was made by the wife.
  • any other image associated with this or any other desired function made such as a "T” or a picture of a "SHIFT” or "ALT” key, etc.
  • FIGURE 16 is an enlarged view of the icon array of FIGURE 3 illustrating in more detail the preferred shading of the various icons.
  • FIGURE 17 is a view of the icon array of FIGURE 16 shown in actual preferred size.
  • FIGURE 18 is an enlarged view of an alternative embodiment of a printed icon array having features of the present invention.
  • the icon array of FIGURE 18 is generally similar to that illustrated and described above in connection with FIGURE 3.
  • the icon 445 in FIGURE 18 corresponds to the car icon 45 shown in FIGURE 3, although the shape and shading of the icons are different.
  • the telephone icon 455 in FIGURE 18 corresponds to the icon 54 in FIGURE 3, although the shape, shading and positioning of the icons are different.
  • icon 447 shows the silhouette of children. This icon may correspond, for instance, to expenditures related to child rearing or day care costs. Alternatively, any other image associated with child rearing expenses, such as a baby crib or cradle, crying baby, pacifier, etc., may be used to represent expenses related to child rearing.
  • icon 447 shows the silhouette of children. This icon may correspond, for instance, to expenditures related to child rearing or day care costs. Alternatively, any other image associated with child rearing expenses, such as a baby crib or cradle, crying baby, pacifier, etc., may be used to represent expenses related to child rearing.
  • icon 447 shows the silhouette of children. This icon may correspond, for instance, to expenditures related to child rearing or day care costs. Alternatively, any other image associated with child rearing expenses, such as a baby crib or cradle, crying baby, pacifier, etc., may be used to represent expenses related to child rearing.
  • icon 447 shows the silhouette of children. This icon may correspond, for instance,
  • This icon design may correspond, for instance, to expenditures related to pet care or veterinary services. Alternatively, any other image associated with pets or veterinarian services, such as a goldfish in a bowl, a bird cage, dog bone, etc., may be used to represent such expenditures, as desired.
  • icon 450 shows a coin. This icon design may correspond, for instance, to small household expenditures, such as for light bulbs, household cleaners, etc. Alternatively, any other image associated with small household expenditures, such as a thumbtack, tape dispenser, scissors, bleach bottle, etc., may be used to represent such expenditures, as desired.
  • icon 458 shows a folded dollar bill.
  • This icon design may correspond, for instance, to expenditures related to a cash allowance, discretionary spending money, or miscellaneous purchases.
  • any other image associated with allowance or discretionary spending such as an open wallet, purse, etc., may be used to represent such expenditures, as desired.
  • icon 465 shows a portion of a rising stock investment curve.
  • This icon design may correspond, for instance, to expenditures made for investment purposes. Alternatively, any other image associated with investments, such as a diamond gem, a ticker tape machine, a stock certificate, etc., may be used to repre ⁇ sent such expenditures, as desired.
  • FIGURE 19 shows an enlarged view of another alternative embodiment of a printed icon array having features of the present invention particularly suited for business use.
  • the individual icons therein preferably represent the corres ⁇ ponding expenditure categories set forth in TABLE 1, below, with icon positions 1-28 indicated from left to right and top to bottom. Alternatively, those skilled in the art will readily appreciate that a variety of icon designs may be used to represent business expenditure categories, as desired.
  • FIGURES 3, 18 and 19 are preferred for indicating household and business type expenditures, it will be readily appreciated by those skilled in the art that any number of various graphic icon designs may be used to represent the same or similar expenditure categories. In other words, icons and corresponding categories may be changed to accommodate the needs of particular bank customers. It is further envisioned that different sets of icons may be provided to meet the needs of different types of households. For instance, a dual income couple with no children may have different expenditure tracking requirements than a family of five, or a single person in college, for instance. In an alternative embodiment, checks are printed with custom icons selected by bank customers from a pre-determined list according to their own individual needs.
  • FIGURE 20 is a detailed view of a personal-sized printed bank check illustrating the preferred placement and dimensions of an icon array 28 relative to the borders of the check. These dimensions preferably conform to well-known industry standards for reader/sorter equipment such as the IBM 3890 XP (image enabled) or BTI 5500 reader/sorter.
  • An icon array 28 for a conventional personal-sized bank check will have a preferred height "H" of up to about 55 mm and a preferred width "W" of up to about 24 mm as illustrated in FIGURE 20.
  • the individual icons in the icon array 28 preferably measure up to about 6.3 mm x 6.3 mm square (C and D) and are preferably separated by a clear space of between about 0.5 mm and about 2 mm vertically (S v ) and between about 1.25 mm and 3.8 mm horizontally (S h ) . More preferably, icon rows are separated by a vertical clear space S v of about 1.75 mm and icon columns are separated by a horizontal clear space S h of about 2.4 mm.
  • the icon array 28 is preferably spaced about 6.3 mm (B) from the left edge of the bank check.
  • the bottom row of icons is positioned about 11.5 mm (E) from the bottom edge of the check, as shown.
  • the icon array 28 is preferably spaced about 3.2 mm (A) from the top edge of the bank check.
  • a minimum space of about 3.8 mm (I) is provided between the icon array 28 and other writing zones on the check face.
  • Business-sized bank checks may accommodate a larger icon array 28, as shown in FIGURE 21.
  • a typical icon array 28 for a business-sized bank check will have a preferred height "H" of up to about 55 mm and a preferred width (W) of up to about 32.5 mm as illustrated in FIGURE 21.
  • twenty-eight icons are arranged in four columns of seven rows each.
  • the icon array 28 in FIGURE 21 is preferably spaced about 9.5 mm (A) from the top edge of the bank check. All other icon array dimensions are preferably the same as described above in connection with FIGURE 20. 2.
  • the icons 45-65 shown in FIGURES 1 and 3, the icons 445-465 shown in FIGURE 18 and the icons shown in FIGURE 19 are printed using a novel technique that provides an icon having not only good image detail and aesthetic appeal, but also enhanced detectability of a mark made thereon by a bank customer. It will be further understood, that while the present invention is described in the context of a printed bank check, it is envisioned that icons constructed in accordance with the present invention may provide similar advantages and benefits in a wide variety of other applications, such as in public opinion polling, voting, surveys, standardized testing, etc.
  • FIGURE 4 is an enlarged view of a printed graphic icon having features of the present invention.
  • the icon 46 generally comprises a relatively dark, preferably solid black, outer portion 74 and a relatively light inner portion 75, as shown in FIGURE 4A.
  • the dark outer portion 74 is preferably sufficiently dark such that its light absorptivity falls above a predetermined threshold level.
  • the light inner portion 75 is preferably sufficiently light such that its light absorptivity falls below a predetermined threshold level.
  • a mark is be detected by scanning the icon 46 and applying threshold imaging (described later) to obtain a bi-level pixel image thereof, as illustrated in FIGURE 4B. Any mark made on the icon would then appear as dark pixels within a pre ⁇ determined intended marking area 77.
  • the particular absorptivity levels selected for the light and dark portions of the icon will depend, among other things, on the sensitivity of a scanner used to scan the each icon, the aesthetic appearance of the icons, as well as the inherent limitations of the particular printing process selected. It will be appreciated that a higher absorptivity will produce a darker appearing icon. Lower absorptivity will produce a lighter appearing icon.
  • an absorptivity of between about 0.10 and 0.50 and, more preferably, about 0.15, is preferred and provides a convenient compromise between the competing design objectives indicated above.
  • the dark outer portion is preferably as dark as possible, having an absorptivity that is at least greater than about 0.75 and, more preferably, greater than about 0.90. Sufficient tolerance is preferably provided to accommodate for any possible variations in printing ink density, color, printing conditions, or the substrate itself. A tolerance level of about plus or minus 10% produces adequate results under most printing conditions. Alternatively, higher or lower absorptivity or tolerance levels may be used, as desired, while still enjoying the benefits of the present invention as disclosed herein.
  • the dark outer portion 74 of the icon 46 completely encloses and defines an inverted silhouette of the particular icon design, as shown in FIGURE 4B, in this case a grocery cart.
  • the intended marking area 77 is further defined within this inverted silhouette area, as shown in FIGURE 4C, and preferably encompasses a relatively large, centrally disposed portion of the light inner portion 75 of the icon 46, as shown.
  • Image detailing is preferably provided within the light inner portion 75 of the icon 46, as shown in FIGURE 4A. These embellishments aesthetically enhance the icon and provide improved recog ⁇ nition of each particular icon design.
  • this image detailing 78 is printed using one or more light colored inks which are screened using a half-tone printing process or other means, as desired, such that the light absorptivity of the light inner portion 75 remains below the aforementioned threshold absorptivity level. This ensures that any such detailing 78 will "drop out" of a scanned pixel image of the icon 46 or may be filtered out or removed using threshold imaging, as will be described in more detail later.
  • Choice of color, use of dithering screens and very thin lines can all be used to decrease the light absorptivity of the detailing 78, as needed, to ensure that it consistently drops out of the scanned image. It is particularly convenient to use certain printing inks referred to in the printing trade as "spot" colors. These printing inks possess a quality whereby the shade and intensity of the color remain substantially constant from print run to print run. Using spot colors for the detailing 78 ensures that these embellish ⁇ ments will drop out consistently from one icon printing run to the next. For instance, a Kramer Process Blue ink screened with a density of between about 10% and 50% and, more preferably, between about 20% and 35% on a light colored substrate produces acceptable results for detailing 78.
  • the screen is preferably canted by between about 30 and 60 degrees and, more preferably, by about 45 degrees from horizontal.
  • the detailing 78 may be screened such that the individual dots comprising the detailing 78 are arranged in a random or substantially non-uniform pattern, as desired.
  • the area ratio of light to dark portions of the icon 46 may be varied as desired, although a light/dark ratio of
  • An optional black outer frame 79 may be provided around the periphery of the icon 46, as desired, in order to provide a defined area within which the graphic icon 46 is fully contained.
  • 25 frame 79 and the white space on either side of the frame 79 provides a convenient reference for locating, scaling and aligning icons, as will be described in more detail later.
  • a mark placed on an icon in accordance with the present invention is detected by scanning
  • Threshold imaging is a well known image processing technique that basically converts a pixel image in the form of a plurality of analog or digital readings of light
  • absorptivity or reflectivity into a bi-level pixel image in which individual pixels are either black ("1") or white ("0") .
  • Black is arbitrarily defined as a light absorptivity reading above a predetermined threshold level
  • white is arbitrarily defined as a light absorptivity reading below a predetermined threshold level.
  • Absorptivity is simply another way to describe the light reflectivity of a particular substrate surface at a desired wavelength. Either term may be used to describe measured light reflectance, but absorptivity will be used here for convenience in later discussions.
  • Light absorptivity readings falling above the black/white threshold appear as black pixels. Absorptivity readings falling below this threshold level appear as white pixels.
  • Threshold imaging may occur in the scanner itself, such as in a bi-level image scanner, for instance.
  • the black/white threshold corresponds to the inherent threshold detection level of the scanner for discerning black from white. This may be adjustable, depending upon the particular scanner.
  • a grey-scale scanner is used to capture the icon image in various shades of black, white and grey.
  • Threshold imaging is then applied in a separ- ate computer imaging system or other image processing device in order to obtain a black and white bi-level pixel image suitable for detecting marks made on the icon.
  • the black/white transition or threshold detection level may be conveniently calibrated in the computer imaging system software or programming, again, depending upon the particular device.
  • icons in accordance with the present invention are adapted to be scanned using a drop-out blue scanner.
  • other wavelengths of light or non-visible radiation may be used, as desired, to achieve the benefits of the present invention as taught herein.
  • the absorptivity of light and dark portions of the icon will be selected having reference to those particular wavelengths.
  • any number or combination of colored filters may be used for icon scanning, as desired, to achieve a particular desired result or effect as taught herein.
  • FIGURE 5 is an enlarged view of an alternative embodiment of an icon printed in accordance with the present invention, illustrating how the icon may be marked by a user.
  • Like numbers are intended to correspond to like characteristics or features of the icon, although the particular shape or form of the icon 45 may be different, as shown.
  • the mark 84 is a typical type of mark which may be placed on an icon constructed in accordance with the present invention. It is an "X" located mostly within the outer icon frame 79, but perhaps partially extending out of the frame, as shown. It may be seen that the center of the mark 84 is located approximately within the intended marking area 77, which in this case, roughly corresponds to the shape of the inverted silhouette formed by the dark outer portion 74.
  • the mark 84 produces a relatively low contrast with the dark outer portion 74 of the icon 45 and a relatively high contrast with the light inner portion 75, including detailing 78, as illustrated in FIGURE 5A.
  • this dramatically enhances the detectability of the mark 84 within the marking area 77, as will be explained.
  • the mark 84 is detected by electronically masking the dark outer portions 74 of the bi-level image shown in FIGURE 5B with a template or mask 86 that has an open area (within the dashed lines) corresponding roughly to the size and shape of the intended marking area 77.
  • this is done electronically in a computer imaging processing system, as will be explained in more detail later.
  • the open area of the mask 86 is somewhat smaller than the corresponding intended marking area 77 so that a degree of image tolerance is thereby provided for slight variances and misalignment of the mask 86 and the icon 45.
  • Image tolerance may be provided uniformly around the open area of the mask 86, substantially as shown or, more preferably, the mask is adjusted by trial and error testing so as to provide larger tolerances in certain "problem" areas and smaller tolerances in other areas.
  • this maximizes the size of the mask within the intended marking area in order to provide optimal dynamic range of mark detection.
  • a variety of mask shapes and sizes may be used, as desired, while still enjoying the benefits of the present invention as herein disclosed.
  • FIGURE 22 is an enlarged view of another alternative embodiment of a graphic icon having features of the present invention.
  • the icon 464 generally comprises an outer portion 474 defining an inverted silhouette of a desired icon design, in this case a credit card having a magnetic strip.
  • the outer icon portion 474 is preferably printed in a solid color using a suitable drop-out ink, as will be described in more detail below.
  • An inner icon portion 475 is provided within the silhouette area defined by the outer icon portion 474.
  • Various graphic details 478 are providing within the inner icon portion 475, as shown, further defining the icon design and enhancing human recognition thereof.
  • the graphic details 478 are preferably also printed in drop-out ink using any one of a number of well-known half-tone screening techniques such that they appear lighter than the outer icon portion 474.
  • the resulting icon 464 has an overall aesthetically pleasing appearance, enhanced user recognition of the icon design and improved machine detection of marks made thereon.
  • the light inner icon portion 475 also provides a target marking area for providing maximum contrast with a mark made thereon by a user so that the user can readily see when the icon has been adequately marked.
  • the inner icon portion 475 has only minimal or no shading 478 such that the open area therein is as large as possible for enhancing mark contrast and improving user recognition thereof.
  • less than about 25% and, more preferably, less than about 10% of the inner icon area 475 comprises shading 478.
  • a thin, black frame 479 may be provided around the outer icon portion 474, as shown, to further define the intended marking area.
  • the frame 479 preferably measures about 6.4 mm x 6.4 mm square and is at least 0.7 points (0.25
  • a suitable drop ⁇ out ink has a spectral absorptivity or "print contrast signal” ("PCS") of about 0.40 or less.
  • PCS can be measured on well- known commercially available test equipment equipped with a filter having a peak spectral response at 5550 angstroms (555 nanometers) and a one-half peak spectral response at 5100 to 6100 angstroms (510 to 610) nanometers.
  • the most preferred color is Purple Pantone #251. This color has a PCS of 0.23 and provides optimal contrast and aesthetic appeal for most applications.
  • FIGURE 22B illustrates how the icon 464 appears to a scanner having a threshold PCS detection level above about 0.40. As shown, the entire icon 464 (with the exception of the outer frame 479) is invisible to the scanner. Any marks made on the icon 464 will readily appear in a bi-level pixel image of the icon 464 as dark contiguous pixels disposed within the dark outer frame 479.
  • a pixel image of an array of such icons 464 will reveal the relative positions of each icon by the outer frame 479 so that a bank customer can visually identify any marks made thereon.
  • the black outer frame 479 may be omitted, as illustrated in FIGURE 23A, such that the entire icon 464' will be invisible to a scanner as illustrated in FIGURE 23B.
  • checks are sorted and processed electronically using a scanner and computer imaging system capable of discerning which of a plurality of icons have been marked by a customer.
  • a computer software routine is implemented by the computer imaging system or other computer image processor to detect particular marked icon(s). Marked icon(s) are then translated into corresponding expenditure categories which are stored in a transaction record in association with other information representative of each check transaction.
  • FIGURE 6 is a schematic illustration of one embodiment of an expenditure tracking system in accordance with the present invention.
  • the expenditure tracking system comprises a MICR decoder 104, a scanner 106, and a central processor 108.
  • a printer 110 or other output means may be provided, as desired, but is not necessary to practice the invention herein disclosed.
  • Bank checks 8 are drawn via conventional high-speed check handling equipment shown here schematically as comprising conveyor belt 102, through a MICR decoder 104 and a scanner 106. For continuous operation, checks are fed through the expenditure tracking system on a substantially continuous basis as they come in. More preferably, however, the system is operated in a batch mode whereby stacks of checks are inserted into the machinery, shown, and processed in a batch mode with a transaction record being generated and stored for each batch run.
  • the MICR decoder 104 and scanner 106 are adapted to decode and scan bank checks while they are fed through horizontally on edge, as shown.
  • Commercially available MICR decoders and scanners are capable of handling up to 60,000 checks per hour, depending upon the particular machine and the complexity of the check image to be scanned.
  • a DEC Kiensel combination scanner and computer imaging system available from Digital Equipment Corporation, for instance, provides a convenient scanner 106.
  • a variety of other high ⁇ speed scanners are commercially available from such manufacturers as NCR, Kodak and Unisys, and may be used, as desired, to practice the present invention.
  • the MICR decoder 104 is preferably of a type that is commonly available in the banking industry for decoding MICR code and electronically conveying information representative of the MICR code to an associated computer or other peripheral device. Although shown here separately for illustrative purposes, the MICR decoder 104 more preferably comprises a magnetic reading head or module that is incorporated into a single integral structure with the image scanner 106. Preferably this comprises an NCR 7780 High-Speed Power Encoder fitted with a MICR Reader Module, available from NCR Corporation.
  • the central processor 108 preferably comprises a high- speed computer having at least a 66 MHz 486 microprocessor, 16 MB of working RAM, 2 GB of fixed disk or magnetic tape storage and an image capable high-resolution, high-refresh monochrome monitor.
  • the central processor 108 may comprise any computer imaging system or other computer image processor capable of receiving and processing pixel images and other information at high rates of speed. It will be further appreciated that such image processing may either be done on ⁇ line or off-line, depending upon the relative speed of the central processor 108 compared to the speed of the MICR decoder 104 and scanner 106.
  • the MICR decoder 104 reads the magnetic encoded numbers on the bottom of each check 8 and transmits this information to the central processor 108.
  • the scanner 106 then scans the front and, preferably, the back of each check 8 in substantially rapid succession and transmits a pixel image thereof to the central processor 108.
  • other scan resolutions or pixel image sizes may be used, as desired, while still enjoying the benefits of the present invention. It is important, however, that the scan resolution and pixel image size be at least minimally sufficient to allow recognition of a mark made on the check by a writing instrument such as a ball-point pen.
  • each check 8 is then analyzed in the central processor 108 to determine which, if any, of a plurality of graphic icons have been marked. It will be understood that these pixel images need not be actually displayed, but may be stored in working memory and manipulated in accordance with well known pixel imaging techniques.
  • this information is then combined with other transaction information, such as the dollar amount of the check, check transaction number, bank account number, bank routing number, and payee name, in order to generate an expenditure statement 112 which may be provided to the bank customer, as desired.
  • this information may be electronically downloaded, as desired, via modem or other means to a home or business computer 114, as shown.
  • FIGURE 7 is a front view of one possible embodiment of an expenditure statement 112 in accordance with the present invention.
  • the statement 112 contains customary information such as the account number and bank customer name at the top, as shown. Expenditures are then broken down by category, such as auto expenses, groceries, etc., as shown. Within each category are listed corresponding check transaction numbers 113, obtained, for instance, from the MICR code. Next to each check transaction number 113 is provided a printed image of the payee name 114, obtained from the check image, and the amount of the check 115, as determined from the MICR code. Optionally, this check amount may be verified against the amount written in the check amount box using a modified OCR technique described in more detail later.
  • image capturing and reproducing of the payee box 16 provides a convenient way of reporting each check transaction to a bank customer without having to return or provide copies of individual checks. Furthermore, it provides additional security by affording the bank customer an opportunity to identify and verify the payee name and thereby determine if the check had been fraudulently written or obtained.
  • OCR optical character recog ⁇ nition
  • one or more optical character recog ⁇ nition (“OCR") techniques may be used to convert a hand ⁇ written or typed payee name in the payee box 16 into ASCII equivalent characters that can be similarly reproduced in an expenditure statement or other accounting statement provided to the bank customer.
  • Image capturing and reproducing of the text image within the payee box 16 is preferred, however, due to the current difficulties of primary recognition of hand ⁇ writing using presently available OCR techniques and the aforementioned benefits of reproducing the actual payee box 16 on the expenditure statement 112.
  • the above described expenditure statement is convenient for monitoring monthly expenditures in each of a plurality of expenditure categories.
  • a wide variety of different types of expenditure statements may be generated, as desired, such as a year-to-date statement or an assets-and- income statement, etc.
  • Expenditure information may also be organized into a pie chart or other similar graphic form in order to visually illustrate a particular breakdown of expenditures, as desired.
  • various graphs, tables and statement forms may be provided to convey expenditure tracking information to a customer in a convenient and useful way.
  • such expenditure tracking information is incorporated into a conventional bank statement to provide a more detailed and useful analysis of account deposits and withdrawals.
  • a statement would be an all-encompassing statement of expenditures, deposits, account balance, interest earned, ATM, POS, and EFT withdrawals and transactions, etc.
  • This format is particularly desirable for banks that wish to offer such premium services as part of a preferred customer program or other incentive program intended to attract and keep bank customers.
  • such statements may become standard in the banking industry as customers continue to demand more detailed and useful account information from their banking institutions.
  • FIGURE 8 is a more detailed schematic block diagram of an expenditure tracking system having features of the present invention.
  • bank checks 8 are sent through the MICR decoder 104 and the scanner 106.
  • the order in which the check 8 enters the decoder 104 and the image scanner 106 is relatively unimportant; however, for convenience it is preferred that the MICR decoder 104 reads the check first so that the MICR code may be used thereafter as a reference number for subsequent processing steps.
  • the MICR decoder 104 transmits to the central processor 108 an electronic signal which corresponds to the MICR code recorded on the bottom of the check 8.
  • the scanner 106 is adapted to scan the check 8 at high speeds and produce an image thereof 8' which is also provided to the central processor 108.
  • the scanner 106 is preferably adapted to produce a 16 level grey-scale pixel image of each check. Alternatively, the scanner 106 may be adapted to provide a bi-level image of each check, as desired.
  • the central processor 108 receives a series of binary data from the scanner 106 representative of a pixel image 8' of each check. This is preferably in the form of a TIFF file or other standard pixel image format, such as an ASCII file with commas delimited zones.
  • a computer subroutine 117 processes this image by applying threshold imaging, aligning the image and correcting for minor distortions.
  • Another subroutine 118 captures the pixel image of the amount box 18' .
  • Subroutine 120 verifies that the amount written in the amount box 18' corresponds to the amount read from the MICR code by the decoder 104. This may be done using a secondary OCR recognition technique, which will be described in more detail later.
  • a second image capture subroutine 122 captures a pixel image of the payee box 16', as shown. This is recorded in pixel form in the transaction record by the transaction update subroutine 121.
  • a third image capture subroutine 124 captures the icon array 28', as shown, as well as any optional icon boxes (not shown) .
  • a novel mark detection subroutine 126 determines which icons (if any) have been marked and provides this information to the transaction update subroutine 121. The transaction record is thereby updated accordingly, with the check amount, payee, and expenditure category as described herein. Periodically, the central processor 108 may be prompted to provide a cumulative download of certain transactions recorded in the transaction record.
  • FIGURE 9 is a more detailed flow chart of the image processing subroutine 117 shown in FIGURE 8. This is preferably in the form of a computer software subroutine or other electronic circuitry that may be called on demand to perform the steps described.
  • the subroutine 117 begins at step 150 with the routine initialization of variables, defining common variables, allocation of working memory space, etc.
  • Step 151 inputs the pixel check image 8' from the scanner 106 (shown in FIGURE 8) into working memory.
  • the check image 8' is stored in a commonly accessible memory location such that the image may be accessed by any subroutine or software called to operate or perform functions on the image.
  • This may be, for instance, a specifically allocated portion of RAM memory associated with the central processor 108, itself, or in an external storage device, such as a hard disk or CD-ROM disk, as desired.
  • the image 8' is stored in binary or hexadecimal form in a TIFF file or other pixel image format wherein each binary digit represents a particular pixel location of the image. Each image will occupy approximately 192 K of working memory.
  • the storage and accessing of pixel image information in working memory is well known to those skilled in the art.
  • the pixel image may be stored in memory row-by-row, column-by-column, or any other convenient means for storing pixel images.
  • it is stored row-by-row, starting with the pixel in the upper left most corner of the check image and proceeding to the right until the last pixel in each row is reached.
  • An end-of-row code such as a "00" or "FF" may be inserted into the series of binary data representative of the check image 8' to indicate the end of each pixel row. The data then continues with the left most pixel of the next row.
  • the beginning and end of each pixel image stored in memory may be further defined by recording the first and last memory location occupied by the data representative of the image.
  • consecutive images may be "stacked" separated by an appropriate hexadecimal code, as desired, indicating the beginning and end of each pixel image.
  • any number of pixel images may be stored as linear arrays of binary or hexadecimal data which can be stored and accessed serially in working memory or other storage media, as desired.
  • threshold imaging is applied at step 152 to convert the image to black and white.
  • Threshold imaging may be done, for instance, by defining a desired threshold black/white level and then comparing each grey-scale pixel to this threshold level to determine whether it falls above or below the threshold level. This will likely be a trial and error process for each particular check design.
  • the threshold should not be set so high that marks made upon the bank check by a bank customer will tend to fall below the threshold and drop out.
  • the threshold level is set just above the level that will cause the light inner portion of each icon to consistently drop out. This provides optimal dynamic range of mark detection.
  • a threshold level of between about 7 and 10 and, more prefer ⁇ ably, about 9 provides a convenient threshold level for most scanning purposes. Pixels falling above this threshold level
  • bi-level pixel image is stored in working memory or other convenient memory location, as desired, for further processing.
  • the check image 8' is compared at step 153 to a reference or sample check image that has also been stored in an accessible location in working memory.
  • the images are first compared for size in step 154 using a combination of an edge detection and pixel counting techniques.
  • the check image is initially processed by filtering out all areas but those showing the highest contrast. This will occur wherever a white pixel is next to a black pixel and indicates the presence of an "edge" .
  • the check 8 in FIGURE 8 has been scanned against a dark or black background by the image scanner 106, such that the edge of the check image 8' will show high contrast with the black background.
  • the approximate size of the check image is then determined by counting or estimating the number of pixels within the check outline. If this image is significantly larger or smaller than the corresponding sample check image then the check is either aborted or, optionally, the check image 8' may be scaled at step 156 using any one of a number of well known pixel image scaling techniques, such as those contained in Visionshape's AutoClass ® software library, available from Visionshape of Orange, CA. If size correction is attempted, then the scaled image is again compared at step 153 to the sample check image. If the size of the image is now within predetermined tolerances, such as plus or minus 10%, then the subroutine 117 proceeds to the next step 156.
  • Step 156 determines whether the image is distorted either vertically or horizontally.
  • Vertical distortion refers to a scaled check image that is either taller or shorter than the sample check image.
  • Horizontal distortion refers to a scaled check image that is longer or shorter horizontally than the stored check image. Either one of these types of distortions may occur in a high speed scanner using raster or linear array scan input. Distortion may be caused, for instance, by variations in the speed of the check going past a linear CCD scanner, causing the image to either be stretched or compacted. If the checks are fed horizontally, then hori- zontal distortion is more likely. If the checks are fed vertically, then vertical distortion is more likely. It is desirable to keep such speed fluctuations and distortions to a minimum.
  • a photographic-type image-capturing device may be used, as desired, to take a substantially instantaneous "snap shot" of the entire check image. In that case, it will be appreciated that the likelihood of image distortion is substantially reduced. Either type of scanner may be used depending upon cost and availability. If significant image distortion is detected, then the check is aborted.
  • step 158 may be provided in order to attempt to correct this distortion by either stretch ⁇ ing or shrinking the check image 8' either vertically or horizontally, as the case may be. This may be done using any one of several well known pixel image scaling techniques, such as contained in the aforementioned Visionshape AutoClass ® software library. If distortion correction is attempted, then the check image 8' is again compared to the sample image in step 152 and readjusted, as desired, until it is within predetermined tolerances, such as plus or minus 10%.
  • the next step 160 is to check for image skew. This may occur, for instance, if a check is not lying flat on one edge as it is drawn past the image scanner 106 shown in FIGURE 8. This may cause the resulting check image 8' to be angled or rotated from its normal horizontal position.
  • Image skew is detected using a line detection technique, such as available from Visionshape's Autoclass Library, whereby known vertical and horizontal lines on the check image 8' are detected and then analyzed to determined if they are skewed. Degree of skew is preferably determined according to the average of all detected lines.
  • step 162 attempts to remedy this skew by rotating the image 8' .
  • This may be done using any one of several well known pixel image rotation algorithms, such as is contained in the aforementioned Visionshape AutoClass ® software library.
  • image rotation is incremented in accordance with the direction and angular degree of skew detected. Several rotations may be necessary before the image is within acceptable skew tolerances, such as, for instance, plus or minus 3 degrees rotation.
  • Step 164 verifies that the correct side of the bank check has been scanned or, in other words, that the check 8 has not been flipped front-to-back in the image scanner 106.
  • This is preferably accomplished using a pixel image overlay technique whereby a sample check image is combined or merged with the check image 8' using an appropriate Boolean operator, such as AND, NAND or XOR (exclusive OR) , operating upon corresponding pixels.
  • Boolean operator such as AND, NAND or XOR (exclusive OR) , operating upon corresponding pixels.
  • the resulting image roughly reflects the percentage overlap of individual pixels between the sample image and the check image 8' .
  • a high percentage of pixel overlap would indicate a relatively high probability that the check images correspond such that the front of the check has probably been scanned.
  • a low percentage of pixel overlap would indicate that the front of the check has probably not been adequately scanned or is otherwise non-recognizable.
  • a flipped check image may be detected using any one of several pixel image recognition or verification algorithms such as is contained in the aforementioned Visionshape AutoClass ® software library.
  • next step 166 attempts to correct this by switching or flipping the image from back to front. If both sides of the check have been simultaneously scanned by the scanner 106, then the images are swapped electronically. If not, then mechanical means are provided for routing the check back through the image scanner so that the other side is presented for scanning.
  • each of the image correcting loops 153-166 has an abort feature whereby the check is automatically aborted or the correction procedure is automatically termi ⁇ nated after a certain predetermined number of correction attempts have been made.
  • the threshold for aborting may vary from one correction step to the next. For instance, for the scaling of the image 154 it may be convenient to set an abort threshold of say 8-10 tries, whereas the flipped image 166 may have an abort threshold of only two tries since if neither side of the check produces correspondence with the sample check image then it is probably not possible to process it in the automated check expenditure system of the present invention.
  • a check is aborted, it is preferably forwarded to a manual inspection station or other auxiliary service station so that the system can proceed with other checks, the bulk of which will be able to be deciphered and processed automatically by the expenditure tracking system.
  • the corrected check image 8" is stored in memory as discussed above in connection with the step 151. This may be at the same memory location or a different memory location as the original check image 8', as desired, although preferably it is overwritten in the same memory location so as to conserve use of memory space.
  • the subroutine 117 terminates at step 174 and command control is passed back to the central processor 108 for performing further processing upon the corrected check image 8", as will be described below.
  • FIGURE 10 shows a more detailed flowchart diagram of the image capture subroutine 118 shown in FIGURE 8.
  • the subroutine is initialized at step 180.
  • the corrected check image 8" is inputted from the preceding image processing step 117 shown in FIGURE 8. Again, this inputting step is preferably accomplished by enabling access to a commonly accessible memory location where the corrected check image 8" is preferably stored.
  • step 184 locates the amount box 18' on the check image. This is preferably accomplished using a combination of edge detection and zone locating tech ⁇ niques. In this technique a zone is defined on the check image relative to known marks or lines on the check, itself.
  • the size of this zone is preferably at least slightly larger than the amount box 18' in order to accommodate for slight variations in the size and location of the amount box 18 occurring during previous scanning and image processing steps.
  • a convenient zone size for the amount box is approximately 75 pixels vertically by approximately 330 pixels horizontally and corresponds roughly to the proportions of the amount box 18 shown in FIGURE 1. Alternatively, larger or smaller zones may be used, as desired, depending upon the observed accuracy of the system in locating the amount box 18' for each particular check design.
  • step 186 isolates the amount box image 18' . This will result in a somewhat smaller pixel image measuring approx ⁇ imately 75 pixels vertically by 300 pixels horizontally.
  • the pixel image 18' is then filtered at step 188 using any one of several conventional pixel image filtering techniques, such as speckle removal, available from Visionshape's AutoClass ® software library.
  • speckle removal any individual pixels or small groups of pixels having no contiguous neighbors are reversed so that they will become contiguous with their neighbors.
  • a small black spot appearing in an otherwise white zone would be replaced with a white spot so that a contiguous white image is presented.
  • white spots found in a black contiguous area The number of pixels comprising an individual speckle may be varied as desired to provide a convenient level of filtering. If the speckle size is set to low, then not all the speckles in the image may be removed.
  • the speckle size for filtering is selected to correspond to at least a size smaller than a normal decimal point made by a ballpoint pen.
  • the filtered image of the amount box 18' is outputted for further use by the central processor 108, as will be described below.
  • the subroutine terminates at step 190 and command control is passed back to the central processor 108.
  • FIGURE 11 is a further detailed flowchart diagram of the subroutine 120 shown in FIGURE 8.
  • This subroutine verifies that the amount indicated in the amount box 18 corresponds to the amount entered on the check in MICR code.
  • the subroutine is initialized at step 196, as shown.
  • the MICR code is inputted at step 198 and stored temporarily in working memory.
  • Step 200 extracts from this MICR code the dollar amount of the check represented by the right most eight MICR digits on most checks. In this case, the MICR code indicates that the check is for $126.69. This dollar amount is stored in working memory at step 202, as shown.
  • Step 204 inputs the pixel image of the amount box 18' obtained from the subroutine 118, as previously described. Again, this is preferably inputted by enabling access to a common memory area containing binary data representative of the pixel image 18' . Beginning on one side of the image 18' step 206 isolates each digit in the pixel image 18' proceeding from right to left, in this case, beginning with the numeral "9". Alternatively, verification may proceed from left to right, as desired.
  • Digit isolation is accomplished using conventional image processing techniques such as have been described previously.
  • the image is divided into segments separated (if possible) by at least one vertical column of substantially contiguous white pixels. These white pixels represent a space between individual digits.
  • the numeral "9" may be separated from the rest of the image by locating a vertical column of substantially contiguous pixels between the six and the nine so that the character nine can then be isolated and examined in more detail.
  • OCR recognition is preferably secondary, however, in that the software is instructed to begin with the particular expected character, in this case the numeral "9".
  • the OCR software looks for and confirms the existence of several characteristic features of the particular isolated digit and generates a match percentage output representative of the percentage likelihood that the isolated digit is the expected digit. For example, for the numeral "9" the OCR software may look for a substantially vertical line or slightly curved line connected to a contiguous top portion which formes a closed loop.
  • the OCR software is instructed to stop after the first attempt at recognition is made. If the match percentage output is greater than a predetermined threshold percentage, then a "match" is assumed and the subroutine proceeds to the next step. If the match percentage output is less than the predetermined threshold, then the check is aborted at step 212 and either rescanned to obtain a better image or manually inspected, as desired.
  • the confidence level of the verification subroutine 120 can be adjusted, as desired, by increasing or decreasing the threshold match percentage required to assume a match has been made.
  • a threshold match percentage of between about 75% and 100% and, more preferably, about 90% provides a convenient confidence level for most expenditure tracking purposes.
  • the next step 214 asks whether there are more digits to be compared.
  • This step basically uses the OCR software to verify whether the isolated digit corresponds to a printed dollar sign, which is also preferably captured in the amount box 18' .
  • the software recognizes the printed dollar sign, it assumes that it has reached the end of the left most field of the amount image 18' . Because this dollar sign is printed uniformly on each check, it is easily recognizable using the OCR software described above. Alternatively, a simple pixel image overlay technique may be used, as desired. If step 214 determines that there are more digits to be compared, then step 216 increments the digit counter N and returns the subroutine to the step 206 for isolating the next digit.
  • step 216 outputs the verified MICR dollar amount for use in subsequent processing steps.
  • the subroutine 120 terminates at step 218 and command control is passed back to the central processor 108.
  • FIGURE 12 is a more detailed flowchart diagram of the subroutine 122 shown in FIGURE 8.
  • This capture subroutine 122 is similar to the capture subroutine 118 described previously with a few exceptions that will be described.
  • the subroutine is initialized at step 230.
  • Step 232 inputs the corrected check image 8" into working memory. Again, this is preferably done by enabling access to a commonly accessible memory area, as described previously.
  • Step 234 locates the payee box 16 using the edge detection technique described previously in connection with FIGURE 10. A zone is defined corresponding to the expected location of the payee box 16 and an isolated pixel image is obtained thereof in step 236. This image is then cropped and rotated as desired so that it will present neatly in an expenditure statement, as shown previously in
  • FIGURE 7 This image is then filtered at step 238, if desired, using the aforementioned speckle removal filtering technique.
  • the filtered image of the payee box 16' is then outputted, as shown, for further use by the central processor
  • the subroutine 122 terminates at step 240 and command control is passed back to the central processor 108.
  • FIGURE 13 is a more detailed flowchart diagram of the subroutine 124 shown in FIGURE 8.
  • This subroutine captures an image of the icon array 28' including any supplemental or auxiliary icon boxes (not shown) .
  • the subroutine is initialized at step 250.
  • the corrected check image 8" is inputted at step 252, preferably by enabling access to a commonly accessible memory area containing binary data representative of the check image 8".
  • Step 254 locates the icon array 28' . This may be done using any one of a variety of pixel image detection techniques, as previously described.
  • a combination of zone locating and edge detection techniques are used to locate the icon array 28' .
  • a suitable zone is defined such that it covers substantially the entire area within which the icon array 28' is expected to be found.
  • a zone measuring approximately 660 pixels vertically by approximately 330 pixels horizontally provides a convenient zone size for capturing the icon array 28' .
  • edge detection is used to locate the edge of white pixels just outside of the outer frame of individual icons in order to register the image for subsequent processing.
  • the image 28' may be filtered in step 258 using a speckle filtering technique, as described previously. The filtered image 28" is then outputted for further processing by the central processor 108.
  • the subroutine terminates at step 260 and command control is passed back to the central processor 108.
  • FIGURE 14 is a more detailed flowchart diagram of the subroutine 126 shown in FIGURE 8.
  • This subroutine determines which, if any, icons have been marked by a bank customer.
  • the subroutine 126 is initialized at step 270.
  • the filtered image of the icon array 28" is inputted at step 272, preferably by enabling access to a commonly accessible memory area containing binary data in the form of a TIFF file represen- tative of the image 28".
  • Step 274 locates each individual icon "N" by zone location using the white edge just outside of the black outer frame of individual icons as reference lines.
  • Step 276 isolates each icon "N" by first copying the pixel image within the corresponding zone into a separate TIFF file stored in working memory and then applying edge detection to locate the white edges just inside the black outer frame of the copied icon image.
  • step 278 further filters each individual icon image to remove any remaining spurious noise or other image defects present in the icon image. Individual icons are then masked in order to remove known dark portions of the icon image, as described previously in connection with FIGURE 5C.
  • a suitable mask such as mask 86 shown in FIGURE 5C, is preferably created for each particular icon and is stored in working memory in the form of a bi-level pixel image or TIFF file that can be accessed and manipulated similar to the pixel icon images described above.
  • the mask may reside in working memory in the form of a predetermined algorithm for removing or transforming known dark portions of each corresponding icon.
  • several steps are first performed to adjust the icon image and/or mask to provide a desired correspondence therebetween. It is particularly important to ensure that the icon and mask images are properly aligned so that known dark areas of the icon image will not protrude through open or white areas of the corresponding mask.
  • the open or white area of the mask 86 (corresponding to the area inside the dashed lines in FIGURE 5C) is preferably somewhat smaller than the intended marking area 77, as indicated, in order to provide a degree of tolerance for slight misalignments.
  • the mask area outside of the dashed lines shown in FIGURE 5C is preferably all black.
  • a uniform mask may be applied over icons such as shown in Figure 22 in order to eliminate any pixels attributable to the frame 479 and to detect the occurrence of supra-threshold pixels in the intended marking area within the frame 479.
  • step 282 determines whether the icon image is larger or smaller than the corresponding mask. This is preferably determined by edge detection and then counting the number of pixels within the detected outer edge of the icon. If the icon area is smaller than the corresponding mask, then the icon is scaled accordingly in step 284, using known pixel image scaling techniques such as contained in Visionshape's AutoClass ® software library.
  • Step 286 checks to see whether the icon is distorted in any way. This is determined using edge detection and then counting the pixels along each edge of the icon to determine whether it is longer or shorter than expected. If distortion is detected, then step 288 stretches or shrinks the icon image, as needed, to provide a suitable correspondence with the mask.
  • a variety of pixel image stretching or shrinking techniques may be used, as desired, to scale the image.
  • a convenient technique is to provide for pixel expansion or contraction from a center line dividing the icon horizontally or vertically, as needed. The two halves of the icon are then either separated or pushed together while columns or rows of icons are replicated or removed at the centerline in order to provide a contiguous pixel image. It will be appreciated that while the above described technique will not produce exactly scaled icons, it is fast and convenient where only small degrees of shrinkage or stretching are required and sufficient tolerance is otherwise provided in the mask to accommodate slight icon variations.
  • step 290 checks for possible skew of the icon image. If skew is detected, step 292 rotates the mask image accordingly in predetermined increments until the skew is corrected to within predetermined tolerances. Again, this may be done using any variety of well known image pixel rotation techniques such as contained in Visionshape's AutoClass ® software library. Alternatively, the pixel icon image may be rotated, if desired, to correct for skew.
  • the mask is registered with the icon and applied at step 294. This is done by combining or merging the registered mask image with the icon image using an appropriate combination of Boolean operators, such as AND, NAND or XOR.
  • Boolean operators such as AND, NAND or XOR.
  • a NAND operator is particularly preferred for achieving the desired masking result, as illustrated in TABLE 4 below.
  • a logical NAND operator i.e., (i NAND ) , takes the value FALSE or "0" if both i and m are “1" (corresponding to both black pixels) , or TRUE or "1” if either i and m are "0"
  • RESULT pixel, r is set equal to NOT(i) or "W” as indicated above in TABLE 4. If (i NAND m) is TRUE, then the corres- ponding RESULT pixel, r, is set equal to i.
  • the resulting pixel image should be composed of substantially all white pixels except for any marks placed on the icon by a bank customer.
  • Step 296 counts the number of remaining contiguous black pixels (#CP) present in the resulting icon image.
  • Step 298 compares this number (#CP) to a threshold number of pixels (T) required to assume that a mark has been detected. If the number of remaining contiguous black pixels (#CP) is greater than this threshold number (T) , then a mark is assumed to be detected.
  • Step 300 outputs the icon number (N) corresponding to the selected expenditure category, in this case groceries, and the subroutine 126 continues on to the next step. On the other hand, if the number of contiguous black pixels (#CP) is less than the threshold number (T) , then step 302 acknowledges that no mark has been detected for that particular icon (N) .
  • a threshold (T) of about two-hundred pixels provides a convenient reference number for assuming the existence of a mark. Alternatively, smaller or larger threshold numbers (T) may be used, as desired, while still enjoying the benefits of the present invention.
  • Step 304 determines whether there are more icons to be examined. If so, step 306 increments the icon counter (N) and the subroutine returns to step 274 in order to examine the next icon (N) . If no more icons are left to be examined, then the subroutine terminates at step 308 and returns command control to the central processor 108. Note, that the subroutine 126 may output more than one expenditure category if, for instance, the bank customer has marked more than one icon, indicating that the check transaction is to be split evenly between the marked categories.
  • FIGURE 24 shows an alternative subroutine 126' for detecting which of a plurality of icons in an array of icons has been marked.
  • the subroutine 126' may be used with checks having an array of drop-out icons printed in accordance with the preferred embodiment shown and described in connection with FIGURE 23.
  • the entire icon 464' is printed or screened using a drop-out ink so that the entire icon will be invisible to a scanner, as shown in FIGURE 23B. Any marks made on the icon will appear as dark pixels in an otherwise white image.
  • the subroutine 126' locates these pixels on an x-y grid relative to one or more predetermined reference lines and icon positions to determine whether a corresponding icon has been marked.
  • the subroutine 126' begins at step 501 with the routine initialization of variables, defining common variables, allocation of working memory, etc.
  • the reference lines are preferably black horizontal and vertical lines disposed on the check in or near the icon array 28.
  • the memo line 324 includes a short vertical reference line 325 originating at the far left side of the memo line and extending approximately 6.3 mm upward. The combination of the horizontal memo line 324 and the vertical reference line 325 provide a convenient reference for locating the icon array 28 with respect to the x-y grid shown.
  • the reference lines are at least 0.7 points (0.25 mm)thick and are printed using a non-drop-out ink, as indicated above. Any color having a minimum PCS of about 0.4 would be acceptable as a non-drop-out color. This would include black, dark blue, dark forest green, etc. Black is the most preferred color because it is the darkest and is standard within the check printing industry.
  • the subroutine 126' identifies and locates the reference lines in steps 503, 505
  • the relative x-y position of the icon array and corresponding icon positions can be calculated in accordance with predetermined preferred dimensions.
  • the subroutine 126' then inputs the portion of the check image corresponding to the icon array 28' at step 507 and stores this in working memory.
  • the subroutine counts the number of contiguous supra-threshold ("black") pixels (#CP n ) present in the resulting pixel image in a location corresponding to a particular icon position "n" .
  • a predetermined threshold number T
  • T a threshold of about two hundred contiguous pixels provides a convenient reference number for determining the existence of a mark. If no mark is detected, then the subroutine increments the icon position counter "n" at step 515 and the subroutine returns to step 509.
  • the subroutine 126' assumes that a mark is present, as indicated by step 517.
  • the subroutine then outputs the corresponding selected expenditure category at step 519, in this case groceries, and the subroutine continues on to the next step. This process continues until all icon positions "n” have been checked as indicated at step 514. Once all icon positions "n” have been checked for marks, the subroutine 126' terminates at step 515 and returns command control to the central processor 108.
  • FIGURE 15 is a more detailed flowchart diagram of the subroutine 121 shown in FIGURE 8.
  • This subroutine updates a stored transaction record according to information received from other subroutines described above.
  • the subroutine is initialized at step 330, as indicated.
  • Step 332 inputs the MICR code obtained from the MICR decoder 104 shown in FIGURE 8.
  • Step 334 inputs the verified amount of the check which is the output of the subroutine 120 indicated in FIGURE 8 and described in more detail in FIGURE 11. In this case, the indicated amount is $126.69.
  • Step 336 inputs the pixel image of the payee box 16' previously outputted by the subroutine 122 shown in FIGURE 8 and described in more detail in FIGURE 12.
  • Step 338 inputs the icon number (or numbers) for which marks have been detected by the mark detection subroutine 126 shown in FIGURE 8 and described in more detail in FIGURE 14.
  • step 344 inputs deposit, ATM, POS and other EFT transaction information from a bank 346 or EFT network. This latter information may be internal to the bank or, alternatively, it may be downloaded via modem to a separate processing center, as desired.
  • Step 340 records inputted information in a cumulative transaction record according to account number, check transaction number, expenditure category, dollar amount and payee.
  • this transaction record is stored in a computer data base or other storage media, as desired, such that it may be periodically accessed, further processed and incorporated into an expenditure statement 348, as shown.
  • this statement 348 is preferably in the form of a more detailed bank account statement showing expenditures, deposits, balance, interest earned, ATM, POS and EFT transactions, etc.
  • other types of reports or statements may be produced, as desired, to provide transaction information to a bank customer in a convenient form.
  • an expenditure tracking system and method in accordance with the present invention is further adapted to automatically track electronic transactions such as may occur through the use of an ATM or POS terminal.
  • bank customers are provided with an ATM card, credit card, or other wallet-sized card that is printed with a plurality of graphic icons corresponding to predetermined expenditure categories, substantially as described above. Superimposed over each icon is a Transaction Icon Number (TIN) which identifies each possible icon choice.
  • TIN Transaction Icon Number
  • PIN Personal Identification Number
  • the customer then further enters a TIN number corresponding to the particular ATM or POS transaction expenditure category applicable. This information may either be prompted for by the ATM or POS terminal or, alternatively, the TIN may simply be entered immediately following the initial PIN access code separated, for instance, by either the ⁇ * ⁇ or "#" key.
  • icons may be displayed directly on an ATM or POS screen and may be selected by a bank customer by touching the screen or by depressing a corresponding button provided on the ATM or POS keypad, as desired.
  • a "smart-card” type credit or ATM card may also be provided such as, for instance, a Schlumberger-type IC card.
  • a card could comprise, for instance, a simple microprocessor, IC terminals, and magnetic strip and/or internal storage capabilities, as desired.
  • a plurality of printed icons may be provided on the card, itself, disposed on a corresponding grid of pressure sensitive buttons. Icons may then be selected by depressing the pressure sensitive button corresponding to each icon. Prior to inserting the smart-card, for instance, the card user presses the icon which best classifies the nature of the particular electronic transaction. This information is then be transmitted via the IC terminals to the ATM or POS or other EFT terminal, as desired, for providing automated tracking of electronic expenditure transactions.
  • deposit and EFT transaction information is inputted electronically from the payor bank or EFT network to the expenditure tracking system, which is also preferably located within the payor bank.
  • the expenditure tracking system may be located in an off-site processing center, such as in a check clearing house or other check processing center, as desired.
  • checks are MICR read and scanned for marks in a check clearing house. For each check the clearing house detects which expenditure categories have been selected and records this information on a magnetic tape of check trans ⁇ actions of the type that is ordinarily provided to each payor bank serviced by the check clearing house. The payor bank then downloads this information into its own computer, as desired, and organizes it to produce an expenditure statement or more detailed bank statement in accordance with the present invention.
  • an individual bank customer may request that his canceled checks be returned to a designated check processing center.
  • the processing center MICR reads and scans each canceled check to generate a statement of expenditures broken out by account, expenditure category and amount, which is sent back to the bank customer.
  • this enables a customer at virtually any bank to enjoy the benefits of the present invention as herein disclosed.
  • the bank customer may further designate that his bank statement be forwarded to the processing center so that the information therein can be combined with the expenditure information obtained from the canceled checks in order to generate a more detailed bank statement of the type described above.
  • the bank statement is used as a founda- tional document for generating the customer's more detailed statement.
  • the present invention offers a consistent and comprehensive journalization of transactions without requiring secondary data entry or electronic downloading of information from each individual banking institution handling those particular transactions. Also, this ensures that customers who fail to consistently mark their checks will still receive valuable financial records which capture ATM, POS and other recorded transactions.
  • the tracking system in accordance with the present invention continues to provide detailed information on ATM and EFT transactions, as well as showing the amount of unclassified or miscellaneous funds expended, thereby subtly reminding the client to stay current with expenditure marking. '
  • a customer's bank statement is recognized by using a variable vertical zone delimiting technology available from high-end OCR developers, such as Visionshape ® of Orange, CA.
  • a unique OCR template is created for each type of bank statement that may be encountered.
  • the software is then "trained" to identify items such as horizontal lines and field description titles in order to extract the desired information.
  • the statement is first scanned into a computerized image processing system.
  • the software first registers the column location for each particular field of information contained on the statement. Variable zones are then defined extending down from each corresponding field.
  • the zones are variable in the sense that the software will continue to expect data to occur in the same horizontal field location until it confronts a different graphic configuration, such as a horizontal line in a zone defining text.
  • the software will then expect that the zone is changing where a new type of data will be processed.
  • This new zone will be identifiable, not only by the horizontal line and text, but an OCR reader will also encounter new headings and column configurations which also signifies the occurrence of a new or different type of data.
  • the text within each zone is then OCR read and recorded. Key words in the POS and ATM description fields are similarly identified and recorded such that the transactions may be properly categorized and identified in a subsequently generated expenditure report.
  • Other possible preferred embodiments will be readily apparent to those skilled in the art.

Abstract

An improved system is provided for automatically tracking check transactions and generating an expenditure statement (112) thereof using printed bank checks (8) having a plurality of graphic icons (28) disposed thereon. The bank customer marks the icon which describes the particular expense for which the check payment is being made. The payor bank or a check processing center scans each check to determine which icon(s) have been marked for each particular check transaction. Recorded expenditures are then automatically recorded in a cumulative transaction record. Periodically, this information is organized into a detailed expenditure statement (112) that can be provided to the bank customer.

Description

EXPENDITURE CATEGORIZATION AND TRACKING SYSTEM
BACKGROUND OF THE INVENTION
1. Field of the Invention
This invention relates to expenditure tracking systems and, more particularly, to an improved automated expenditure tracking system comprising a novel method and apparatus for automatically tracking check expenditures and deposits using printed bank checks having a plurality of graphic icons disposed thereon representative of particular expenditure categories.
2. Description of the Related Art
Millions of people utilize bank checks every day for personal and business use to transact sales of goods and services and to pay bills via funds deposited in a checking or money-market account. Millions more people use Automated Teller Machines ("ATM"), Point Of Sale terminals ("POS") or other Electronic Funds Transfer ("EFT") machines to withdraw or transfer cash electronically in order to make cash purchases and to obtain convenient amounts of cash for discretionary spending.
It is often desirable when making check transactions or ATM or POS withdrawals from a checking account to be able to keep track of and monitor expenditures according to a predetermined set of expenditure categories for purposes of budgeting and/or managing personal or business finances. For instance, it is convenient for a bank checking account customer to know at the end of each month not only how much money is currently available in the customer's checking or money-market account, but also what types and amounts of expenditures have been made during the previous month or several months on such items as food, clothing, entertainment, mortgage, rent, etc. In this manner, a bank customer managing his personal or business finances can identify possible problem areas in which expenses should be reduced in an effort to reduce overall costs and to save money. Such budgeting and monitoring of expenditures is often critical for successful long-term financial planning. Experience has shown that most individuals fail to plan adequately for their financial future. A recent U.S. Census Bureau survey reports that over 85% of Americans 65 or older are living on an income of less than $10,000.00 per year. The majority of these households, however, earned enough income to set aside for more than an adequate retirement investment, but failed to do so. Unfortunately, many working individuals today are following the same trend toward future financial insecurity. Particularly in the hectic modern-day world of two income families and even greater financial pressures, it is absolutely essential to be able to monitor expenditures and investments in order to provide for a sound financial future.
The U.S. Small Business Administration has similarly noted that a large percentage of all new small businesses fail within the first year of operation. This is partially attributable to a lack of adequate financial planning and monitoring of expenditures by relatively inexperienced business managers. Without adequate budgeting and monitoring of business expenses, the cash flow of even a moderately successful business can be quickly subsumed by losses from poor investments and wasteful spending. Again, budgeting and monitoring of expenditures is critical to the financial well being of small businesses.
One of the main reasons individuals and small businesses fail to adequately plan their finances is the current lack of a convenient mechanism for budgeting and monitoring expen¬ ditures and investments. Larger businesses and more affluent individuals hire accountants and other professionals to budget and monitor their expenditures. But many working individuals and small businesses simply cannot afford such personalized professional services. These individuals and small businesses either perform these accounting services themselves or go without them.
For those individuals and small businesses that choose to perform their own accounting services, several tools have recently become available. Most notable are several computer accounting software programs that are now readily available to assist individuals and small businesses in personal and business financial planning. Typically, such software programs can be used with a personal computer or similar device capable of performing basic financial computations. One particularly popular computer accounting software program is marketed under the name "Quicken™" and is available from Intuit, Inc. of Menlo Park, California. This program allows users to assign expenditure account categories by entering a text description of each into the program's database. For each check transaction, the user then identifies the appropriate account category and types in the check number and check amount. Once the information has been entered into the computer, it can be manipulated electronic¬ ally to generate various types of account statements, expend- iture charts and the like, which can be accessed by the user via a video display monitor, an attached printer or magnetic disk storage media. Deposits and other transactions are handled in a similar fashion by the user's manually entering the raw data from the deposit slip, transaction receipt or the like, into the computer.
A significant drawback of these types of computer accounting software programs is that they require the bank customer or user to enter into the computer "raw" data from each check transaction occurring within a given transaction period. This data may, for instance, be entered by the bank customer from his returned checks or from a separate ledger book in which check transactions are routinely entered and recorded. Inputting this data may require a considerable expenditure of time and effort where, for instance, the bank customer has made hundreds of individual check transactions during a given transaction period.
This secondary data entry step is also highly incon¬ venient. Experience has shown that, while many people want financial management tools, most lack the time and discipline necessary to maintain accurate financial records on their own. Busy families, individuals, and small businesses demand accurate financial reporting in order to reach their financial goals, but they often do not want to expend the significant amounts of time and effort required to maintain such records themselves. Many individuals, in particular, find the use of a personal computer or a keypad highly inconvenient for enter- ing and recording check expenditure information. Recent statistics indicate that almost half of all American house¬ holds are intimidated by computers. Other bank customers simply do not have access to a computer and, therefore, cannot benefit from these types of computer accounting software programs.
Even among those individuals and small businesses who own a computer and who have purchased accounting or financial planning software, research has shown that a significant percentage of them are not consistent with their inputting and reporting of check transactions. Quite often, after several months of neglect these computer software users, faced with many hours of "catch-up" work, abandon their bookkeeping tasks altogether. The result is that the computer software goes largely unused, defeating the very purpose of budgeting and financial planning.
Other expenditure tracking systems have been proposed in which the bank check, itself, can be labeled or marked by a bank customer with numbered expenditure categories. Upon presentment of such a check for payment, the bank teller re- enters the expenditure category number in magnetic code
("MICR") on the bottom of the check. The check is then processed using a MICR decoder. A centralized computer records the transaction amount and expenditure category number for each check and provides the customer with a periodic statement of expenditures. In this manner, the labor intensive step of re-entering expenditure account information into a computer is, in effect, shifted from the customer to the bank.
A drawback of these types of expenditure tracking systems, however, is that they are not well suited for individual and small business. Specifically, the numbers used to represent expenditure categories are not easily identifiable by customers as representing any particular type of expenditure. Rather, in order to record the appropriate category number a customer is required to refer to a separ¬ ately recorded index or legend of accounts in order to match each number with its corresponding expenditure category. This cross-referencing of expenditure categories is highly incon¬ venient where, for instance, the customer does not have convenient reference to the recorded legend at the time the check is made out and the transaction executed. In such cases the customer either guesses, or he simply does not record the expense at all. This can cause undesirable inaccuracies in the expenditure tracking system. Numbered expenditure categ¬ ories are simply not sufficiently intuitive or descriptive to allow the use of these types of expenditure tracking systems by the general banking public.
Another significant disadvantage with prior art expenditure tracking systems in general is that they cannot adequately account for ATM and POS transactions, which occupy an increasingly larger percentage of checking and money-market account transactions. To account for such transactions a customer must keep a copy of all receipts and then separately record them in either a written ledger or computer data base and reconcile these receipts with their bank statement at the end of each month or other financial period. Again, this takes time and effort and can result in undesirable inaccuracies as customers fail to stay current with recorded expenditure information.
Each of the above prior art systems require bank customers and/or the bank itself to perform secondary data entry operations, either in a separate account ledger or via a computer or MICR encoder keypad, in order to provide accurate monitoring of expenditures. It would represent a significant advance in the art to provide an automated expenditure tracking system which eliminates the need for such secondary data entry. It would represent a further advance in the art to provide such a system that is easy and inexpensive to use, is intuitive and easy to understand even in cross- linguistic environments without the need for special instructions or training, and that maintains consistent reporting regardless of a customer's level of diligence in recording individual expenditures. SUMMARY OF THE INVENTION
The present invention comprises, in one embodiment, a printed bank check having a plurality of easily recognizable graphic icons disposed thereon representative of predetermined expenditure categories. Each icon is adapted to be marked by a customer and machine-read in order to track and record individual check transactions. Preferably, each icon consists of an ergonomically designed pictorial representation of a particular object or idea which is familiar to the customer and which is associated with each type of expenditure. Additional expenditure information may optionally be provided on the back of each check in order, for instance, to allow a bank customer to allocate a single check transaction between one or more expenditure categories or to record one or more deposits, as desired. In another embodiment, the present invention provides a novel printed graphic icon for enhancing the detectability of a mark made thereon. The icon is provided with a defined marking area intended to receive a customer's mark. The periphery of the intended marking area is defined by a dark outer portion forming an outline or inverted silhouette of the icon design. Shading, highlighting, and other details are provided within the inverted silhouette area using a light colored ink and/or tones, defining a relatively light inner portion. These details aesthetically enhance the icon design and provide improved recognition of the icon by a customer. The light inner portion of the icon is selected to be below the threshold detection level of a scanner or other device used to scan the icon design into a computer imaging system such that only extraneous marks made by a bank customer appear as dark areas within a pixel image of the intended marking area.
In another embodiment the present invention provides a printed graphic icon adapted to be invisible to a scanner, yet readily recognizable to the human eye. The icon is defined by an outer portion forming an outline or inverted silhouette of a desired icon design. Shading, highlighting, and other details of the icon design are provided in an inner icon portion within the inverted silhouette. These details aesthetically enhance the icon design to provide improved human recognition thereof. Both the outer and inner icon portions are printed or screened using a suitable "drop-out" ink having a light absorptivity that is below a defined threshold detection level of a scanner such that any extraneous marks made on the icon will appear as dark contiguous pixels within a bi-level pixel image of the icon. Optionally, "drop-out" icons may be enclosed within, a thin, black frame so that when scanned the resulting pixel image will reveal only the icon frame and any marks made therein.
In another embodiment, the present invention provides a novel method for detecting the presence of a mark placed over a printed graphic icon as provided in accordance with the present invention. The icon is scanned via a scanner or other device into a computer imaging system to produce a bi-level black and white pixel image of the icon. A mask having a size and shape corresponding to the dark outer portions of the icon design is placed over the pixel image of the icon such that it masks the entire pixel image outside of the intended marking area of the icon. A mark is detected if more than a predetermined number of contiguous dark pixels are detected within the remaining pixel image, corresponding to the intended marking area of the icon. In another embodiment, the present invention provides a novel method for detecting the presence of a mark placed over one of a number of printed graphic icons provided in an array. The icon array is scanned via a scanner or other device into a computer imaging system. The computer registers the icon array on an x-y grid by recognizing and locating a target comprising one or more predetermined reference lines. A mark is detected in a particular icon location if more than a predetermined number of contiguous dark pixels are detected within a portion of the pixel image corresponding to the x-y location of the particular icon.
In another embodiment, the present invention comprises a system and method for automatically tracking expenditures using pictorial icons at the point of sale/payment represen¬ ting expenditure categories which can be marked or otherwise activated by a customer to indicate a particular expenditure category. A bank customer selects the icon or icons which apply to the particular transaction for which the expenditure transaction is made. This information is recorded in a cumulative transaction record. Periodically, the transaction record is organized into a statement of expenditures broken down by expenditure category and amount which may be provided to the bank customer in the form of an end-of-month expenditure statement or electronic data downloaded via modem or other means to a home or business computer.
In another embodiment, the present invention comprises a system and method for processing bank checks of the type adapted to be marked by a bank customer to indicate a selected expenditure category corresponding to a particular check expenditure. Basic check transaction information, such as the account number and the dollar amount of each bank check, is decoded using a MICR decoder. Checks are then scanned in substantially rapid succession to generate a series of binary data representative of a pixel image thereof. An central processor manipulates the binary data to detect in each of a plurality of predetermining intended marking areas on the check the presence or absence of one or more marks indicative of particular expenditure categories selected by a bank customer. Transaction information is then recorded in a cumulative transaction record in association with each selected expenditure category corresponding to each particular check transaction. Periodically, the transaction record is organized into a statement of expenditures broken down by expenditure category and amount which may be provided to the bank customer in the form of an end-of-month expenditure statement or electronic data downloaded via modem or other means to a home or business computer.
In another embodiment, the present invention comprises a novel expenditure statement in which a pixel image of each payee name recorded on a bank check is reproduced directly on the expenditure statement in association with corresponding transaction information, such as customer's account number, check transaction number and the dollar amount of the check.
Other features and advantages of the present invention will become readily apparent to persons skilled in the art having reference to the drawings herein and the detailed description that follows.
BRIEF DESCRIPTION OF THE FIGURES By way of example and to make the following detailed description more clear, reference is made to the accompanying drawings, of which:
FIGURE 1 is a view of the front side of a printed bank check having features of the present invention;
FIGURE 2 is a view of the back side of a printed bank check having optional features in accordance with the present invention;
FIGURE 3 is an enlarged view of the icon array 28 shown in FIGURE 1 illustrating in more detail a number of possible graphic icon designs that may be provided on a printed bank check in accordance with the present invention;
FIGURE 4 is an enlarged view of one embodiment of a printed icon having features of the present invention;
FIGURE 5 is an enlarged view of an alternative embodiment of a printed icon having features of the present invention, illustrating in more detail how the icon may be marked by a bank customer to indicate a selected expenditure category;
FIGURE 6 is a schematic diagram of an automated check expenditure tracking system having features of the present invention; FIGURE 7 is a front view of an expenditure statement of the type generated by a check expenditure tracking system of the type shown in FIGURE 6, and having features of the present invention;
FIGURE 8 is a more detailed schematic diagram of the check expenditure tracking system of FIGURE 6;
FIGURE 9 is a more detailed schematic diagram of the image processing sub-routine 117 of FIGURE 8;
FIGURE 10 is a more detailed schematic diagram of the check amount capture sub-routine 118 of FIGURE 8;
FIGURE 11 is a more detailed schematic diagram of the amount verification sub-routine 120 of FIGURE 8; FIGURE 12 is a more detailed schematic diagram of the payee box capture sub-routine 122 of FIGURE 8;
FIGURE 13 is a more detailed schematic diagram of the icon array capture sub-routine 124 of FIGURE 8;
FIGURE 14 is a more detailed schematic diagram of the mark detection sub-routine 126 of FIGURE 8;
FIGURE 15 is a more detailed schematic diagram of the transaction update sub-routine 121 of FIGURE 8;
FIGURE 16 is an enlarged view of the icon array of FIGURE 3 illustrating in more detail the preferred shading of the various icons;
FIGURE 17 is a view of the icon array of FIGURE 16 shown in actual preferred size;
FIGURE 18 is an enlarged view of an alternative embodiment of a printed icon array having features of the present invention;
FIGURE 19 is an enlarged view of another alternative embodiment of a printed icon array particularly suited for business use;
FIGURE 20 is a detailed view of a personal-sized printed bank check having features in accordance with the present invention, showing the preferred location of the icon array;
FIGURE 21 is a detailed view of a business-sized printed bank check having features in accordance with the present invention, showing the preferred location of the icon array; FIGURE 22 is an enlarged view of an alternative embodiment of a printed graphic icon having features in accordance with the present invention, showing how the icon appears to the human eye (FIGURE 22A) and to a bi-level scanner (FIGURE 22B) ;
FIGURE 23 is an enlarged view of another alternative embodiment of a printed graphic icon having features in accordance with the present invention, showing how the icon appears to the human eye (FIGURE 23A) and to a bi-level scanner (FIGURE 23B) ; and
FIGURE 24 is a detailed schematic diagram of an alternative mark detection sub-routine 126' which may be substituted for the subroutine 126 of FIGURE 8.
DETAILED DESCRIPTION 1. Printed Bank Check
FIGURE 1 is a view of the front side of a printed bank check 8 having features of the present invention. The check generally comprises a substrate 10 upon which is printed a plurality of boxes, lines, and spaces 12-24 for entering customary check-transaction information. An array of graphic icons 28 is provided for recording one or more expenditure categories which correspond to the particular transaction being made, as will be described in more detail later.
In accordance with industry custom a magnetic ink charac¬ ter recognition code ("MICR" code) 26 is printed at the bottom of the check substrate 10. The MICR code 26 contains machine readable information consisting of the bank routing number, customer account number, and the check transaction number. The dollar amount of the check may also be recorded in MICR code (not shown) on the check by a payee bank when the check is cashed or deposited by the payee. The MICR code 26 is used primarily in automated check clearing houses to route the check and charge it against the proper payor bank. It is also used by the payor bank to automatically credit and debit individual customer accounts and to periodically generate a statement of accounts identifying each customer's transactions by check transaction number along with the remaining balance of the customer's account.
The size and weight of the check substrate 10 may be varied as desired, but preferably conforms to one of several well-known banking industry standards. For instance, a 24# weight 70 x 6 150 mm rectangular substrate 10 is convenient for personal use. A 24# weight 3 75 mm x 210 mm check substrate 10 is convenient for certain business and professional use. For relatively high volume or computer controlled check writing it may be further convenient to provide multiple checks printed on a single perforated substrate that is particularly adapted for use with a computer controlled printer. Alternatively, it will be readily apparent to persons skilled in the art that virtually an infinite number of shapes and sizes of substrates 10 may be used, as desired, while still enjoying the benefits of the present invention herein disclosed.
Optionally, the check substrate 10 may be further provided with a security pattern or other design disposed thereon for discouraging fraudulent reproduction of checks or providing an aesthetic or ornamental check design. For instance, it will be seen that the check substrate 10 illustrated in FIGURE 1, has been lightly printed with the mark "OnTRACK™" in a repeating pattern covering substantially the entire front side of the substrate 10. It will be readily apparent to those skilled in the art that a wide variety of optional background designs may be used, as desired, while still enjoying the benefits of the present invention herein disclosed.
As briefly noted above, a plurality of boxes, lines, and spaces 12-24 are provided on the front side of the substrate 10 for entering customary check-transaction information. The current day and month may be entered on line 12, the year on line 14. The payee's name may be entered in the payee box 16. The dollar amount of the check may be entered in arabic numerals in the amount box 18 and written out in long-hand on the verification line 20. The maker of the check signs on line 22. Notes or other extraneous information may be recorded on an optionally provided memo line 24.
The payee box 16 is preferably adapted to be electron¬ ically scanned into a computer imaging system or other device such that the text image within the box 16 can be captured in pixel form and reproduced, as desired, in an expenditure statement or other accounting statement provided to a bank customer. The particular size and shape of the payee box 16 may be varied, as desired, to provide a convenient area for recording the payee's name. The payee box 16 is preferably at least minimally sufficient to accommodate both hand-written and typed payee designations. A payee box having a height of 8 mm and a length of 75 mm for instance, provides a convenient size for most check-writing purposes. Other payee box dimensions may be used, as desired, while still enjoying the benefits of the present invention herein disclosed. The outer frame comprising the payee box 16 is preferably of relatively uniform line thickness and density. Optionally, it may be screened using a half-tone printing technique or other means, as desired, in order to lighten the outer frame. In this manner, when the check 8 is scanned into a computer imaging system the outline image of the payee box 16 can be filtered out using threshold imaging, as will be described in more detail later.
The amount box 18 is similarly adapted to be electron¬ ically scanned so that the text image within the box 18 may be captured in pixel form. Preferably a handwritten or typed dollar amount in the amount box 18 may be verified against the dollar amount contained in the MICR code 26 using a modified optical character recognition ("OCR") technique, as will be described in more detail later. As with the payee box 16, described above, the size and shape of the amount box 18 can be varied, as desired, but is preferably at least minimally sufficient to accommodate both hand-written and typed dollar amounts. An amount box 18 having a height of about 6 mm and a length of about 25 mm provides a convenient size for most check-writing purposes. Alternatively, a larger or smaller amount box 18 may be provided, as desired, while still enjoying the benefits of the present invention herein disclosed. The outer frame comprising the amount box 18 is preferably of relatively uniform line thickness and density. Optionally, it may be screened using a half-tone printing technique or other means, as desired, in order to lighten the outer frame such that the outline image of the amount box 18 can be filtered out using threshold imaging, as will be described in more detail later.
An array of twenty-one unique graphic icons 28 is provided on the left-most side of the check, as shown. It will be appreciated that each of the individual graphic icons in the icon array 28 represents a particular category or type of expenditure, such as, for instance, automotive expenses, groceries, meals, etc. A customer desiring to record a particular check expenditure marks the icon (or icons) in the icon array 28 that correspond to the particular expense for which the check payment is being made. The expenditure category information is thereby permanently recorded on the check itself at the time the transaction is made.
One or more optional icon boxes, such as the circular box 30, may also be provided, as desired, to further characterize a given check expenditure as being, for instance, either tax deductible or reimbursable. Such optional boxes may be located immediately adjacent to the icon array 28, as shown, or, alternatively, at any convenient location on the check substrate 10 that would not encroach on other zones of the check that preferably conform to banking industry standards. Any such optional icon boxes 30 may be provided with or without a corresponding icon design or text description, as desired.
The icon array 28 and any optional icon boxes 30 are preferably adapted to be scanned into a computer imaging system or other device so that the image can be processed in order to ascertain which icon(s), if any, have been marked. This information is then recorded in association with other information representative of the particular check trans¬ action, such as the customer account number, check transaction number and dollar amount of the check. A bank or processing center periodically organizes this recorded information into a statement of expenditures or an accounting broken down by expenditure category, check transaction number and amount. Preferably, this is in the form of a monthly expenditure statement provided to the bank customer. Alternatively, it may be a statement of year-to-date expenditures, or any other breakdown of expenditures that a bank customer may find convenient or helpful for purposes of budgeting or financial planning. In this manner, it will be appreciated that each check expenditure made using a printed bank check in accord¬ ance with the present invention may be automatically tracked and recorded, as will be described in more detail later.
A customer desiring to purchase groceries at a grocery store, for instance, might write out a check for $50 to pay for the groceries, marking an icon on the check picturing a grocery cart or other indicia representative of grocery expenses. Once the transaction is completed and the check is presented for payment, the payor bank, a check clearing house or a designated processing center scans each check to deter¬ mine selected expenditure categories and records this information in association with other basic information identifying the transaction. This may be done either before or after the check is paid and canceled, as desired.
For multiple purchases using a single check transaction customers may wish to allocate or "split" the transaction between two or more discrete expenditure categories. If, for example, the customer attends an educational luncheon which he pays for using a single check, the customer may wish to split the check expenditure between meal expenses and educational expenses. The customer may do this by placing an "X" or other mark on each icon in the icon array 28 that is applicable. The check expenditure would then be automatically allocated equally among each expenditure category indicated.
On the other hand, a customer may not wish to split the check evenly. Assume, for instance, that a customer picks up a video cassette at the grocery store and pays for its rental fee along with his weekly groceries. The transaction should properly be recorded as partially attributable to groceries and partially attributable to personal entertainment expenses. Accordingly, an optional feature of the present invention is to provide on the back of a bank check as shown in FIGURE 1 a plurality of optional lines and boxes, as illustrated in FIGURE 2, for distributing a single check transaction between multiple expenditure categories.
FIGURE 2 is a view of the back side of a printed bank check 8 having this optional feature in accordance with the present invention. On the left side of the back of the check is provided a customary endorsement area demarcated by the line 31, above which endorsements may be made. An empty space is preferably provided in the area immediately to the right of the endorsement line 31 in order to accommodate bank processing information which may be subsequently printed on the back of the check. Further to the right is provided a second array of twenty-one icons 32 corresponding to the icon array 28 shown in FIGURE 1. These icons in the array 32 may or may not be provided with corresponding graphic icon designs, as desired, depending upon the additional printing expenses involved. Preferably, each icon box in the icon array 32 has a unique icon position number or letter assoc¬ iated with it, as shown, corresponding to each particular expenditure category represented pictorially by corresponding icons in the icon array 28 shown on the front of the check. If a customer desires to allocate a particular check transaction between two or more expenditure categories, the customer marks the box 34 indicating "split check" and enters the appropriate icon position numbers in the column of boxes 36 provided. Next to each icon position number, the customer then enters in the corresponding spaces 37 the dollar amount portion of the check transaction which is to be allocated to that particular expenditure category. This is repeated for each different expenditure category desired. The total is then added up and entered in the space 38 provided. This total will usually correspond to the amount recorded on the front of the check.
Optionally, it is further envisioned that split-check information may be recorded on any subsequent check used to pay for goods and/or services, as desired, provided that the check transaction to be split is sufficiently identified by date and dollar amount, as provided in the spaces 43 and 38, respectively. This feature is convenient, for instance, for hurried transactions where the bank customer does not have time or otherwise forgets to record check-split information on the back of a particular check. Advantageously, this feature allows the bank customer to record split-check information on any subsequent check, as desired, and the information will be automatically entered by the expenditure tracking system. If necessary, optional spaces (not shown) may be provided on the back of the check for indicating the check transaction number of the particular check to be split. This is usually not necessary, however, since it is usually possible to identify the intended split-check according to transaction date and dollar amount.
Check deposits are handled in a similar fashion in that the back of any particular check may be used to record various deposits which the bank customer has previously made. Accordingly, an array of optional deposit icons 40 is provided on the back of the check, as shown, and assigned a unique letter or number designating the source of deposited funds. Again, these icons in the array 40 may or may not be provided with corresponding graphic icon designs, as desired, depending upon the additional printing expenses involved and the desirability of using graphic images to designate the source of funds deposited. The customer marks the box 42 indicating that a deposit is being recorded. He then enters the appropriate deposit icon letter(s) in the column of boxes 34, designating the source of deposited funds, and enters the dollar amount of each check being deposited in the corres¬ ponding spaces 37 provided. The day, month and year of the deposit is entered in the boxes 43 provided. In an optional embodiment, it is further envisioned that the back of the check, itself, may be used as deposit slip.
Preferably, the back of the check is adapted to be scanned and processed substantially in the same manner as with the front of the check. Specialized OCR software, such as that available from Visionshape® of Orange, CA, is used to analyze and/or read the hand-written letters or numbers entered in the boxes 36 and dollar amounts entered in the corresponding spaces 37. Alternatively, these portions of the check may be processed and read manually by visual inspection of the back of the check itself or a pixel image thereof, as desired.
Advantageously, it will be appreciated that a bank customer using a printed bank check in accordance with the present invention can track his monthly expenditures without having to perform any secondary data entry steps. All of the expenditure category information may be recorded by the bank customer on the check, itself, contemporaneously with the check transaction.
In an optional embodiment of the present invention, expenditure tracking information may be downloaded directly from a bank or processing center, as desired, via modem or other means to a home or business computer for use with other accounting or expenditure tracking software. In this manner it will be appreciated that a bank customer can have the flexibility of using his favorite computer accounting program to budget and monitor expenditures without having to perform secondary data entry of check transactions. A wallet-size reference card showing icons and superimposed numbers may be further provided for later account adjustments using a telephone or computer network system, as desired, or for manually annotating receipts of petty cash expenditures.
FIGURE 3 is an enlarged view of the icon array 28 shown in FIGURE 1, illustrating in more detail a number of different possible graphic icon designs that may be provided on a printed bank check in accordance with the present invention. Alternatively, it is envisioned that bank checks having different types or numbers of icons may be provided, as desired, to suit the needs of particular customers according to whether, for instance, the customer is an individual, household, or business. For custom applications, it is further envisioned that customers will be able to choose from a predetermined selection of custom graphic icons, which are then arranged on a bank check, as desired. Certain bank customers will find it convenient to design their own icon array 28 when it is necessary or desirable, for instance, to indicate special or unusual expenditures peculiar to that individual bank customer. In any event, it will be readily understood by those persons skilled in the art that a variety of graphic icon designs may be used on a printed bank check to represent any particular group of expenditure categories in accordance with the present invention herein disclosed.
A conventional 70 mm x 150 mm bank check can support an icon array 28 having a height "H" of about 50 mm and a width "W" of about 25 mm without encroaching into other zones of the check that preferably conform to banking industry standards, as illustrated in FIGURE 1. Alternatively, other shapes or sizes of icon arrays 28 may be used, as desired, while still enjoying the benefits of the present invention. The size and shape of individual icons within the icon array 28 may also be varied, as desired, but are preferably no smaller than about 5 mm x 5 mm in order to ensure ease of recognition by bank customers. The number of icons in the icon array 28 may be varied, as desired, while still enjoying the benefits of the present invention. For instance, it is believed that anywhere from about five to fifty and, more preferably, from about ten to thirty icons may be used to indicate various expenditure categories, as desired. In a particularly preferred embodiment, twenty-one icons each measuring 6.3 mm x 6.3 mm are arranged in three columns of seven rows each, as shown. This particular arrangement of icons is convenient for a wide variety of expenditure tracking purposes. For business checks, additional icons may be provided by adding one or two additional columns of seven icons each, as needed. Individual icons in the icon array 28, shown in FIGURE 3, are preferably separated by a clear space of between about 0.5 mm and 1.25 mm vertically (Sv) and between about 1.25 mm and 3.8 mm horizontally (Sh) . More preferably, icon rows are separated by a vertical clear space Sv of about 0.85 mm and icon columns are separated by a horizontal clear space Sh of about 2.3 mm. It will be appreciated that these clear spaces provide a buffer for marks which may extend beyond a particular icon box. A wider horizontal clear space Sh separating each column of icons in the icon array 28 is preferred in order to provide additional room for compensating any horizontal image distortion caused by horizontal feeding of checks through a high-speed scanner, as will be described in more detail later. Alternatively, for vertical feeding of checks through a high-speed scanner it may be desirable to provide a wider vertical clear space Sv between each row of icons in the icon array 28 in order to allow for compensation of any vertical image distortion.
The icon array 28 shown in FIGURE 3 is typical for individuals and household bank customers. While the individ¬ ual icons shown in FIGURE 3 are particularly suited for indicating corresponding expenditure categories, as will be described below, it will be readily understood by those persons skilled in the art that a wide variety of other icon designs may be used, as desired, to indicate the same or similar expenditure categories while still enjoying the benefits of the present invention. A brief description of the icons shown in FIGURE 3 is provided below for purposes of illustration only.
Beginning in the upper left hand corner, icon 45 illustrates a sun setting behind the front end of an auto¬ mobile. This icon design may correspond, for instance, to automotive expenditures, such as routine maintenance, oil changes, gasoline, etc. Alternatively, any other image associated with automotive expenses may be used to represent such expenditures, such as an oil can, a gas pump, or the like. To the right, icon 46 illustrates a basket-type grocery cart with wheels. This icon design may correspond, for instance, to expenditures made for groceries, laundry detergent and other items typically purchased at a grocery store. Alternatively, any other image associated with groceries or grocery stores may be used, such as a loaf of bread, a can of soda, etc., to represent such expenditures. Further to the right, icon 47 shows a short-sleeve sports shirt. This may correspond, for instance, to expenditures made for purchasing and cleaning of clothing. Alternatively, separate icons may be used to represent expenditures for clothes purchases and for cleaning services, as desired.
In the second row first column, icon 48 shows a gift box wrapped with a bow. This icon design may correspond, for instance, to expenditures made for gifts and presents. Alternatively, any other image associated with gift giving, such as a birthday cake, a Christmas tree, etc., may be used to represent such expenditures. To the right, icon 49 shows a cross. This icon design may correspond, for instance, to expenditures made for medical services. Alternatively, any other image associated with medical services, such as a doctor, nurse, stethoscope, etc., may be used to represent such expenditures. Further to the right, icon 50 shows a picture of a capitol building superimposed on a large "T" . This icon design may correspond, for instance, to expenditures made for income taxes or FICA withholdings. Alternatively, any other image associated with payment of taxes or social security, such as a representative tax form, tax collector, Uncle Sam, etc., may be used to represent such expenditures.
In the third row first column, icon 51 shows a small house having a window and a door. This icon design may correspond, for instance, to housing expenditures, such as a mortgage or rent payments. Alternatively, any other image associated with housing expenditures, such as a deed, a bank, a landlord, etc., may be used to indicate such expenditures. To the right, icon 52 shows a hammer extending into a circular background. This may correspond, for instance, to expenditures made for routine home maintenance, home improve- ments, tools, etc. Alternatively, any other image associated with home maintenance and improvements, such as a paint brush, handyman, etc., may be used to indicate such expenditures. Further to the right, icon 53 shows a lamp on a table in front of a picture frame. This icon design may correspond, for instance, to expenditures made for home furnishings, household decorating expenses and the like. Alternatively, any other image associated with furniture or home decorating, such as a lounge recliner, wall paper, carpeting, etc., may be used to represent such expenditures.
In the fourth row first column, icon 54 shows a tele¬ phone. This icon design may correspond, for instance, to expenditures made for phone services. Alternatively, separate icons may be used, as desired, to indicate both local and long distance as well as cellular phone expenses. To the right, icon 55 shows an electrical plug of the type found on small electrical appliances. This icon design may correspond, for instance, to expenditures made for electricity or electrical service. Alternatively, any other image associated with electricity or electrical service, such as an electrical socket, a lightning bolt, or the like, may be used, as desired, to represent such expenditures. Further to the right, icon 56 shows a charge or credit card having a circle design, a magnetic strip and a charge number. This icon design may correspond, for instance, to expenditures made for credit card or charge cards. Alternatively, the front of an actual credit or charge card, such as a Visa™ or Mastercard™, may be used to indicate such expenditures.
In the fifth row first column, icon 57 shows a set of eating utensils. This icon design may correspond, for instance, to expenditures made for meals or restaurant services. Alternatively, any other image associated with restaurant services, such as a waitress, maitre d' or the like, may be used to represent such expenditures. To the right, icon 58 shows a cap and tassel of the type used in graduation commencement ceremonies. This icon design may correspond, for instance, to expenditures made for educational purposes, such as college tuition, seminars, and similar expenditures. Alternatively, any other image associated with educational expenses, such as books, calculators, computers and the like, may be used, as desired, to represent such expenditures. Further to the right, icon 59 shows a theater mask. This icon design may correspond, for instance to entertainment expenses such as movies, theater, comedy clubs and the like. Alternatively, any other image associated with entertainment, such as a movie projector, a circus big-top, a martini, etc., may be used to represent such expenditures, as desired.
In the sixth row first column, icon 60 shows an open hand extending into a light circular background. This icon design may correspond, for instance, to expenditures made for charitable purposes. Alternatively, any other image associated with charity or charity fund-raisers, such as a homeless person, Shriners cap or a United Way symbol, may be used to represent such expenditures, as desired. To the right, icon 61 shows an airplane ascending into the sunset. This icon design may correspond, for instance, to expenditures for travel, such as air travel, cruises, trains, etc. Alternatively, any other image associated with traveling or vacations, such as a cruise ship, a train, a map or the like, may be used, as desired, to represent such expenditures. Further to the right, icon 62 shows a large dollar sign within a light circular background. This icon design may correspond, for instance, to expenditures made for investment purposes. Alternatively, any other image associated with investments, such as a diamond, a ticker tape machine, etc., may be used to represent such expenditures, as desired.
The bottom row of icons 63-65 are special function icons provided for added check-writing flexibility. The two "star" icons 63 and 64 are user-definable icons. Icon 63 is a dark star and icon 64 is a light star, as shown. These icons may correspond, for instance, to a particular type of expenditure transaction that does not readily fall within one of the other expenditure categories indicated. These may be expenditures peculiar to a particular bank customer or they may be unusual, one-time-only expenses such as, for example, wedding expenses or legal expenses. Alternatively, any other symbol, such as letters, numbers, etc. may be used to indicate these user- definable expenditure categories.
To the right, icon 65 shows a toggle switch. This icon design may be used, for instance, in a similar fashion to a function key (i.e., SHIFT/ALT/CTRL) on a computer keypad, to indicate an extended or alternative list of icon expenditure category choices which may be recorded on a separate card or known to the bank customer personally. For example, an unmarked toggle icon 65 may indicated household expenditures, while a marked toggle icon may indicate business expenditures, each according to its own particular icon array, as desired. Alternatively, the toggle icon 65 may be used to indicate, for example, whether the check expenditure was made by the husband or wife in the case of a jointly held checking account. For instance, checks with the toggle icon 65 marked may indicate that the particular check expenditure was made by the husband. An unmarked toggle icon 65 may indicate that the check expenditure was made by the wife. Alternatively, any other image associated with this or any other desired function made be used as desired, such as a "T" or a picture of a "SHIFT" or "ALT" key, etc.
FIGURE 16 is an enlarged view of the icon array of FIGURE 3 illustrating in more detail the preferred shading of the various icons. FIGURE 17 is a view of the icon array of FIGURE 16 shown in actual preferred size.
FIGURE 18 is an enlarged view of an alternative embodiment of a printed icon array having features of the present invention. The icon array of FIGURE 18 is generally similar to that illustrated and described above in connection with FIGURE 3. Those skilled in the art will recognize, for instance, that the icon 445 in FIGURE 18 corresponds to the car icon 45 shown in FIGURE 3, although the shape and shading of the icons are different. Similarly the telephone icon 455 in FIGURE 18 corresponds to the icon 54 in FIGURE 3, although the shape, shading and positioning of the icons are different.
The variety of icons illustrated demonstrates the flexibility involved in selecting different icons to suit individual customer needs. A brief description of several of the more unique icons shown in FIGURE 18 is provided below for purposes of illustration only. Beginning in the top row, right-most column, icon 447 shows the silhouette of children. This icon may correspond, for instance, to expenditures related to child rearing or day care costs. Alternatively, any other image associated with child rearing expenses, such as a baby crib or cradle, crying baby, pacifier, etc., may be used to represent expenses related to child rearing. In the second row down, second column from the left, icon
449 shows a dog on a leash. This icon design may correspond, for instance, to expenditures related to pet care or veterinary services. Alternatively, any other image associated with pets or veterinarian services, such as a goldfish in a bowl, a bird cage, dog bone, etc., may be used to represent such expenditures, as desired. To the right, icon 450 shows a coin. This icon design may correspond, for instance, to small household expenditures, such as for light bulbs, household cleaners, etc. Alternatively, any other image associated with small household expenditures, such as a thumbtack, tape dispenser, scissors, bleach bottle, etc., may be used to represent such expenditures, as desired.
In the fifth row down, second column from the left, icon 458 shows a folded dollar bill. This icon design may correspond, for instance, to expenditures related to a cash allowance, discretionary spending money, or miscellaneous purchases. Alternatively, any other image associated with allowance or discretionary spending, such as an open wallet, purse, etc., may be used to represent such expenditures, as desired.
In the bottom row, right-most column, icon 465 shows a portion of a rising stock investment curve. This icon design may correspond, for instance, to expenditures made for investment purposes. Alternatively, any other image associated with investments, such as a diamond gem, a ticker tape machine, a stock certificate, etc., may be used to repre¬ sent such expenditures, as desired. FIGURE 19 shows an enlarged view of another alternative embodiment of a printed icon array having features of the present invention particularly suited for business use. The individual icons therein preferably represent the corres¬ ponding expenditure categories set forth in TABLE 1, below, with icon positions 1-28 indicated from left to right and top to bottom. Alternatively, those skilled in the art will readily appreciate that a variety of icon designs may be used to represent business expenditure categories, as desired.
TABLE 1
ICON # DESIGN EXPENSE
1 Dollar Bill Net Payroll
2 Dome w/ Dollar Bill Payroll Taxes
3 Boxes Supplies
4 Hard Hat Outside Services/ Contract Labor
5 Target Client Costs
6 Megaphone Advertising/Promotion
7 Auto Vehicle Expense
8 Forklift Equipment
9 Umbrella Insurance
10 Brief Case Professional Services
11 House Dwelling Rent
12 Hammer Repairs/Maintenance
13 Desk Office Expense
14 Dome Taxes
15 Airplane Travel
16 Fork/Spoon Meals/Entertainment
17 Telephone Telephone
18 Electric Plug Utilities
19 White Board Professional Growth
20 Ampersand Miscellaneous
21 Stock Chart Investments/Assets
22 Bank Debt/Mortgage
23 Bucket Owner Draw
24 Recycle Sign Reimbursables
25 NUMBER 1 User Defined
26 NUMBER 2 User Defined
27 NUMBER 3 User Defined
28 NUMBER 4 User Defined
Although the particular icons shown in FIGURES 3, 18 and 19 are preferred for indicating household and business type expenditures, it will be readily appreciated by those skilled in the art that any number of various graphic icon designs may be used to represent the same or similar expenditure categories. In other words, icons and corresponding categories may be changed to accommodate the needs of particular bank customers. It is further envisioned that different sets of icons may be provided to meet the needs of different types of households. For instance, a dual income couple with no children may have different expenditure tracking requirements than a family of five, or a single person in college, for instance. In an alternative embodiment, checks are printed with custom icons selected by bank customers from a pre-determined list according to their own individual needs. In that case, a bank or processing center scanning the checks would preferably record selected icons and corresponding expenditure categories for each individual bank customer. FIGURE 20 is a detailed view of a personal-sized printed bank check illustrating the preferred placement and dimensions of an icon array 28 relative to the borders of the check. These dimensions preferably conform to well-known industry standards for reader/sorter equipment such as the IBM 3890 XP (image enabled) or BTI 5500 reader/sorter. An icon array 28 for a conventional personal-sized bank check will have a preferred height "H" of up to about 55 mm and a preferred width "W" of up to about 24 mm as illustrated in FIGURE 20. The individual icons in the icon array 28 preferably measure up to about 6.3 mm x 6.3 mm square (C and D) and are preferably separated by a clear space of between about 0.5 mm and about 2 mm vertically (Sv) and between about 1.25 mm and 3.8 mm horizontally (Sh) . More preferably, icon rows are separated by a vertical clear space Sv of about 1.75 mm and icon columns are separated by a horizontal clear space Sh of about 2.4 mm.
The icon array 28 is preferably spaced about 6.3 mm (B) from the left edge of the bank check. Preferably the bottom row of icons is positioned about 11.5 mm (E) from the bottom edge of the check, as shown. For a personal-sized bank check the icon array 28 is preferably spaced about 3.2 mm (A) from the top edge of the bank check. Preferably, a minimum space of about 3.8 mm (I) is provided between the icon array 28 and other writing zones on the check face.
Business-sized bank checks may accommodate a larger icon array 28, as shown in FIGURE 21. A typical icon array 28 for a business-sized bank check will have a preferred height "H" of up to about 55 mm and a preferred width (W) of up to about 32.5 mm as illustrated in FIGURE 21. In the preferred embodiment shown twenty-eight icons are arranged in four columns of seven rows each. The icon array 28 in FIGURE 21 is preferably spaced about 9.5 mm (A) from the top edge of the bank check. All other icon array dimensions are preferably the same as described above in connection with FIGURE 20. 2. Printed Graphic Icon
Preferably, the icons 45-65 shown in FIGURES 1 and 3, the icons 445-465 shown in FIGURE 18 and the icons shown in FIGURE 19 are printed using a novel technique that provides an icon having not only good image detail and aesthetic appeal, but also enhanced detectability of a mark made thereon by a bank customer. It will be further understood, that while the present invention is described in the context of a printed bank check, it is envisioned that icons constructed in accordance with the present invention may provide similar advantages and benefits in a wide variety of other applications, such as in public opinion polling, voting, surveys, standardized testing, etc.
FIGURE 4 is an enlarged view of a printed graphic icon having features of the present invention. The icon 46 generally comprises a relatively dark, preferably solid black, outer portion 74 and a relatively light inner portion 75, as shown in FIGURE 4A. The dark outer portion 74 is preferably sufficiently dark such that its light absorptivity falls above a predetermined threshold level. The light inner portion 75 is preferably sufficiently light such that its light absorptivity falls below a predetermined threshold level. A mark is be detected by scanning the icon 46 and applying threshold imaging (described later) to obtain a bi-level pixel image thereof, as illustrated in FIGURE 4B. Any mark made on the icon would then appear as dark pixels within a pre¬ determined intended marking area 77. A substantially all white intended marking area 77, as shown in FIGURE 4C, indicates that no mark has been detected. The particular absorptivity levels selected for the light and dark portions of the icon will depend, among other things, on the sensitivity of a scanner used to scan the each icon, the aesthetic appearance of the icons, as well as the inherent limitations of the particular printing process selected. It will be appreciated that a higher absorptivity will produce a darker appearing icon. Lower absorptivity will produce a lighter appearing icon. For the light inner portion of the icon, an absorptivity of between about 0.10 and 0.50 and, more preferably, about 0.15, is preferred and provides a convenient compromise between the competing design objectives indicated above. The dark outer portion is preferably as dark as possible, having an absorptivity that is at least greater than about 0.75 and, more preferably, greater than about 0.90. Sufficient tolerance is preferably provided to accommodate for any possible variations in printing ink density, color, printing conditions, or the substrate itself. A tolerance level of about plus or minus 10% produces adequate results under most printing conditions. Alternatively, higher or lower absorptivity or tolerance levels may be used, as desired, while still enjoying the benefits of the present invention as disclosed herein.
It will be appreciated that providing an icon with light and dark portions, as described above, provides a high degree of user recognition and also dramatically enhances the detect- ability of a mark made within the defined marking area 77, as will be described in more detail later. It will be appreciated that user recognition of icons is critically important, particularly in cross-linguistic environments. Preferably the dark outer portion 74 of the icon 46 completely encloses and defines an inverted silhouette of the particular icon design, as shown in FIGURE 4B, in this case a grocery cart. The intended marking area 77 is further defined within this inverted silhouette area, as shown in FIGURE 4C, and preferably encompasses a relatively large, centrally disposed portion of the light inner portion 75 of the icon 46, as shown. Image detailing, such as shadowing and highlighting 78, is preferably provided within the light inner portion 75 of the icon 46, as shown in FIGURE 4A. These embellishments aesthetically enhance the icon and provide improved recog¬ nition of each particular icon design. Preferably, this image detailing 78 is printed using one or more light colored inks which are screened using a half-tone printing process or other means, as desired, such that the light absorptivity of the light inner portion 75 remains below the aforementioned threshold absorptivity level. This ensures that any such detailing 78 will "drop out" of a scanned pixel image of the icon 46 or may be filtered out or removed using threshold imaging, as will be described in more detail later.
Choice of color, use of dithering screens and very thin lines can all be used to decrease the light absorptivity of the detailing 78, as needed, to ensure that it consistently drops out of the scanned image. It is particularly convenient to use certain printing inks referred to in the printing trade as "spot" colors. These printing inks possess a quality whereby the shade and intensity of the color remain substantially constant from print run to print run. Using spot colors for the detailing 78 ensures that these embellish¬ ments will drop out consistently from one icon printing run to the next. For instance, a Kramer Process Blue ink screened with a density of between about 10% and 50% and, more preferably, between about 20% and 35% on a light colored substrate produces acceptable results for detailing 78. Alternatively, a wide variety of colors, screen densities and substrates may be used while still enjoying the benefits of the invention as herein disclosed. It will be understood by those skilled in the art that conventional screening produces a printed image that is composed of a uniform array of small dots. For optimal results, it is preferred to arrange this array of dots in a slightly canted or non-uniform position with respect to a scanner used to scan the icon image. This ensures that uniform rows or columns of dots will not register simul- 5 taneously with the scanner's sensor array. Advantageously, this increases the probability that the detailing 78 will consistently drop out of a scanned image. Accordingly, the screen is preferably canted by between about 30 and 60 degrees and, more preferably, by about 45 degrees from horizontal.
10 Alternatively, the detailing 78 may be screened such that the individual dots comprising the detailing 78 are arranged in a random or substantially non-uniform pattern, as desired.
The area ratio of light to dark portions of the icon 46 may be varied as desired, although a light/dark ratio of
15 between about 2:1 and 1:2 and, more preferably, about 1:1 is preferred for most icon designs. It will be understood that for a 1:1 light/dark ratio, about 50% of the icon will be comprised of light portions and about 50% of the icon will be comprised of dark portions. Alternatively, larger or smaller
2.0 light/dark area ratios may be used, as desired, while still enjoying the benefits of the present invention. An optional black outer frame 79 may be provided around the periphery of the icon 46, as desired, in order to provide a defined area within which the graphic icon 46 is fully contained. This
25 frame 79 and the white space on either side of the frame 79 provides a convenient reference for locating, scaling and aligning icons, as will be described in more detail later.
As mentioned above, a mark placed on an icon in accordance with the present invention is detected by scanning
30 the icon 46 and then applying threshold imaging to obtain a bi-level pixel image of the icon, as shown in FIGURES 5A and 5B. Threshold imaging is a well known image processing technique that basically converts a pixel image in the form of a plurality of analog or digital readings of light
35 absorptivity or reflectivity, into a bi-level pixel image in which individual pixels are either black ("1") or white ("0") . Black is arbitrarily defined as a light absorptivity reading above a predetermined threshold level, and white is arbitrarily defined as a light absorptivity reading below a predetermined threshold level. It will be appreciated that "absorptivity" is simply another way to describe the light reflectivity of a particular substrate surface at a desired wavelength. Either term may be used to describe measured light reflectance, but absorptivity will be used here for convenience in later discussions. Light absorptivity readings falling above the black/white threshold appear as black pixels. Absorptivity readings falling below this threshold level appear as white pixels.
Threshold imaging may occur in the scanner itself, such as in a bi-level image scanner, for instance. In that case, the black/white threshold corresponds to the inherent threshold detection level of the scanner for discerning black from white. This may be adjustable, depending upon the particular scanner. Preferably, however, a grey-scale scanner is used to capture the icon image in various shades of black, white and grey. Threshold imaging is then applied in a separ- ate computer imaging system or other image processing device in order to obtain a black and white bi-level pixel image suitable for detecting marks made on the icon. Advantageously, in that case the black/white transition or threshold detection level may be conveniently calibrated in the computer imaging system software or programming, again, depending upon the particular device.
Preferably icons in accordance with the present invention are adapted to be scanned using a drop-out blue scanner. Alternatively, other wavelengths of light or non-visible radiation may be used, as desired, to achieve the benefits of the present invention as taught herein. For instance, it may be desirable in certain applications to use near-visible infrared, ultra-violet or broad-band visible light. In that case, the absorptivity of light and dark portions of the icon will be selected having reference to those particular wavelengths. Optionally, any number or combination of colored filters may be used for icon scanning, as desired, to achieve a particular desired result or effect as taught herein.
FIGURE 5 is an enlarged view of an alternative embodiment of an icon printed in accordance with the present invention, illustrating how the icon may be marked by a user. Like numbers are intended to correspond to like characteristics or features of the icon, although the particular shape or form of the icon 45 may be different, as shown. The mark 84 is a typical type of mark which may be placed on an icon constructed in accordance with the present invention. It is an "X" located mostly within the outer icon frame 79, but perhaps partially extending out of the frame, as shown. It may be seen that the center of the mark 84 is located approximately within the intended marking area 77, which in this case, roughly corresponds to the shape of the inverted silhouette formed by the dark outer portion 74. It may be appreciated that the mark 84 produces a relatively low contrast with the dark outer portion 74 of the icon 45 and a relatively high contrast with the light inner portion 75, including detailing 78, as illustrated in FIGURE 5A. Advantageously, this dramatically enhances the detectability of the mark 84 within the marking area 77, as will be explained.
The mark 84 is detected by electronically masking the dark outer portions 74 of the bi-level image shown in FIGURE 5B with a template or mask 86 that has an open area (within the dashed lines) corresponding roughly to the size and shape of the intended marking area 77. Preferably, this is done electronically in a computer imaging processing system, as will be explained in more detail later. Preferably, the open area of the mask 86 is somewhat smaller than the corresponding intended marking area 77 so that a degree of image tolerance is thereby provided for slight variances and misalignment of the mask 86 and the icon 45. Image tolerance may be provided uniformly around the open area of the mask 86, substantially as shown or, more preferably, the mask is adjusted by trial and error testing so as to provide larger tolerances in certain "problem" areas and smaller tolerances in other areas. Advantageously, this maximizes the size of the mask within the intended marking area in order to provide optimal dynamic range of mark detection. Alternatively, it will be readily apparent to those skilled in the art that a variety of mask shapes and sizes may be used, as desired, while still enjoying the benefits of the present invention as herein disclosed.
It will be appreciated that once the known dark portions of the icon 45 have been masked out, all that remains of the original icon image are the white pixels corresponding to the light inner portion 75 of the icon. Any remaining contiguous dark pixels within the open area of the mask 86 are then counted and compared to a predetermined threshold number to determine whether a mark has been detected. Preferably, filtering is used to remove spurious "noise" in the pixel image before mark detection is attempted. This noise may appear, for instance, as specks or dots in the pixel image.
FIGURE 22 is an enlarged view of another alternative embodiment of a graphic icon having features of the present invention. The icon 464 generally comprises an outer portion 474 defining an inverted silhouette of a desired icon design, in this case a credit card having a magnetic strip. The outer icon portion 474 is preferably printed in a solid color using a suitable drop-out ink, as will be described in more detail below. An inner icon portion 475 is provided within the silhouette area defined by the outer icon portion 474. Various graphic details 478 are providing within the inner icon portion 475, as shown, further defining the icon design and enhancing human recognition thereof. The graphic details 478 are preferably also printed in drop-out ink using any one of a number of well-known half-tone screening techniques such that they appear lighter than the outer icon portion 474. The resulting icon 464 has an overall aesthetically pleasing appearance, enhanced user recognition of the icon design and improved machine detection of marks made thereon. The light inner icon portion 475 also provides a target marking area for providing maximum contrast with a mark made thereon by a user so that the user can readily see when the icon has been adequately marked. Preferably, the inner icon portion 475 has only minimal or no shading 478 such that the open area therein is as large as possible for enhancing mark contrast and improving user recognition thereof. Preferably, less than about 25% and, more preferably, less than about 10% of the inner icon area 475 comprises shading 478. A thin, black frame 479 may be provided around the outer icon portion 474, as shown, to further define the intended marking area. The frame 479 preferably measures about 6.4 mm x 6.4 mm square and is at least 0.7 points (0.25 mm) thick.
As indicated above, the entire icon 464 (with the exception of the optional black outer frame 479) is printed using a suitable drop-out ink. Preferably, a suitable drop¬ out ink has a spectral absorptivity or "print contrast signal" ("PCS") of about 0.40 or less. PCS can be measured on well- known commercially available test equipment equipped with a filter having a peak spectral response at 5550 angstroms (555 nanometers) and a one-half peak spectral response at 5100 to 6100 angstroms (510 to 610) nanometers.
A wide variety of suitable drop-out inks may be used to practice the present invention, as shown in TABLE 2 below.
TABLE 2
Color Desc Modifier Name/Pantone No. PCS< PCS < .15 .25
Yellow Basic Yellow, 012 X Process Yellow X
100-102, 106-109, 1 13-1 15 X
120-123, 1205-1225, 127-129 X
Yellow-Orange 1 16, 130, 136, 1365 X
Orange Basic 021 X
Red Basic 032 X Basic Warm Red X
Beige-Orange 141 , 148, 1485, 1495 X
142, 149, 1505 X
Beige-Red 155, 156, 1555-1575 X 157, 158, 1585 X
Red 162, 163, 1625, 1635, 169, 170 X 176, 177, 1765, 1775, 1767 X Red-Pink 182, 189, 1895, 196, 203, 217 X
183, 190, 1905, 197, 210, 223 X
Purple 230, 2365, 243, 250 X
231 , 236, 251 X
Violet-Blue 2706 X
Green 379, 386, 387 X 380, 388 X
Green-Yellow 393, 394, 395, 3935, 3945, 3955 X
Beige-Brown 461 X 460 X
Florescent Grn, 802-806, 810-812 X Yel, Org, Red
These colored inks are available from any number of well- known large commercial printing supply companies. The preferred range of colors or combinations of colors for providing both drop-out capability and good aesthetic contrast will have a PCS of between about 0.05 and 0.25. The more preferred range providing the most contrast to the human eye and yet retaining a drop-out capability will fall between the PCS scale from about 0.15 to 0.25. These preferred colors are indicated in TABLE 3 below:
TABLE 3
Color Pantone Number
Beige-Orange 142, 149, 1505
Beige-Red 157, 158, 1585
Red 164, 1645, 178, 1785, 1767
Red-Pink 183, 190, 1905, 197, 210, 223
Purple 231, 236, 251
Violet-Blue 2706
Green 380, 388
Beige-Brown 460
Fluorescent 802-806, 810-812
The most preferred color is Purple Pantone #251. This color has a PCS of 0.23 and provides optimal contrast and aesthetic appeal for most applications.
As indicated above, the outer icon portion 474 and the inner icon portion 475 are preferably printed using a drop-out ink having a PCS of less than about 0.4. FIGURE 22B illustrates how the icon 464 appears to a scanner having a threshold PCS detection level above about 0.40. As shown, the entire icon 464 (with the exception of the outer frame 479) is invisible to the scanner. Any marks made on the icon 464 will readily appear in a bi-level pixel image of the icon 464 as dark contiguous pixels disposed within the dark outer frame 479. Those skilled in the art will readily appreciate that a pixel image of an array of such icons 464, reproduced on a bank statement for example, will reveal the relative positions of each icon by the outer frame 479 so that a bank customer can visually identify any marks made thereon. Alternatively, the black outer frame 479 may be omitted, as illustrated in FIGURE 23A, such that the entire icon 464' will be invisible to a scanner as illustrated in FIGURE 23B. Having thus described a printed bank check and graphic icon in accordance with the present invention, attention will now be directed to a preferred method and apparatus in accordance with the present invention for automatically tracking check expenditures using the above-described printed bank checks and graphic icons.
3. Expenditure Tracking System and Method
In accordance with one preferred embodiment of an expenditure tracking system and method of the present invention, checks are sorted and processed electronically using a scanner and computer imaging system capable of discerning which of a plurality of icons have been marked by a customer. A computer software routine is implemented by the computer imaging system or other computer image processor to detect particular marked icon(s). Marked icon(s) are then translated into corresponding expenditure categories which are stored in a transaction record in association with other information representative of each check transaction.
FIGURE 6 is a schematic illustration of one embodiment of an expenditure tracking system in accordance with the present invention. The expenditure tracking system comprises a MICR decoder 104, a scanner 106, and a central processor 108. A printer 110 or other output means may be provided, as desired, but is not necessary to practice the invention herein disclosed.
Bank checks 8 are drawn via conventional high-speed check handling equipment shown here schematically as comprising conveyor belt 102, through a MICR decoder 104 and a scanner 106. For continuous operation, checks are fed through the expenditure tracking system on a substantially continuous basis as they come in. More preferably, however, the system is operated in a batch mode whereby stacks of checks are inserted into the machinery, shown, and processed in a batch mode with a transaction record being generated and stored for each batch run.
Preferably, the MICR decoder 104 and scanner 106 are adapted to decode and scan bank checks while they are fed through horizontally on edge, as shown. Commercially available MICR decoders and scanners are capable of handling up to 60,000 checks per hour, depending upon the particular machine and the complexity of the check image to be scanned. A DEC Kiensel combination scanner and computer imaging system, available from Digital Equipment Corporation, for instance, provides a convenient scanner 106. A variety of other high¬ speed scanners are commercially available from such manufacturers as NCR, Kodak and Unisys, and may be used, as desired, to practice the present invention. Alternatively, it will be appreciated that, depending upon the speed and volume of throughput of checks processed by the expenditure tracking system, higher or lower speed components may be used, as desired, while still enjoying the benefits of the present invention. The MICR decoder 104 is preferably of a type that is commonly available in the banking industry for decoding MICR code and electronically conveying information representative of the MICR code to an associated computer or other peripheral device. Although shown here separately for illustrative purposes, the MICR decoder 104 more preferably comprises a magnetic reading head or module that is incorporated into a single integral structure with the image scanner 106. Preferably this comprises an NCR 7780 High-Speed Power Encoder fitted with a MICR Reader Module, available from NCR Corporation.
The central processor 108 preferably comprises a high- speed computer having at least a 66 MHz 486 microprocessor, 16 MB of working RAM, 2 GB of fixed disk or magnetic tape storage and an image capable high-resolution, high-refresh monochrome monitor. Alternatively, the central processor 108 may comprise any computer imaging system or other computer image processor capable of receiving and processing pixel images and other information at high rates of speed. It will be further appreciated that such image processing may either be done on¬ line or off-line, depending upon the relative speed of the central processor 108 compared to the speed of the MICR decoder 104 and scanner 106.
In operation, the MICR decoder 104 reads the magnetic encoded numbers on the bottom of each check 8 and transmits this information to the central processor 108. The scanner 106 then scans the front and, preferably, the back of each check 8 in substantially rapid succession and transmits a pixel image thereof to the central processor 108. A pixel image having dimensions 825 pixels high by 1800 pixels wide, corresponding to a 300 dpi scan, provides a convenient size for purposes of expenditure tracking using printed bank checks having graphic icons in accordance wit the present invention. Alternatively, other scan resolutions or pixel image sizes may be used, as desired, while still enjoying the benefits of the present invention. It is important, however, that the scan resolution and pixel image size be at least minimally sufficient to allow recognition of a mark made on the check by a writing instrument such as a ball-point pen.
The pixel image of each check 8 is then analyzed in the central processor 108 to determine which, if any, of a plurality of graphic icons have been marked. It will be understood that these pixel images need not be actually displayed, but may be stored in working memory and manipulated in accordance with well known pixel imaging techniques. Once selected expenditure categories have been determined, this information is then combined with other transaction information, such as the dollar amount of the check, check transaction number, bank account number, bank routing number, and payee name, in order to generate an expenditure statement 112 which may be provided to the bank customer, as desired. Alternatively, this information may be electronically downloaded, as desired, via modem or other means to a home or business computer 114, as shown. FIGURE 7 is a front view of one possible embodiment of an expenditure statement 112 in accordance with the present invention. The statement 112 contains customary information such as the account number and bank customer name at the top, as shown. Expenditures are then broken down by category, such as auto expenses, groceries, etc., as shown. Within each category are listed corresponding check transaction numbers 113, obtained, for instance, from the MICR code. Next to each check transaction number 113 is provided a printed image of the payee name 114, obtained from the check image, and the amount of the check 115, as determined from the MICR code. Optionally, this check amount may be verified against the amount written in the check amount box using a modified OCR technique described in more detail later.
Advantageously, image capturing and reproducing of the payee box 16 provides a convenient way of reporting each check transaction to a bank customer without having to return or provide copies of individual checks. Furthermore, it provides additional security by affording the bank customer an opportunity to identify and verify the payee name and thereby determine if the check had been fraudulently written or obtained. Alternatively, one or more optical character recog¬ nition ("OCR") techniques may be used to convert a hand¬ written or typed payee name in the payee box 16 into ASCII equivalent characters that can be similarly reproduced in an expenditure statement or other accounting statement provided to the bank customer. Image capturing and reproducing of the text image within the payee box 16 is preferred, however, due to the current difficulties of primary recognition of hand¬ writing using presently available OCR techniques and the aforementioned benefits of reproducing the actual payee box 16 on the expenditure statement 112. The above described expenditure statement is convenient for monitoring monthly expenditures in each of a plurality of expenditure categories. Alternatively, a wide variety of different types of expenditure statements may be generated, as desired, such as a year-to-date statement or an assets-and- income statement, etc. Expenditure information may also be organized into a pie chart or other similar graphic form in order to visually illustrate a particular breakdown of expenditures, as desired. Alternatively, it will be readily apparent to those skilled in the art that various graphs, tables and statement forms may be provided to convey expenditure tracking information to a customer in a convenient and useful way.
In a particularly preferred embodiment, such expenditure tracking information is incorporated into a conventional bank statement to provide a more detailed and useful analysis of account deposits and withdrawals. Most preferably, such a statement would be an all-encompassing statement of expenditures, deposits, account balance, interest earned, ATM, POS, and EFT withdrawals and transactions, etc. This format is particularly desirable for banks that wish to offer such premium services as part of a preferred customer program or other incentive program intended to attract and keep bank customers. Alternatively, it is envisioned that such statements may become standard in the banking industry as customers continue to demand more detailed and useful account information from their banking institutions.
FIGURE 8 is a more detailed schematic block diagram of an expenditure tracking system having features of the present invention. In operation, bank checks 8 are sent through the MICR decoder 104 and the scanner 106. The order in which the check 8 enters the decoder 104 and the image scanner 106 is relatively unimportant; however, for convenience it is preferred that the MICR decoder 104 reads the check first so that the MICR code may be used thereafter as a reference number for subsequent processing steps. The MICR decoder 104 transmits to the central processor 108 an electronic signal which corresponds to the MICR code recorded on the bottom of the check 8. The scanner 106 is adapted to scan the check 8 at high speeds and produce an image thereof 8' which is also provided to the central processor 108. The scanner 106 is preferably adapted to produce a 16 level grey-scale pixel image of each check. Alternatively, the scanner 106 may be adapted to provide a bi-level image of each check, as desired.
The central processor 108 receives a series of binary data from the scanner 106 representative of a pixel image 8' of each check. This is preferably in the form of a TIFF file or other standard pixel image format, such as an ASCII file with commas delimited zones. A computer subroutine 117 processes this image by applying threshold imaging, aligning the image and correcting for minor distortions. Another subroutine 118 captures the pixel image of the amount box 18' . Subroutine 120 verifies that the amount written in the amount box 18' corresponds to the amount read from the MICR code by the decoder 104. This may be done using a secondary OCR recognition technique, which will be described in more detail later. A second image capture subroutine 122 captures a pixel image of the payee box 16', as shown. This is recorded in pixel form in the transaction record by the transaction update subroutine 121. A third image capture subroutine 124 captures the icon array 28', as shown, as well as any optional icon boxes (not shown) . A novel mark detection subroutine 126 then determines which icons (if any) have been marked and provides this information to the transaction update subroutine 121. The transaction record is thereby updated accordingly, with the check amount, payee, and expenditure category as described herein. Periodically, the central processor 108 may be prompted to provide a cumulative download of certain transactions recorded in the transaction record. This may be provided, for instance, to a printer 110 in order to generate a periodic expenditure statement 112, as desired. Alternatively, this information may be downloaded directly to a bank customer's home or business computer 114, as shown. FIGURE 9 is a more detailed flow chart of the image processing subroutine 117 shown in FIGURE 8. This is preferably in the form of a computer software subroutine or other electronic circuitry that may be called on demand to perform the steps described. The subroutine 117 begins at step 150 with the routine initialization of variables, defining common variables, allocation of working memory space, etc. Step 151 inputs the pixel check image 8' from the scanner 106 (shown in FIGURE 8) into working memory. Preferably, the check image 8' is stored in a commonly accessible memory location such that the image may be accessed by any subroutine or software called to operate or perform functions on the image. This may be, for instance, a specifically allocated portion of RAM memory associated with the central processor 108, itself, or in an external storage device, such as a hard disk or CD-ROM disk, as desired. The image 8' is stored in binary or hexadecimal form in a TIFF file or other pixel image format wherein each binary digit represents a particular pixel location of the image. Each image will occupy approximately 192 K of working memory. The storage and accessing of pixel image information in working memory is well known to those skilled in the art. For instance, the pixel image may be stored in memory row-by-row, column-by-column, or any other convenient means for storing pixel images. Preferably it is stored row-by-row, starting with the pixel in the upper left most corner of the check image and proceeding to the right until the last pixel in each row is reached. An end-of-row code such as a "00" or "FF" may be inserted into the series of binary data representative of the check image 8' to indicate the end of each pixel row. The data then continues with the left most pixel of the next row. The beginning and end of each pixel image stored in memory may be further defined by recording the first and last memory location occupied by the data representative of the image. Alternatively, consecutive images may be "stacked" separated by an appropriate hexadecimal code, as desired, indicating the beginning and end of each pixel image. In this manner, it will be appreciated that any number of pixel images may be stored as linear arrays of binary or hexadecimal data which can be stored and accessed serially in working memory or other storage media, as desired.
If the check image 8' is a grey-scale image then threshold imaging is applied at step 152 to convert the image to black and white. Threshold imaging may be done, for instance, by defining a desired threshold black/white level and then comparing each grey-scale pixel to this threshold level to determine whether it falls above or below the threshold level. This will likely be a trial and error process for each particular check design. In selecting an appropriate threshold level, it is desirable to ensure that the light inner portion of each icon consistently drops out of the scanned image. On the other hand, the threshold should not be set so high that marks made upon the bank check by a bank customer will tend to fall below the threshold and drop out. Preferably, the threshold level is set just above the level that will cause the light inner portion of each icon to consistently drop out. This provides optimal dynamic range of mark detection.
If checks are scanned using a 16 level grey-scale scanner, for instance, where 0 = lightest and 15 = darkest, a threshold level of between about 7 and 10 and, more prefer¬ ably, about 9 provides a convenient threshold level for most scanning purposes. Pixels falling above this threshold level
(corresponding to high absorptivity) are then designated as black pixels, or "l"s. Pixels falling below this threshold level are designated as white pixels, or "0"s. The resulting bi-level pixel image is stored in working memory or other convenient memory location, as desired, for further processing.
Once the check image 8' has been inputted into memory as a bi-level pixel image, it is compared at step 153 to a reference or sample check image that has also been stored in an accessible location in working memory. The images are first compared for size in step 154 using a combination of an edge detection and pixel counting techniques. The check image is initially processed by filtering out all areas but those showing the highest contrast. This will occur wherever a white pixel is next to a black pixel and indicates the presence of an "edge" . Preferably, the check 8 in FIGURE 8 has been scanned against a dark or black background by the image scanner 106, such that the edge of the check image 8' will show high contrast with the black background.
Once the outline of the check image 8' has been established, the approximate size of the check image is then determined by counting or estimating the number of pixels within the check outline. If this image is significantly larger or smaller than the corresponding sample check image then the check is either aborted or, optionally, the check image 8' may be scaled at step 156 using any one of a number of well known pixel image scaling techniques, such as those contained in Visionshape's AutoClass® software library, available from Visionshape of Orange, CA. If size correction is attempted, then the scaled image is again compared at step 153 to the sample check image. If the size of the image is now within predetermined tolerances, such as plus or minus 10%, then the subroutine 117 proceeds to the next step 156.
Step 156 determines whether the image is distorted either vertically or horizontally. Vertical distortion refers to a scaled check image that is either taller or shorter than the sample check image. Horizontal distortion refers to a scaled check image that is longer or shorter horizontally than the stored check image. Either one of these types of distortions may occur in a high speed scanner using raster or linear array scan input. Distortion may be caused, for instance, by variations in the speed of the check going past a linear CCD scanner, causing the image to either be stretched or compacted. If the checks are fed horizontally, then hori- zontal distortion is more likely. If the checks are fed vertically, then vertical distortion is more likely. It is desirable to keep such speed fluctuations and distortions to a minimum. Alternatively, a photographic-type image-capturing device may be used, as desired, to take a substantially instantaneous "snap shot" of the entire check image. In that case, it will be appreciated that the likelihood of image distortion is substantially reduced. Either type of scanner may be used depending upon cost and availability. If significant image distortion is detected, then the check is aborted. Optionally, step 158 may be provided in order to attempt to correct this distortion by either stretch¬ ing or shrinking the check image 8' either vertically or horizontally, as the case may be. This may be done using any one of several well known pixel image scaling techniques, such as contained in the aforementioned Visionshape AutoClass® software library. If distortion correction is attempted, then the check image 8' is again compared to the sample image in step 152 and readjusted, as desired, until it is within predetermined tolerances, such as plus or minus 10%.
Once the size and distortion variations have been checked, the next step 160 is to check for image skew. This may occur, for instance, if a check is not lying flat on one edge as it is drawn past the image scanner 106 shown in FIGURE 8. This may cause the resulting check image 8' to be angled or rotated from its normal horizontal position. Image skew is detected using a line detection technique, such as available from Visionshape's Autoclass Library, whereby known vertical and horizontal lines on the check image 8' are detected and then analyzed to determined if they are skewed. Degree of skew is preferably determined according to the average of all detected lines.
If significant image skew is detected, the check may either be aborted or, preferably, step 162 attempts to remedy this skew by rotating the image 8' . This may be done using any one of several well known pixel image rotation algorithms, such as is contained in the aforementioned Visionshape AutoClass® software library. Preferably, image rotation is incremented in accordance with the direction and angular degree of skew detected. Several rotations may be necessary before the image is within acceptable skew tolerances, such as, for instance, plus or minus 3 degrees rotation.
Step 164 verifies that the correct side of the bank check has been scanned or, in other words, that the check 8 has not been flipped front-to-back in the image scanner 106. This is preferably accomplished using a pixel image overlay technique whereby a sample check image is combined or merged with the check image 8' using an appropriate Boolean operator, such as AND, NAND or XOR (exclusive OR) , operating upon corresponding pixels. The resulting image roughly reflects the percentage overlap of individual pixels between the sample image and the check image 8' . A high percentage of pixel overlap would indicate a relatively high probability that the check images correspond such that the front of the check has probably been scanned. A low percentage of pixel overlap would indicate that the front of the check has probably not been adequately scanned or is otherwise non-recognizable. Of course, it is possible that heavily canceled or marked-up checks may result in poor correspondence even though the check has been properly scanned. These types of image defects will result in the check being aborted at steps 168 and 170, as indicated. Alternatively, a flipped check image may be detected using any one of several pixel image recognition or verification algorithms such as is contained in the aforementioned Visionshape AutoClass® software library.
If a flipped image is detected the next step 166 attempts to correct this by switching or flipping the image from back to front. If both sides of the check have been simultaneously scanned by the scanner 106, then the images are swapped electronically. If not, then mechanical means are provided for routing the check back through the image scanner so that the other side is presented for scanning.
Preferably, each of the image correcting loops 153-166 has an abort feature whereby the check is automatically aborted or the correction procedure is automatically termi¬ nated after a certain predetermined number of correction attempts have been made. The threshold for aborting may vary from one correction step to the next. For instance, for the scaling of the image 154 it may be convenient to set an abort threshold of say 8-10 tries, whereas the flipped image 166 may have an abort threshold of only two tries since if neither side of the check produces correspondence with the sample check image then it is probably not possible to process it in the automated check expenditure system of the present invention.
In the event that a check is aborted, it is preferably forwarded to a manual inspection station or other auxiliary service station so that the system can proceed with other checks, the bulk of which will be able to be deciphered and processed automatically by the expenditure tracking system. If it is determined that a successful image scan has been obtained, then the corrected check image 8" is stored in memory as discussed above in connection with the step 151. This may be at the same memory location or a different memory location as the original check image 8', as desired, although preferably it is overwritten in the same memory location so as to conserve use of memory space. After the corrected check image 8" is stored in working memory, the subroutine 117 terminates at step 174 and command control is passed back to the central processor 108 for performing further processing upon the corrected check image 8", as will be described below.
FIGURE 10 shows a more detailed flowchart diagram of the image capture subroutine 118 shown in FIGURE 8. The subroutine is initialized at step 180. The corrected check image 8" is inputted from the preceding image processing step 117 shown in FIGURE 8. Again, this inputting step is preferably accomplished by enabling access to a commonly accessible memory location where the corrected check image 8" is preferably stored. Once the corrected check image 8" has been inputted or access provided, step 184 locates the amount box 18' on the check image. This is preferably accomplished using a combination of edge detection and zone locating tech¬ niques. In this technique a zone is defined on the check image relative to known marks or lines on the check, itself. This corresponds to a defined area on the check within which the amount box 18' is expected to be found. The size of this zone is preferably at least slightly larger than the amount box 18' in order to accommodate for slight variations in the size and location of the amount box 18 occurring during previous scanning and image processing steps. A convenient zone size for the amount box is approximately 75 pixels vertically by approximately 330 pixels horizontally and corresponds roughly to the proportions of the amount box 18 shown in FIGURE 1. Alternatively, larger or smaller zones may be used, as desired, depending upon the observed accuracy of the system in locating the amount box 18' for each particular check design.
The pixels in the locating zone are then examined using an edge detection technique in order to detect the outer borders of the amount box 18' . The amount box should be properly oriented at this point. Optionally, a further orientation or rotation step may be provided in order to prevent skew of the amount box 18' . Once edge detection has successfully located the amount box 18' within the locating zone, step 186 isolates the amount box image 18' . This will result in a somewhat smaller pixel image measuring approx¬ imately 75 pixels vertically by 300 pixels horizontally.
Once the pixel image 18' has been isolated, it is then filtered at step 188 using any one of several conventional pixel image filtering techniques, such as speckle removal, available from Visionshape's AutoClass® software library. In this technique, any individual pixels or small groups of pixels having no contiguous neighbors are reversed so that they will become contiguous with their neighbors. Thus, for instance, a small black spot appearing in an otherwise white zone would be replaced with a white spot so that a contiguous white image is presented. The same is true of white spots found in a black contiguous area. The number of pixels comprising an individual speckle may be varied as desired to provide a convenient level of filtering. If the speckle size is set to low, then not all the speckles in the image may be removed. On the other hand, if the speckle size is set to high, then potentially critical portions of the check image may be removed. Preferably, the speckle size for filtering is selected to correspond to at least a size smaller than a normal decimal point made by a ballpoint pen. The filtered image of the amount box 18' is outputted for further use by the central processor 108, as will be described below. The subroutine terminates at step 190 and command control is passed back to the central processor 108.
FIGURE 11 is a further detailed flowchart diagram of the subroutine 120 shown in FIGURE 8. This subroutine verifies that the amount indicated in the amount box 18 corresponds to the amount entered on the check in MICR code. The subroutine is initialized at step 196, as shown. The MICR code is inputted at step 198 and stored temporarily in working memory. Step 200 extracts from this MICR code the dollar amount of the check represented by the right most eight MICR digits on most checks. In this case, the MICR code indicates that the check is for $126.69. This dollar amount is stored in working memory at step 202, as shown.
Step 204 inputs the pixel image of the amount box 18' obtained from the subroutine 118, as previously described. Again, this is preferably inputted by enabling access to a common memory area containing binary data representative of the pixel image 18' . Beginning on one side of the image 18' step 206 isolates each digit in the pixel image 18' proceeding from right to left, in this case, beginning with the numeral "9". Alternatively, verification may proceed from left to right, as desired.
Digit isolation is accomplished using conventional image processing techniques such as have been described previously. Preferably, the image is divided into segments separated (if possible) by at least one vertical column of substantially contiguous white pixels. These white pixels represent a space between individual digits. The numeral "9", for instance, may be separated from the rest of the image by locating a vertical column of substantially contiguous pixels between the six and the nine so that the character nine can then be isolated and examined in more detail.
Each isolated digit is then verified using a conventional OCR software routine, such as is available from Visionshape's AutoClass® software library. OCR recognition is preferably secondary, however, in that the software is instructed to begin with the particular expected character, in this case the numeral "9". The OCR software then looks for and confirms the existence of several characteristic features of the particular isolated digit and generates a match percentage output representative of the percentage likelihood that the isolated digit is the expected digit. For example, for the numeral "9" the OCR software may look for a substantially vertical line or slightly curved line connected to a contiguous top portion which formes a closed loop.
The OCR software is instructed to stop after the first attempt at recognition is made. If the match percentage output is greater than a predetermined threshold percentage, then a "match" is assumed and the subroutine proceeds to the next step. If the match percentage output is less than the predetermined threshold, then the check is aborted at step 212 and either rescanned to obtain a better image or manually inspected, as desired. The confidence level of the verification subroutine 120 can be adjusted, as desired, by increasing or decreasing the threshold match percentage required to assume a match has been made. A threshold match percentage of between about 75% and 100% and, more preferably, about 90% provides a convenient confidence level for most expenditure tracking purposes.
It will be appreciated that by using secondary OCR recognition the amount written in the amount box 18 can be quickly and accurately verified against the MICR code dollar amount with recognition rates exceeding roughly 90%. This is a significant improvement over most primary OCR techniques, which currently achieve only about a 66% recognition rate for hand-written numerical characters. Alternatively, as OCR technology develops and improves it is further envisioned that OCR may be used directly to read and verify the written check amount against the MICR code.
The next step 214 asks whether there are more digits to be compared. This step basically uses the OCR software to verify whether the isolated digit corresponds to a printed dollar sign, which is also preferably captured in the amount box 18' . When the software recognizes the printed dollar sign, it assumes that it has reached the end of the left most field of the amount image 18' . Because this dollar sign is printed uniformly on each check, it is easily recognizable using the OCR software described above. Alternatively, a simple pixel image overlay technique may be used, as desired. If step 214 determines that there are more digits to be compared, then step 216 increments the digit counter N and returns the subroutine to the step 206 for isolating the next digit. The subroutine 120 continues to operate as described above until all digits have either been verified or the check has been aborted. Once all the digits have been verified, then step 216 outputs the verified MICR dollar amount for use in subsequent processing steps. The subroutine 120 terminates at step 218 and command control is passed back to the central processor 108.
FIGURE 12 is a more detailed flowchart diagram of the subroutine 122 shown in FIGURE 8. This capture subroutine 122 is similar to the capture subroutine 118 described previously with a few exceptions that will be described. The subroutine is initialized at step 230. Step 232 inputs the corrected check image 8" into working memory. Again, this is preferably done by enabling access to a commonly accessible memory area, as described previously. Step 234 locates the payee box 16 using the edge detection technique described previously in connection with FIGURE 10. A zone is defined corresponding to the expected location of the payee box 16 and an isolated pixel image is obtained thereof in step 236. This image is then cropped and rotated as desired so that it will present neatly in an expenditure statement, as shown previously in
FIGURE 7. This image is then filtered at step 238, if desired, using the aforementioned speckle removal filtering technique. The filtered image of the payee box 16' is then outputted, as shown, for further use by the central processor
108. The subroutine 122 terminates at step 240 and command control is passed back to the central processor 108.
FIGURE 13 is a more detailed flowchart diagram of the subroutine 124 shown in FIGURE 8. This subroutine captures an image of the icon array 28' including any supplemental or auxiliary icon boxes (not shown) . The subroutine is initialized at step 250. The corrected check image 8" is inputted at step 252, preferably by enabling access to a commonly accessible memory area containing binary data representative of the check image 8". Step 254 locates the icon array 28' . This may be done using any one of a variety of pixel image detection techniques, as previously described.
Preferably, a combination of zone locating and edge detection techniques are used to locate the icon array 28' . A suitable zone is defined such that it covers substantially the entire area within which the icon array 28' is expected to be found. A zone measuring approximately 660 pixels vertically by approximately 330 pixels horizontally provides a convenient zone size for capturing the icon array 28' . Within the zone, edge detection is used to locate the edge of white pixels just outside of the outer frame of individual icons in order to register the image for subsequent processing. Optionally, the image 28' may be filtered in step 258 using a speckle filtering technique, as described previously. The filtered image 28" is then outputted for further processing by the central processor 108. The subroutine terminates at step 260 and command control is passed back to the central processor 108. FIGURE 14 is a more detailed flowchart diagram of the subroutine 126 shown in FIGURE 8. This subroutine determines which, if any, icons have been marked by a bank customer. The subroutine 126 is initialized at step 270. The filtered image of the icon array 28" is inputted at step 272, preferably by enabling access to a commonly accessible memory area containing binary data in the form of a TIFF file represen- tative of the image 28". Step 274 locates each individual icon "N" by zone location using the white edge just outside of the black outer frame of individual icons as reference lines. Step 276 isolates each icon "N" by first copying the pixel image within the corresponding zone into a separate TIFF file stored in working memory and then applying edge detection to locate the white edges just inside the black outer frame of the copied icon image. Optionally, step 278 further filters each individual icon image to remove any remaining spurious noise or other image defects present in the icon image. Individual icons are then masked in order to remove known dark portions of the icon image, as described previously in connection with FIGURE 5C. A suitable mask such as mask 86 shown in FIGURE 5C, is preferably created for each particular icon and is stored in working memory in the form of a bi-level pixel image or TIFF file that can be accessed and manipulated similar to the pixel icon images described above. Alternatively, the mask may reside in working memory in the form of a predetermined algorithm for removing or transforming known dark portions of each corresponding icon. In order to apply the mask accurately, several steps are first performed to adjust the icon image and/or mask to provide a desired correspondence therebetween. It is particularly important to ensure that the icon and mask images are properly aligned so that known dark areas of the icon image will not protrude through open or white areas of the corresponding mask. To ensure consistent and adequate mask coverage, the open or white area of the mask 86 (corresponding to the area inside the dashed lines in FIGURE 5C) is preferably somewhat smaller than the intended marking area 77, as indicated, in order to provide a degree of tolerance for slight misalignments. It will be further understood that the mask area outside of the dashed lines shown in FIGURE 5C is preferably all black. Alternatively, a uniform mask may be applied over icons such as shown in Figure 22 in order to eliminate any pixels attributable to the frame 479 and to detect the occurrence of supra-threshold pixels in the intended marking area within the frame 479.
Referring again to FIGURE 14, step 282 determines whether the icon image is larger or smaller than the corresponding mask. This is preferably determined by edge detection and then counting the number of pixels within the detected outer edge of the icon. If the icon area is smaller than the corresponding mask, then the icon is scaled accordingly in step 284, using known pixel image scaling techniques such as contained in Visionshape's AutoClass® software library.
Step 286 checks to see whether the icon is distorted in any way. This is determined using edge detection and then counting the pixels along each edge of the icon to determine whether it is longer or shorter than expected. If distortion is detected, then step 288 stretches or shrinks the icon image, as needed, to provide a suitable correspondence with the mask. A variety of pixel image stretching or shrinking techniques may be used, as desired, to scale the image. A convenient technique, however, is to provide for pixel expansion or contraction from a center line dividing the icon horizontally or vertically, as needed. The two halves of the icon are then either separated or pushed together while columns or rows of icons are replicated or removed at the centerline in order to provide a contiguous pixel image. It will be appreciated that while the above described technique will not produce exactly scaled icons, it is fast and convenient where only small degrees of shrinkage or stretching are required and sufficient tolerance is otherwise provided in the mask to accommodate slight icon variations.
The next step 290 checks for possible skew of the icon image. If skew is detected, step 292 rotates the mask image accordingly in predetermined increments until the skew is corrected to within predetermined tolerances. Again, this may be done using any variety of well known image pixel rotation techniques such as contained in Visionshape's AutoClass® software library. Alternatively, the pixel icon image may be rotated, if desired, to correct for skew.
Once the pixel image of the icon and mask have been adjusted to correspond, then the mask is registered with the icon and applied at step 294. This is done by combining or merging the registered mask image with the icon image using an appropriate combination of Boolean operators, such as AND, NAND or XOR. A NAND operator is particularly preferred for achieving the desired masking result, as illustrated in TABLE 4 below.
TABLE 4 IMAGE (i) B B W W
MASK (m) B W B W
RESULT (r) W B W W
It will be understood by those skilled in the art that a logical NAND operator, i.e., (i NAND ) , takes the value FALSE or "0" if both i and m are "1" (corresponding to both black pixels) , or TRUE or "1" if either i and m are "0"
(corresponding to both white pixels, or mixed white and black pixels) . If (i NAND m) is FALSE, then the corresponding
RESULT pixel, r, is set equal to NOT(i) or "W" as indicated above in TABLE 4. If (i NAND m) is TRUE, then the corres- ponding RESULT pixel, r, is set equal to i. The resulting pixel image should be composed of substantially all white pixels except for any marks placed on the icon by a bank customer.
Step 296 counts the number of remaining contiguous black pixels (#CP) present in the resulting icon image. Step 298 compares this number (#CP) to a threshold number of pixels (T) required to assume that a mark has been detected. If the number of remaining contiguous black pixels (#CP) is greater than this threshold number (T) , then a mark is assumed to be detected. Step 300 outputs the icon number (N) corresponding to the selected expenditure category, in this case groceries, and the subroutine 126 continues on to the next step. On the other hand, if the number of contiguous black pixels (#CP) is less than the threshold number (T) , then step 302 acknowledges that no mark has been detected for that particular icon (N) . A threshold (T) of about two-hundred pixels provides a convenient reference number for assuming the existence of a mark. Alternatively, smaller or larger threshold numbers (T) may be used, as desired, while still enjoying the benefits of the present invention.
Step 304 determines whether there are more icons to be examined. If so, step 306 increments the icon counter (N) and the subroutine returns to step 274 in order to examine the next icon (N) . If no more icons are left to be examined, then the subroutine terminates at step 308 and returns command control to the central processor 108. Note, that the subroutine 126 may output more than one expenditure category if, for instance, the bank customer has marked more than one icon, indicating that the check transaction is to be split evenly between the marked categories.
FIGURE 24 shows an alternative subroutine 126' for detecting which of a plurality of icons in an array of icons has been marked. Preferably, the subroutine 126' may be used with checks having an array of drop-out icons printed in accordance with the preferred embodiment shown and described in connection with FIGURE 23. It will be recalled that in this particular embodiment, the entire icon 464' is printed or screened using a drop-out ink so that the entire icon will be invisible to a scanner, as shown in FIGURE 23B. Any marks made on the icon will appear as dark pixels in an otherwise white image. The subroutine 126' locates these pixels on an x-y grid relative to one or more predetermined reference lines and icon positions to determine whether a corresponding icon has been marked. The subroutine 126' begins at step 501 with the routine initialization of variables, defining common variables, allocation of working memory, etc. At step 503 the subroutine locates a predetermined vertical reference line corresponding to the line x=0 on an x-y grid. This may be accomplished using any one of a number of line or edge detection techniques well known in the art. Next, at step 505 the subroutine locates a predetermined horizontal reference line corresponding to the line y=0 on the x-y grid. Again, this may be accomplished using a line or edge detection technique. The reference lines are preferably black horizontal and vertical lines disposed on the check in or near the icon array 28. These lines are preferably printed in a non-drop-out color such as black so that they may be detected by a scanner. If desired, the payee box, amount box, memo line, or signature line of a check may be used as convenient reference lines for locating the icon array on an x-y grid. In a particularly preferred embodiment shown in FIGURES 20 and 21, the memo line 324 includes a short vertical reference line 325 originating at the far left side of the memo line and extending approximately 6.3 mm upward. The combination of the horizontal memo line 324 and the vertical reference line 325 provide a convenient reference for locating the icon array 28 with respect to the x-y grid shown.
Preferably, the reference lines are at least 0.7 points (0.25 mm)thick and are printed using a non-drop-out ink, as indicated above. Any color having a minimum PCS of about 0.4 would be acceptable as a non-drop-out color. This would include black, dark blue, dark forest green, etc. Black is the most preferred color because it is the darkest and is standard within the check printing industry.
Referring again to FIGURE 24, once the subroutine 126' identifies and locates the reference lines in steps 503, 505, the relative x-y position of the icon array and corresponding icon positions can be calculated in accordance with predetermined preferred dimensions. The subroutine 126' then inputs the portion of the check image corresponding to the icon array 28' at step 507 and stores this in working memory. At step 509 the subroutine counts the number of contiguous supra-threshold ("black") pixels (#CPn) present in the resulting pixel image in a location corresponding to a particular icon position "n" . If the number of contiguous black pixels (#CPn) is less than a predetermined threshold number (T) , then the subroutine assumes that no mark is present in that particular icon area, as indicated at step 513. A threshold (T) of about two hundred contiguous pixels provides a convenient reference number for determining the existence of a mark. If no mark is detected, then the subroutine increments the icon position counter "n" at step 515 and the subroutine returns to step 509.
On the other hand, if the number of contiguous black pixels (#CPn) in a particular icon position "n" is greater than the threshold number (T) then the subroutine 126' assumes that a mark is present, as indicated by step 517. The subroutine then outputs the corresponding selected expenditure category at step 519, in this case groceries, and the subroutine continues on to the next step. This process continues until all icon positions "n" have been checked as indicated at step 514. Once all icon positions "n" have been checked for marks, the subroutine 126' terminates at step 515 and returns command control to the central processor 108.
FIGURE 15 is a more detailed flowchart diagram of the subroutine 121 shown in FIGURE 8. This subroutine updates a stored transaction record according to information received from other subroutines described above. The subroutine is initialized at step 330, as indicated. Step 332 inputs the MICR code obtained from the MICR decoder 104 shown in FIGURE 8. Step 334 inputs the verified amount of the check which is the output of the subroutine 120 indicated in FIGURE 8 and described in more detail in FIGURE 11. In this case, the indicated amount is $126.69. Step 336 inputs the pixel image of the payee box 16' previously outputted by the subroutine 122 shown in FIGURE 8 and described in more detail in FIGURE 12. Step 338 inputs the icon number (or numbers) for which marks have been detected by the mark detection subroutine 126 shown in FIGURE 8 and described in more detail in FIGURE 14. Optionally, step 344 inputs deposit, ATM, POS and other EFT transaction information from a bank 346 or EFT network. This latter information may be internal to the bank or, alternatively, it may be downloaded via modem to a separate processing center, as desired. Step 340 records inputted information in a cumulative transaction record according to account number, check transaction number, expenditure category, dollar amount and payee. Preferably this transaction record is stored in a computer data base or other storage media, as desired, such that it may be periodically accessed, further processed and incorporated into an expenditure statement 348, as shown. For maximum convenience, this statement 348 is preferably in the form of a more detailed bank account statement showing expenditures, deposits, balance, interest earned, ATM, POS and EFT transactions, etc. Alternatively, other types of reports or statements may be produced, as desired, to provide transaction information to a bank customer in a convenient form. After each transaction is recorded, the subroutine 121 terminates and passes command control back to the central processor 108.
In a particularly preferred embodiment, an expenditure tracking system and method in accordance with the present invention is further adapted to automatically track electronic transactions such as may occur through the use of an ATM or POS terminal. Preferably, bank customers are provided with an ATM card, credit card, or other wallet-sized card that is printed with a plurality of graphic icons corresponding to predetermined expenditure categories, substantially as described above. Superimposed over each icon is a Transaction Icon Number (TIN) which identifies each possible icon choice.
At an ATM or POS terminal, the customer enters the usual
Personal Identification Number (PIN) to obtain access to his funds electronically. The customer then further enters a TIN number corresponding to the particular ATM or POS transaction expenditure category applicable. This information may either be prompted for by the ATM or POS terminal or, alternatively, the TIN may simply be entered immediately following the initial PIN access code separated, for instance, by either the ιι*ιι or "#" key. Alternatively, icons may be displayed directly on an ATM or POS screen and may be selected by a bank customer by touching the screen or by depressing a corresponding button provided on the ATM or POS keypad, as desired.
Optionally, it is further envisioned that a "smart-card" type credit or ATM card may also be provided such as, for instance, a Schlumberger-type IC card. Such a card could comprise, for instance, a simple microprocessor, IC terminals, and magnetic strip and/or internal storage capabilities, as desired. A plurality of printed icons may be provided on the card, itself, disposed on a corresponding grid of pressure sensitive buttons. Icons may then be selected by depressing the pressure sensitive button corresponding to each icon. Prior to inserting the smart-card, for instance, the card user presses the icon which best classifies the nature of the particular electronic transaction. This information is then be transmitted via the IC terminals to the ATM or POS or other EFT terminal, as desired, for providing automated tracking of electronic expenditure transactions.
As noted above, preferably deposit and EFT transaction information is inputted electronically from the payor bank or EFT network to the expenditure tracking system, which is also preferably located within the payor bank. Alternatively, at least some portion of the expenditure tracking system may be located in an off-site processing center, such as in a check clearing house or other check processing center, as desired. For instance, in one alternatively preferred embodiment of the present invention checks are MICR read and scanned for marks in a check clearing house. For each check the clearing house detects which expenditure categories have been selected and records this information on a magnetic tape of check trans¬ actions of the type that is ordinarily provided to each payor bank serviced by the check clearing house. The payor bank then downloads this information into its own computer, as desired, and organizes it to produce an expenditure statement or more detailed bank statement in accordance with the present invention.
In another alternative preferred embodiment, an individual bank customer may request that his canceled checks be returned to a designated check processing center. The processing center MICR reads and scans each canceled check to generate a statement of expenditures broken out by account, expenditure category and amount, which is sent back to the bank customer. Advantageously, this enables a customer at virtually any bank to enjoy the benefits of the present invention as herein disclosed. Optionally, the bank customer may further designate that his bank statement be forwarded to the processing center so that the information therein can be combined with the expenditure information obtained from the canceled checks in order to generate a more detailed bank statement of the type described above.
In that event, the bank statement is used as a founda- tional document for generating the customer's more detailed statement. Advantageously, by relying on the bank statement and not the customer's own journal of transactions, the present invention offers a consistent and comprehensive journalization of transactions without requiring secondary data entry or electronic downloading of information from each individual banking institution handling those particular transactions. Also, this ensures that customers who fail to consistently mark their checks will still receive valuable financial records which capture ATM, POS and other recorded transactions. Advantageously, the tracking system in accordance with the present invention continues to provide detailed information on ATM and EFT transactions, as well as showing the amount of unclassified or miscellaneous funds expended, thereby subtly reminding the client to stay current with expenditure marking. '
Preferably, a customer's bank statement is recognized by using a variable vertical zone delimiting technology available from high-end OCR developers, such as Visionshape® of Orange, CA. A unique OCR template is created for each type of bank statement that may be encountered. The software is then "trained" to identify items such as horizontal lines and field description titles in order to extract the desired information. To process a particular customer's bank statement, the statement is first scanned into a computerized image processing system. The software first registers the column location for each particular field of information contained on the statement. Variable zones are then defined extending down from each corresponding field. The zones are variable in the sense that the software will continue to expect data to occur in the same horizontal field location until it confronts a different graphic configuration, such as a horizontal line in a zone defining text. The software will then expect that the zone is changing where a new type of data will be processed. This new zone will be identifiable, not only by the horizontal line and text, but an OCR reader will also encounter new headings and column configurations which also signifies the occurrence of a new or different type of data. The text within each zone is then OCR read and recorded. Key words in the POS and ATM description fields are similarly identified and recorded such that the transactions may be properly categorized and identified in a subsequently generated expenditure report. Other possible preferred embodiments will be readily apparent to those skilled in the art.
Although this invention has been disclosed in the context of certain preferred embodiments, it will be understood by those skilled in the art that the present invention extends beyond the specifically disclosed embodiments to other alternative embodiments of the invention. Thus, it is intended that the scope of the present invention herein disclosed should not be limited by the particular disclosed embodiments described above, but should be determined only by reference to the claims that follow.

Claims

WHAT IS CLAIMED IS;
1. A system for categorizing expenditure transactions, comprising: means for providing a predetermined number of graphic icons at the point of each said expenditure transaction, said icons being representative of a particular expenditure category which can be selected by an individual conducting said transaction to indicate that said expenditure is of a type corresponding to said selected expenditure category; and means for permanently recording information representative of each said selected expenditure category in association with other information representative of said corresponding expenditure transaction.
2. A system in accordance with Claim 1 wherein said graphic icons are provided on a printed bank check such that said graphic icons may be selected by placing a mark over the particular graphic icon corresponding to each said expenditure transaction.
3. A system in accordance with Claim 1 wherein said graphic icons are provided on a display screen associated with an ATM, POS or other EFT machine such that said graphic icons may be selected by touching said screen or by activating a corresponding numbered key provided on an associated keypad.
4. A system in accordance with Claim 1 wherein said graphic icons are provided on a keypad associated with an ATM, POS or other EFT machine such that said graphic icons may be selected by activating a corresponding key on said keypad.
5. A system in accordance with Claim 1 wherein said graphic icons are provided on a removable card for use in an
ATM, POS or other EFT machine whereby said graphic icons may be selected by activating a corresponding numbered key associated with said ATM, POS or other EFT machine.
6. A system in accordance with Claim 1 wherein said graphic icons are provided on a removable card for use in an
ATM, POS or other EFT machine whereby said graphic icons may be selected by activating a corresponding touch sensitive area provided on said removable card itself.
7. A bank check for use in an expenditure categorization system as recited in Claim 1, said bank check comprising: a substrate of generally rectangular shape and having front and back sides; a plurality of lines, spaces or boxes disposed on at least one side of said substrate defining the front of said bank check, said plurality of lines, spaces or boxes being of a sufficient size and shape to accommodate recording of customary check-transaction information; and a plurality of graphic icons disposed on at least one side of said bank check and arranged in a regular pattern, each said plurality of graphic icons comprising a pictorial or schematic representation corresponding to a predetermined expenditure category, each of said plurality of graphic icons further being configured to receive a mark thereon such that a selected expenditure category may be permanently recorded on said bank check substantially contemporaneously with a particular check transaction.
8. A printed bank check in accordance with Claim 7 wherein said substrate measures about 70 mm high by about 150 mm wide.
9. A printed bank check in accordance with Claim 7 wherein said substrate measures about 75 mm high by about 210 mm wide.
10. A printed bank check in accordance with Claims 7, 8 or 9 wherein said plurality of printed lines, spaces or boxes comprises at least one elongated rectangular box for recording the amount of said bank check, said at least one elongated rectangular box being configured to be scanned so that a pixel image may be generated thereof which may be verified against the amount contained in a MICR code disposed on said check.
11. A printed bank check in accordance with Claims 7, 8,
9 or 10 wherein said plurality of printed lines, spaces or boxes comprises at least a second elongated rectangular box for recording the name of the payee of said bank check and wherein said second elongated rectangular box is further adapted to be scanned so that a pixel image thereof may be generated and reproduced on an expenditure statement or other bank report.
12. A printed bank check in accordance with Claims 7, 8, 9, 10 or 11 wherein twenty-one graphic icons are disposed on the front side of said bank check in an array of three relatively uniform columns of seven icons each.
13. A printed bank check in accordance with Claim 12 wherein each of said plurality of graphic icons is of substantially uniform size and shape and is larger than about 5 mm wide by about 5 mm high.
14. A method for processing bank checks of the type recited in Claim 7, said method comprising the following steps: decoding a MICR code disposed on each said bank check to obtain basic transaction information contained in said MICR code, including at least the account number and the amount of said bank check; scanning said bank checks in succession to generate a series of binary data representative of a pixel image thereof; detecting in each of a plurality of predetermining areas on said check image the presence or absence of one or more marks indicative of a particular expenditure category selected by said bank customer; and recording information representative of said transaction information and said selected expenditure category in a cumulative transaction record; whereby an expenditure statement may be periodically generated from said transaction record for purposes of budgeting and financial planning of future expenditures.
15. A method for processing bank checks in accordance with Claim 14 wherein each of said bank checks is scanned using a bi-level scanner having a predetermined threshold detection level to produce a series of binary data representative of a bi-level pixel image of each said check.
16. A method for processing bank checks in accordance with Claim 14 wherein each of said bank checks is scanned using a grey-scale scanner to produce a series of binary data representative of a grey-scale pixel image of each said check which is subsequently converted to a bi-level pixel image by applying threshold imaging according to a desired threshold level.
17. A printed graphic icon for use in an expenditure categorization system as recited in Claim 1, said graphic icon comprising: a substrate; an outer icon portion printed on said substrate defining the outline of a particular desired icon design, the PCS of said outer portion being selected to be below a first defined threshold level; and an inner icon portion screened on said substrate within said outline defining detailing, shadowing and/or highlighting of said particular desired icon design, the PCS of said inner portion being selected to be below a second defined threshold level such that a mark made on said icon by an ink pen will produce a PCS that is above a third defined threshold level.
18. A printed graphic icon in accordance with Claim 17 wherein said icon is printed with a drop-out ink having a PCS of between about 0.05 and 0.25.
19. A printed graphic icon in accordance with Claim 17 or 18 wherein said outer icon portion has a PCS of less than about 0.25.
20. A printed graphic icon in accordance with Claims 17,
18 or 19 wherein said inner icon portion has a PCS of less than about 0.15.
21. A printed graphic icon in accordance with Claims 17,
18, 19 or 20 wherein said inner icon portion is screened onto said substrate with a screen density of between about 20% and
35%.
22. A printed graphic icon in accordance with Claims 17, 18, 19, 20 or 21 wherein said inner icon portion is screened onto said substrate with a screen angle of between about 30 and 60 degrees from horizontal.
23. A printed graphic icon in accordance with Claim 22 wherein said inner icon portion is screened onto said substrate with a screen angle of about 45 degrees from horizontal.
24. A printed graphic icon in accordance with Claims 17, 18, 19, 20, 21, 22 or 23 wherein said inner and outer icon portions are printed or screened on said substrate using a purple drop-out ink Pantone #251.
25. A printed graphic icon in accordance with Claims 17, 18, 19, 20, 21, 22, 23 or 24 further comprising a relatively dark outer frame disposed around said outer icon portion, said frame having a PCS that is substantially above said third defined threshold level.
26. A printed graphic icon in accordance with Claim 25 wherein said outer frame is black and is at least about 0.7 points (.25 mm) thick.
27. A printed graphic icon for use in an expenditure categorization system as recited in Claim 1, said graphic icon comprising: a substrate; a relatively dark outer icon portion disposed on said substrate defining the outline of a particular desired icon design; a relatively light inner icon portion disposed on said substrate, said inner icon portion comprising detailing, shadowing and/or highlighting of said particular desired icon design, said detailing, shadowing and/or highlighting comprising no more than about 25% of the total area of said inner icon portion; whereby a mark made on said icon by an ink pen will produce a PCS that is above a defined threshold level.
28. A printed graphic icon in accordance with Claim 27 wherein said detailing, shadowing and/or highlighting comprises no more than about 10% of the total area of said inner icon portion
PCT/US1995/010386 1994-07-27 1995-07-27 Expenditure categorization and tracking system WO1996003719A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
AU34062/95A AU693597B2 (en) 1994-07-27 1995-07-27 Expenditure categorization and tracking system

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US08/281,441 US5740271A (en) 1994-07-27 1994-07-27 Expenditure monitoring system
US08/281,441 1994-07-27
US08/479,912 1995-06-07
US08/479,912 US5737440A (en) 1994-07-27 1995-06-07 Method of detecting a mark on a oraphic icon

Publications (1)

Publication Number Publication Date
WO1996003719A1 true WO1996003719A1 (en) 1996-02-08

Family

ID=26960891

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US1995/010386 WO1996003719A1 (en) 1994-07-27 1995-07-27 Expenditure categorization and tracking system

Country Status (4)

Country Link
US (3) US5737440A (en)
AU (1) AU693597B2 (en)
CA (1) CA2195954A1 (en)
WO (1) WO1996003719A1 (en)

Cited By (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1903513A1 (en) * 1997-03-11 2008-03-26 Cummins-Allison Corporation Automated document processing system using full image scanning
US7680739B1 (en) 2008-11-07 2010-03-16 U.S. Bank, National Association Check processing and categorizing system
US8041098B2 (en) 2001-09-27 2011-10-18 Cummins-Allison Corp. Document processing system using full image scanning
US8126793B2 (en) 2001-07-05 2012-02-28 Cummins-Allison Corp. Automated payment system and method
US8162125B1 (en) 1996-05-29 2012-04-24 Cummins-Allison Corp. Apparatus and system for imaging currency bills and financial documents and method for using the same
US8169602B2 (en) 1996-11-27 2012-05-01 Cummins-Allison Corp. Automated document processing system and method
US8204293B2 (en) 2007-03-09 2012-06-19 Cummins-Allison Corp. Document imaging and processing system
US8391583B1 (en) 2009-04-15 2013-03-05 Cummins-Allison Corp. Apparatus and system for imaging currency bills and financial documents and method for using the same
US8417017B1 (en) 2007-03-09 2013-04-09 Cummins-Allison Corp. Apparatus and system for imaging currency bills and financial documents and method for using the same
US8428332B1 (en) 2001-09-27 2013-04-23 Cummins-Allison Corp. Apparatus and system for imaging currency bills and financial documents and method for using the same
US8433123B1 (en) 2001-09-27 2013-04-30 Cummins-Allison Corp. Apparatus and system for imaging currency bills and financial documents and method for using the same
US8437532B1 (en) 2009-04-15 2013-05-07 Cummins-Allison Corp. Apparatus and system for imaging currency bills and financial documents and method for using the same
US8437530B1 (en) 2001-09-27 2013-05-07 Cummins-Allison Corp. Apparatus and system for imaging currency bills and financial documents and method for using the same
US8437529B1 (en) 2001-09-27 2013-05-07 Cummins-Allison Corp. Apparatus and system for imaging currency bills and financial documents and method for using the same
US8459436B2 (en) 2008-10-29 2013-06-11 Cummins-Allison Corp. System and method for processing currency bills and tickets
US8478020B1 (en) 1996-11-27 2013-07-02 Cummins-Allison Corp. Apparatus and system for imaging currency bills and financial documents and method for using the same
US8538123B1 (en) 2007-03-09 2013-09-17 Cummins-Allison Corp. Apparatus and system for imaging currency bills and financial documents and method for using the same
US8627939B1 (en) 2002-09-25 2014-01-14 Cummins-Allison Corp. Apparatus and system for imaging currency bills and financial documents and method for using the same
US8929640B1 (en) 2009-04-15 2015-01-06 Cummins-Allison Corp. Apparatus and system for imaging currency bills and financial documents and method for using the same
US8944234B1 (en) 2001-09-27 2015-02-03 Cummins-Allison Corp. Apparatus and system for imaging currency bills and financial documents and method for using the same
US9141876B1 (en) 2013-02-22 2015-09-22 Cummins-Allison Corp. Apparatus and system for processing currency bills and financial documents and method for using the same

Families Citing this family (137)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5737440A (en) * 1994-07-27 1998-04-07 Kunkler; Todd M. Method of detecting a mark on a oraphic icon
US6195453B1 (en) * 1995-01-17 2001-02-27 Jerome Simonoff Method for laser printing MICR encoded negotiable instruments from graphic images
US7096003B2 (en) * 1996-08-08 2006-08-22 Raymond Anthony Joao Transaction security apparatus
US6607081B2 (en) * 1996-11-15 2003-08-19 Diebold, Incorporated Automated transaction machine system
US20030217005A1 (en) * 1996-11-27 2003-11-20 Diebold Self Service Systems, Division Of Diebold, Incorporated Automated banking machine system and method
US5973692A (en) * 1997-03-10 1999-10-26 Knowlton; Kenneth Charles System for the capture and indexing of graphical representations of files, information sources and the like
US6085977A (en) * 1997-10-06 2000-07-11 Axiohm Tranaction Solutions, Inc. Check processing procedure
JP3422924B2 (en) * 1998-03-27 2003-07-07 富士通株式会社 CHARACTER RECOGNITION DEVICE, CHARACTER RECOGNITION METHOD, AND COMPUTER-READABLE RECORDING MEDIUM RECORDING PROGRAM FOR CAUSING COMPUTER TO EXECUTE THE METHOD
USD425934S (en) * 1998-05-14 2000-05-30 Kunkler Todd M Bank check
US6298334B1 (en) * 1998-10-15 2001-10-02 Netdecide Corporation Object-based numeric-analysis engine
US6504946B1 (en) * 1998-10-26 2003-01-07 Ncr Corporation Method of processing misoriented items in an image-based item processing system and an apparatus therefor
US7596606B2 (en) * 1999-03-11 2009-09-29 Codignotto John D Message publishing system for publishing messages from identified, authorized senders
AU4038300A (en) * 1999-03-31 2000-10-16 Walker Digital, Llc Method and system for providing transactional overdraft protection
US7664705B2 (en) * 1999-03-31 2010-02-16 Walker Digital, Llc Methods and systems for accepting offers via checks
GB2363874B (en) * 1999-11-06 2004-08-04 Dennis Sunga Fernandez Bioinformatic transaction scheme
JP4032204B2 (en) 1999-12-10 2008-01-16 セイコーエプソン株式会社 Magnetic pattern recognition device, recognition method, and information recording medium
US7050997B1 (en) * 2000-02-11 2006-05-23 Wood Jr John F Personal financial management system, method and program using a graphical object-oriented programming methodology
US20020051562A1 (en) * 2000-04-11 2002-05-02 Sheppard Clinton E. Scanning method and apparatus for optical character reading and information processing
US7003490B1 (en) 2000-07-19 2006-02-21 Ge Capital Commercial Finance, Inc. Multivariate responses using classification and regression trees systems and methods
US7478062B2 (en) * 2001-03-19 2009-01-13 Alcatel-Lucent Usa Inc. Financial management system and method
DE10132589B4 (en) * 2001-07-05 2005-11-03 Koenig & Bauer Ag Method for qualitative assessment of material
US20030061132A1 (en) * 2001-09-26 2003-03-27 Yu, Mason K. System and method for categorizing, aggregating and analyzing payment transactions data
US7020320B2 (en) * 2002-03-06 2006-03-28 Parascript, Llc Extracting text written on a check
JP3898075B2 (en) * 2002-03-18 2007-03-28 株式会社リコー Image processing apparatus, image processing method, and recording medium
US20040010466A1 (en) * 2002-07-11 2004-01-15 Anderson David F. Financial instrument system providing multiple transaction information reporting and storing options and fraud and warranty protection
US8930270B2 (en) 2002-07-30 2015-01-06 Aol Inc. Smart payment instrument selection
US20040167835A1 (en) * 2003-02-24 2004-08-26 Jyh-Ching Yaur Record keeping system supporting tax determination
US20050091292A1 (en) * 2003-10-22 2005-04-28 Jui-Sheng Pai Classificatory accounting calculator structure
US20050097046A1 (en) 2003-10-30 2005-05-05 Singfield Joy S. Wireless electronic check deposit scanning and cashing machine with web-based online account cash management computer application system
US7500598B2 (en) * 2003-11-25 2009-03-10 American Express Travel Related Services Company, Inc. Negotiable instruments and systems and processing same
US20050128510A1 (en) * 2003-12-16 2005-06-16 Campbell Michael C. Method for selecting images for action by an imaging apparatus
US20060005221A1 (en) * 2004-07-02 2006-01-05 Sony Corporation And Sony Electronics, Inc. Navigation aids for television user interface
JP2006053735A (en) * 2004-08-11 2006-02-23 Seiko Epson Corp Network equipment, program used therefor, and control method thereof
US20060196930A1 (en) * 2005-03-04 2006-09-07 Hart Matt E Categorization of financial transactions
US20060224558A1 (en) * 2005-03-24 2006-10-05 Flora John R Associating multiple categories with single payee or payor in financial software application
US20060218087A1 (en) * 2005-03-24 2006-09-28 Zimmerman Jeffrey P Automated aggregation and comparison of individual spending relative to population of similar users
US20060218088A1 (en) * 2005-03-24 2006-09-28 Flora John R Intelligent auto-fill transaction data
US20060218086A1 (en) * 2005-03-24 2006-09-28 Heather Campbell Payee aliasing
US9235841B2 (en) 2005-07-22 2016-01-12 Gtj Ventures, Llc Transaction security apparatus and method
US9245270B2 (en) 2005-07-22 2016-01-26 Gtj Ventures, Llc Transaction security apparatus and method
US9911124B2 (en) 2005-07-22 2018-03-06 Gtj Ventures, Llc Transaction security apparatus and method
US7653233B2 (en) * 2005-09-12 2010-01-26 Pitney Bowes Inc. Confirming cancellation of truncated checks
JP4674513B2 (en) * 2005-09-14 2011-04-20 富士ゼロックス株式会社 Spatial layout reproduction method, reader, and program
JP4860388B2 (en) * 2005-09-27 2012-01-25 株式会社リコー Image processing apparatus, image processing method, and computer-readable recording medium storing program for executing the method
US8490863B1 (en) * 2005-10-17 2013-07-23 Dollar Bank, Federal Savings Bank Secure financial report and method of processing and displaying the same
US20070208587A1 (en) * 2005-12-08 2007-09-06 Arun Sitaraman Systems, software, and methods for communication-based business process messaging
KR100800998B1 (en) * 2005-12-24 2008-02-11 삼성전자주식회사 Apparatus and method for home network device controlling
US8177121B2 (en) * 2006-01-13 2012-05-15 Intuit Inc. Automated aggregation and comparison of business spending relative to similar businesses
JP4807618B2 (en) * 2006-03-06 2011-11-02 富士ゼロックス株式会社 Image processing apparatus and image processing program
US8185453B1 (en) 2006-03-21 2012-05-22 Intuit Inc. Contextual access to workflow functionality
US7656404B1 (en) 2006-03-21 2010-02-02 Intuit Inc. Line trimming and arrow head placement algorithm
US7606750B1 (en) * 2006-03-30 2009-10-20 Intuit Inc. Method and system for displaying a spending comparison report
US20080021831A1 (en) * 2006-07-19 2008-01-24 Andrew Blaikie Methods of processing a check in a payee positive pay system
US8606013B2 (en) * 2006-08-31 2013-12-10 Glory Ltd. Paper sheet identification device and paper sheet identification method
US8126252B2 (en) * 2006-10-26 2012-02-28 Bank Of America Corporation Method and system for enhanced check image privacy
US7876949B1 (en) 2006-10-31 2011-01-25 United Services Automobile Association Systems and methods for remote deposit of checks
US7873200B1 (en) 2006-10-31 2011-01-18 United Services Automobile Association (Usaa) Systems and methods for remote deposit of checks
US8351677B1 (en) 2006-10-31 2013-01-08 United Services Automobile Association (Usaa) Systems and methods for remote deposit of checks
US7885451B1 (en) 2006-10-31 2011-02-08 United Services Automobile Association (Usaa) Systems and methods for displaying negotiable instruments derived from various sources
US8799147B1 (en) 2006-10-31 2014-08-05 United Services Automobile Association (Usaa) Systems and methods for remote deposit of negotiable instruments with non-payee institutions
US8708227B1 (en) 2006-10-31 2014-04-29 United Services Automobile Association (Usaa) Systems and methods for remote deposit of checks
US20090018860A1 (en) * 2007-01-08 2009-01-15 Joel Edward Sikes Method and computer program for back office check conversion
US8023717B1 (en) * 2007-01-16 2011-09-20 Burroughs Payment Systems, Inc. Method and system for processing backwards documents in a document reader/imager
US8023718B1 (en) * 2007-01-16 2011-09-20 Burroughs Payment Systems, Inc. Method and system for linking front and rear images in a document reader/imager
US10380559B1 (en) 2007-03-15 2019-08-13 United Services Automobile Association (Usaa) Systems and methods for check representment prevention
US8959033B1 (en) 2007-03-15 2015-02-17 United Services Automobile Association (Usaa) Systems and methods for verification of remotely deposited checks
US20080262883A1 (en) * 2007-04-19 2008-10-23 Weiss Stephen J Systems and methods for compliance and announcement display and notification
US8538124B1 (en) 2007-05-10 2013-09-17 United Services Auto Association (USAA) Systems and methods for real-time validation of check image quality
US8433127B1 (en) 2007-05-10 2013-04-30 United Services Automobile Association (Usaa) Systems and methods for real-time validation of check image quality
US20090041330A1 (en) * 2007-08-07 2009-02-12 Journey Jeffrey E Enhanced check image darkness measurements
US9058512B1 (en) 2007-09-28 2015-06-16 United Services Automobile Association (Usaa) Systems and methods for digital signature detection
US9892454B1 (en) 2007-10-23 2018-02-13 United Services Automobile Association (Usaa) Systems and methods for obtaining an image of a check to be deposited
US9898778B1 (en) 2007-10-23 2018-02-20 United Services Automobile Association (Usaa) Systems and methods for obtaining an image of a check to be deposited
US9159101B1 (en) 2007-10-23 2015-10-13 United Services Automobile Association (Usaa) Image processing
US8358826B1 (en) 2007-10-23 2013-01-22 United Services Automobile Association (Usaa) Systems and methods for receiving and orienting an image of one or more checks
US8046301B1 (en) 2007-10-30 2011-10-25 United Services Automobile Association (Usaa) Systems and methods to modify a negotiable instrument
US7996314B1 (en) 2007-10-30 2011-08-09 United Services Automobile Association (Usaa) Systems and methods to modify a negotiable instrument
US7996316B1 (en) 2007-10-30 2011-08-09 United Services Automobile Association Systems and methods to modify a negotiable instrument
US8001051B1 (en) 2007-10-30 2011-08-16 United Services Automobile Association (Usaa) Systems and methods to modify a negotiable instrument
US7996315B1 (en) 2007-10-30 2011-08-09 United Services Automobile Association (Usaa) Systems and methods to modify a negotiable instrument
US8320657B1 (en) 2007-10-31 2012-11-27 United Services Automobile Association (Usaa) Systems and methods to use a digital camera to remotely deposit a negotiable instrument
US8290237B1 (en) 2007-10-31 2012-10-16 United Services Automobile Association (Usaa) Systems and methods to use a digital camera to remotely deposit a negotiable instrument
US7896232B1 (en) 2007-11-06 2011-03-01 United Services Automobile Association (Usaa) Systems, methods, and apparatus for receiving images of one or more checks
US7900822B1 (en) 2007-11-06 2011-03-08 United Services Automobile Association (Usaa) Systems, methods, and apparatus for receiving images of one or more checks
KR100829107B1 (en) * 2008-01-24 2008-05-16 변규일 O m r card for a cheat action prevention
US10380562B1 (en) 2008-02-07 2019-08-13 United Services Automobile Association (Usaa) Systems and methods for mobile deposit of negotiable instruments
US8351678B1 (en) 2008-06-11 2013-01-08 United Services Automobile Association (Usaa) Duplicate check detection
US8422758B1 (en) 2008-09-02 2013-04-16 United Services Automobile Association (Usaa) Systems and methods of check re-presentment deterrent
US10504185B1 (en) 2008-09-08 2019-12-10 United Services Automobile Association (Usaa) Systems and methods for live video financial deposit
US7974899B1 (en) 2008-09-30 2011-07-05 United Services Automobile Association (Usaa) Atomic deposit transaction
US7962411B1 (en) 2008-09-30 2011-06-14 United Services Automobile Association (Usaa) Atomic deposit transaction
US7885880B1 (en) 2008-09-30 2011-02-08 United Services Automobile Association (Usaa) Atomic deposit transaction
US8275710B1 (en) 2008-09-30 2012-09-25 United Services Automobile Association (Usaa) Systems and methods for automatic bill pay enrollment
US8391599B1 (en) 2008-10-17 2013-03-05 United Services Automobile Association (Usaa) Systems and methods for adaptive binarization of an image
US7949587B1 (en) 2008-10-24 2011-05-24 United States Automobile Association (USAA) Systems and methods for financial deposits by electronic message
US7970677B1 (en) 2008-10-24 2011-06-28 United Services Automobile Association (Usaa) Systems and methods for financial deposits by electronic message
US8229203B2 (en) * 2008-10-29 2012-07-24 Rdm Corporation Dynamic print contrast signal determination for paper documents
US8452689B1 (en) 2009-02-18 2013-05-28 United Services Automobile Association (Usaa) Systems and methods of check detection
US8406500B2 (en) * 2009-03-03 2013-03-26 Seiko Epson Corporation Simultaneously scanning multiple checks
US10956728B1 (en) 2009-03-04 2021-03-23 United Services Automobile Association (Usaa) Systems and methods of check processing with background removal
US8542921B1 (en) 2009-07-27 2013-09-24 United Services Automobile Association (Usaa) Systems and methods for remote deposit of negotiable instrument using brightness correction
US9779392B1 (en) 2009-08-19 2017-10-03 United Services Automobile Association (Usaa) Apparatuses, methods and systems for a publishing and subscribing platform of depositing negotiable instruments
US8977571B1 (en) 2009-08-21 2015-03-10 United Services Automobile Association (Usaa) Systems and methods for image monitoring of check during mobile deposit
US8699779B1 (en) 2009-08-28 2014-04-15 United Services Automobile Association (Usaa) Systems and methods for alignment of check during mobile deposit
US20110182471A1 (en) * 2009-11-30 2011-07-28 Abisee, Inc. Handling information flow in printed text processing
US9129340B1 (en) 2010-06-08 2015-09-08 United Services Automobile Association (Usaa) Apparatuses, methods and systems for remote deposit capture with enhanced image detection
US20110320294A1 (en) * 2010-06-23 2011-12-29 Bank Of America Corporation Active budget control
USD658679S1 (en) * 2010-08-31 2012-05-01 Apple Inc. Graphical user interface for a display screen or portion thereof
JP2012085186A (en) * 2010-10-13 2012-04-26 Sony Corp Editing device, method, and program
US8661038B1 (en) 2011-05-31 2014-02-25 Intuit Inc. Method and system for utilizing location data for automatic categorization of financial transactions
US8924393B1 (en) 2011-07-28 2014-12-30 Intuit Inc. Method and system for improving automatic categorization of financial transactions
US20140195382A1 (en) * 2011-07-29 2014-07-10 Nec Corporation Collation/retrieval system, collation/retrieval server, image feature extraction apparatus, collation/retrieval method, and program
US8996417B1 (en) 2011-10-13 2015-03-31 Intuit Inc. Method and system for automatically obtaining and categorizing cash transaction data using a mobile computing system
US10380565B1 (en) 2012-01-05 2019-08-13 United Services Automobile Association (Usaa) System and method for storefront bank deposits
US8660984B1 (en) 2012-01-13 2014-02-25 Intuit Inc. Method and system for automatic categorization of check-based financial transactions
US8964239B2 (en) * 2012-01-27 2015-02-24 Xerox Corporation Methods and systems for handling multiple documents while scanning
US20130202185A1 (en) * 2012-02-08 2013-08-08 Scientific Games International, Inc. Method for optically decoding a debit or credit card
US8915780B2 (en) 2012-02-08 2014-12-23 Scientific Games International, Inc. Logistics methods for processing lottery and contest tickets with generic hardware
US8855377B1 (en) 2012-03-09 2014-10-07 Intuit Inc. Method and system for semi-automated setup of accounts within a data management system
US8798354B1 (en) * 2012-04-25 2014-08-05 Intuit Inc. Method and system for automatic correlation of check-based payments to customer accounts and/or invoices
US20140052591A1 (en) * 2012-08-20 2014-02-20 Sap Ag Joining Of Logistical And Financial Data Related to Procurement Spending
US8688573B1 (en) 2012-10-16 2014-04-01 Intuit Inc. Method and system for identifying a merchant payee associated with a cash transaction
US9767503B2 (en) 2012-11-30 2017-09-19 Bank Of America Corporation Payment authorization prompting categorization
US10552810B1 (en) 2012-12-19 2020-02-04 United Services Automobile Association (Usaa) System and method for remote deposit of financial instruments
USD740852S1 (en) * 2013-02-06 2015-10-13 Samsung Electronics Co., Ltd. Display screen with graphic user interface
CA2823575C (en) 2013-03-15 2016-03-15 Election Systems & Software, Llc System and method for decoding marks on a response sheet
USD745888S1 (en) * 2013-09-03 2015-12-22 Samsung Electronics Co., Ltd. Display screen or portion thereof with icon
US11138578B1 (en) 2013-09-09 2021-10-05 United Services Automobile Association (Usaa) Systems and methods for remote deposit of currency
US9286514B1 (en) 2013-10-17 2016-03-15 United Services Automobile Association (Usaa) Character count determination for a digital image
US9666023B2 (en) 2014-07-18 2017-05-30 Scientific Games International, Inc. Logistics methods for processing lottery and contest tickets with generic hardware
CA2956252C (en) 2014-07-29 2020-12-29 Scientific Games Holdings Limited Method and system for providing alternative usages of closed lottery networks and systems
US10402790B1 (en) 2015-05-28 2019-09-03 United Services Automobile Association (Usaa) Composing a focused document image from multiple image captures or portions of multiple image captures
USD797146S1 (en) * 2016-06-03 2017-09-12 Samsung Electronics Co., Ltd. Display screen or portion thereof with icon
US11030752B1 (en) 2018-04-27 2021-06-08 United Services Automobile Association (Usaa) System, computing device, and method for document detection
USD905723S1 (en) * 2019-05-01 2020-12-22 Volvo Car Corporation Display screen with animated vehicle selection graphical user interface
CN111091090A (en) * 2019-12-11 2020-05-01 上海眼控科技股份有限公司 Bank report OCR recognition method, device, platform and terminal
US11900755B1 (en) 2020-11-30 2024-02-13 United Services Automobile Association (Usaa) System, computing device, and method for document detection and deposit processing

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE2508591C2 (en) * 1974-03-06 1987-08-27 Recognition Equipment Inc., Dallas, Tex., Us
DE3709399A1 (en) * 1986-03-24 1987-10-01 Sharp Kk ELECTRONIC BILLING STORAGE DEVICE
EP0527639A2 (en) * 1991-08-14 1993-02-17 U.S. Order, Inc. Home financial transaction system

Family Cites Families (56)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB527639A (en) * 1939-04-11 1940-10-14 Auto Klean Strainers Ltd Improvements relating to straining or filtering apparatus for liquids
US3363917A (en) * 1966-07-20 1968-01-16 Stikum Inc Means for providing a document, such as a check or the like, with a surface for encoding magnetic characters or indicia
US3980323A (en) * 1972-10-11 1976-09-14 Exchange National Bank Of Chicago Method of recording and identifying intelligence on bank checks by category and of indexing cancelled bank checks by category for subsequent use
US4027142A (en) * 1974-03-06 1977-05-31 Recognition Equipment Incorporated Automated processing of financial documents
US3949363A (en) * 1974-06-28 1976-04-06 Recognition Equipment, Incorporated Bar-Code/MICR/OCR merge
US3998556A (en) * 1975-06-23 1976-12-21 Potlatch Corporation Color contrast gauge
US4308588A (en) * 1978-06-05 1981-12-29 Siwula John T Electronic checkbook
US4346917A (en) * 1978-09-25 1982-08-31 Clancy Bruce N Checkbook accounting system
US4441160A (en) * 1978-11-06 1984-04-03 Auto-Register, Inc. Point of sale terminal having prompting display
DE2852989C3 (en) * 1978-12-07 1981-07-02 Sebastian Bauer Kg, 8201 Raubling Pocket-sized check marking device
JPS6028182B2 (en) * 1979-10-06 1985-07-03 ミノルタ株式会社 Image reading device
DE3038179C2 (en) * 1980-10-09 1982-07-29 GAO Gesellschaft für Automation und Organisation mbH, 8000 München Recording medium with an image motif superimposed by a line pattern and method for its production
US4400017A (en) * 1981-03-04 1983-08-23 Pendergrass Russell G Integrated budget and check record book
US4634148A (en) * 1981-06-24 1987-01-06 Greene Edwin B Negotiable instrument
US4523330A (en) * 1982-12-23 1985-06-11 Ncr Canada Ltd - Ncr Canada Ltee Banking system and method
US4588211A (en) * 1983-11-17 1986-05-13 Greene Edwin B Machine readable document
US4623965A (en) * 1984-02-27 1986-11-18 Wing Donald K Electronic checkbook
USD279907S (en) 1984-09-06 1985-07-30 American Standard Inc. Combined checks and check stubs
US4648317A (en) * 1985-05-07 1987-03-10 American Screen Printing Equipment Co. Manually operated screen printing apparatus
US4667985A (en) * 1986-02-28 1987-05-26 Ncr Corporation Bank check form
IL78437A0 (en) * 1986-04-08 1986-08-31 Tiferet Fashion Accessories 85 Promissory note
US5093787A (en) * 1986-06-12 1992-03-03 Simmons John C Electronic checkbook with automatic reconciliation
US5193055A (en) * 1987-03-03 1993-03-09 Brown Gordon T Accounting system
US4877948A (en) * 1987-06-25 1989-10-31 Krueger Loren L Combination bar code and mark-sense reader
JPH0737892B2 (en) * 1988-01-12 1995-04-26 大日本スクリーン製造株式会社 Pattern defect inspection method
US4910696A (en) * 1988-01-27 1990-03-20 Grossman Kurt W Computerized personal portable account register
US4974878A (en) * 1988-04-20 1990-12-04 Remittance Technology Corporation Financial data processing system using payment coupons
US5121945A (en) * 1988-04-20 1992-06-16 Remittance Technology Corporation Financial data processing system
US4958066A (en) * 1988-08-19 1990-09-18 Secured Transactions Financial instrument verification and method of production
US4906026A (en) * 1989-02-16 1990-03-06 Image/Chek Corporation Subliminal checkbook system
US5016919A (en) * 1989-03-10 1991-05-21 Frank Rotondo Check and magnetic strip arrangement
US5039847A (en) * 1989-03-24 1991-08-13 Omron Corporation Image processing apparatus having an image scanner
US5237620A (en) * 1989-05-01 1993-08-17 Credit Verification Corporation Check reader method and system for reading check MICR code
US5091961A (en) * 1989-07-14 1992-02-25 American Magnetics Corp. Magnetic ink character decoder
US5140139A (en) * 1989-11-13 1992-08-18 Cognitronics Corporation Preparing mark/read documents with markable boxes and locating the boxes from the document scan data
US5258935A (en) * 1990-03-30 1993-11-02 Ure Michael J Self-inputting checkbook accounting device
US5060980A (en) * 1990-05-30 1991-10-29 Xerox Corporation Form utilizing encoded indications for form field processing
US5144448A (en) * 1990-07-31 1992-09-01 Vidar Systems Corporation Scanning apparatus using multiple CCD arrays and related method
US5044668A (en) * 1990-08-31 1991-09-03 Wright Lyle E Check checker system
US5187351A (en) * 1990-09-10 1993-02-16 Addmaster Corporation Processing of bank documents
US5221838A (en) * 1990-12-24 1993-06-22 Motorola, Inc. Electronic wallet
JP3311362B2 (en) * 1991-04-10 2002-08-05 株式会社日本コンラックス Information recording / reproducing device
US5187044A (en) * 1991-05-14 1993-02-16 Minnesota Mining And Manufacturing Company Flexographic printing plate
US5202828A (en) * 1991-05-15 1993-04-13 Apple Computer, Inc. User interface system having programmable user interface elements
US5233547A (en) * 1991-11-12 1993-08-03 Ncr Corporation Electronic checking account apparatus and method having a digitizer to receive information as a check is being written
US5229589A (en) * 1991-11-21 1993-07-20 Optimum Solutions Corp., Inc. Questionnaire scanning system employing expandable answer mark areas for efficient scanning and mark detection
US5334821A (en) * 1992-07-16 1994-08-02 Telxon Corporation Portable point of sale terminal
US5341290A (en) * 1992-09-15 1994-08-23 James Lu Modular system for printing and processing financial documents
US5433483A (en) * 1993-11-01 1995-07-18 Yu; Mason K. Consumer-initiated, automatic classified expenditure bank check system
USD365598S (en) 1994-03-25 1995-12-26 Kunkler Todd M Bank check
US5740271A (en) * 1994-07-27 1998-04-14 On-Track Management System Expenditure monitoring system
US5737440A (en) * 1994-07-27 1998-04-07 Kunkler; Todd M. Method of detecting a mark on a oraphic icon
USD384099S (en) 1995-11-01 1997-09-23 Ontrack Management Systems, Inc. Check book
USD386784S (en) 1995-12-21 1997-11-25 Kunkler Todd M Bank check
USD396487S (en) 1997-07-15 1998-07-28 Kunkler Todd M Bank check
USD396488S (en) 1997-07-15 1998-07-28 Kunkler Todd M Bank check

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE2508591C2 (en) * 1974-03-06 1987-08-27 Recognition Equipment Inc., Dallas, Tex., Us
DE3709399A1 (en) * 1986-03-24 1987-10-01 Sharp Kk ELECTRONIC BILLING STORAGE DEVICE
EP0527639A2 (en) * 1991-08-14 1993-02-17 U.S. Order, Inc. Home financial transaction system

Cited By (60)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8162125B1 (en) 1996-05-29 2012-04-24 Cummins-Allison Corp. Apparatus and system for imaging currency bills and financial documents and method for using the same
US8714336B2 (en) 1996-05-29 2014-05-06 Cummins-Allison Corp. Apparatus and system for imaging currency bills and financial documents and method for using the same
US8442296B2 (en) 1996-11-27 2013-05-14 Cummins-Allison Corp. Check and U.S. bank note processing device and method
US8339589B2 (en) 1996-11-27 2012-12-25 Cummins-Allison Corp. Check and U.S. bank note processing device and method
US8478020B1 (en) 1996-11-27 2013-07-02 Cummins-Allison Corp. Apparatus and system for imaging currency bills and financial documents and method for using the same
US8437531B2 (en) 1996-11-27 2013-05-07 Cummins-Allison Corp. Check and U.S. bank note processing device and method
US9390574B2 (en) 1996-11-27 2016-07-12 Cummins-Allison Corp. Document processing system
US8169602B2 (en) 1996-11-27 2012-05-01 Cummins-Allison Corp. Automated document processing system and method
US8380573B2 (en) 1996-11-27 2013-02-19 Cummins-Allison Corp. Document processing system
EP1903513A1 (en) * 1997-03-11 2008-03-26 Cummins-Allison Corporation Automated document processing system using full image scanning
US8701857B2 (en) 2000-02-11 2014-04-22 Cummins-Allison Corp. System and method for processing currency bills and tickets
US9495808B2 (en) 2000-02-11 2016-11-15 Cummins-Allison Corp. System and method for processing casino tickets
US9129271B2 (en) 2000-02-11 2015-09-08 Cummins-Allison Corp. System and method for processing casino tickets
US8126793B2 (en) 2001-07-05 2012-02-28 Cummins-Allison Corp. Automated payment system and method
US8944234B1 (en) 2001-09-27 2015-02-03 Cummins-Allison Corp. Apparatus and system for imaging currency bills and financial documents and method for using the same
US8041098B2 (en) 2001-09-27 2011-10-18 Cummins-Allison Corp. Document processing system using full image scanning
US8437529B1 (en) 2001-09-27 2013-05-07 Cummins-Allison Corp. Apparatus and system for imaging currency bills and financial documents and method for using the same
US8428332B1 (en) 2001-09-27 2013-04-23 Cummins-Allison Corp. Apparatus and system for imaging currency bills and financial documents and method for using the same
US8396278B2 (en) 2001-09-27 2013-03-12 Cummins-Allison Corp. Document processing system using full image scanning
US8437530B1 (en) 2001-09-27 2013-05-07 Cummins-Allison Corp. Apparatus and system for imaging currency bills and financial documents and method for using the same
US8639015B1 (en) 2001-09-27 2014-01-28 Cummins-Allison Corp. Apparatus and system for imaging currency bills and financial documents and method for using the same
US8644585B1 (en) 2001-09-27 2014-02-04 Cummins-Allison Corp. Apparatus and system for imaging currency bills and financial documents and method for using the same
US9142075B1 (en) 2001-09-27 2015-09-22 Cummins-Allison Corp. Apparatus and system for imaging currency bills and financial documents and method for using the same
US8655046B1 (en) 2001-09-27 2014-02-18 Cummins-Allison Corp. Apparatus and system for imaging currency bills and financial documents and method for using the same
US8103084B2 (en) 2001-09-27 2012-01-24 Cummins-Allison Corp. Document processing system using full image scanning
US8655045B2 (en) 2001-09-27 2014-02-18 Cummins-Allison Corp. System and method for processing a deposit transaction
US8644584B1 (en) 2001-09-27 2014-02-04 Cummins-Allison Corp. Apparatus and system for imaging currency bills and financial documents and method for using the same
US8433123B1 (en) 2001-09-27 2013-04-30 Cummins-Allison Corp. Apparatus and system for imaging currency bills and financial documents and method for using the same
US9355295B1 (en) 2002-09-25 2016-05-31 Cummins-Allison Corp. Apparatus and system for imaging currency bills and financial documents and method for using the same
US8627939B1 (en) 2002-09-25 2014-01-14 Cummins-Allison Corp. Apparatus and system for imaging currency bills and financial documents and method for using the same
US8625875B2 (en) 2007-03-09 2014-01-07 Cummins-Allison Corp. Document imaging and processing system for performing blind balancing and display conditions
US8538123B1 (en) 2007-03-09 2013-09-17 Cummins-Allison Corp. Apparatus and system for imaging currency bills and financial documents and method for using the same
US8204293B2 (en) 2007-03-09 2012-06-19 Cummins-Allison Corp. Document imaging and processing system
US8417017B1 (en) 2007-03-09 2013-04-09 Cummins-Allison Corp. Apparatus and system for imaging currency bills and financial documents and method for using the same
US8542904B1 (en) 2007-03-09 2013-09-24 Cummins-Allison Corp. Apparatus and system for imaging currency bills and financial documents and method for using the same
US8459436B2 (en) 2008-10-29 2013-06-11 Cummins-Allison Corp. System and method for processing currency bills and tickets
US7856403B2 (en) 2008-11-07 2010-12-21 U.S. Bank, National Association Check processing and categorizing system
US7680739B1 (en) 2008-11-07 2010-03-16 U.S. Bank, National Association Check processing and categorizing system
US9189780B1 (en) 2009-04-15 2015-11-17 Cummins-Allison Corp. Apparatus and system for imaging currency bills and financial documents and methods for using the same
US8787652B1 (en) 2009-04-15 2014-07-22 Cummins-Allison Corp. Apparatus and system for imaging currency bills and financial documents and method for using the same
US9195889B2 (en) 2009-04-15 2015-11-24 Cummins-Allison Corp. System and method for processing banknote and check deposits
US8929640B1 (en) 2009-04-15 2015-01-06 Cummins-Allison Corp. Apparatus and system for imaging currency bills and financial documents and method for using the same
US8437532B1 (en) 2009-04-15 2013-05-07 Cummins-Allison Corp. Apparatus and system for imaging currency bills and financial documents and method for using the same
US8948490B1 (en) 2009-04-15 2015-02-03 Cummins-Allison Corp. Apparatus and system for imaging currency bills and financial documents and method for using the same
US8958626B1 (en) 2009-04-15 2015-02-17 Cummins-Allison Corp. Apparatus and system for imaging currency bills and financial documents and method for using the same
US8644583B1 (en) 2009-04-15 2014-02-04 Cummins-Allison Corp. Apparatus and system for imaging currency bills and financial documents and method for using the same
US8559695B1 (en) 2009-04-15 2013-10-15 Cummins-Allison Corp. Apparatus and system for imaging currency bills and financial documents and method for using the same
US8391583B1 (en) 2009-04-15 2013-03-05 Cummins-Allison Corp. Apparatus and system for imaging currency bills and financial documents and method for using the same
US8478019B1 (en) 2009-04-15 2013-07-02 Cummins-Allison Corp. Apparatus and system for imaging currency bills and financial documents and method for using the same
US8437528B1 (en) 2009-04-15 2013-05-07 Cummins-Allison Corp. Apparatus and system for imaging currency bills and financial documents and method for using the same
US10452906B1 (en) 2009-04-15 2019-10-22 Cummins-Allison Corp. Apparatus and system for imaging currency bills and financial documents and method for using the same
US8594414B1 (en) 2009-04-15 2013-11-26 Cummins-Allison Corp. Apparatus and system for imaging currency bills and financial documents and method for using the same
US9477896B1 (en) 2009-04-15 2016-10-25 Cummins-Allison Corp. Apparatus and system for imaging currency bills and financial documents and method for using the same
US8467591B1 (en) 2009-04-15 2013-06-18 Cummins-Allison Corp. Apparatus and system for imaging currency bills and financial documents and method for using the same
US9972156B1 (en) 2009-04-15 2018-05-15 Cummins-Allison Corp. Apparatus and system for imaging currency bills and financial documents and method for using the same
US9971935B1 (en) 2009-04-15 2018-05-15 Cummins-Allison Corp. Apparatus and system for imaging currency bills and financial documents and method for using the same
US9558418B2 (en) 2013-02-22 2017-01-31 Cummins-Allison Corp. Apparatus and system for processing currency bills and financial documents and method for using the same
US10163023B2 (en) 2013-02-22 2018-12-25 Cummins-Allison Corp. Apparatus and system for processing currency bills and financial documents and method for using the same
US9141876B1 (en) 2013-02-22 2015-09-22 Cummins-Allison Corp. Apparatus and system for processing currency bills and financial documents and method for using the same
US11314980B1 (en) 2013-02-22 2022-04-26 Cummins-Allison Corp. Apparatus and system for processing currency bills and financial documents and method for using the same

Also Published As

Publication number Publication date
US6014454A (en) 2000-01-11
US5917931A (en) 1999-06-29
CA2195954A1 (en) 1996-02-08
AU693597B2 (en) 1998-07-02
AU3406295A (en) 1996-02-22
US5737440A (en) 1998-04-07

Similar Documents

Publication Publication Date Title
AU693597B2 (en) Expenditure categorization and tracking system
US5740271A (en) Expenditure monitoring system
USRE47309E1 (en) System and method for capture, storage and processing of receipts and related data
US6816608B2 (en) Storing information recorded as part of a financial transaction with a quantity of data stored determined by a monetary value of the transaction
US8235284B1 (en) Systems, methods and apparatus for receiving images of one or more checks
US5689579A (en) Rule-based circuit, method and system for performing item level reconciliation
AU570974B2 (en) Machine readable document and method for processing
US8693070B2 (en) Receipts scanner and financial organizer
US8464933B1 (en) Systems, methods and apparatus for receiving images of one or more checks
US5444794A (en) Check image capture system
US4724309A (en) Machine readable document and method for processing
US4634148A (en) Negotiable instrument
US6873715B2 (en) System of central signature verifications and electronic receipt transmissions
US6002787A (en) Fingerprint analyzing and encoding system
EP0661654A2 (en) Method and system for automatic compilation of a customer information database of bank check data
US20020145035A1 (en) Remote automated document processing system
JPH01161490A (en) Image decomposing copy reference system
CN101571698A (en) Method for matching images, image matching device, image data output apparatus, and recording medium
CN101320426B (en) Image processing device and method, image forming device and image processing system
JP2002092682A (en) Method and system of detecting watermark
JP2020057186A (en) Accounting software and system
CN101320425A (en) Image processing apparatus, image forming apparatus, image processing system, and image processing method
US20210224924A1 (en) Receipts scanner and financial organizer
US20220237937A1 (en) Distributed computer system for document authentication
MXPA00002182A (en) Improved secure documents

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AM AT AU BB BG BR BY CA CH CN CZ DE DK EE ES FI GB GE HU IS JP KE KG KP KR KZ LK LR LT LU LV MD MG MN MW MX NO NZ PL PT RO RU SD SE SG SI SK TJ TM TT UA UG UZ VN

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): KE MW SD SZ UG AT BE CH DE DK ES FR GB GR IE IT LU MC NL PT SE BF BJ CF CG CI CM GA GN ML MR NE SN TD TG

WR Later publication of a revised version of an international search report
121 Ep: the epo has been informed by wipo that ep was designated in this application
DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
WWE Wipo information: entry into national phase

Ref document number: 2195954

Country of ref document: CA

REG Reference to national code

Ref country code: DE

Ref legal event code: 8642

122 Ep: pct application non-entry in european phase