FORM 2
THE PATENTS ACT 1970
[39 OF 1970]
&
THE PATENTS (AMENDMENT) RULES, 2006
COMPLETE SPECIFICATION
[See Section 10; rule 13]
"FUEL DISPENSING ENVIRONMENT WITH IMAGE PROCESSING OF POINT
OF SALE DISPLAY"
Gilbarco Veeder Root India Pvt. Ltd., of First Floor, Tower-1, Equinox Business Park, LBS Marg, Off. BKC, Mumbai - 400070, INDIA,
The following specification particularly describes the invention and the manner in which it is to be performed:

TITLE
FUEL DISPENSING ENVIRONMENT WITH IMAGE PROCESSING OF POINT OF
SALE DISPLAY
FIELD OF THE INVENTION
[0001] The present invention relates generally to service stations at which fuel is dispensed. More particularly, the present invention relates to a fuel dispensing environment with image processing of a point of sale display.
BACKGROUND
[0002] Retail fueling environments usually include a plurality of fuel dispensers located in a forecourt area outside of a convenience store building. Typically, the fuel dispensers will each be equipped with pay-at-the-pump capability by which the customer can perform the fueling transaction using a user interface on the respective fuel dispenser. For example, the customer can present a credit or debit card using a card reader installed on the fuel dispenser's user interface to pay for the fuel without entering the store. In other cases, the customer may want or need to go into the convenience store to pay for the fuel or to purchase other items. [0003] The convenience store will generally be equipped with a point-of-sale (POS) system (i.e., device) to handle certain functions relating to transactions that occur in the retail fueling environment. For instance, the POS device will generally include software components adapted to display a graphical user interface (GUI). Transactions are recorded using the POS for inventory reconciliation and other recordkeeping purposes. In addition, the POS may allow the station's manager the ability to set options associated with the POS or the service station, such as the appearance of receipts issued by the station's dispensers.
SUMMARY OF CERTAIN ASPECTS
[0004] The present invention recognizes and addresses the foregoing considerations, and others, of prior art construction and methods. In this regard, certain exemplary and non-limiting aspects of the present invention will now be described. These aspects are intended to provide some context for certain principles associated with the present invention, but are not intended to be defining of the full scope of the present invention.

[0005] A point of sale device is provided, in an example embodiment, including a user interface and processing circuitry. The processing circuitry is configured to capture at least a portion of an image displayed on the user interface including an indicator, compare the at least a portion of the image to one or more stored display images, determine a point of sale device condition (which may be or include an indicator identification) based on the comparison of the at least a portion of the image to the one or more stored display images, and cause condition data associated with the determined point of sale device condition to be displayed on the user interface. The condition data is indicative of potential causes of the determined point of sale device condition. [0006] In another example embodiment, a point of sale device is provided including a user interface and processing circuitry. The processing circuitry is configured to receive an indication of a press and hold gesture associated with an indicator displayed on the user interface and cause condition data associated with a determined point of sale device condition or an indicator identification to be displayed on the user interface. The condition data is indicative of potential causes of the determined point of sale device condition.
[0007] Additional embodiments may include systems and methods similar to those described above with respect to the fuel dispensing environment. Different systems and methods of the present invention utilize various combinations of the disclosed elements and method steps as supported by the overall disclosure herein. Thus, combinations of elements other than those discussed above may be claimed. Moreover, the accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate one or more embodiments of the invention and, together with the description, serve to explain the principles of the invention.
BRIEF DESCRIPTION OF THE DRAWINGS
[0008] A full and enabling disclosure of the present invention, including the best mode thereof
directed to one of ordinary skill in the art, is set forth in the specification, which makes reference
to the appended drawings, in which:
[0009] FIG. 1 is a diagrammatic representation of a retail fueling environment incorporating
certain aspects of the present invention.
[0010] FIG. 2 is a diagrammatic representation showing additional details of the enhanced
dispenser hub of FIG. 1 according to an embodiment of the present invention.

[0011] FIG. 3 is a diagrammatic representation showing additional details of a fuel dispenser
shown in FIG. 1 according to an embodiment of the present invention.
[0012] FIGs. 4A-4F illustrate screen shots of a user interface associated with the point of sale
device of FIG. 1 including screen capture and image processing according to an embodiment of
the present invention.
[0013] FIG. 5 illustrates a block diagram of one example of processing circuitry according to an
embodiment of the present invention.
[0014] FIG. 6 illustrates a method of utilizing a point of sate device according to an example
embodiment of the present invention.
[0015] Repeat use of reference characters in the present specification and drawings is intended to
represent same or analogous features or elements of the invention.
DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS
[0016] Reference will now be made in detail to presently preferred embodiments of the invention, one or more examples of which are illustrated in the accompanying drawings. Each example is provided by way of explanation of the invention, not limitation of the invention. In fact, it will be apparent to those skilled in the art that modifications and variations can be made in the present invention without departing from the scope or spirit thereof. For instance, features illustrated or described as part of one embodiment may be used on another embodiment to yield a still further embodiment. Thus, it is intended that the present invention covers such modifications and variations as come within the scope of the appended claims and their equivalents.
[0017] In some instances, a user of a POS device (e.g., a cashier) may receive an indicator on the POS display and not understand the meaning of the indicator. The indicator may, in some instances, be an icon with which the cashier is unfamiliar, a notification, or an error indication (such as a fuel dispenser error) or the like. The user has previously been required to ask a supervisor or navigate a help menu to identify the indicator or determine the cause of the indicator, which takes time and may have confusing or non-intuitive vocabulary. Further, these solutions may prevent or prolong interaction with customers. In contrast, example embodiments of the present invention allow the user to select a portion of the displayed image, which may be compared to one or more images in a database corresponding to POS device conditions. The

POS may cause data to be displayed on the user interface to inform the user of potential causes of the condition. This displayed data may take the form of an indicator identification, e.g. the meaning of the icon, notification, a function description of the indicator, error indication, or the like. Additionally, displaying the potential causes or meaning of the indicator in response to capturing a portion of the display image may limit or prevent a need for the user to navigate a help menu and/or solicit assistance of a supervisor.
[0018] In some example embodiments, the POS may automatically select a portion of the user interface including the indicator, such as in an instance in which the indicator is indicative of an error condition. Additionally or alternatively, the user may select the portion of the image to be evaluated, such as by a touch and hold gesture associated with an indicator or outlining an indicator.
[0019] In some instances, the POS may also display corrective action data, such as a list of steps to correct an error indicator, or potential causes of the error indicator. The POS may discontinue displaying the condition data in response to a user input, or automatically based on the indicator no longer being indicative of the POS condition.
[0020] In some instances, the POS may establish communications with a remote support service to assist with a determination of POS conditions or assist with correcting a POS condition. The POS may transmit the portion of the image to the remote support service for identification. Additionally or alternatively, the POS may receive an indication of one or more completed steps of a suggested corrective action and transmit data associated with the completed steps to the remote support service. Receiving the portion of the image and/or the data associated with the completed steps may limit or prevent repeating troubleshooting efforts or requesting previously determine information, which may reduce and focus troubleshooting efforts.
Example Fueling Environment [0021] FIG 1 illustrates an exemplary retail fueling environment 1 in accordance with an embodiment of the present invention. One or more fuel dispensers 10 are located in the forecourt region of the retail fueling environment. The fuel dispensers 10 are operative to dispense fuel supplied from one or more underground storage tanks (USTs) into a customer's vehicle. Typically, the fuel dispensers 10 will be provided with "pay-at-the-pump" capability, allowing the customer to authorize and pay for the fueling transaction at the dispenser itself. The

retail fueling environment 1 also includes a point-of-sale (POS), i.e., aPOS device 12, that handles in-store sales activities, as well as various inventory and configuration functions. [0022] Although embodiments are contemplated in which the electronic payment server is incorporated into or is in direct communication with POS 12, the illustrated embodiment utilizes an enhanced dispenser hub (EDH) 14 as shown and described in U.S. Pat. No. 8,438,064 (incorporated fully herein by reference for all purposes). EDH 14 includes an electronic payment server that allows processing of payment card information. In particular, credit (or debit) card information from the fuel dispensers 10 and any in-store card readers is fed to EDH 14, which seeks approval from a remote host processing system 16 via a suitable off-site communication link 18.
[0023] Referring now to FIG. 2, EDH 14 includes processing circuitry 60B for running a forecourt module 20 and a payment/network module 22. Forecourt module 20 is adapted to control the operation of devices located in the retail fueling environment's forecourt. In this example, forecourt module 20 comprises several modules, including fuel/pump control module 24, card reader module 26, security module 28, car wash module 30, and tank monitor module 32. The fuel/pump control module 24 handles operation of dispensers 10, while the car wash module 30 handles operation of any on-site car washes. The tank monitor module 32 handles operation of any tank monitors connected to the underground storage tanks of the retail fueling environment. The card reader module 26 handles operation of the card readers of the retail fueling environment, such as the card readers of dispensers 10. The security module 28 handles encryption of the sensitive information transmitted by the components of the retail fueling environment. For instance, payment card data received by the various card readers in the retail fueling environment may be handled by the card reader module 26 and encrypted by the security module 28.
[0024] Payment module 22 performs validation of the payment card information received by the various card readers in the retail fueling environment. In particular, payment module 22 handles communications to and from the host processing system 16. As shown, payment module 22 communicates with a PIN pad module 34 when information from a PIN pad is necessary to process the transaction.
[0025] Referring now to FIG. 3, additional details regarding the various components of fuel dispenser 10 can be more easily explained. As shown, fuel dispenser 10 includes processing

circuitry 60C. In addition, dispenser 10 may also comprise a CRIND module 40 which may be associated with or include processing circuitry 60D. Those of ordinary skill in the art are familiar with CRIND units used in fuel dispensers, but additional background information is provided in U.S. Pat. No. 4,967,366, the entirety of whicjh is incorporated by reference herein for all purposes.
[0026] As shown, processing circuitry 60C and CRIND module 40 of the fuel dispenser 10 are in operative communication with EDH 14 via an interface 44. In addition, either or both of processing circuitry 60C and CRIND module 40 may be in wired or wireless communication with the internet and/or one or more cloud servers via off-site communication link 18, as depicted in FIG. 1, or another suitable communication link.
[0027] Processing circuitry 60C includes the hardware and software necessary to control the hydraulic components and functions of dispenser 10. Those of ordinary skill in the art are familiar with the operation of the hydraulics 46 of dispenser 10. In general, however, fuel from USTs is pumped through a piping network into an inlet pipe at the fuel dispenser. Fuel being dispensed passes through a flow meter, which is responsive to flow rate or volume. A displacement sensor, such as a pulser, is employed to generate a signal in response to fuel flow though the meter and communicate this information to processing circuitry 60C. Processing circuitry 60C may also provide control signaling to a valve that may be opened and closed to permit or not permit dispensing of fuel.
[0028] Meter flow measurements from the displacement sensor are collected by processing circuitry 60C. Processing circuitry 60C also typically performs calculations such as cost associated with a fuel dispensing transaction. As a dispensing transaction progresses, fuel is then delivered to a hose and through a nozzle into the customer's vehicle. Dispenser 10 typically includes a nozzle boot, which may be used to hold and retain the nozzle when not in use. The nozzle boot may include a mechanical or electronic switch in communication with processing circuitry 60C to indicate when the nozzle has been removed for a fuel dispensing request and when the nozzle has been replaced, signifying the end of a fueling transaction. Processing circuitry 60C may thus determine whether a transaction has been initiated or completed. [0029] Processing circuitry 60C may further be operative to control one or more displays 48 on the dispenser. For example, a transaction price total display may present customers with the price for fuel that is dispensed. A transaction gallon total display may be used to present customers

with the measurement of fuel dispensed in units of gallons (or liters). Finally, price per unit (PPU) displays may be provided to show the price per unit of fuel dispensed in either gallons or liters, depending on the programming of dispenser 10.
[0030] CRIND module 40 includes processing circuitry 60D configured to support payment processing and peripheral interfaces at dispenser 10. In this regard, CRIND module 40 may be in operative communication with several input devices. For example, a PIN pad 50 is typically used for entry of a PIN if the customer is using a debit card for payment of fuel or other goods or services. CRIND module 40 may also be in operative communication with a card information reader 52 for accepting credit, debit, or other magnetic stripe or chip cards for payment. Additionally, card information reader 52 may accept loyalty or program-specific cards as is well known. Further, CRIND module 40 may be in operative communication with other payment or transactional devices such as a receipt printer 54.
[0031] One or more display(s) 56 may be used to display information, such as transaction-related prompts and advertising, to the customer. The customer may use soft keys to respond to information requests presented to the user via display 56. In some embodiments, however, a touch screen may be used for display 56. In this case, display 56 may be configured to display a virtual keypad for receiving payment data such as a PIN of a debit card or the billing postal (zip) code of a credit card, for instance. Display 56 may also be used in this case to receive a selection from the customer regarding the displayed information.
[0032] Audio/video electronics 58 are adapted to interface with the CRIND module 40 and/or an auxiliary audio/video source to provide advertising, merchandising, and multimedia presentations to a customer in addition to basic transaction functions. The graphical user interface provided by the dispenser may allow customers to purchase goods and services other than fuel at the dispenser. For example, the customer may purchase a car wash and/or order food from the store while fueling a vehicle.
[0033] Referring again to FIG 1, POS 12 includes a server 59 having processing circuitry 60A and associated memory. In the present example, processing circuitry 60A executes several software modules including manager workstation module 62 and cashier workstation module 64. When executed, manager workstation module 62 displays a GUI on manager workstation 66 that allows the owner, operator, or manager of the fueling station to set options for the fueling environment. Manager workstation module 66 is also adapted to provide point-of-sale ("POS")

capabilities, including the ability to conduct transactions for items offered for sale by the fueling station. Toward this end, manager workstation 66 includes a suitable display 68, such as a touchscreen display, and may further include one or more speakers 70. As one skilled in art will appreciate, server 59 and manager workstation 66 of POS 12 may or may not be incorporated into the same hardware.
[0034] Similarly, cashier workstation module 64 provides a cashier, clerk, or other employee the capability to effect a transaction for one or more items or services offered by the fueling station. Cashier workstation module 64 communicates with the hardware of cashier workstation 72, which includes its own display 74 and optional speaker(s) 76.
[0035] In operation, a user positions a vehicle adjacent to one of dispensers 10 and uses the dispenser to refuel the vehicle. For payment, the user inserts and removes a payment card from card information reader 52. Card information reader 52 reads the information on the payment card and transmits the information to forecourt module 20 via CRIND module 40 and card reader module 26. The forecourt module 20 provides the payment information to network payment module 22, which contacts host processing system 16 operated by the financial institution associated with the user's payment card. The financial institution either validates or denies the transaction and transmits such a response to network payment module 22. The information received from the financial institution's host computer system is transmitted from network payment module 22 back to forecourt module 20 to handle appropriately. This may include transmitting to dispenser 10 a request that the user provide another payment card if the transaction is denied, or printing a receipt if authorized.
[0036] For additional information regarding retail fueling environments, reference is made to U.S. Pat. Nos. 6,435,204 (entitled "Fuel Dispensing System"), 5,956,259 (entitled "Intelligent Fueling"), 5,734,851 (entitled "Multimedia Video/Graphics in Fuel Dispensers"), 6,052,629 (entitled "Internet Capable Browser Dispenser Architecture"), 5,689,071 (entitled "Wide Range, High Accuracy Flow Meter"), and 6,935,191 ("entitled "Fuel Dispenser Fuel Flow Meter Device, System and Method"), all of which are hereby incorporated by reference for all purposes as if set forth verbatim herein.
[0037] As noted above, it may be desirable to provide remote support capability for POS 12. In this regard, POS 12 includes a modem 78 (or other communication portal) that allows communication with a remote support service 80 via a suitable communication link 82. When

remote access is desired, store personnel utilizing POS 12 (e.g., using manager workstation 66) may enable modem 78 to communicate with the remote support service 80. The remote support service 80 may establish remote access to data or control of the POS 12, EDH 14, fuel dispensers 10, or the like via the communication link.
Example Screen Capture and Image Processing [0038] FIG. 4A illustrates an image 100 of a user interface display, such as display 68 or display 74, associated with the POS 12. The image 100 may include a keypad area 102, a keypad display area 104, a speed/department key area 106, a fueling environment area 109, a transaction queue 110, additional transaction keys 111, and a receipt journal 112. In the depicted embodiment the user interface display may include a touch screen configured to receive user input. The keypad area 102 may include numerical values to enter prices or quantities for services or items. The user input entered by the keypad area 102 or totals associated with the user input may be displayed in keypad display area 104. The speed/department key area 106 may include one or more keys indicative of commonly purchased items or departments for item or service look up. The transaction queue 110 may include a display of one or more services or items which have not been assigned to a transaction, such as when an item has been entered but a quantity has not been selected, a prepaid fuel transaction that resulted in a surplus of funds to be refunded, or the like. The receipt journal 112 includes the services and items which have been entered for a current transaction.
[0039] The fueling environment area 109 may include controls and indicators for the fueling environment 1. The controls may include an emergency stop 107 for causing all fueling operations to terminate. The fueling environment area 109 may also include one or more fueling transaction controls, e.g. fuel keypad 113 for authorizing and otherwise handling fueling transactions, such as prepay, receipt printing, or the like. Additionally, the fueling environment area 109 may include a respective fuel dispenser status indicator 108 for indicating a current status of the associated fuel dispenser 10 in the fueling environment 1.
[0040] Turning to FIG. 4B, the image 100 may include one or more indicators 130 that may be unfamiliar to the user, including status indicators, such as the fuel dispenser status indicators, keys of various keypads, error condition indicators or the like. FIG. 4B also depicts a plurality of example indicators 130 that may variously appear in image 100, including a CRIND receipt

paper low icon 120, a fuel dispenser offline icon 122, a refund key 124, a suspend transaction key 126, and a tax exempt key 148. Indicators may also include textual alerts or errors, messages, notifications, or the like. As a further example, indicators may include status notifications which reflect the status of individual hardware components, such as a card reader error, POS transaction notifications, cashier alerts, such as an icon indicating that the amount of money in the till has exceeded a threshold requiring a safe drop, card authorization network status, such as on line and offline, or the like.
[0041] The POS 12 may be configured to automatically without user interaction select a portion of the image 100 displayed on the user interface, or may receive an indication of a manual selection of a portion of the image. Manual or automatic selection of a portion of the image 100 may be chosen by a user, such as in a screen capture selection window 132. Manual or automatic selection is confirmed in this case by a button labeled with the acronym "SCIP" (Screen Capture and Image Processing). The user, e.g. cashier, manager, or the like, may or may not know the meaning of each of the displayed indicators. In an instance in which the user is unfamiliar with the indicator, the user may manually select a portion of the displayed image 100, such as by dragging a curser or a finger to indicate the selected area 136, such as depicted in FIG. 4C. !f manual selection has been chosen, a selection prompt 134 may be displayed to indicate to the user to select at least a portion of the image 100. Additionally or alternatively, the user may use a press and hold or prolonged touch gesture in association with an unfamiliar indicator 130 to indicate a selected indicator 152, such as depicted in FIG. 4E,
[0042] In the case of automatic selection, the POS 12 itself may select a portion of image 100 based on one or more predetermined events, such as a change to a status icon, e.g. fuel dispenser status indicator 108. In this regard, the POS 12 may scan the image 100 at a predetermined interval, such as 1 scan per second, 12 scans per second, or the like, and compare the scanned image to a previous image, e.g. the previous scan, a previously stored image, or the like. In an instance in which a change to an indicator or the presence of a new indicator is detected, the POS 12 may select the changed area. In some instances, the POS 12 may select the changed area and a portion 136 of the image 100 surrounding the changed portion, such as 3 mm, 5 mm, 1 cm, or the like. .
[0043] After the relevant portion of the displayed image 100 is selected, the POS 12 may compare the portion of the image 100 to one or more images stored in an image database. The

image database may include one or more programmed indicators or commonly programmed indicators associated with the POS and/or screen captures of the programmed indicators. The comparison of the captured portion of the image 100 to the one or more stored display images may involve image processing such as, a comparison of pixels, object recognition, imaging formatting, changes to image size, or the like. The POS 12 may assign a probability score to one or more of the stored display images based on the comparison, for example 50 percent, 75 percent 98 percent, or the like.
[0044] The POS 12 may be configured to determine a POS condition and/or other indicator identification based on the comparison of the portion of the image to the one or more stored display images. In an example embodiment, the POS 12 may determine a pixel match, or other indicator match. In some example embodiments, the POS 12 may compare the probability score to a probability threshold, such as 70 percent, 85 percent, 95 percent, or the like. The POS 12 may then select a stored display image for which the probability score satisfies the probability threshold. In an instance in which multiple stored display images satisfy the probability threshold, the stored display image with the highest probability score may be used. Each of the stored display images may be associated with a POS condition and/or other indicator identification. The POS 12 may determine the POS condition or other indicator identification based on the selected stored display image.
[0045] The POS 12 may cause the data associated with POS condition and/or other indicator identification to be displayed on the user interface. In this regard, FIG. 4D depicts examples of condition data and other indicator identifications. In some example embodiments, the indicator identifications may include a function description of the indicator. These may include CRIND receipt paper low condition data 138, transaction data prompt identification 140, a fuel dispenser offline condition data 142, a refund key identification 144, a suspend transaction key identification 146, and a tax exempt key identification 148.
[0046] The CRIND receipt paper low condition data 138 indicates that the CRIND receipt paper is low. (Preferably, CRIND receipt paper low condition data 138 is only displayed when the fuel dispenser 10 is idle.) The transaction data prompt identification 140 indicates a request for the tender type and amount for a current transaction. The fuel dispenser offline condition data 142 indicates that fuel dispenser 10 is offline and no longer in communication with or responding to the EDH 14. The fuel dispenser offline condition data 142 also indicates that an error message is

available for viewing by selecting diagnosis. The refund key identification 144 indicates that a refund allows a return of items to be performed. The suspend transaction key identification 146 indicates that a transaction has been started and suspended. The suspend transaction key identification 146 may also indicate that the suspend transaction key 126 may be selected to resume to tender or void the transaction. The tax exempt key identification 148 indicates that the tax exempt key allows for the tax to be removed on a item or transaction.
[0047] In an example embodiments, such as in response to the POS 12 receiving an indication of a press and hold gesture in association with an indicator 130, the POS 12 may cause an indicator 130 to indicate selection, such as by highlighting the indicator 130 in a different color, shading, or the like. The POS 12 may cause an indicator identification 160 to be displayed on the user interface, such as proximate to the selected indicator 130. As discussed above, the indicator identification 160 may include a name of the indicator and a function description, e.g. a description of the function or functions provided by the indicator 130. For example, the indicator 130 selected in FIG. 4E is a "No Sale" indicator. The indicator identification 160 includes the name of the indicator 130, e.g. No Sale, and a functional description of the indicator 130, allows an operator to open the cash drawer without initiation of a sales transaction. [0048] In some example embodiments, the POS 12 may discontinue displaying the condition data, e.g. indicator identification, in response to an indication of a release gesture associated with the indicator 130, A release gesture may include lifting a user finger from the user interface, a lift followed by a tap of the user interface, such as an area of the user interface associated with the indicator 130, or the like.
[0049] In some example embodiments, the POS 12 may cause corrective action data to be displayed on the user interface. The corrective action data may be displayed with the condition data or may be displayed in response to selection of a corrective action prompt associated with the displayed condition data. In the example depicted in FIG. 4F, corrective action data is displayed in a corrective action window 150. The corrective action data preferably includes an indication 152 of the POS condition. In the depicted example, the indication 152 of POS condition indicates that the POS condition is a pump/dispenser is offline, which may be associated with the fuel dispenser offline condition data 142 discussed above. The corrective action data also include one or more corrective actions 154. The corrective actions 154 may include hardware checks, running diagnostic tests, resetting one or more systems or portions of

systems, or the like. In the depicted example, the corrective actions include forecourt wrongly configured, check cables for loose connections/breakage, and check whether the CRIND module 40 is powered on. In some instances, the user may perform the corrective actions to resolve the POS condition without contacting a help desk, e.g. the remote support service 80. [0050] The POS 12 may cause a close condition data display indicator 156 to be displayed. The POS 12 may discontinue displaying the condition data and/or the corrective actions 154 in response to a user selection of the close condition data display indicator 156, Additionally or alternatively, the POS 12 may automatically discontinue displaying the condition data in response to the portion of the image displayed on the user interface no longer being indicative of the POS condition, e.g. the POS condition being corrected. In some instances the POS 12 may receive indications of completed corrective actions 154. For example, the POS 12 may receive user input indicative of completed corrective actions 154 and/or feedback from one or more components of the fueling environment, such as in response to a diagnostic test. [0051] Referring again to FIG. 1, the POS 12 in some example embodiments may establish communication with the remote support service 80, such as via modem 78. The POS 12 in this case may cause the portion of the image 100 to be transmitted to the remote service 80. The remote support service 80 may utilize the portion of the image for trend analysis and/or computer learning. In an example embodiment, such as an instance in which the POS condition was not corrected by the user, the POS 12 may transmit data associated with the completed corrective actions 154 to the remote support service 80. The data associated with the completed corrective actions 154 may include an indication of completed steps, qualitative or quantitative diagnostic feedback, or the like. The transmission of the data associated with the completed corrective actions 154 may be performed in response to a user input. Additionally or alternatively, the data associated with the completed corrective actions 154 may be transmitted to the remote support service 80 automatically, such as in an instance in which the POS condition is not corrected upon receiving an indication of the completion of the corrective actions 154. The remote support service 80 may utilize the portion of the image and/or the completed corrective actions 154 to determine potential causes of the POS condition and the corrective steps taken by the user, which may reduce questions asked of the user and minimize repeated performance of steps.

[0052] Although the screen capture and image processing is discussed in the context of a fueling environment, one of ordinary skill in the art would immediately appreciate that the process may be applied to various other computing devices including a user interface display.
Example Processing Circuitry [0053] FIG. 5 shows certain elements of processing circuitry 60 for a POS 12, EDH 14, fuel dispenser 10, and/or CRIND module 40. The processing circuitry 60 of FIG. 5 may be employed, for example, on onboard circuitry within the POS 12, EDH 14, fuel dispenser 10, and/or CRIND module 40 in circuitry associated with a convenience store, a network device, server, proxy, or the like, as discussed above in reference to processing circuitry 60A, 60B, 60C, and 60D of FIGs. 1, 2, and 3, respectively. Alternatively, embodiments may be employed on a combination of devices. Furthermore, it should be noted that the devices or elements described below may not be mandatory and thus some may be omitted in certain embodiments. [0054] In an example embodiment, the processing circuitry 60 is configured to perform data processing, application execution and other processing and management services according to an example embodiment of the present invention. In one embodiment, the processing circuitry 60 may include a memory 274 and a processor 272 that may be in communication with or otherwise control a user interface 276 and a communication interface 278. As such, the processing circuitry 60 may be embodied as a circuit chip (e.g. an integrated circuit chip) configured (e.g. with hardware, software or a combination of hardware and software) to perform operations described herein. However, in some embodiments, the processing circuitry 60 may be embodied as a portion of a server, computer, or workstation. In situations where the processing circuitry 60 is embodied as a server or at a remotely located computing device, the user interface 276 may be disposed at another device (e.g. at a computer terminal or client device such as the fuel dispenser 10) that may be in communication with the processing circuitry 60 via the communication interface 278 and/or a network.
[0055] The network may be a data network, such as a local area network (LAN), a metropolitan area network (MAN), a wide area network (WAN) (e.g. the Internet), and/or the like, which may couple devices of the fueling environment 1 to devices such as processing elements (e.g. computer terminals, server computers or the like) and/or databases. Communication between the network and the devices or databases may be accomplished by either wired or wireless

communication mechanisms and corresponding communication protocols, as necessary or desired.
[0056] The user interface 276 may comprise an input/output device for receiving instructions directly from a user. In this regard, the user interface 276 may be in communication with the processing circuitry 60 to receive user input via the user interface 276 and/or to present output to a user as, for example, audible, visual, mechanical or other output indications. The user interface 276 may include, for example, a keyboard, a mouse, a joystick, a display (e.g. a touch screen display), a microphone, a speaker, or other input/output mechanisms. Further, the processing circuitry 60 may comprise, or be in communication with, user interface circuitry configured to control at least some functions of one or more elements of the user interface 276. The processing circuitry 60 and/or user interface circuitry may be configured to control one or more functions of one or more elements of the user interface 276 through computer program instructions (e.g. software and/or firmware) stored on a memory device accessible to the processing circuitry 60 (e.g. volatile memory, non-volatile memory, and/or the like). In some example embodiments, the user interface circuitry is configured to facilitate user control of at least some functions of the apparatus through the use of a display configured to respond to user inputs. The processing circuitry 60 may also comprise, or be in communication with, display circuitry configured to display at least a portion of a user interface 276, the display and the display circuitry configured to facilitate user control of at least some functions of the apparatus. [0057] The communication interface 278 may be any means such as a device or circuitry embodied in either hardware, software, or a combination of hardware and software that is configured to receive and/or transmit data from/to a network and/or any other device or module in communication with the processing circuitry 60, the POS 12, and/or EDH 14 of the fueling environment (and/or a remote cloud server, either directly or via a router located in the convenience store). In some instances the communications interface 278 may be referred to as a cloud connection processor (CCP) and may provide secured, e.g. encrypted, communication between the processing circuitry, the network, and/or remote servers. The communication interface 278 may also include, for example, an antenna (or multiple antennas) and supporting hardware and/or software for enabling communications with the network or other devices (e.g. a user device). In some environments, the communication interface 278 may alternatively or additionally support wired communication. As such, for example, the communication interface

278 may include a communication modem and/or other hardware/software for supporting communication via cable, digital subscriber line (DSL), universal serial bus (USB) or other mechanisms. In an exemplary embodiment, the communication interface 278 may support communication via one or more different communication protocols or methods. In some cases, IEEE 802,15.4 based communication techniques such asZigBee or other low power, short range communication protocols, such as a proprietary technique based on IEEE 802.15.4 may be employed along with radio frequency identification (RFID) or other short range communication techniques.
Example Flowchart(s) and Operations [0058] Embodiments of the present invention provide methods, apparatus and computer program products for operating a POS in a fueling environment. Various examples of operations that may be performed in accordance with embodiments of the present invention will now be further described with reference to FIG. 6.
[0059] FIG. 6 illustrates a flowchart according to exemplary methodology of the present invention. The operations illustrated in and described with respect to FIG. 6 may, for example, be performed by, with the assistance of, and/or under the control of one or more of the processor 272, memory 274, communication interface 278, and/or user interface 276. The methodolgy may include capturing at least a portion of an image displayed on the user interface at operation 606, comparing the at least a portion of the image to one or more stored display images at operation 608, determining a point of sale device condition based on the comparison of the at least a portion of the image to the one or more stored display images at operation 610, and causing condition data associated with the determined point of sale device condition to be displayed on the user interface at operation 612.
[0060] In some embodiments, the method may include additional, optional operations, and/or the
operations described above may be modified or augmented. Some examples of modifications,
optional operations, and augmentations are described below, as indicated by dashed lines, such
as, receiving a user input indicative of the selected portion of the image displayed on the user
interface at operation 602, receiving an indication of a touch and hold gesture associated with an
indicator on the user interface at operation 603, and/or automatically, without user input,
selecting one or more portions of the image displayed on the user interface at operation 604. The

method may also include causing corrective action data to be displayed in association with the condition data at operation 614, causing a close condition data display indicator to be shown at operation 616, and discontinuing displaying the condition data at operation 618. The method may further include establishing communications with a remote support service at operation 620, causing the at least a portion of the image to be transmitted to the remote support service at operation 622, causing data associated with the completed steps of the corrective action data to be transmitted to the remote support service at operation 624, causing the at least a portion of the image to be transmitted to the remote support service at operation 626, and allowing the remote support service to establish remote control of the point of sale device at operation 628. [0061] FIG. 6 illustrates a flowchart of a system, method, and computer program product according to one or more example embodiments. It will be understood that each block of the flowchart, and combinations of blocks of the flowchart, may be implemented by various means, such as hardware and/or a computer program product comprising one or more computer-readable mediums having computer readable program instructions stored thereon. For example, one or more of the procedures described herein may be embodied by computer program instructions of a computer program product. In this regard, the computer program product(s) which embody the procedures described herein may be stored by, for example, the memory 274 and executed by, for example, the processor 272. As will be appreciated, any such computer program product may be loaded onto a computer or other programmable apparatus to produce a machine, such that the computer program product including the instructions which execute on the computer or other programmable apparatus creates means for implementing the functions specified in the flowchart block(s). Further, the computer program product may comprise one or more non-transitory computer-readable mediums on which the computer program instructions may be stored such that the one or more computer-readable memories can direct a computer or other programmable apparatus to cause a series of operations to be performed on the computer or other programmable apparatus to produce a computer-implemented process such that the instructions which execute on the computer or other programmable apparatus implement the functions specified in the flowchart block(s).
[0062] In some embodiments, the system may be further configured for additional operations or includes various optional modifications. In this regard, in an example embodiment, capturing the at least a portion of an image displayed on the user interface includes receiving a user input

indicative of a selected portion of the image displayed on the user interface. In an example embodiment, capturing the at least a portion of an image displayed on the user interface includes automatically, without user input, selecting one or more portions of the image displayed on the user interface. In some example embodiments, the processing circuitry is further configured to cause corrective action data to be displayed in association with the condition data. In an example embodiment, the processing circuitry is further configured to cause a close condition data display indicator to be displayed on the user interface and discontinue displaying the condition data in response to selection of the close condition data display indicator. In some example embodiments, the processing circuitry is further configured to automatically, without user input, discontinue displaying the condition data in response to the portion of the image displayed on the user interface no longer being indicative of the determined point of sale device condition. In an example embodiment, the processing circuitry is further configured to establish communications with a remote support service and cause the at least a portion of the image to be transmitted to the remote support service. In some example embodiments, the processing circuitry is further configured to cause corrective action data to be displayed in association with the condition data, receive an indication of one or more completed steps of the corrective action data, and cause data associated with the completed steps of the corrective action data to be transmitted to the remote support service. In an example embodiment, the data associated with the completed steps is transmitted in response to a user input. In some example embodiments, the data associated with the completed steps is transmitted automatically, without user input. In an example embodiment, the processing circuitry is further configured to allow the remote support service to establish remote control of the point of sale device. In an example embodiment, the indicator identification includes a function description of the indicator. In some example embodiments, wherein the condition data is indicative of potential causes of the determined point of sale device condition. In some example embodiments, the processing circuitry is further configured to discontinue displaying the condition data in response to an indication of a release gesture associated with the indicator.
[0063] Many modifications and other embodiments of the invention set forth herein will come to mind to one skilled in the art to which the invention pertains having the benefit of the teachings presented in the foregoing descriptions and the associated drawings. Therefore, it is to be understood that embodiments are not to be limited to the specific embodiments disclosed and

that modifications and other embodiments are intended to be included within the scope of the invention. Moreover, although the foregoing descriptions and the associated drawings describe example embodiments in the context of certain example combinations of elements and/or functions, it should be appreciated that different combinations of elements and/or functions may be provided by alternative embodiments without departing from the scope of the invention. In this regard, for example, different combinations of elements and/or functions than those explicitly described above are also contemplated within the scope of the invention.

WHAT IS CLAIMED IS:
1. A point of sale device comprising:
a user interface and
processing circuitry, wherein the processing circuitry is configured to:
recieve an indication of a press and hold gesture associated with an indicator
displayed on the user interface; and
cause condition data associated with a determined point of sale device condition
or an indicator identification to be displayed on the user interface.
2. The point of sale device of claim 1, wherein, the processing circuitry is further
configured to:
capture at least a portion of an image displayed on the user interface including the
indicator;
compare the at least a portion of an captured to one or more stored display images; and determine the point of sale device condition or the indicator identification based on a
comparison of the at least a portion of the image to the one or more stored display images.
3. The point of sale device of claim 1, wherein the indicator identification includes a function description of the indicator and.
4. The point of sale device of claim 1, wherein the condition data is indicative of potential causes of the determined point of sale device condition.
5. The point of sale device of claim 1, wherein the processing circuitry is further configured to:
cause corrective action data to be displayed in association with the condition data.
6. The point of sale device of claim 1, wherein the processing circuitry is further
configured to:

discontinue displaying the condition data in response to an indication of a release gesture associated with the indicator.
7. The point of sale device of claim 1, wherein the processing circuitry is further
configured to:
cause a close condition data display indicator to be displayed on the user interface, and discontinue displaying the condition data in response to selection of the close condition data display indicator.
8. The point of sale device of claim 1, wherein the processing circuitry is further
configured to:
automatically, without user input, discontinue displaying the condition data in response to a portion of the image displayed on the user interface no longer being indicative of the determined point of sale device condition.
9. The point of sale device of claim 1, wherein the processing circuitry is further
configured to:
establish communications with a remote support service, and
cause the at least a portion of the image to be transmitted to the remote support service.
10. The point of sale device of claim 9, wherein the processing circuitry is further
configured to:
cause corrective action data to be displayed in association with the condition data; receive an indication of one or more completed steps of the corrective action data; and cause data associated with the completed steps of the corrective action data to be transmitted to the remote support service.
11. The point of sale device of claim 10, wherein the data associated with the completed
steps is transmitted in response to a user input.

12. The point of sale device of claim 10, wherein the data associated with the completed steps is transmitted automatically, without user input.
13. The point of sale device of claim 9, wherein the processing circuitry is further configured to:
allow the remote support service to establish remote control of the point of sale device.
14. A fueling environment comprising:
one or more fuel dispensers;
one or more workstations; and a point of sale device comprising: a user interface and processing circuitry, wherein the processing circuitry is configured to:
recieve an indication of a press and hold gesture associated with an indicator displayed on the user interface; and
cause condition data associated with a determined point of sale device condition or an indicator identification to be displayed on the user interface.
15. The fueling environment of claim 14, wherein the processing circuitry is further
configured to:
capture at least a portion of an image displayed on the user interface including the
indicator;
compare the at least a portion of an captured to one or more stored display images; and determine the point of sale device condition or the indicator identification based on a
comparison of the at least a portion of the image to the one or more stored display images.
16. The fueling environment of claim 14, wherein the indicator identification includes a
function description of the indicator.
17. The fueling environment of claim 14, wherein the condition data is indicative of potential causes of the determined point of sale device condition

18. The fueling environment of claim 14, wherein the processing circuitry is further
configured to:
cause corrective action data to be displayed in association with the condition data.
19. The fueling environment of claim 14, wherein the processing circuitry is further
configured to:
discontinue displaying the condition data in response to an indication of a release gesture associated with the indicator.
20. The fueling environment of claim 14, wherein the processing circuitry is further
configured to:
cause a close condition data display indicator to be displayed on the user interface, and discontinue displaying the condition data in response to selection of the close condition data display indicator.
21. The fueling environment of claim 14, wherein the processing circuitry is further
configured to:
automatically, without user input, discontinue displaying the condition data in response to . a portion of the image displayed on the user interface no longer being indicative of the determined point of sale device condition.
22. The fueling environment of claim 14, wherein the processing circuitry is further
configured to:
establish communications with a remote support service, and
cause the at least a portion of the image to be transmitted to the remote support service.