A METHOD AND SYSTEM FOR CONTROLLING ELECTRONIC DISPLAY DEVICES

USING DIGITAL WATERMARKS

FIELD OF THE INVENTION

[0001] The present invention relates to the field of electronic display devices, and more specifically to the field of controlling electronic display devices using digital watermarks.

BACKGROUND

[0001] Universal remote control units have gained popularity for use in remotely controlling multiple devices, for example a television, a cable box, and an air conditioner. A universal remote control unit typically has a plurality of operating modes for controlling the multiple devices. Each operating mode allows a user to remotely control one of the multiple devices. However, such a universal remote control unit requires that the user explicitly change operating mode from one device to another. Also, operation of the universal remote control unit is often confusing, particularly when the user powers on the multiple devices and then desires to control one of the multiple devices. Moreover, numerous button presses are typically required to power on and power off the multiple devices.

[0002] Current universal remote control units have included a single mode push button instead of separate push buttons corresponding to each of the multiple devices. By pressing a mode push button, the operating mode of the universal remote control unit changes from one operating mode to a next operating mode. However, it is often necessary to press the mode push button a number of times in order to change from one operating mode to another. Also, the user is required to remember position of the device in a device cycle, and to set menu of the device manually. Moreover, number of push buttons is limited by design of the universal remote control unit.

[0003] In the light of the foregoing discussion there is a need for an efficient method and system for controlling electronic display devices using digital watermarks.

SUMMARY

[0004] Embodiments of the present disclosure described herein provide a method and system for controlling electronic display devices using digital watermarks.

[0005] An example of a method of sharing controlling electronic display devices using digital watermarks includes receiving an input image of an electronic display device from a remote control unit. The method also includes processing the input image to identify the electronic display device based on a digital watermark embedded in the input image. The method further includes providing a menu of the electronic display device to the remote control unit. Further, the method includes enabling control of the electronic display device by a user of the remote control unit.

[0006] An example of a system for controlling electronic display devices using digital watermarks includes a plurality of electronic display devices, a remote control unit in communication with the electronic display devices to display menus, a server that enables controlling of the electronic display devices by the remote control unit, and a communication interface for establishing communication between an electronic display device and the remote control unit. The server includes a memory that stores instructions. Further, the server includes a processor responsive to the instructions to receive an input image of an electronic display device from a remote control unit, to process the input image to identify the electronic display device based on a digital watermark embedded in the input image, to provide a menu of the electronic display device to the remote control unit, and to enable control of the electronic display device by a user of the remote control unit. Moreover, the server includes a device manager unit that manages the electronic display devices.

BRIEF DESCRIPTION OF FIGURES

[0007] The accompanying figure, similar reference numerals may refer to identical or functionally similar elements. These reference numerals are used in the detailed description to illustrate various embodiments and to explain various aspects and advantages of the present disclosure.

[0008] FIG. 1 is a block diagram of an environment, in accordance with which various embodiments can be implemented;

[0009] FIG. 2 is a block diagram of a server, in accordance with one embodiment;

[0010] FIG. 3 is a block diagram of a system, in accordance with one embodiment;

[0011] FIG. 4 is a flowchart illustrating registration of the electronic display device, in accordance with one embodiment;

[0012] FIG. 5 is a flowchart illustrating initialization of the electronic display device, in accordance with one embodiment;

[0013] FIG. 6 is a flowchart illustrating loading of menu of the electronic display device, in accordance with one embodiment;

[0014] FIG. 7 is a flowchart illustrating user operation, in accordance with one embodiment; and

[0015] FIG. 8 is a flowchart illustrating a method of controlling electronic display devices using digital watermarks, in accordance with one embodiment.

DETAILED DESCRIPTION

[0016] It should be observed the method steps and system components have been represented by conventional symbols in the figure, showing only specific details which are relevant for an understanding of the present disclosure. Further, details may be readily apparent to person ordinarily skilled in the art may not have been disclosed. In the present disclosure, relational terms such as first and second, and the like, may be used to distinguish one entity from another entity, without necessarily implying any actual relationship or order between such entities.

[0017] Embodiments of the present disclosure described herein provide a method and system for controlling electronic display devices using digital watermarks.

[0018] FIG. 1 is a block diagram of an environment 100, in accordance with which various embodiments can be implemented. The environment 100 includes one or more electronic display devices, for example an electronic display device 105A and an electronic display device 105B, a network 110, a remote control unit 115, and a server 120. The electronic display devices, hereinafter referred to as display devices, are connected to the remote control unit 115 and the server 120 through the network 110. Examples of the display devices include, but are not limited to, a digital television, a mobile device, a laptop, a tablet device, a personal digital assistant (PDA), a smart phone, and a home theater system. Examples of the network 110 include, but are not limited to, a local area network, a wide area network and a wireless network.

[0019] The display devices, for example the display device 105A and the display device 105B, can be controlled by the remote control unit 115 via the server 120.

[0020] The server 120 receives an input image of the display device 105A from the remote control unit 115. The input image is processed by the server 120 to identify the display device 105A based on a digital watermark embedded in the input image. The server 120 provides a menu of the display device 105A to the remote control unit 115 thereby enabling control of the display device 105A by a user of the remote control unit 115.

[0021] The server 120 including a plurality of elements is explained in detail in conjunction with FIG. 2.

[0022] FIG. 2 is a block diagram of the server 120, in accordance with one embodiment.

[0023] The server 120 includes a bus 205 or other communication mechanism for communicating information, and a processor 210 coupled with the bus 205 for processing information. The server 120 also includes a memory 215, for example a random access memory (RAM) or other dynamic storage device, coupled to the bus 205 for storing information and instructions to be executed by the processor 210. The memory 215 can be used for storing temporary variables or other intermediate information during execution of instructions by the processor 210. The server 120 further includes a read only memory (ROM) 220 or other static storage device coupled to the bus 205 for storing static information and instructions for the processor 210. A storage unit 225, for example a magnetic disk or optical disk, is provided and coupled to the bus 205 for storing information.

[0024] The server 120 can be coupled via the bus 205 to a display 230, for example a cathode ray tube (CRT), for displaying data. The input device 235, including alphanumeric and other keys, is coupled to the bus 205 for communicating information and command selections to the processor 210. Another type of user input device is the cursor control 240, for example a mouse, a trackball, or cursor direction keys for communicating direction information and command selections to the processor 210 and for controlling cursor movement on the display 230.

[0025] Various embodiments are related to the use of the server 120 for implementing the techniques described herein. In some embodiments, the techniques are performed by the server 120 in response to the processor 210 executing instructions included in the memory 215. Such instructions can be read into the memory 215 from another machine-readable medium, for example the storage unit 225. Execution of the instructions included in the memory 215 causes the processor 210 to perform the process steps described herein.

[0026] In some embodiments, the processor 210 can include one or more processing units for performing one or more functions of the processor 210. The processing units are hardware circuitry used in place of or in combination with software instructions to perform specified functions.

[0027] The term "machine-readable medium" as used herein refers to any medium that participates in providing data that causes a machine to perform a specific function. In an embodiment implemented using the server 120, various machine-readable media are involved, for example, in providing instructions to the processor 210 for execution. The machine-readable medium can be a storage medium, either volatile or non-volatile. A volatile medium includes, for example, dynamic memory, such as the memory 215. A non-volatile medium includes, for example, optical or magnetic disks, for example the storage unit 225. All such media must be tangible to enable the instructions carried by the media to be detected by a physical mechanism that reads the instructions into a machine.

[0028] Common forms of machine-readable media include, for example, a floppy disk, a flexible disk, hard disk, magnetic tape, or any other magnetic media, a CD-ROM, any other optical media, punchcards, papertape, any other physical media with patterns of holes, a RAM, a PROM, and EPROM, a FLASH-EPROM, any other memory chip or cartridge.

[0029] In another embodiment, the machine-readable media can be transmission media including coaxial cables, copper wire and fiber optics, including the wires that include the bus 205. Transmission media can also take the form of acoustic or light waves, such as those generated during radio-wave and infra-red data communications. Examples of machine-readable media may include, but are not limited to, a carrier wave as described hereinafter or any other media from which the server 120 can read. For example, the instructions can initially be carried on a magnetic disk of a remote computer. The remote computer can load the instructions into its dynamic memory and send the instructions over a telephone line using a modem. A modem local to the server 120 can receive the data on the telephone line and use an infra-red transmitter to convert the data to an infra-red signal. An infra-red detector can receive the data carried in the infra-red signal and appropriate circuitry can place the data on the bus 205. The bus 205 carries the data to the memory 215, from which the processor 210 retrieves and executes the instructions. The instructions received by the memory 215 can optionally be stored on the storage unit 225 either before or after execution by the processor 210. All such media must be tangible to enable the instructions carried by the media to be detected by a physical mechanism that reads the instructions into a machine.

[0030] The server 120 also includes a communication interface 245 coupled to the bus 205. The communication interface 245 provides a two-way data communication coupling between the server 120 and the display device 105A, and the server 120 and the remote control unit 115, through the network 110. For example, the communication interface 245 can be an integrated services digital network (ISDN) card or a modem to provide a data communication connection to a corresponding type of telephone line. As another example, the communication interface 245 can be a local area network (LAN) card to provide a data communication connection to a compatible LAN. In any such implementation, the communication interface 245 sends and receives electrical, electromagnetic or optical signals that carry digital data streams representing various types of information.

[0031] The processor 210 in the server 120 is operable to receive an input image of the display device 105A from the remote control unit 115. The input image is processed by the processor 210 to identify the display device 105A based on a digital watermark embedded in the input image. The processor 210 provides a menu of the display device 105A to the remote control unit 115 thereby enabling control of the display device 105A by a user of the remote control unit 115.

[0032] The server 120 further includes a device manager unit 250 that manages the display device 105A.

[0033] The device manager unit 250 is explained in detail in conjunction with FIG. 3.

[0034] FIG. 3 is a block diagram of a system 300, in accordance with one embodiment. The system 300 includes the display device 105A, the remote control unit 115, and the device manager unit 250. The remote control unit 115 includes an image capture unit 305 and the display 230, for example a touch screen display. The device manager unit 250 further includes a watermark detector unit 310, a watermark identifier unit 315, a watermark generator 320, a menu generator 325, a device database 330, a command handler unit 335, and a device communicator unit 340.

[0035] In some embodiments, the server 120 including the device manager unit 250 can be present within the remote control unit 115. In other embodiments, the server 120 can be created using cloud computing.

[0036] The display device 105A has capability to render a digital watermark, hereinafter referred to as a watermark, or a quick response (QR) Code on its display screen along with video data. If peripheral devices, for example CD/DVD player and audio player, is connected to the display device 105A, the display device 105A can also show watermarks corresponding to the peripheral devices on the display screen of the display device 105A. The display device 105A further communicates to the device manager unit 250 via WiFi or Bluetooth for receiving the watermark and user commands. The display device 105A can also receive the user commands directly from the remote control unit 115.

[0037] The remote control unit 115 uses the image capture unit 305 to capture' input images. The frequency of the input image is set to a default value which can be modified by a user. To save power, the image capture unit 305 captures the input image only when motion is detected by a motion sensor of the remote control unit 115. The input images are sent to the server 120 for further processing. The device manager unit 250 in the server 120 provides a menu to be displayed based on identified display device, for example the display device 105A. The menu is displayed to the user of the remote control unit 115. The user commands can then be sent directly to the display device 105A or to the server 120 based on device capability. In some examples, communication can be performed via WiFi or Bluetooth. The display 230, for example a touch screen display, displays the menu received from the device manager unit 250 and will receive the user commands provided by the user.

[0038] The watermark detector unit 310 receives the input image from the image capture unit 305 and detects for presence of the watermark embedded in the input image. The watermark identifier unit 315 identifies validity of the watermark and generates a watermark identifier if the watermark is valid. The watermark generator 320 generates the watermark, based on a device identifier, for a display device that is newly connected. The watermark of the display device 105A is stored in the device database 330. The watermark is displayed on a screen of the display device 105A and is either invisible or partially visible to human eye. The menu generator 325 creates the menu for the display device 105A. The menu can either be fetched from the display device 105A or can be created by the user based on the device capability. The menu is further stored in the device database 330. The device database 330 includes maintains a list of the display devices controlled using the remote control unit 115, and also stores the watermarks and menus associated with the display devices.

[0039] A device identifier (ID) is generated and assigned to each of the display devices. Details of the display device 105A, including the device capability, the menu and the watermark can be queried from the device database 330 by providing the device identifier. The command handler unit 335 receives one or more user commands issued from the user of the remote control unit 115. The command handler unit 335 further identifies a communication mode and the display device, for example the display device 105A, to transmit the user commands. The device communicator unit 340 issues the user commands to enable communication between the display device 105A and the remote control unit 115. The device communicator unit 340 issues the user commands based on the device capability of the display device 105A fetched from the device database 330 and based on the communication mode, for example Bluetooth or WiFi.

[0040] FIG. 4 is a flowchart illustrating registration of the electronic display device, in accordance with one embodiment. The method starts at step 405.

[0041] At step 410, display devices that are available on a network are identified. The display devices, for example the display device 105A, can be identified by a server, for example the server 120.

[0042] At step 415, the device database, for example the device database 330, is searched and registration of the display device is checked.

[0043] At step 420, it is determined if the display device is already registered. If the display device is already registered the method stops at step 445.

[0044] If the display device is not registered, a device identifier (ID) is generated for the display device and stored in the device database, at step 425.

[0045] At step 430, a watermark is generated for the display device and stored in the device database.

[0046] At step 435, device capability is fetched from the display device and stored in the device database against a device identifier (ID).

[0047] At step 440, a menu is fetched from the display device or created based on the device capability.

[0048] The method stops at step 445.

[0049] FIG. 5 is a flowchart illustrating initialization of the electronic display device, in accordance with one embodiment. The method starts at step 505.

[0050] At step 510, the watermark is received from the server.

[0051] At step 515, it is determined if a device is a display device. If the device is the display device, step 520 is performed else step 530 is performed.

[0052] At step 520, the watermark is rendered on a screen of the display device. [0053] At step 525, the video data is subsequently rendered.

[0054] At step 530, it is determined if the device is connected to the display device or is a peripheral device.

[0055] At step 535, the watermark is then blended in a video stream such that the watermark is visible on the display device.

[0056] The method stops at step 540

[0057] FIG. 6 is a flowchart illustrating loading of menu of the electronic display device, in accordance with one embodiment. The method starts at step 605.

[0058] At step 610, a user of the remote control unit, for example the remote control unit 115, points the remote control unit to a display device.

[0059] In some embodiments, the user can also set priority of the display devices, based on frequency of usage, when the user is pointing towards multiple devices at one time. In such a case, the remote control unit displays the menu of the display device having a higher priority. If priority is not set, or the display devices have similar priority, then the user can be asked to select from available display devices.

[0060] At step 615, motion is detected in the remote control unit and an input image is captured. The input image can be captured by an image capture unit, for example the image capture unit 305.

[0061] At step 620, the input image is sent to the server.

[0062] At step 625, a watermark detector unit, for example the watermark detector unit 310, processes the input image and detects presence of the watermark.

[0063] At step 630, it is determined if the watermark is available in the input image. If the watermark is available in the input image, step 635 is performed else step 615 is performed.

[0064] At step 635, the device ID is acquired from a watermark identifier unit, for example watermark identifier unit 315.

[0065] At step 640, the menu is fetched from the device database based on the device ID.

[0066] At step 645, the menu is sent to the remote control unit.

[0067] At step 650, the remote control unit displays the menu on its screen.

[0068] The method stops at step 655.

[0069] FIG. 7 is a flowchart illustrating user operation, in accordance with one embodiment. The method starts at step 705.

[0070] At step 710, the user makes a selection from the menu of the remote control unit.

[0071] At step 715, a user command is sent to a command handler unit, for example the command handler unit 335, along with the device ID.

[0072] At step 720, the command handler unit validates the user command based on the device capability.

[0073] At step 725, it is determined if the user command is valid. If the user command is valid step 730 is performed else step 745 is performed.

[0074] At step 730, a device communicator unit, for example the device communicator unit 340, will determine a communication mode from the device capability.

[0075] At step 735, the device communicator unit transmits the user command to the display device.

[0076] At step 740, the display device performs the user command.

[0077] The method stops at step 745.

[0078] A method of controlling electronic display devices using digital watermarks is explained in detail in conjunction with FIG. 8.

[0079] FIG. 8 is a flowchart illustrating a method of controlling electronic display devices using digital watermarks, in accordance with one embodiment. The method starts at step 805.

[0080] At step 810, an input image of an electronic display device, for example the electronic display device 105A, is received from a remote control unit, for example the remote control unit 115. The input image is captured by an image capture unit, for example the image capture unit 305. The input image is captured when motion is detected in the electronic display device.

[0081] At step 815, the input image is processed to identify the electronic display device based on a digital watermark embedded in the input image. The digital watermark can be generated by a watermark generator, for example the watermark generator 320, based on a device identifier. The input image is received by a watermark detector unit, for example the watermark detector unit 305, to detect the digital watermark. Validity of the digital watermark is identified by a watermark identifier unit, for example the watermark identifier unit 310, and a watermark identifier is generated if the digital watermark is valid.

[0082] In some embodiments, if a peripheral device is connected to the display device, the watermark of the peripheral device is blended in a video stream of the electronic display device and rendered on a screen of the electronic display device.

[0083] At step 820, a menu of the electronic display device is provided to the remote control unit. The menu for the electronic display device is created by a menu generator, for example the menu generator 325. The menu and device capability is further fetched by the server by providing a device identifier.

[0084] In some embodiments, the remote control unit is able to display multiple menus in case multiple electronic display devices are identified at one time.

[0085] In some embodiments, the menu can be customized by the user based on the device capability.

[0086] At step 825, control of the electronic display device is enabled by a user of the remote control unit. The user views the menu on a display, for example the display 230, and can make a selection from the menu. In one example, the display is a touch screen display. The selection translates to a user command which is then sent to a command handler unit, for example the command handler unit 335. The user command is then issued by a device communicator unit, for example the device communicator unit 340, to enable communication between the electronic display device and the remote control unit. The electronic display device hence can be controlled by the user.

[0087] The method stops at step 830.

[0088] Advantageously, the embodiments specified in the present disclosure enable control of electronic display devices using digital watermarks. A single remote control unit can hence be used to control multiple devices, both display devices and peripheral devices, by only pointing to the multiple devices. The present disclosure also enables customization of the menu by a user. The present disclosure further allows existing electronic display devices to be controlled as wireless technologies, for example infrared, Bluetooth, and WiFi, are used.

[0089] In the preceding specification, the present disclosure and its advantages have been described with reference to specific embodiments. However, it will be apparent to a person of ordinary skill in the art that various modifications and changes can be made, without departing from the scope of the present disclosure, as set forth in the claims below. Accordingly, the specification and figures are to be regarded as illustrative examples of the present disclosure, rather than in restrictive sense. All such possible modifications are intended to be included within the scope of present disclosure.

I/We claim:

1. A method of controlling electronic display devices using digital watermarks, the method comprising:

receiving an input image of an electronic display device from a remote control unit;

processing the input image to identify the electronic display device based on a digital watermark embedded in the input image;

providing a menu of the electronic display device to the remote control unit; and enabling control of the electronic display device by a user of the remote control unit.

2. The method as claimed in claim 1, wherein the input image is captured by the remote control unit.

3. The method as claimed in claim 1, wherein processing the input image comprises:

detecting the digital watermark embedded in the input image, wherein the digital watermark is invisible to the user;

identifying validity of the digital watermark; and

generating a watermark identifier if the digital watermark is valid.

4. The method as claimed in claim 3 and further comprising:
generating the digital watermark, based on a device identifier, for an electronic display device that is newly connected; and

creating the menu for the electronic display device.

5. The method as claimed in claim 1 and further comprising:

maintaining a list of the electronic display devices controlled using the remote control unit; and
storing the digital watermarks and menus associated with the electronic display devices.

6. The method as claimed in claim 5 and further comprising performing registration of the electronic display device if the electronic display device is excluded from the list of the electronic display devices;

7. The method as claimed in claim 5 and further comprising:
generating the digital watermarks based on device identifiers;
creating the menus for the electronic display devices; and
displaying the digital watermarks corresponding to one or more peripheral devices on the display screen of the display device.

8. The method as claimed in claim 1, wherein enabling control of the electronic
display device comprises:

receiving one or more user commands, based on the menu, from the remote control unit;
identifying a communication mode and the electronic display device to transmit the one or more user commands; and
issuing the one or more user commands based on device capability of the electronic display device.

9. A system for controlling electronic display devices using digital watermarks, the system comprising:
a plurality of electronic display devices;

a remote control unit in communication with the electronic display devices to display menus;

a server that enables controlling of the electronic display devices by the remote control unit, the server comprising:
a memory that stores instructions; and

a processor responsive to the instructions to receive an input image of an electronic display device from a remote control unit;

process the input image to identify the electronic display device based on a digital watermark embedded in the input image;

provide a menu of the electronic display device to the remote control unit; and

enable control of the electronic display device by a user of the remote control unit;

a device manager unit that manages the electronic display devices; and a communication interface for establishing communication between the electronic display device and the remote control unit.

10. The system as claimed in claim 10, wherein the device manager unit further comprises:
a watermark detector unit that detects the digital watermark embedded in the input image;
a watermark identifier unit that identifies validity of the digital watermark and generates a watermark identifier if the digital watermark is valid;
a watermark generator that generates the digital watermark, based on a device identifier, for an electronic display device that is newly connected;
a menu generator that creating the menu for the electronic display device;
a device database that maintains a list of the electronic display devices controlled using the remote control unit, and stores the digital watermarks and the menus associated with the electronic display devices;
a command handler unit that receives one or more user commands; and
a device communicator unit that issues the one or more user commands to enable communication between the electronic display device and the remote control unit.