Sign In to Follow Application
View All Documents & Correspondence

"Method And System For Exchanging Data Between Computer Systems And Auxiliary Displays"

Abstract: Described is a system and method by which application programs running on a main computer system communicate with an auxiliary display device (such as a cell phone, pocket-sized computer, alarm clock, television, digital picture frame and so forth) to provide viewable information on the device, remote control capabilities, and notifications. Via API calls, programs provide information in the same format regardless of the device capabilities and/or the connection type. An auxiliary display platform converts the information into a format understood by a device driver, which then filters the information as desired for its particular hardware device before the information is communicated. Return communications return data such as status and user interaction with the displayed information. Software vendors may thus write code once to output information on auxiliary displays, while hardware manufacturers can have their devices work as auxiliary displays, with little or no modification to existing hardware.

Get Free WhatsApp Updates!
Notices, Deadlines & Correspondence

Patent Information

Application #
Filing Date
17 November 2005
Publication Number
40/2009
Publication Type
INA
Invention Field
COMPUTER SCIENCE
Status
Email
Parent Application
Patent Number
Legal Status
Grant Date
2023-01-31
Renewal Date

Applicants

MICROSOFT CORPORATION
ONE MICROSOFT WAY, REDMOND, WASHINGTON 98052, U.S.A.

Inventors

1. ANDREW J. FULLER
ONE MICROSOFT WAY, REDMOND, WA 98052, U.S.A.
2. DANIEL J. POLIVY
ONE MICROSOFT WAY, REDMOND, WA 98052, U.S.A.
3. MATTHEW P. RHOTEN
ONE MICROSOFT WAY, REDMOND, WA 98052, U.S.A.
4. MICHAEL S. BERNSTEIN
ONE MICROSOFT WAY, REDMOND, WA 98052, U.S.A.
5. ROGER H. WYNN
ONE MICROSOFT WAY, REDMOND, WA 98052, U.S.A.

Specification

METHOD AND SYSTEM FOR EXCHANGING DATA BETWEEN COMPUTER SYSTEMS
AND AUXILIARY DISPLAYS
FIELD OF THE INVENTION
The invention relates generally to computer systems, and more particularly to an improved system and method for communicating information between a computer system and an auxiliary device
BACKGROUND OF THE INVENTION
United States Patent Applications Serial Nos 10/429,930 and 10/429,932 are generally directed towards the concept of computer systems having auxiliary processing and auxiliary mechanisms that provide some auxiliary computing functionality For example, a small LCD on the lid or side of a laptop computer can provide its owner with useful information, such as a meeting location and time, even when the main computer display is not easily visible, e g , when a laptop computer's lid is closed and/or the mam computer is powered down Controls such as buttons may be provided to allow the user to interact with the auxiliary device to view different types of data, such as to scroll through appointments among calendar data, read email messages, read directions, and so forth
Somewhat similar to an auxiliary LCD screen built into a mobile host computer, a mobile telephone, a music playing device, a pocket-sized personal computer, a personal digital assistant and so forth can serve as an auxiliary device to a main computer when connected to it physically and/or via a wireless (e g , Bluetooth or infrared) link, as long as the device is programmed to allow its display and/or other functionality to be leveraged by the main computer In general, any device with I/O capabilities that can interface in virtually any way with a computer system can potentially serve as an auxiliary computing device
However, there are many varieties of devices that can serve as an auxiliary display for a computer system For example, some devices can connect to a computer system via a hardwired connection such as USB, while other devices connect via wireless protocols such as 802 11, 802 16 or Bluetooth Some, such as "smart" mobile phones and pocket-sized computing devices provide reasonably good graphics, available memory, and may be already arranged to connect to a host computer system in some way Other devices are more limited, however, and may, for example, only provide a single line of text, lights, and/or audio At the same time, there are many types of software programs that run on a main computer system and
would benefit from being able to output information to an auxiliary display
What is needed is a way for manufacturers of hardware devices that can be used as auxiliary displays to interface with a host computer system, m a manner that requires little if any change to contemporary hardware devices At the same time, such a solution should allow application programs to be written to use auxiliary displays, independent of the type of auxiliary display device actually m use
SUMMARY OF THE INVENTION
Briefly, the present invention provides a system and method by which application programs running on a mam computer system communicate with an auxiliary display device (such as a cell phone, pocket-sized computer, clock, television, digital picture frame and so forth) to provide viewable information on the device, remote control capabilities, and notifications To this end, application programs and the like such as written by independent software vendors communicate with an auxiliary display platform via an application programming interface (API) set, which in turn converts the information as needed into a format understood by a device driver of an auxiliary computing device The device
driver filters the information as desired and formats it for its particular hardware device, which may be coupled to the system via any wired or wireless connection The device driver forwards the data to an appropriate hardware interface for communicating to the auxiliary device A return communication path from the auxiliary device to the main computer system is also provided
By abstracting out the type of auxiliary device and/or how it is connected, only a predefined protocol and data format are needed for a program to communicate with a wide variety of devices, that likely have different capabilities To utilize an auxiliary display, an independent software vendor simply calls the API to the auxiliary display platform, providing a parameter (or parameters) corresponding to data in an agreed upon format for the API Thereafter, the data is converted to a format understood by a device driver that interfaces with the auxiliary display platform, whereby the device driver may adjust the information as needed before forwarding it to transport hardware interfaces for communication to its corresponding auxiliary device
In one alternative, a hardware vendor may choose to implement Microsoft -based firmware (eg, comprising a TmyCLR-based firmware stack) and thereby guarantee that the user will receive a full auxiliary device experience For
example, if configured with the TmyCLR-based firmware stack, little if any filtering is required, as any program data provided via the API is known to be capable of being handled by the auxiliary device The data is communicated via an agreed upon format / protocol, and thus the device driver and/or the API layer need only convert the application program-provided data to the appropriate format and forward it according to the protocol to the hardware transport Because the type of auxiliary device is known to have an appropriate firmware stack, the format may be proprietary
In another alternative, a possibly-reduced (but still valuable) experience is available to those devices having simpler needs and capabilities with respect to handling the program data, provided via the same API To this end, device drivers that run on the main computer system implement defined hardware interfaces to seamlessly extend the auxiliary display platform to any type of auxiliary device Components above the device driver may filter and/or convert the ISV-supplied data, such that the data is provided to the device driver in a predefined format that the device driver understands The device driver may also filter the data as appropriate for its corresponding auxiliary device, e g , to remove graphics from data for its corresponding auxiliary device when such a device is only capable of displaying text Hardware devices capable
of running code may choose to have some or virtually all of the device driver functionality run on the device instead of in the device driver on the main computer
Note that much of the interface/wire protocol used by the device drivers to provide the data to a hardware transport interface may be defined to be the same regardless of the connection mechanism being used As a result, device drivers may share a certain amount of code, even though the actual connection mechanism may be different By using this mechanism, devices appear to work consistently regardless of how they are attached
In addition to working with auxiliary displays such as mobile telephones and secondary computers, the present invention may be used to extend the ability of the main computer system to communicate with previously single-purpose devices, such as televisions, radios, other media players, digital image-based picture frames, clocks including watches and alarm clocks, and so forth With some software and little or no hardware additions, such existing devices may easily expand their utility by allowing them to integrate with a main computer system The platform is extensible in hardware and software to enable such scenarios At the same time, the task of communicating with an auxiliary device from the perspective of independent software vendors is greatly simplified because
application program code only needs to be written once to have it run on a wide variety of devices, with no additional work required to adapt the program for different auxiliary devices Other advantages will become apparent from the following detailed description when taken m conjunction with the drawings, in which
BRIEF DESCRIPTION OF THE DRAWINGS
FIG 1 is a block diagram representing a general purpose computing device in the form of a conventional personal computer system into which the present invention may be incorporated,
FIGS 2A-2E are exemplary illustrations generally representing locations for placement of the auxiliary display on various devices,
FIG 3 is a block diagram generally representing an example layered architecture by which application programs can exchange data with the firmware of an arbitrary auxiliary display device in accordance with an aspect of the present invention,
FIG 4 is an example representation of how m one implementation, an auxiliary-aware application program interfaces with the auxiliary display platform to exchange

data with multiple auxiliary display devices, in accordance with an aspect of the present invention, and
FIG 5 is an example representation of how m one implementation, an auxiliary-aware application program interfaces with the auxiliary display platform to exchange data with a basic auxiliary display device, in accordance with an aspect of the present invention, and
FIG 6 is an example representation of how in one implementation, an auxiliary-aware application program interfaces with the auxiliary display platform to exchange data with an enhanced auxiliary display device, m accordance with an aspect of the present invention
DETAILED DESCRIPTION
EXEMPLARY OPERATING ENVIRONMENT
FIG 1 is a block diagram representing a computing device 120 m the form of a personal computer system into which the present invention may be incorporated Those skilled m the art will appreciate that the personal computer system 120 depicted in FIG 1 is intended to be merely illustrative and that the present invention may be practiced with other computer system configurations, including hand-held devices, multi-processor systems, microprocessor-based or programmable consumer electronics, network PCs, minicomputers, mainframe
computers, headless servers and the like The invention may also be practiced m distributed computing environments where tasks are performed by remote processing devices that are linked through a communications network In a distributed computing environment, program modules may be located in both local and remote memory storage devices
The personal computer system 120 included a processing unit 121, a system memory 122, and a system bus 123 that couples various system components including the system memory to the processing unit 121 The system bus 123 may be any of several types of bus structures including a memory bus or memory controller, a peripheral bus, and a local bus using any of a variety of bus architectures The system memory includes read-only memory (ROM) 124 and random access memory (RAM) 125 A basic input/output system 126 (BIOS), containing the basic routines that help to transfer information between elements within the personal computer 120, such as during start-up, is stored in ROM 124 The personal computer 120 may further include a hard disk drive 127 for reading from and writing to a hard disk, not shown, a magnetic disk drive 128 for reading from or writing to a removable magnetic disk 129, and an optical disk drive 130 for reading from or writing to a removable optical disk 131 such as a CD-ROM or other optical media The hard disk drive 127, magnetic disk drive 128, and
optical disk drive 130 are connected to the system bus 123 by a hard disk drive interface 132, a magnetic disk drive interface 133, and an optical drive interface 134, respectively The drives and their associated computer-readable media provide non-volatile storage of computer readable instructions, data structures, program modules and other data for the personal computer 120 Although the exemplary computer system described herein employs a hard disk, a removable magnetic disk 129 and a removable optical disk 131, it should be appreciated by those skilled m the art that other types of computer readable media which can store data that is accessible by a computer, such as magnetic cassettes, flash memory cards, digital video disks, Bernoulli cartridges, random access memories (RAMs), read-only memories (ROMs) and the like may also be used in the exemplary computer system
A number of program modules may be stored on the hard disk, magnetic disk 129, optical disk 131, ROM 124 or RAM 125, including an operating system 135 (such as Windows® XP), one or more application programs 136 (such as Microsoft® Outlook), other program modules 137 and program data 138 A user may enter commands and information into the personal computer 12 0 through input devices such as a keyboard 140 and pointing device 142 Other input devices (not shown) may include a
microphone, joystick, game pad, satellite dish, scanner or the like These and other input devices are often connected to the processing unit 121 through a serial port interface 146 that is coupled to the system bus, but may be connected by other interfaces, such as a parallel port, game port or universal serial bus (USB) A monitor 147 or other type of display device is also connected to the system bus 123 via an interface, such as a video adapter 148 In addition to the monitor 147, personal computers typically include other peripheral output devices (not shown), such as speakers and printers An auxiliary display 200 is an additional output device, and may, for example, be connected to the system bus 123 via an auxiliary display interface 155 An auxiliary display 101 may also connect to a computing device 20 through a serial interface or by other interfaces, such as a parallel port, game port, infrared or wireless connection, universal serial bus (USB) or other peripheral device connection An input device 2 01 m FIG 1 may provide one or more actuators to interface with and/or control the auxiliary display 200, and for example may be part of the auxiliary display device, but alternatively may be independent thereof and connected to the system bus 123 via input device interface 156, which may be a serial interface, or by other interfaces, such as a parallel port, game port, infrared or wireless connection,
universal serial bus (USB) or other peripheral device connection
The personal computer 120 may operate in a networked environment using logical connections to one or more remote computers, such as a remote computer 14 9 The remote computer 149 may be another personal computer, a server, a router, a network PC, a peer device or other common network node, and typically includes many or all of the elements described above relative to the personal computer 120, although only a memory storage device 150 has been illustrated m FIG 1 The logical connections depicted m FIG 1 include a local area network (LAN) 151 and a wide area network (WAN) 152 Such networking environments are commonplace m offices, enterprise-wide computer networks, Intranets and the Internet
When used m a LAN networking environment, the personal computer 120 is connected to the local network 151 through a network interface or adapter 153 When used m a WAN networking environment, the personal computer 120 typically includes a modem 154 or other means for establishing communications over the wide area network 152, such as the Internet The modem 154, which may be internal or external, is connected to the system bus 123 via the serial port interface 14 6 In a networked environment, program modules depicted relative to the personal computer 120, or portions
thereof, may be stored in the remote memory storage device It will be appreciated that the network connections shown are exemplary and other means of establishing a communications link between the computers may be used
It should be noted that the computer system need not be fully operational for an auxiliary device to work m accordance with the present invention Indeed, an auxiliary device may still work when the computer is powered down, at least to a default extent or to an extent configured by a user, such as when the computer system is m a sleep state or a hibernate mode, and/or when the user has not yet logged on or is otherwise locked out of the system via security mechanisms
The auxiliary device may supplement the mam display and may also serve as a surrogate display when the mam display is shut down or otherwise not operational (e g , disconnected), to give the user some information For example, information such as how to power up the mam display might be helpful, as would a room number and/or directions to a meeting on an auxiliary display device connected to a mobile computer that the user can view when the mam display is off and/or not easily visible (e g , the lid of a laptop is closed) The auxiliary device may play audio and/or video, show images, show calendar information, show emails and so forth
To enable and control communication in these powered-down modes, firmware may exist, stored in non-volatile memory, which when loaded and operated on by a secondary processor, enables the auxiliary display, along with other auxiliary components to be used, as long as some power is available Note that as used herein, the terms "firmware" and "device hardware" are essentially equivalent, and can be generally considered as representing the auxiliary memory, the code therein and/or the secondary processor on which it runs
FIGS 2A-2E illustrate exemplary locations on or associated with computing devices for placement of auxiliary display screens 200a-200e, respectively As represented in FIGS 2A and 2B, an auxiliary display screen 200a may be placed on the front, back or other surface of a standalone (landlme or mobile) phone 202, (which need not be physically coupled if otherwise linked such as via Bluetooth technology) and/or another auxiliary display screen 200b placed on the edge or lid of a mobile computer 204 or tablet computing device (not shown) Another place for an auxiliary display screen 200c (FIG 2C) may be on a phone mounted on a computer or a peripheral device attached to a computer such as on monitor 206 or on a keyboard (not shown) FIGS 2D and 2E illustrate additional placements of auxiliary display screens 200d and 200e on the front panel of a standalone console 208 connected
to a computer, or some other housing 210 (such as a housing for the motherboard), respectively Those skilled in the art will appreciate that an auxiliary display screen may be placed on any surface of any computing device or other device having display capabilities, such as placed on a watch with a wireless or other connection to a computer, on a remote control device, on a remote wall-mounted unit, and so forth Indeed, the auxiliary display need not be physically close to the main computer system, as the connection may be over a LAN or WAN, or even over the internet
As should be apparent from FIGS 2A-2E, an auxiliary display may be in the form of any number of known types of displays such as one or more LEDs, a 2-hne alphanumeric display, a monochrome display, or a color display Those skilled in the art will appreciate that the present invention may also use the display of other computing or communication devices as the auxiliary display 200 These other computing or communication devices include general purpose computers, cell phones, and handheld devices such as a pager or a personal digital assistant (PDA) Additionally, the present invention may use a virtual auxiliary display implemented within an area of the onscreen display of the computing device 120 (eg a screensaver or a component of the graphical user interface) as the auxiliary display 200, including before a user has logged
in The auxiliary display 200 may include a combination of any of the forms described above, and also be physically or logically combined with indicators such as one or more LEDs and/or used in conjunction with a virtual auxiliary display
An auxiliary device may provide functionality even without a screen, or when its screen is powered down For example, an auxiliary device may play audio, collect data (e g , for later download to the main computer), perform calculation and so forth Also, the display may comprise one or more LEDs or the like rather than a full screen Thus, although many benefits and advantages arise from having an auxiliary display screen, and thus an auxiliary device may be referred to herein as an auxiliary display, a display is not required In general, an auxiliary display, as referred to herein, may be composed of essentially anything that can be sensed, including any visual, audible, and/or tactile representations
EXCHANGING DATA WITH AUXILIARY DISPLAYS
The present invention is generally directed towards communication with auxiliary devices, such as to provide notifications and other content for display on the auxiliary device display, and possibly to obtain return information from the display, such as based on user interaction with the
auxiliary device As will be understood, there are many types of devices that can serve as an auxiliary display device, including those that do not necessarily have displays but can provide some output such as a sound or light Although a number of examples are used herein, including displays on laptop lids, mobile phones, pocket-sized personal computers, digital image-based picture frames, kitchen displays, televisions, media players, clocks including alarm clocks, watches and so forth, the present invention is not limited to any of these examples, but rather anticipates the use of any device capable of outputtmg sensory information, even when referred to as an auxiliary "display " For example, other types of devices include auxiliary devices embedded within or using the main display of a consumer electronics device, (such as a refrigerator, home theater receiver, DVD player, and so forth), wall displays, automotive, transportation or other vehicular units (e g , using displays already in a car/tram/plane as an auxiliary display) , keyboards or other input devices of the main computer system, PDAs (including non-cellular telephone PDAs), and the like
Similarly, the present invention is not limited to any particular mechanism for coupling the auxiliary display to another computer system, and thus is not limited to the wired or wireless examples used herein The connection may be
relatively close or relatively distant, essentially anywhere, such as over a LAN or WAN, or over a virtual private connection over the Internet
Turning to FIG 3 of the drawings, there is shown an example architecture that exposes auxiliary devices 300 and/or 301 to clients comprising application programs 302 and other programs (e g , operating system components) via an auxiliary display API set 304 The API 304 provides APIs for various functions, including registering a client application 306 (a component of the program or possibly the program itself) with the system, sending content to the attached devices, sending notifications to the attached devices, and receiving events from the attached devices Events may include navigation events, content request events, content change events, and so forth
In keeping with an aspect of the present invention, the use of the API set 304 exposes only an "auxiliary display system" to the clients, there is no direct access to individual devices As a result, for an independent software vendor, after registering a program component as a client application (via the API set 304), content may be sent to any auxiliary device using another call to the same API set 304, regardless of the device's actual type and capabilities Although the user experience may differ, the program need not
adapt to the auxiliary device that is present Note that while an application program can obtain capability information about the auxiliary device, and may choose to act differently based on the capabilities, the application program need not do so in order to use the device This is because the present invention provides an architecture that handles further communications, freeing the application program from the complex tasks including tailoring data to any particular device
The API layer 304 is written on a portable device API set 310, which communicates with the device's driver process via user-mode driver framework 312 The portable device API set 310 maps the auxiliary display into a category of portable devices and it allows enumeration of the device's capabilities This is encapsulated within the user-mode driver, however, and not exposed to the client application 306
In general, the client application 306 sends notifications directly to the auxiliary device The device is capable of displaying notifications, as well as generating its own notifications based on the data provided from the main computer system Other (optional) components shown in FIG 3 include a notifications client 316 that can provide notifications on the auxiliary display For example, even
when an application program such as a calendar program is not running, it may be desirable to provide scheduled notifications corresponding to that program, the notifications client 316 enables such scenarios Note that as described below with reference to FIGS 4-6, the components below the application layer and above the device drivers 324 and 325 may be generally referred to as the "auxiliary display platform " Turning to the hardware vendor's perspective, in general, each auxiliary display vendor provides a corresponding auxiliary device driver 324, although if the device is built in a certain way, the device driver may be supplied by the provider of the auxiliary display platform More particularly, as described below, certain types of auxiliary devices are considered "enhanced" displays because they are configured with certain firmware that among other things is generally compatible with any information that can be received via the APIs 304 For such devices, the device driver 325 may be generic, (and thus may be provided by the auxiliary display platform provider), generally operating to perform some straightforward tasks, such as to convert the API-received information to a proprietary format understood by the auxiliary device firmware For other auxiliary devices, referred to herein as "basic" displays, the driver needs to be compatible with the device's capabilities, and thus the
auxiliary display vendor needs to provide a driver customized to that device or class of devices
In any event, the user mode driver framework provides a device driver interface (DDI) for coupling device drivers (e g , 324 and 325) to the auxiliary display platform The drivers then forward data corresponding to the API-received information to an appropriate hardware interface (transport) for communication to the auxiliary display device For example, in FIG 3, the basic device driver 324 is shown as forwarding data (via a previously defined protocol) to the remote stack and driver 327 for wireless (e g , Bluetooth, Wi-FI, AM/FM infrared and so forth) communication to the device 300, whereas the enhanced device driver 325 is shown as forwarding data to USB-based hardware 328, although other types of transports including network transports such as TCP/IP-based transports are feasible As is understood, these connections are only shown for example purposes, as any device driver will forward data for wireless or wired communication as appropriate
Note that as represented in FIG 4, multiple devices may be coupled to a computer to serve as an auxiliary display at the same time A user may configure (e g , via a control panel or the like of a system data providers component 308) which client applications' data are displayed on which
devices The system data provider 308 also supplies system information such as time data, wireless signal strength data, the computer's audio volume and mute state, and/or battery level data to auxiliary displays In one implementation, the auxiliary display platform 430 consults a system-maintained matrix 432 whenever a client application 306 sends content, to determine which device or devices are to receive the information Some translation of content for different device types may occur at this level, as well as possibly at other levels above the device driver level and m the device driver, as described below The API of the auxiliary display platform 430 will also send events and the like from auxiliary devices to the application client application, again using the matrix to route the events back to the client application (or client applications) as appropriate
As described below, some of the content that may be downloaded to an auxiliary device comprises notifications When a user dismisses a notification on one auxiliary device, the user generally wants that notification dismissed on other auxiliary devices (an option which may be user-configurable) To this end, when the return information communicated from an auxiliary device indicates that a particular notification was dismissed, the auxiliary display platform sends a dismissal
instruction to each other auxiliary devices to which that notification had been routed
Turning to FIGS 5 and 6, an "enhanced" display is one that runs a particular firmware stack known to the auxiliary display platform For example, m one present implementation, such a firmware stack includes a TinyCLR component and supports TinyCLR object serialization A basic display is any display that does not run a stack known to the auxiliary display platform
FIG 5 is a representation of components for using a basic display 500 as an auxiliary display In general, the program 302 makes an API call to the auxiliary display platform 430 as described above The auxiliary display platform 430, which knows which device (or devices) to send the auxiliary information, also knows whether each device is an enhanced display or a basic display In this example, the device is a basic display 500, and thus the auxiliary device transfers the data, provided m a basic content format as an API parameter, that any basic device driver supports
One such basic content format is XML-based, and thus the basic device driver 550 needs to be able to parse XML If desired, a library 552 including functionality that calls to a system XML parser may be leveraged by the device driver The device driver 550 filters and/or transforms the information as
necessary for its particular device, and forwards it to a transport for communication to the basic auxiliary display device
As can be seen, the platform is extensible such that basic devices are supported with little or no changes In general, the only component necessary is a device driver for that specific device
In some instances, basic devices may be run with no firmware/software changes to the device For example, certain devices already respond to modem commands (GSM AT) and can output data Thus, device driver 550 (or possibly a higher-level component) may transform the data and insert appropriate modem commands, whereby the auxiliary device will display data with no hardware change or reprogrammmg necessary Any other format and/or defined interaction mechanism that other devices already support may be similarly used
However, this is not always possible, and thus some auxiliary devices will need additional firmware to work as an auxiliary display Note that some auxiliary devices allow code to be downloaded and run on the device In any event, m order to function as an auxiliary display, it is up to the device vendor to decide what capabilities to provide with a basic device, and how to divide functionality between the
device driver (also typically provided by the device vendor) and the device firmware
As is understood, there are thus at least two levels at which data may be converted, filtered and/or transformed before being communicated to the basic auxiliary display 500, namely in the auxiliary display platform and in the device driver 550 As one general goal is to make the program's API calls independent of any particular device type, the converter may thus need to vary depending on the device's capabilities, as device drivers are typically intended to be kept relatively small
As one example, notifications should generally use the same notification API from the perspective of the program 302 regardless of device capabilities Thus, a title, text and optional information such as images, icons, buttons, menus and so forth may be specified as parameters Devices not capable of graphics will have the information stripped of anything other than the text, and even the text may be modified to fit a particular device display, such as by alternating lines over time
As another example, an API is provided for content download, such as to populate a cache on the device In the event that the device does not have a cache and defined navigational framework, the auxiliary display platform can
provide a navigational framework, performing tasks such as fetching a next item upon request, supplying a different bitmap that corresponds to a different page upon a link being selected, and so forth
Turning to FIG 6, for an enhanced device 600, essentially the only requirement is to establish a data pipe and pass in serialized objects, e g , via a serializer 640 A user-mode driver may work for all enhanced displays, regardless of connection type, however it is likely more straightforward to use one driver per device per connection type In any event, the driver 660 is responsible for translating the API-provided data and commands into something that the TmyCLR-based device is capable of understanding In general, because the firmware operation is well-known to the provider of the auxiliary display platform, the objects that are passed can be essentially anything that the auxiliary display platform, enhanced device driver and enhanced device agree upon
Content will generally be downloaded to a cache on the enhanced device, and the device itself will then handle the content as desired Note that this allows for disconnected usage, as well as having multiple applications running on the system provide content, with one application being run at a time to access the cached content on the auxiliary display
Notifications will impose on the current running application, by design Notifications may be arranged for presentation in any suitable ordering, such as in a FIFO (first-in first-out) manner, although as can be readily appreciated, there may be a different priority among types of notifications (e g , urgent, recent and so forth may be given a higher priority than a regular or old notification)
In one implementation, represented m FIG 6, to navigate and display cached content, device applications 669 and a shell program 670 run on a TmyCLR framework 674 and component 676, which interprets, navigates, and displays the data In general, the shell program 670 provides a home page, non-client area (an area on the device's screen which is always visible when the display is on no matter what other content is being displayed on the device, typically used to display commonly needed things, such as a clock, a battery indicator, a network indicator), menus and the general look and feel of the auxiliary display device The data provided may be m the form of or modified into a directed graph of screens, each of which is a visual tree of TmyCLR View objects rooted by a TmyCLR Form object The shell layer receives button events from the lower layers of the firmware, interprets them, and navigates around in the data as appropriate The shell program 670 also accepts notification requests from the mam
computer system via the auxiliary display platform as described above, and issues requests to the main computer system to provide new content when it learns from the caching manager 672 that content is needed (e g , missing) The shell program 670 also displays timed notifications, which can occur when the main computer system is not connected
The offline caching manager 672 comprises an assembly, written on top of the TinyCLR 676, which manages the cache of data items stored on the device This component also performs some memory management, dealing with the fact that system application programs may provide more data than the device can store If the firmware modifies the data cache, this component tracks that information, and posts events to the application program on the system to let it know either immediately if the main computer system is online, or if not online, when the machine comes back online The cache manager may be exposed to the driver 660 via an interface
It should be noted that auxiliary devices may be configured by their manufacturer to have expanded capabilities beyond those described above To this end, one or more hardware components may be added, along with a driver in the stack to expose any new components to the auxiliary device and the rest of the auxiliary display platform Such hardware extensions are described m copending U S Patent application
entitled "Extensible Architecture for Auxiliary Displays" filed concurrently herewith and incorporated by reference herein
As can be seen from the foregoing, the present invention provides an auxiliary display platform by which application programs may be written to communicate information to auxiliary displays, independent of the type of auxiliary display device actually m use At the same time, the auxiliary display platform enables manufacturers of hardware devices to have those devices used as auxiliary displays with little if any change to the hardware The present invention thus provides numerous benefits and advantages needed in contemporary computing
While the invention is susceptible to various modifications and alternative constructions, certain illustrated embodiments thereof are shown m the drawings and have been described above in detail It should be understood, however, that there is no intention to limit the invention to the specific form or forms disclosed, but on the contrary, the intention is to cover all modifications, alternative constructions, and equivalents falling within the spirit and scope of the invention

We claim:
1. In a computing environment, a system comprising:
a main computer system comprising a principal electionic display device
for displaying text and images ieceived to a user;
an auxiliary electronic display device which is secondary to the principal electionic display device and which lias reduced display capabilities with respect to the piincipal electionic display such that it is secondary to the principal electronic display, and which is configured to display at least one of text or images received from the main computer system to the user; and
an auxiliary platfomi on the main computet system, the auxiliary platform including,
a) an application interface that receives calls firom a program
running on the main cornputei system, including a call having a set of at
least one parameter corresponding to infbimation to communicate to the
secondary, auxiliaiy electionic display device, the information including
content for display on the secondary, auxiliary electronic display device,
the set of at least one parameter being independent of* any particular
auxiliary device hardware; and
b) a device driver interface that couples the auxiliary platform to a
device driver associated with the auxiliary electronic display device, the
device driver associated with the auxiliary electronic display device being
capable of removing at least some of the content to communicate to the
auxiliary electronic display device so as to produce a filtered set of content
less than that produced by the computer program for display on the
auxiliary electionic display device; and
wherein the auxiliary platform converts the content into a format understood by the device driver.
2„ The system of claim 1 wherein the auxiliary electionic display device comprises a mobile communications device
3 The system of claim 1 wherein the auxiliary electronic display device comprises a device from among a set of device types containing: a separate computer; a secondary display screen with button actuators; a watch; a wall display; a display scieen; a digital picture ftame; a clock; a television; a radio; a media player; a device embedded within or using the main display of a consumer electionics device; automotive, transportation or other vehicular' units; keyboaids or other input devices of the main computer system; a pager; or a personal digital assistant
4 Ihe system of claim 1 wherein the auxiliary electronic display device includes firmware capable of processing the infoimation when received in a proprietaty format
5 The system of claim 1 wherein the auxiliary platform converts the information into a markup language-based format understood by the device driver oi by firmware on the auxiliary electronic display device..
6. The system of claim 1 wherein the information corresponds to a notification.
7 The system of claim 1 wherein at least part of the content corresponds to an image to display on the auxiliary electronic display device
8 The system of claim 1 wherein at least part of the content corresponds to text to display on the auxiliary electronic display device.
9. The system of claim 1 wherein a second auxiliary device is connected to the computei system, and wheiein the auxiliary platform maintains a data structure that contains data as to which auxiliaiy device oi devices the information is to be routed for the program tunning on the main computer system..
10 The system of claim 9 wherein the call includes data that indicates that the information is to be routed to the second auxiliary device, wheiein the second auxiliary device includes a corresponding device driver for the second auxiliaiy device, and wheiein the auxiliaiy platfoirn routes the infoimation to the device driver for the second auxiliary device.
11. The system of claim 1 wheiein the auxiliaiy electronic display device is coupled to the device driver via a wireless connection to the main computei' system.
12. The system of claim 1 wherein the auxiliary electronic display device is coupled to the device driver via a wired connection to the main computei system.
13. The system of claim 1 wherein the device driver sends return information to the auxiliary platform in response to the information forwarded for communication to the auxiliary electronic display device..
14. The system of claim 13 wheiein the return infoimation corresponds to user interaction with the auxiliaiy electronic display device..
15. The system of claim 1, wherein the auxiliary electronic display device is configured to display at least one of text or images to the user when the main computer system is powered down
16 The system of claim 1, wherein the auxiliary electronic display device is an enhanced auxiliary display compatible with any information that can be received via the auxiliary platform, arid wherein the device driver is a generic device driver.
17 In a computing environment, a method comprising:
receiving calls from a computer program ninning on a main computer system, including a call having a set of at least one associated parameter that corresponds to information to communicate to an auxiliary electronic display device, the information including content for display on the auxiliary electronic display device and the set of at least one parameter being independent of any particular auxiliary electronic display device hardware, and wherein the main computer system includes a main electronic display device for displaying text and image content to a user; and wherein the main computer system is coupled to the auxiliary electronic display device having reduced display capabilities with regard to the main electronic display, such that the auxiliary electronic display device is secondary to the main electronic display device and capable of displaying at least one of text or image content received from the main computer system to the user;
accessing the mformation to communicate to the auxiliary electronic display device;
determining that the auxiliary electronic display device has reduced display capabilities and a device driver for the auxiliary electronic display device removing at least some of the content of the information so as to pioduce a
filtered set of content less than that produced by the computet program for display on the auxiliary electronic display device;
converting the filtered set of content to a foimat undeistood by the auxiliaiy electronic display device; and
communicating data corresponding to the filtered set of content to the auxiliaiy electronic display device
18, The method of claim 17 further comprising, displaying the filtered
set of content on the auxiliary electronic display device
19. The method of claim 17 wherein the calls are received at an
auxiliary platform, and further comprising, making the call to the auxiliary
platform.
20 1 he method of claim 17 wherein converting the filtered set of content to a format undeistood by the auxiliary electronic display device comprises converting the filtered set of content into a markup language-based format
21, The method of claim 17 wherein converting the filtered set of content to a foimat understood by the auxiliary electronic display device comprises converting the filtered set of content into a proprietary format
22 The method of claim 17 wherein communicating data conesponding to the filtered set of content comprises sending notification data,
23, The method of claim 17, wherein converting the filtered set of content comprises changing image information.
24 The method of claim 17 wherein a second auxiliary device is connected to the main computer system, and fiuther comprising, accessing routing information to determine whether to communicate the data corresponding to the filtered set of content to the second auxiliary device,,
25 The method of claim 17 further comprising, receiving return inforaiation from the auxiliary electronic display device.
26. The method of claim 25 wherein the return information corresponds to user interaction with the auxiliary electronic display device, and further comprising, communicating other data to the auxiliary electronic display device based on the user interaction therewith.
27 The method of claim 17 furthei comprising, receiving return information from another auxiliary device,.
28 The method of claim 27 wherein the return information corresponds to dismissal of a notification on the other auxiliary electronic display device, and further comprising, communicating additional data to the auxiliary electronic display device based on the return information to dismiss a corresponding notification on the auxiliary electronic display device
29 The method of claim 17, further comprising determining that the main electronic display device is not operational and, in response, communicating the filtered set of content to the auxiliary electronic display device.
30. The method of claim 17, wherein the auxiliary electronic display device is a virtual auxiliary display within an area of the main electronic display device
31. The method of claim 22, wherein the notification data is scheduled uotification data, and wherein the method further comprises caching the scheduled notification data on the auxiliary electronic display device for display to the user even if the computer program is not running

32 The method of claim 17, wherein the auxiliary electronic display device is incapable of displaying graphics, and wherein the device driver removing at least some of the content of the information so as to produce a filtered set of content less than that produced by the computer program for display on the auxiliaiy electronic display device comprises removing all graphics from the content
33 The method of claim 17, wherein removing at least some of the content of the information so as to produce a filtered set of content less than that produced by the computer program for display on the auxiliary electronic display device comprises reducing an amount of text content which is presented to the user using the auxiliary electronic display device.
34. The method of claim 24, wheiein the data corresponding to the information is an event notification, the method further comprising:
displaying, to the user, the event notification on the auxiliary electronic display device;
receiving, at the auxiliary electronic display device, user input directing handling of an event cotresponding to the event notification; and
sending to the main computer system, from the auxiliary eleclronic display device, information indicative of the user input directing how to handle the event,
35 The method of claim 34, wherein the user input directing handling of the event comprises receiving user input dismissing the event and wherein the method further comprises sending a dismissal to the second auxiliary device
36 At least one computer-readable medium having computer-executable instructions which when executed perform the method of claim 17,,
37. At least one computer-readable medium having computer-executable instructions which when executed perform a method, comprising:
receiving calls from a computer piograrrt running on a main computer system, including a call having a set of at least one parameter corresponding to information to communicate to an auxiliary electronic display device, the information including content for display on the auxiliary electronic display device and the set of at least one parameter being independent of any particular auxiliary electronic display device hardware, and wherein the main computer system includes a main electronic display device for displaying text and image content to a user, and wherein the main computet system is coupled to a plurality of auxiliary electronic display devices, the auxiliary electronic display devices having reduced display capabilities with regard to the main electronic display, such that the auxiliary electronic display devices are each secondary to the main electronic display device and capable of displaying at least one of text or images received from the main computer system to the user, wherein at least one of the auxiliary electronic display devices is positioned to display content independent of the main electronic display;
determining to which of a plurality of types of auxiliary electronic display devices the infoimation should be communicated, and for each such auxiliary electronic display device;
a) accessing the infoimation to communicate to the auxiliary electronic display device;
b) determining that the auxiliary electronic display device has reduced display capabilities and using a device driver specific to the auxiliary electronic display device to remove at least some of the content so as to produce a filtered set of content less than that produced by the computer program for display on the auxiliary electronic display device;

c) converting the filtered set of content to a format understood by that auxiliary electronic display device or by a device driver for that auxiliary electronic display device; and
d) communicating the filtered set of content to that auxiliary electronic display device, wherein the filtered set of content comprises scheduled notification data; and
caching the scheduled notification data on at least one auxiliary electronic display device for display to the user even if the computer program is not tunning,
38, The computer-readable medium of claim 37 wherein at least one of
the auxiliary electronic display devices comprises an enhanced auxiliaiy display.
39. The computer-readable medium of claim 37 wherein at least one of
the auxiliary electronic display devices comprises a basic auxiliary display,
40 The computer-readable medium of claim 37 wherein at least one of the auxiliary electronic display devices comprises an enhanced auxiliary display
and at least one other of the auxiliary electionic display devices comprises a basic
auxiliary display.
41, T he computer -readable medium of claim 3 8, wherein the enhanced auxiliary display includes a paiticular fiimware stack, the particular fiimware stack that includes a Tiny CLR component and suppoits Tiny CLR object serialization,

Documents

Application Documents

# Name Date
1 3074-del-2005-Form-13-(10-11-2008).pdf 2008-11-10
2 3074-del-2005-Claims-(10-11-2008).pdf 2008-11-10
3 3074-DEL-2005-GPA-(16-06-2010).pdf 2010-06-16
4 3074-DEL-2005-Correspondence-Others-(16-06-2010).pdf 2010-06-16
5 3074-DEL-2005-Form-1-(02-12-2010).pdf 2010-12-02
6 3074-DEL-2005-Correspondence-Others-(02-12-2010).pdf 2010-12-02
7 3074-del-2005-gpa.pdf 2011-08-21
8 3074-del-2005-form-5.pdf 2011-08-21
9 3074-del-2005-form-3.pdf 2011-08-21
10 3074-del-2005-form-2.pdf 2011-08-21
11 3074-del-2005-form-18.pdf 2011-08-21
12 3074-del-2005-form-13.pdf 2011-08-21
13 3074-del-2005-form-1.pdf 2011-08-21
14 3074-del-2005-drawings.pdf 2011-08-21
15 3074-del-2005-description (complete).pdf 2011-08-21
16 3074-del-2005-correspondence-others.pdf 2011-08-21
17 3074-del-2005-assignment.pdf 2011-08-21
18 3074-del-2005-abstract.pdf 2011-08-21
19 3074-del-2005-Claims.pdf 2014-11-26
20 MTL-GPOA - MLK1.pdf ONLINE 2015-03-05
21 MS to MTL Assignment.pdf ONLINE 2015-03-05
22 FORM-6-701-800(MLK).27.pdf ONLINE 2015-03-05
23 MTL-GPOA - MLK1.pdf 2015-03-13
24 MS to MTL Assignment.pdf 2015-03-13
25 FORM-6-701-800(MLK).27.pdf 2015-03-13
26 CBR-PRS1-30-04-2015.pdf 2015-04-30
27 new covering letter.pdf 2015-05-05
28 PD000931IN-SC_Respone-CBR-correspondance-GPOA.pdf 2015-06-24
29 mark-up page 1-29-claims track.pdf 2015-06-24
30 FORM 2-cs.pdf 2015-06-24
31 amended claims_clean- Copy.pdf 2015-06-24
32 Abstract.pdf 2015-06-24
33 3074-DEL-2005_EXAMREPORT.pdf 2016-06-30
34 Other Patent Document [01-11-2016(online)].pdf 2016-11-01
35 3074-DEL-2005-HearingNoticeLetter-(DateOfHearing-15-11-2019).pdf 2019-11-05
36 3074-DEL-2005-Correspondence to notify the Controller (Mandatory) [06-11-2019(online)].pdf 2019-11-06
37 3074-DEL-2005-FORM-26 [14-11-2019(online)].pdf 2019-11-14
38 3074-DEL-2005-Power of Attorney-221119.pdf 2019-11-26
39 3074-DEL-2005-Correspondence-221119.pdf 2019-11-26
40 3074-DEL-2005-Written submissions and relevant documents (MANDATORY) [28-11-2019(online)].pdf 2019-11-28
41 3074-DEL-2005-FORM 3 [28-11-2019(online)].pdf 2019-11-28
42 3074-DEL-2005-Power of Attorney-181219.pdf 2019-12-20
43 3074-DEL-2005-Correspondence-181219.pdf 2019-12-20
44 3074-DEL-2005-US(14)-ExtendedHearingNotice-(HearingDate-13-01-2023).pdf 2023-01-06
45 3074-DEL-2005-Correspondence to notify the Controller [09-01-2023(online)].pdf 2023-01-09
46 3074-DEL-2005-FORM-26 [12-01-2023(online)].pdf 2023-01-12
47 3074-DEL-2005-Written submissions and relevant documents [24-01-2023(online)].pdf 2023-01-24
48 3074-DEL-2005-PatentCertificate31-01-2023.pdf 2023-01-31
49 3074-DEL-2005-IntimationOfGrant31-01-2023.pdf 2023-01-31
50 3074-DEL-2005-FORM-27 [12-09-2025(online)].pdf 2025-09-12

ERegister / Renewals

3rd: 18 Apr 2023

From 17/11/2007 - To 17/11/2008

4th: 18 Apr 2023

From 17/11/2008 - To 17/11/2009

5th: 18 Apr 2023

From 17/11/2009 - To 17/11/2010

6th: 18 Apr 2023

From 17/11/2010 - To 17/11/2011

7th: 18 Apr 2023

From 17/11/2011 - To 17/11/2012

8th: 18 Apr 2023

From 17/11/2012 - To 17/11/2013

9th: 18 Apr 2023

From 17/11/2013 - To 17/11/2014

10th: 18 Apr 2023

From 17/11/2014 - To 17/11/2015

11th: 18 Apr 2023

From 17/11/2015 - To 17/11/2016

12th: 18 Apr 2023

From 17/11/2016 - To 17/11/2017

13th: 18 Apr 2023

From 17/11/2017 - To 17/11/2018

14th: 18 Apr 2023

From 17/11/2018 - To 17/11/2019

15th: 18 Apr 2023

From 17/11/2019 - To 17/11/2020

16th: 18 Apr 2023

From 17/11/2020 - To 17/11/2021

17th: 18 Apr 2023

From 17/11/2021 - To 17/11/2022

18th: 18 Apr 2023

From 17/11/2022 - To 17/11/2023

19th: 14 Nov 2023

From 17/11/2023 - To 17/11/2024