METHOD FOR EXCHANGING INFORMATION BETWEEN A MOBILE TERMINAL
AND A SERVER
The invention relates to the field of methods for exchanging information between a mobile terminal and a server. The user of the mobile terminal sends the photo of an object to a server that returns information to him about the object. The information exchange may continue and lead to real communication allowing the user to receive additional information about the object contained in the photo, from the server.
According to prior art described in Chinese patent application CN1458613, a method is known, in the certification field, for sending a photo of a certification mark from a mobile terminal to a server, which compares the photo with a predetermined base of certification marks and in return informs the mobile terminal whether or not the certification mark is authentic. A disadvantage of this prior art is that it is limited to a type of object that is identically compared with a set of references contained in a predefined database. Furthermore, the response is of the yes/no type, and is consequently relatively poor. As soon as the object is no longer identically compared with a set of references in a predefined database, this prior art is no longer capable of providing the mobile terminal user with any information about the object contained in the photo.
In addition to the photo, the invention proposes that the mobile terminal user should attach additional information that the server firstly uses to distinguish the relevant object in the photo and therefore to receive help in selecting an appropriate database, and secondly to be able to provide the mobile terminal user with a broader answer better adapted to the relevant object, in other words the object in which the mobile terminal user is interested. Otherwise, a totally automatic shape recognition search could be made without any information being provided by the user, which would make the server search through a large number of fairly large databases and spend an excessive amount of time in analysing the photo. This small amount of effort by the mobile terminal user, which is contrary to the usual quest for the most automated possible methods requiring the least amount of effort by the user, will be very cost effective as it provides the mobile terminal user with a satisfactory response while using a reasonable level of resources, resulting in a reasonable response time and global cost. Furthermore, since a photo usually has a rich and complex content, and the mobile terminal user is often only interested in a single element or at least a small number of elements on this photo, if the user does not help the server a little, the server may be obliged to ask the mobile

terminal user a very large number of irrelevant questions so as to target the type of information in which this user is interested, which will eventually surely annoy the user, so that this service is more trouble than it is worth.
The invention relates to a method including a step to send at least one photo from a mobile terminal to a server; a step in which the server analyses the photo sent; a step in which at least one item of information related to the contents of the analysed photo is associated with the analysed photo; a step in which information associated with the photo or at least part of the information associated with the photo is sent to the mobile terminal; characterised in that the mobile terminal provides the server with additional information that will help the server to identify a sub-set of the photo; the server uses the additional information to identify a sub-set of the photo.
According to one method of making the identification, the server first of all uses the additional information to locate a sub-set of the photo and then identifies the sub-set located, possibly, but preferably not, using the additional information. According to another method of making the identification, the server simultaneously locates and identifies a sub-set of the photo, using the additional information.
Preferably, the additional information and the photo(s) form the only information that the mobile terminal user supplies to the server.
The invention also relates to a mobile terminal and a server, which are particularly suitable for using the method according to the invention. The mobile terminal is preferably a mobile telephone.
According to the invention, a mobile terminal is also provided comprising an optical device for recording at least one photo; a device for sending the photo to a server; a device for receiving at least one item of information from a server related to the contents of the sent photo: characterised in that the mobile terminal also comprises a device that may or may not be separate from the optical device, that a mobile terminal user can use to enter additional information that will help a server to identify a sub-set of the photo sent; and in that the send device is capable of sending additional information to a server.
According to the invention, a server is also provided comprising a device for reception of a photo from a mobile terminal; a device for analysing the received photo and for associating at least one item of information about the contents of the analysed photo, with the analysed photo; a device for sending information associated with the photo or at least part of the information associated with the photo, to a mobile terminal;

characterised in that the reception device is capable of receiving additional information from a mobile terminal that the server will use to identify a sub-set of the photo; the analysis and association device is capable of using additional information to identify a sub-set of the photo.
The invention will be better understood and other special features and advantages will become clearer after reading the following description and the appended figure given as an example, wherein figure 1 that diagrammatically shows an example of a system using the method according to the invention.
Figure 1 diagrammatically shows an example of a system using the method according to the invention. A mobile terminal 1 is connected to a server 3 through a communication network 2. The communication network 2 is an internet type network. The mobile terminal 1 is a mobile telephone connected to the network 2, for example through a GPRS (General Packet Radio Service) type link. The server 3 is connected to the network 2 through a link, for example of the ADSL (Asymmetric Data Subscriber Line) type. The mobile terminal 1 and the server 3 communicate with each other through the network 2. The mobile terminal 1 comprises an optical device 10 for recording at least one photo, possibly a set of photos making up a video, a reception device 11, a send device 12, and an input device 13. The server 3 comprises an analysis device 31, a reception device 32, a send device 33, an association device 34, and an information database 35.
The optical recording device 10 takes a photo. The user of the mobile terminal 1 inputs additional information through the input device 13. The send device 12 on the mobile terminal 1 sends the photo and the additional information received by the reception device 32 of the server 3. The analysis device 31 analyses the contents of the photo by means of the additional information. More precisely, the analysis device 31 identifies a sub-set of the photo using the additional information, doing this particularly using shape recognition methods. Once the sub-set has been identified, the association device 34 associates an object with the identified sub-set, possibly using databases containing reference objects. This object corresponds to the contents of the identified sub-set. The association device 34 then associates one or several items of information with this object, for example either using a database 35 internal to the server 3 or exchanging information with external databases 20 through the network 2 and using a reception device 32 and send devices 33. The information associated with the object is sent through the send device 33 of the server 3 and is received by the reception device

11 of the mobile terminal 1. The user of the mobile terminal 1 can then access the information associated with the object.
In one embodiment, the additional information is in text form. This is a message that may be a single word, for example "animal" sent with a photo by the mobile terminal to the server. The server then analyses the different areas of the photo searching for an animal and finishes for example by recognising a "lion" in a large yellow and brown area on the photo. In one option, this additional information in text form is sent in SMS (Short Message Service) form. According to another option, the combination of this additional information in text form and the photo is sent in MMS (Multimedia Message Service) form.
In another embodiment, the additional information comprises graphic marking of at least one area of the photo, which the server uses to mark this area even before identifying it. For example, the user has positioned a cursor on the white area of the photo, thus informing the server about what interests him in the photo, namely a white area for example corresponding to a statue representing the "Victory of Samothrace". In another example, the user has surrounded the white area for example with a square, thus informing the server that the object in which he is interested is located in this surrounded area that contains the statue representing the "Victory of Samothrace".
In another embodiment, several photos are sent by the mobile terminal to the server in video form. The additional information comprises a voice message included in the sound track associated with the video. While the user is filming a herd of herbivores running in the savannah during a safari, he states vocally that he is interested in the "animal with long horns". The server then identifies the corresponding area on the photo, looks for an animal by making comparisons with the elements in an animals database and recognises an antelope called a "sable antelope". The server can then send "sable antelope" to the mobile terminal together with a detailed technical datasheet about the animal.
In another embodiment, the additional information includes a voice message sent by the mobile terminal user to the server during the telephone call between the mobile terminal and the server. Thus, all information contained in the additional information guides the server to quickly and correctly recognise an object in a photo, using small quantities of resources. The user sends a photo, for example asking what is the "brownish mushroom". The server then for example easily determines a boletus,

and for example might .inform the user that it is a boletus, that is edible and even delicious in an omelette.
In another embodiment, the additional information includes a response to a multiple-choice questionnaire displayed by the server to the mobile terminal that helps to guide the user. For example, is the colour of the object predominantly green, yellow, red, etc.? is the object a vegetable, animal, work of art, etc? Is the object closest to the right, left, top or bottom? The server eventually recognises that the long dark stain at the right that represents an animal is a "moray eel".
In another embodiment, the additional information is provided through a predetermined query made by the server, this server asking for some information from the user.
In another embodiment, the additional information may have been given once and for all for a certain time interval. For example "I am in the Louvre Art Gallery all day and I would like information about works of art inside this Museum" or "I am leaving for safari in Kenya this week and I would like information about all animals that I will see". By default, the server will always consider the same additional information during the chosen time period, which makes it even easier for the mobile terminal user to use the service proposed by the server. Optionally, the user can even define a user profile describing his tastes, activities and interests, so as to guide the server in determining objects contained in the photo provided by the mobile terminal user.
In one type of embodiment, the additional information is sent by the mobile terminal at the same time as the photo is being sent. The mobile terminal user makes a small effort initially and the server then acts quickly and efficiently. In another type of embodiment, the additional information is sent by the mobile terminal after the server has made a response after the photo has been sent. Therefore, the server's response can guide the user about how to provide the additional information. The user still does not need to make as much effort, because he can remain completely passive; however, this manner of working will be slightly longer due to the information exchange between the mobile terminal and the server. Thus, the server will need slightly more time to obtain additional information that it needs to analyse the photo.
In one preferred option, the method also includes a step to send advice from the server to the mobile terminal; a step to take at least one additional photo by the mobile terminal, the additional photo being taken under conditions different from the previous photo, these different conditions reflecting the advice; a step to send the additional photo

from the mobile terminal to the server. For example, the advice may consist of a request to take a photo under other circumstances, for example to "change angle", "get closer", "use the flash", "change the zoom", if the server finds that the first photo is not sufficient to determine the object satisfactorily for the user.
In one preferred embodiment, the information associated with the photo includes an action plan for the mobile terminal user. For example, the user sends the photo of a snake. The server can send information to him consisting of the snake name and the time remaining to the user to reach a hospital before the poison from a bite by this snake has irreversible effects, for example such as the death of the victim. Advantageously, the terminal according to the invention may be associated with a kit of the main antidotes and the user may receive information such as "in case of a bite, inject the contents of the syringe No. 3 immediately then go to the hospital within two hours", in response to his photo of the snake.
In one preferred option, positioning of the mobile terminal can help to choose a server that is geographically close to the mobile terminal. Thus, communications are less expensive.
In one preferred option, positioning of the mobile terminal provides at least part of the additional information. For example, if the mobile terminal user sends a photo to the server and if the server determines the position of the user as being in the Louvre Art Gallery, the server knows that the user will very probably ask for information about a work of art and by default will analyse the photo making an attempt to recognise one of the works of art in the Louvre Art Gallery directly. For example, if the user of the mobile terminal sends a photo to the server and if this server identifies that the user is positioned in Vincennes Zoo, the server knows that the user will very probably ask him for information about an animal and by default will analyse the photo making an attempt to recognise one of the animals in Vincennes Zoo directly. For example, in the case of a photo of a bear in Vincennes zoo, the server can send information about the animal to the mobile terminal, while in the case of a photo of a bear taken in a national park in the United States, the server could send safety instructions to be observed because the bears are wild, to the mobile terminal, in addition to information about the animal.
In one preferred option, the information associated with the photo and sent by the server to the mobile terminal is in the form of an HTML page, for example sent by mail.

There are many possible applications of the process according to the invention, including, but not limited to, recognition of mushrooms and an indication about their edibility or toxicity, recognition of animals and an indication of their main characteristics such as size, weight, gestation period, habitat, etc., knowledge about snakes and instructions about the antidote to be injected in case of a bite, recognition of works of art and monuments and an indication about their creators, their periods, etc ...

CLAIMS
1. Method including:
- a step to send at least one photo from a mobile terminal (1) to a server (3);
- a step in which the server analyses the photo sent;
- a step in which at least one item of information related to the contents of the analysed
photo is associated with the analysed photo;
- a step in which information associated with the photo or at least part of the information
associated with the photo is sent to the mobile terminal;
characterised in that:
- the mobile terminal provides the server with additional information that will help the
server to identify a sub-set of the photo;
- the server uses the additional information to identify a sub-set of the photo.

2. Method set forth in claim 1, characterised in that the additional information is in text
form.
3. Method set forth in claim 2, characterised in that the additional information in text form
is sent in SMS (Short Message Service) form.
4. Method set forth in claim 2, characterised in that the combination of this additional
information in text form and the photo is sent in MMS (Multimedia Message Service)
form.
5. Method set forth in claim 1, characterised in that the additional information comprises
graphic marking of at least one area of the photo.
6. Method set forth in claim 1, characterised in that several photos are sent by the mobile
terminal to the server in video form and in that the additional information comprises a
voice message included in the sound track associated with the video.
7. Method set forth in claim 1, characterised in that the additional information includes a
voice message sent by the mobile terminal user to the server during the telephone call
between the mobile terminal and the server.

8. Method set forth in claim 1, characterised in that the additional information includes a
response to a multiple-choice questionnaire displayed by the server to the mobile
terminal.
9. Method set forth in any one of the above claims, characterised in that it also includes:

- a step to send advice from the server to the mobile terminal;
- a step to take at least one additional photo by the mobile terminal, the additional photo
being taken under conditions different from the previous photo, these different conditions
reflecting the advice;
- a step to send the additional photo from the mobile terminal to the server.

10. Method set forth in any one of the above claims, characterised in that the information
associated with the photo includes an action plan for the mobile terminal user.
11. Method set forth in any one of the above claims, characterised in that positioning of
the mobile terminal can help to choose a server that is geographically close to the mobile
terminal.
12. Method set forth in any one of the above claims, characterised in that positioning of
the mobile terminal provides at least part of the additional information.
13. Method set forth in any one of the above claims, characterised in that the information
associated with the photo and sent by the server to the mobile terminal is in the form of
an HTML page.
14. Method set forth in any one of the above claims, characterised in that the additional
information is sent by the mobile terminal at the same time as the photo is being sent.
15. Method set forth in any one of claims 1 to 13, characterised in that the additional
information is sent by the mobile terminal after the server has made a response after the
photo has been sent.

16. Method set forth in any one of the above claims, characterised in that the server
firstly uses the additional information to locate a sub-set of the photo and in that the
server then identifies the sub-set located.
17. Method set forth in any one of claims 1 to 15, characterised in that the server
simultaneously locates and identifies a sub-set of the photo, using the additional
information.

18. Method set forth in any one of the above claims, characterised in that the additional
information and the photo(s) form the only information that the mobile terminal user
supplies to the server.
19. Mobile terminal comprising:

- an optical device (10) for recording at least one photo;
- a device (12) for sending the photo to a server;
- a device (11) for receiving at least one item of information from a server related to the
contents of the sent photo;
characterised in that the mobile terminal also comprises a device (13) that may or may not be separate from the optical device, which a mobile terminal user can use to enter additional information that will help a server to identify a sub-set of the photo sent; and in that the send device is capable of sending additional information to a server.
20. Server comprising:
- a device (32) for reception of a photo from a mobile terminal;
- a device (31 and 34) for analysing the received photo and for associating at least one
item of information about the contents of the analysed photo, with the analysed photo;
- a device (33) for sending information associated with the photo or at least part of the
information associated with the photo, to a mobile terminal;
characterised in that:
- the reception device is capable of receiving additional information from a mobile
terminal that the server will use to identify a sub-set of the photo;
- the analysis and association device is capable of using additional information to identify
a sub-set of the photo.