SYSTEM AND METHOD FOR EXCHANGE OF SCRIBBLE DATA BETWEEN GSM DEVICES ALONG WITH VOICE

FIELD OF INVENTION

[1] This invention relates to the field of mobile technology, more particularly for exchanging scribble data information simultaneously with voice between GSM devices.

BACKGROUND

[2] Conventionally, methods are available where speech through audio channel and video data over data channel are transmitted simultaneously by switching the audio channel to a data channel, after detecting a 'gap period' during a voice conversation between mobile users.

[3] However, in the present scenario, technology is not available to send voice along with any other non temporal, real time data simultaneously through a GSM network. Methods are available to send picture and low bit rate video along with voice but parallel data transmission may require re-transmission of the data part when an error occurs in transmission/communication channel. Due to this reason, such methods are not reasonable where data sequence is relevant over time and is to be transferred in as much as real time. Other technologies available for sending data along with voice exchange that exist are: DTM enabled GPRS, WCDMA (3G) etc. But DTM enabled GPRS service is not available or adopted much. Also, 3G is a costly service which is not widely available till date.

[4] Therefore, there exists a need to address the above mentioned issues for scribble data transmission along with speech.

SUMMARY

[5] Embodiments of the present disclosure described herein provide a system and method for real time exchanging of scribble information between two CE devices having GSM connectivity between them along with speech.

[6] According to an embodiment of the present invention, a system for transferring a scribble data along with voice relates to transmitting handwriting along with speech simultaneously on a voice call in a GSM network. A writing pad can be made to appear on an electronic device or a mobile screen while in a voice call. A user scribbles a message or data on a touch screen or a keypad/joystick movement etc in the mobile phone or the electronic device which is taken, processed and sent to a receiver. The scribbled data will be decoded and presented to a display application as to appear to the receiver's screen as the same scribble at the other end instantly. This will happen simultaneously along with the speech.

[7] In one embodiment, by exploiting the trapezoidal or saw tooth wave pattern of individual x and y scribble data and hence after conducting speech synthesis on it, a speech like signal is generated. An identification bit is attached with the speech like signal and transmitted through a communication network along with a voice packet as new voice signal. For a real time discussion using pen paper between two or more persons there is sufficient non-speech time to get the speech like scribble packet streamed along with an actual speech packet. At the receiving end, on detecting the
coordinates can be regenerated and scribble data displayed on the receiver's mobile or electronic device screen.

BRIEF DESCRIPTION OF FIGURES

[8] In the accompanying figures, similar reference numerals refer to identical or functionally similar elements. These reference numerals are used in the detailed description to illustrate various embodiments and to explain various aspects and advantages of the present disclosure.

[9] FIG. 1 illustrates a schematic block diagram of a system for transferring a scribble data along with voice.

[10] FIG. 2 illustrates an example of the scribble data to be transferred.

[11] FIG. 3 illustrates a trapezoidal or a saw tooth wave form representation of the X coordinate of the data of points of the scribble data.

[12] FIG. 4 illustrates a trapezoidal or a saw tooth wave form representation of the y coordinate of the data of points.

[13] FIG. 5 illustrates an example of an interleaved speech and speech like data packets.

[14] FIG. 6 illustrates a method of transferring a scribble data along with voice for scribble data transmission and receiving operation sequence.

[15] Persons skilled in the art will appreciate that elements in the figures are illustrated for simplicity and clarity and have not been drawn to scale. For example, the dimensions of some of the elements in the figure may be exaggerated relative to other elements to help to improve understanding of various embodiments of the present disclosure.

DETAILED DESCRIPTION

[16] It may be observed that the components of the system and method steps have been represented by conventional symbols in the figure, showing only specific details which are relevant for an understanding of the present disclosure. Further, details may be readily apparent to person ordinarily skilled in the art may not have been disclosed. In the present disclosure, relational terms, may be used to distinguish one entity from another entity, without necessarily implying any actual relationship or order between such entities.

[17] Embodiments in the present disclosure as described herein provide a system and a method for transferring a scribble data along with voice.

[18] FIG. 1 illustrates a schematic block diagram of a system for transferring the scribble data along with voice.

[19] In accordance with an embodiment of the present invention, a system for transferring a scribble data along with voice relates to transmitting handwriting along with speech on a voice call in a GSM (Global System for Mobile Communication) network. A writing pad like a touch screen or a keypad may be made to appear on a mobile screen or an electronic device while a user is in a voice call. The user may scribble a message or data on the touch screen or the keypad movement etc. in the mobile phone or the electronic device.

[20] In order to transmit the scribble data for exchanging information with the other user, the scribble data may be transmitted as voice packet(s). The relative x and y location of the scribbled data are separately accumulated and synthesized as GSM speech like signal. Any available method like autoregressive modeling (AR) for speech production may be used to synthesize the GSM speech like signal,

[21] Further, the synthetic speech that is generated according to the GSM technology is transmitted over the GSM network as speech transmission. The speech like data packet may be transmitted interlaced with the actual speech signal to the GSM network. An identification bit is added in each TDMA packet in the speech like GSM data packet to identify the scribble data.

[22] The scribbled data input is encoded and processed before the scribbled data is transmitted to a receiver. At the receiver end, the scribble data is decoded and forwarded to the display unit for displaying on the receiver's screen instantly. The scribble data is displayed simultaneously on the receiver's screen along with the speech hared.

[23] At 105, the sender inputs scribble data on his mobile screen.

[24] At 110, the input scribble data is re-arranged for speech encoding. Data is arranged in a suitable form to generate a speech like signal by synthesis by using a speech synthesis mechanism.

[25] At 115, the scribble data segments are synthesized using existing speech synthesis mechanisms and the speech like GSM (global system for mobile communications) signal is generated. The Identification bits are added at the beginning of each voice packet.

[26] At 120, the speech like signal is interleaved with an actual speech signal.

[27] At 125, the GSM scribble data signal is transmitted to the communication network through the same channel used in the GSM voice communication.

[28] At 130, the speech like signal is separated from the actual speech signal at the receiver end by identifying the identification bits attached with the speech like signal that was sent in each time sample burst.

[29] At 135, the GSM signal is de-synthesized to generate the scribble data segments.

[30] At 140, individual x and y data is collected as x and y stream separately. Trapezoidal or Saw-tooth patterns are recognized after interpolation for x and y data stream separately and the exact x and y data is generated.

[31] At 145, after ensuring best representation of the recovered data, the (x, y) points are formed and plotted over to generate the output scribble data at the receiving end.

[32] FIG. 2 illustrates an example of the scribble data to be transferred.

[33] FIG. 2 represents the scribbled data which can be drawn on the touch screen of the electronic device or any other data drawn from the pen which needs to be transmitted.

[34] FIG. 3 illustrates a trapezoidal or a saw tooth wave form representation of the X coordinate of the data of points.

[35] The x coordinate data is synthesized and sent after adding identification bits along with the speech signal. The speech converted x-coordinate data on reaching the other end is identified and de-synthesized to retrieve the scribbled x coordinate.

[36] FIG. 4 illustrates a trapezoidal or a saw tooth wave form representation of the y coordinate of the data of points.

[37] The y coordinate data is synthesized and sent after adding identification bits along with the speech signal. The speech converted y-coordinate data on reaching the other end is identified and de-synthesized to retrieve the scribbled y coordinate.

[38] The objective of representing the data in forms of trapezoidal or saw tooth wave in FIG. 3 and FIG. 4, is that it can be used as a strong reference while regenerating the x and the y data. The data can be regenerated or corrected more accurately from the speech converted scribble data. Additionally, there is no sharp change of either of the x and the y data individually at any point of time. So even after distortion of some of the values, the data can be predicted by looking into the few past or future values. Prediction can be done by some interpolation or by best fitting to straight line segments.

[39] The 'x' and the 'y' scribble data are collected separately. After the regeneration or correction of the x and the y data separately, the x and the y data are presented to the drawing layer to be plotted as the (x, y) coordinate and the input scribble data can thus be shown at the receiver end.

[40] FIG. 5 illustrates an example of interleaved speech and speech like data.

[41] FIG. 5 illustrates a speech like scribble data 505 and an actual speech data 510. The speech like scribble data 505 is interleaved with the actual speech data 510. The speech like scribble data 505 is interleaved with the actual speech data 510 and is transmitted through the same transmission channel used by the actual speech data 510 along with the voice packets. The speech like scribble data 505 is received at the receiver end and is identified by using the identification tags (not shown) attached to them. The speech like scribble data 505 is then separated from the actual speech data 510 and is de-synthesized to obtain the original scribble data.

[42] FIG. 6 illustrates a method of transferring a scribble data along with voice for scribble data transmission and receiving operation sequence.

[43] At step 605, the application identifies the scribble coordinates as the relative location from screen top left.

[44] At step 610, the scribble coordinates are arranged with the x and the y positions separately and is optionally sampled for reducing the data.

[45] At step 615, the accumulated scribble coordinates are converted to speech like signal by using an existing speech synthesis mechanism. Identification bits are added to the speech like signal for identifying the scribble speech data.

[46] At step 620, the speech like scribble data is interleaved with the actual speech data in form of speech voice packets.

[47] At step 625, the interleaved speech (voice) data packets are sent through same GSM speech communication or transmission channel as used by the actual speech signals.

[48] At step 630, the interleaved data is transmitted through the GSM communication or transmission channel.

[49] At step 635, the interleaved speech like packets are identified by identifying the attached identification bits. The GSM speech data is then de-synthesized for obtaining the actual scribble data.

[50] At step 640, the x and the y position data is extracted by data analysis using best fit line segments or pattern matching and interpolation.

[51] At step 645, the scribble pattern is drawn on the display device of the receiver's mobile phone or any other electronic device by connecting the extracted x and y points.

[52] The advantages of the system and method as disclosed in the foregoing are that two users can talk and scribble at the same time at the cost of a normal voice call. Moreover, any low feature mobile phone or any other electronic device (with touch pen) may be able to support the scribble feature, as very simple screen may be capable to plot the scribble data in real time.

[53] In the preceding description, the present disclosure and its advantages have been described with reference to specific embodiments. However, it will be apparent to a person of ordinary skill in the art that various modifications and changes can be made, without departing from the scope of the present disclosure, as set forth in the claims below. Accordingly, the specification and figures are to be regarded as illustrative examples of the present disclosure, rather than in restrictive sense. All such possible modifications are intended to be included within the scope of the present disclosure.

I/We claim:

1. A system for exchanging scribble data information between electronic devices, the system comprising:

two or more electronic devices having an interface for scribbling an input;

means for capturing a scribbled data in a sending device;

means for converting scribble data to voice;

means for interleaving voice converted scribbled data to a speech like GSM signal for transmitting to a receiving electronic device;

means for de-synthesizing speech like GSM packets to scribble data packets at the receiving electronic device; and

means for displaying the scribbled data in a receiving electronic device, wherein the scribble data is sent simultaneously with voice in real time.

2. The system as claimed in claim 1, wherein the electronic device is a mobile phone or any electronic device having GSM connectivity.

3. The system as claimed in claim 1, wherein the means for interleaving comprises means for inserting identification bits in the speech converted scribble data for interleaving with actual speech signal.

4. The system as claimed in claim 1, wherein the scribble data is received simultaneously with the voice conversation in the receiving mobile phone or the electronic device.

5. A method of transmitting scribble data information between electronic devices, the method comprising:

identifying scribble coordinates of a scribbled data;

sampling the scribble coordinates;

synthesizing the scribble data segments to generate speech like GSM signal;

inserting identification bits at the beginning of each speech like signal packet;

interleaving the speech like signal with the actual speech signal; and

transmitting the GSM data across a GSM network through a channel as in GSM voice communication.

6. The method as claimed in claim 5, wherein the scribble data stream of x and y coordinate individually is a trapezoidal or a saw tooth waveform and synthesized to speech like GSM signal.

7. The method as claimed in claim 6, wherein the identification bits are inserted at the beginning of the speech like GSM signal packet.

8. A method of receiving scribble data information between electronic devices, the method comprising:

receiving speech like GSM signal in the receiver mobile phone or the electronic device;

identifying interleaved speech like packets by identifying attached identification bits;

de-synthesizing GSM speech data ;

extracting and interpolating the x and y position data methods the received scribbled data; and

generating the scribble pattern on the display device of the receiver's mobile phone or any other electronic device

9. The method as claimed in claim 8, wherein scribble data is received simultaneously with voice in real time in the electronic device having GSM connectivity.