Sign In to Follow Application
View All Documents & Correspondence

Mixed Reality Headset Based On X Server

Abstract: The technology implements the concept of mixed reality by networking a computer with a Head Mounted Display worn by the user. Extending the real world with digital entities. This headset by using mixed reality aims to create an immersive experience for the user by placing X Windows and three-dimensional virtual objects in the virtual environment and enabling the users to interact with these windows. The interaction is done using controllers, buttons, sensors and various other features of the headset. Two devices are required to fulfill the purpose of this technology. One is the headset itself and the other device is the one that does the primary processing and storage functionalities. The other device streams data to the headset and the headset performs the necessary actions depending on the type of data sent. If the data is an image then it is just projected via the HMD.

Get Free WhatsApp Updates!
Notices, Deadlines & Correspondence

Patent Information

Application #
Filing Date
26 April 2019
Publication Number
44/2020
Publication Type
INA
Invention Field
COMPUTER SCIENCE
Status
Email
patent@iem.edu.in
Parent Application

Applicants

INSTITUTE OF ENGINEERING AND MANAGEMENT
Salt Lake Electronics Complex, Gurukul, Y-12 Block EP, Street Number 18, Sector V, Bidhannagar, Kolkata, West Bengal 700091

Inventors

1. Himadri Nath Saha
Salt Lake Electronics Complex, Gurukul, Y-12 Block EP, Street Number 18, Sector V, Bidhannagar, Kolkata, West Bengal 700091
2. Saunak Biswas
Salt Lake Electronics Complex, Gurukul, Y-12 Block EP, Street Number 18, Sector V, Bidhannagar, Kolkata, West Bengal 700091
3. Subhadeep Jasu
Salt Lake Electronics Complex, Gurukul, Y-12 Block EP, Street Number 18, Sector V, Bidhannagar, Kolkata, West Bengal 700091
4. Debarshi Das
Salt Lake Electronics Complex, Gurukul, Y-12 Block EP, Street Number 18, Sector V, Bidhannagar, Kolkata, West Bengal 700091
5. Shayeli Sarker
Salt Lake Electronics Complex, Gurukul, Y-12 Block EP, Street Number 18, Sector V, Bidhannagar, Kolkata, West Bengal 700091

Specification

Description:

The system stated here is comprised of a Head Mounted display and a host device that is connected using a wireless connection. The information sent through this connection can be of several sensor modules fitted in the HMD or data sent to the HMD from the host device to perform a task.
The model diagram of HMD has been depicted in FIG.1.
A. Proposed Model
The different parts that make the HMD and the system work as desired are described in this section:
i) Head Mounted Display: It is a mixed reality headset that does the following tasks:
a) The sensor data and user inputs it captures is sent to the host device for different purposes.
b) It displays any image data it receives from the host device using projectors.
c) It plays any sound data received from the host device using its bone conduction transducer.
d) Tactile data is also received by the HMD for user experience.ii) Host Device: The host device is any device with enough computing resources to run X-server on its operating system and has the capability of processing 3D graphics.
The components present in the Head Mounted Display along with their specifications are as follows:
i) The input components present in the HMD are:
a) Structured Light Scanner cameras: Four 1.3MP SLS cameras with 1080p resolution b) Accelerometer: Sensitivity of 100 mV/g and the dynamic range is +/-50 g, peak. 30-900,000 CPM (+/3dB)c) Gyro sensor: ±300°/s range
d) Microphone
e) Light Dependent Resistor
f) Buttons and scroll wheel: 2 buttons and 1 scroll wheel which contains 2 more buttons.
ii) The output components fitted in the HMD are:
a) Projector: 1920x1080. Quantity- 2pieces.
b) Bone conduction transducers (speakers)
c) Haptic moduleiii) Few other components that are also required are as follows:
a) Wi-Fi module: IEEE 802.11ac
b) Battery: 5000mAh capacity
c) Voltage regulator
d) Processor: ARM processore) USB Type C
f) RAM: 4GB
B. Methodology
The working mechanism of the proposed model can be described as follows:
Stage 1: (initialization of HMD)
1. The headset tries to connect with the host device and it keeps on trying in a loop until the connection is established.
2. Then the headset checks if mixed reality window manager is running on the host device. If it is running the headset initializes the modules that were inactive till now.
Stage 2: (initialization of host device)
1. The window manager is started in the host device and web socket is created to connect with HMD.
2. If connection is not established then window manager runs in a simple 2D mode. But if connection is established the window manager runs in 3D mixed reality mode.Stage 3: (HMD main loop)
1. The HMD collects data from all the input devices (microphone, buttons and scroll wheel) and some of the sensor modules (SLS cameras, LDR, accelerometer and gyro sensor). This data is serialized and sent to the host device using the connection it established earlier.
2. The HMD also receives data from the host device in the form of an input stream and depending on the type of data received the HMD performs a task. If it is image data it is displayed using the projectors, if it is sound then the bone conduction transducers are used and the haptic module in case of tactile output.
Stage 4: (Host device main loop)
1. The mixed reality window manager receives data of different modules from the HMD using the socket connection established earlier.2. The accelerometer and gyro sensor data are used by the window manager to move the virtual camera according to user movement. The LDR data is used to set the brightness of the projector. Structured Light Scanner camera data is used to recreate the real-world environment in the virtual world. The microphone data and the button input data is forwarded to the operating system.
Stage 5: (HMD shutdown procedure)
1. When the user long presses the power button, the shutdown routine of the HMD starts. The socket connection with the host device is ended. All the processes in the HMD end and all the modules are stopped.
Stage 6: (Host device shutdown procedure)
1. When the user shutdowns the host device, the socket connection ends and window manager process also ends. The rest of the shutdown procedure is managed by the operating system of the host device.

Claims:

1. The HMD is very compact and lightweight.
2. The design looks similar to sunglasses, so that the user feels comfortable to wear it anywhere they want.
3. It is cost effective and increases productivity of the user by removing the need of multiple hardware screens at the same time.
4. The host can be any device that is capable to run X Server and has enough processing capability and main memory.

Documents

Application Documents

# Name Date
1 201931016608-AbandonedLetter.pdf 2024-11-29
1 201931016608-FER.pdf 2022-03-31
1 201931016608-FORM 1 [26-04-2019(online)].pdf 2019-04-26
2 201931016608-DRAWINGS [26-04-2019(online)].pdf 2019-04-26
2 201931016608-FER.pdf 2022-03-31
2 201931016608-FORM 13 [08-02-2022(online)].pdf 2022-02-08
3 201931016608-COMPLETE SPECIFICATION [26-04-2019(online)].pdf 2019-04-26
3 201931016608-FORM 13 [08-02-2022(online)].pdf 2022-02-08
3 201931016608-FORM 18 [24-11-2021(online)].pdf 2021-11-24
4 201931016608-COMPLETE SPECIFICATION [26-04-2019(online)].pdf 2019-04-26
4 201931016608-FORM 18 [24-11-2021(online)].pdf 2021-11-24
5 201931016608-COMPLETE SPECIFICATION [26-04-2019(online)].pdf 2019-04-26
5 201931016608-DRAWINGS [26-04-2019(online)].pdf 2019-04-26
5 201931016608-FORM 13 [08-02-2022(online)].pdf 2022-02-08
6 201931016608-DRAWINGS [26-04-2019(online)].pdf 2019-04-26
6 201931016608-FER.pdf 2022-03-31
6 201931016608-FORM 1 [26-04-2019(online)].pdf 2019-04-26
7 201931016608-AbandonedLetter.pdf 2024-11-29
7 201931016608-FORM 1 [26-04-2019(online)].pdf 2019-04-26

Search Strategy

1 201931016608_searchE_31-03-2022.pdf