Abstract: The present subject matter discloses an electronic device 100 and method for enhancing texture of an object present in a video. The electronic device 100 comprises memory unit 106 coupled to image capturing unit 102 and image processing unit 104. The image capturing unit 102 captures a video comprising plurality of frames corresponding to plurality of objects. The image processing unit 104 extracts Region of Interest from a frame of the plurality of frames. The ROI comprises plurality of pixels having threshold values falling within a range of predefined lower and upper threshold value. The image processing unit 104 further segments the plurality of objects into masked objects and unmasked objects. Further, the masked objects are enhanced by adjusting threshold value corresponding to each pixel associated to each masked object based upon dynamic threshold values. Further, an enhanced image is generated by combining the masked objects with the unmasked objects.
CROSS-REFERENCE TO RELATED APPLICATIONS AND PRIORITY
[001] The present application does not claim priority from any patent application.
TECHNICAL FIELD
[002] The present subject matter described herein, in general, relates to a method and an electronic device for enhancing texture of an object in a video in a real-time.
BACKGROUND
[003] During an exhibition, or in a trade fair, or in an expo, or any such public display, a lot of objects are displayed to public. The objective of organizing such public displays is to focus attention of people or viewers on products (i.e., the objects) displayed during such public displays. For gaining the attention, the products must be displayed in an attractive manner. In some cases, these products are not directly displayed to the public due to certain reasons. In such scenarios, the products are displayed through their images, instead of physically presenting the product to the viewers. However, before displaying the images, it is to be ensured that the images must be of a better quality which could attract the public’s attention.
[004] For making the images attractive, lot of video-post processing tools and image processing technique are available offline. These offline tools are generally used by videographers or other professionals to bring amazing effects on the captured videos or images. However, before using such offline tools, knowledge is required by those professionals for using such tools, which is a time taking process and also requires lots of labor in editing clips of the video captured. Hence, it makes mandatory to consult the professional videographers. Apart from this limitation, these offline tools are capable of working on still images only due to their high processing time. Thus, the existing offline tools cannot be implemented in a real-time.
SUMMARY
[005] This summary is provided to introduce aspects related to electronic devices and methods for enhancing texture of an object present in a video are further described below in the detailed description. This summary is not intended to identify essential features of subject matter nor is it intended for use in determining or limiting the scope of the subject matter.
[006] In one implementation, an electronic device for enhancing texture of an object present in a video is disclosed. The electronic device may comprise a memory unit storing a lookup table. The memory unit may be further coupled to an image capturing unit and an image processing unit. Further, the image capturing unit may be configured to capture a video comprising plurality of frames corresponding to a plurality of objects. Further, the image processing unit may be configured to extract Region of Interest (ROI) from a frame of the plurality of frames. The ROI extracted may comprise a plurality of pixels having threshold values falling within a range of a predefined lower threshold value and a predefined upper threshold value, wherein the threshold values may be stored in the lookup table. The image processing unit may further segment the plurality of objects in the frame into masked objects and unmasked objects, wherein the masked objects may belong to the ROI. Further, the image processing unit may enhance the masked objects by adjusting a threshold value corresponding to each pixel associated to each masked object based upon dynamic threshold values pre-stored in the lookup table. Further, the image processing unit may generate an enhanced image by combining the masked objects with the unmasked objects.
[007] In another implementation, a method for enhancing texture of an object present in a video is disclosed. The method may comprise capturing, by an image capturing unit, a video comprising plurality of frames corresponding to a plurality of objects. The method may further comprise extracting, by an image processing unit, Region of Interest (ROI) from a frame of the plurality of frames. Further, the ROI extracted may comprise a plurality of pixels having threshold values falling within a range of a predefined lower threshold value and a predefined upper threshold value, wherein the threshold values may be stored in a lookup table. The method may further comprise a step of segmenting, by the image processing unit, the plurality of objects in the frame into masked objects and unmasked objects, wherein the masked objects may belong to the ROI. Further, the method may comprise a step of enhancing, by the image processing unit, the masked objects by adjusting a threshold value corresponding to each pixel associated to each masked object based upon dynamic threshold values pre-stored in the lookup table. The method may further comprise a step of generating, by the image processing unit, an enhanced image by combining the masked objects with the unmasked objects.
[008] Yet in another implementation a non-transitory computer readable medium embodying a program executable in a computing device for enhancing texture of an object present in a video is disclosed. The program may comprise a program code for capturing a video comprising plurality of frames corresponding to a plurality of objects. The program may further comprise a program code for extracting Region of Interest (ROI) from a frame of the plurality of frames. Further, the ROI extracted may comprise a plurality of pixels having threshold values falling within a range of a predefined lower threshold value and a predefined upper threshold value, wherein the threshold values may be stored in a lookup table. Further, the program may comprise a program code for segmenting the plurality of objects in the frame into masked objects and unmasked objects, wherein the masked objects belong to the ROI. The program may further comprise a program code for enhancing the masked objects by adjusting a threshold value corresponding to each pixel associated to each masked object based upon dynamic threshold values pre-stored in the lookup table. Further, the program may comprise a program code for generating an enhanced image by combining the masked objects with the unmasked objects.
BRIEF DESCRIPTION OF THE DRAWINGS
[009] The detailed description is described with reference to the accompanying figures. In the figures, the left-most digit(s) of a reference number identifies the figure in which the reference number first appears. The same numbers are used throughout the drawings to refer like features and components.
[0010] Figure 1 illustrates working of functional components of an electronic device, in accordance with an embodiment of the present subject matter.
[0011] Figure 2 illustrates a method for enhancing texture of an object present in a video, in accordance with an embodiment of the present subject matter.
DETAILED DESCRIPTION
[0012] Referring to Figure 1, functional components of an electronic device 100 is illustrated, in accordance with an embodiment of the present subject matter. Although the present subject matter is explained considering the electronic device 100 as a camera, it may be understood that the electronic device 100 may also be considered as variety of computing devices like a laptop computer, a desktop computer, a notebook, a tablet, a mobile phone, a handheld device or any other device capable of capturing and processing images or videos (not shown in the figure). Further, the electronic device 100 may comprise an image capturing unit 102, an image processing unit 104 and a memory unit 106. Further, the memory unit 106, coupled with the image capturing unit 102 and the image processing unit 104, stores a lookup table 108.
[0013] The present disclosure relates to an image processing technique for enhancing a look and feel of a captured image or a video. The enhancement may be done in a real-time video shoot which eliminates a need of using video-post processing techniques and external tools which only works on still images. The enhancement is basically done on an object’s image whose texture has not been clearly captured during the video shoot. This happens due to poor light exposure on an object while shooting the object’s video. The object may be a golden jewelry, a silver coin, an idol made up of gold, a diamond necklace, or any other object made up of such elements like such as gold, silver, platinum etc., which makes the object more attractive or more appealing or may be more pleasing for viewers. It must be understood to a person skilled in art that the aforementioned objects and elements are just an example and there may be several other combination of objects and elements upon which the present disclosure may be applicable. Thus, the present disclosure discloses the electronic device 100 which enhances the light exposure on the object in the real-time without using any external lights. The working of the electronic device 100 is explained in subsequent paragraphs of the specification.
[0014] In a first step, the image capturing unit 102, of the electronic device 100, captures a video of a plurality of objects which may be displayed during an exhibition, or in a trade fair, or in an expo, or during any other public display. The video captured comprises plurality of frames corresponding to the plurality of objects. Further, the plurality of frames is stored in the memory unit 106 of the electronic device 100. As conventionally known, that each of these frames are made up of several number of pixels, in which, each pixel has a certain value called as a pixel value which is nothing but a vector of three numbers associated with a RGB color space. Also, each of these frames has certain areas or regions in which the image processing is performed. These areas or regions are known as region of interest (ROI) which is required to be extracted from the frames in order to perform the image processing.
[0015] The basis of such extraction depends upon color of the object which can be seen in the object’s image. In the aforementioned examples, the objects which are considered, for the purpose of the present disclosure, includes a golden jewelry, a silver coin, an idol made up of gold, and a diamond necklace. However, according to one embodiment of present disclosure, the object i.e., the “golden jewelry” is considered for the explanation purpose. In this case, the object (i.e., golden jewelry) has a “golden color”, and therefore, the golden color becomes the basis for the extraction of the ROI from the frames. However, before performing such extraction, a lower threshold value and an upper threshold value may be defined, corresponding to the golden color, and stored in the lookup table 108 which is maintained in the memory unit 106 of the electronic device 100. Therefore, the lower threshold value and the upper threshold value (which are already defined and stored) are referred as a predefined lower threshold value and a predefined upper threshold value respectively. The predefined lower threshold value and the predefined upper threshold value are minimum pixel values and maximum pixel values respectively, which indicate a range of the golden color in the RGB color space.
[0016] Thus, based on above discussed extraction logic, the image processing unit 104, of the electronic device 100, extracts a region of interest (ROI) from each frame of the plurality of the frames stored in the memory unit 106. The ROI extracted comprises a plurality of pixels having thresholds values falling within the aforementioned range of the predefined lower threshold value and the predefined upper threshold value. The threshold values are nothing but a plurality of pixel values associated with the ROI extracted from the frame. Further, the threshold values (i.e., the plurality of pixel values) are stored in the lookup table 108 which is maintained in the memory unit 106 of the electronic device 100. Similarly, the threshold values, of all the ROIs extracted for each of the plurality of frames, are stored in the lookup table 108 of the memory unit 106.
[0017] Since, the ROIs are extracted from the frames, and theses frames forms an image or video of the objects, it must be understood that, the ROIs extracted comprises the objects in it. These objects are the plurality of objects of which the video is captured by the image capturing unit 102 of the electronic device 100. However, the entire ROI having the plurality of objects may not be considered for the purpose of the image processing. This is because, for example, if the entire ROI have an image of a women’s face wearing a golden ear rings, then only the golden ear rings (i.e., the golden jewelry) in that image will be considered for the image processing purpose. As already discussed in the above paragraphs of the specification that the objective of the preset disclosure is to enhance the texture of such objects (golden ear rings in this case) in the image to make it more attractive and pleasing for the viewers. Thus, in the next step, the image processing unit 104 segments the plurality of objects into masked objects and unmasked objects. Both, the masked objects and the unmasked objects may be stored in different sections of the memory unit 106. According to the present case, the masked objects correspond to the golden ear rings and the unmasked objects correspond to the women’s face excluding the golden ear rings, wherein both the masked objects and the unmasked objects belongs to the ROI extracted from the frame. Thus, only the masked objects may be considered for the image processing.
[0018] Now, since only the masked objects have to be considered, the image processing unit 104 processes only those particular set of pixels which correspond to the masked objects. These particular set of pixels are subset of the plurality of pixels which corresponds to the ROI extracted from the frame. Further, each of the set of pixels has their corresponding threshold values, which is nothing but pixel values. Thus, in order to enhance the texture of the masked object (i.e., the golden ear rings), threshold values (i.e., the pixel values) belonging to the masked objects has to be enhanced/increased. However, before performing such enhancement, it is important to determine a level up to which the existing threshold values (pixel values) has to be increased. Thus, a dynamic threshold values may be determined and stored in the lookup table 108 maintained in the memory 106 of the electronic device 100. The dynamic threshold values define the level up to which the existing threshold values, of the masked object, have to be adjusted.
[0019] Therefore, in the next step, the image processing unit 104 enhances the masked objects by adjusting the threshold values (i.e., the existing threshold values) corresponding to each of the set of pixels associated to the masked objects based upon the dynamic threshold values pre-stored in the lookup table 108 of the memory unit 106. Thus, by adjusting the existing threshold values, the quality of the masked object (golden ear ring) get enhanced in the image.
[0020] After performing the enhancement of the masked object, the image processing unit 104 further combines the enhanced masked objects with the unmasked object (stored in the memory unit 106) for generating an overall enhanced image of the object. Now, in this enhanced image, the golden ear rings, on the women’s face, can be seen more attractive due to external light effects and color correction brought in the enhanced image.
[0021] Referring now to Figure 2, the method of enhancing texture of an object present in a video is shown, in accordance with an embodiment of the present subject matter. The method 200 may be described in the general context of computer executable instructions. Generally, computer executable instructions can include routines, programs, objects, components, data structures, procedures, modules, functions, etc., that perform particular functions or implement particular abstract data types. The method 200 may also be practiced in a distributed computing environment where functions are performed by remote processing devices that are linked through a communications network. In a distributed computing environment, computer executable instructions may be located in both local and remote computer storage media, including memory storage devices.
[0022] The order in which the method 200 is described is not intended to be construed as a limitation, and any number of the described method blocks can be combined in any order to implement the method 200 or alternate methods. Additionally, individual blocks may be deleted from the method 200 without departing from the spirit and scope of the subject matter described herein. Furthermore, the method can be implemented in any suitable hardware, software, firmware, or combination thereof. However, for ease of explanation, in the embodiments described below, the method 200 may be considered to be implemented in the above described electronic device 100.
[0023] At block 202, a video comprising plurality of frames may be captured by an image capturing unit. The video may correspond to a plurality of objects.
[0024] At block 204, Region of Interest (ROI), from a frame of the plurality of frames, may be extracted by an image processing unit. The ROI may comprise a plurality of pixels having threshold values falling within a range of a predefined lower threshold value and a predefined upper threshold value. Further, the threshold values may be stored in a lookup table.
[0025] At block 206, the plurality of objects, in the frame, may be segmented by the image processing unit into masked objects and unmasked objects. Further, the masked objects may belong to the ROI.
[0026] At block 208, the masked objects may be enhanced, by the image processing unit, by adjusting a threshold value corresponding to each pixel associated to each masked object based upon dynamic threshold values pre-stored in the lookup table.
[0027] At block 210, an enhanced image may be generated, by the image processing unit, by combining the masked objects with the unmasked objects.
[0028] Although implementations for methods and electronic devices for enhancing texture of an object present in a video have been described in language specific to structural features and/or methods, it is to be understood that the appended claims are not necessarily limited to the specific features or methods described. Rather, the specific features and methods are disclosed as examples of implementations for enhancing texture of an object present in a video.
Claims:WE CLAIM:
1. A method for enhancing texture of an object present in a video, wherein the method comprising:
capturing, by an image capturing unit, a video comprising plurality of frames corresponding to a plurality of objects;
extracting, by an image processing unit, Region of Interest (ROI) from a frame of the plurality of frames, wherein the ROI comprises a plurality of pixels having threshold values falling within a range of a predefined lower threshold value and a predefined upper threshold value, and wherein the threshold values are stored in a lookup table;
segmenting, by the image processing unit, the plurality of objects in the frame into masked objects and unmasked objects, wherein the masked objects belong to the ROI;
enhancing, by the image processing unit, the masked objects by adjusting a threshold value corresponding to each pixel associated to each masked object based upon dynamic threshold values pre-stored in the lookup table; and
generating, by the image processing unit, an enhanced image by combining the masked objects with the unmasked objects.
2. The method of claim 1, wherein the predefined lower threshold value and the predefined upper threshold value are associated with a RGB color space.
3. The method of claim 1, wherein the dynamic threshold values are associated with the RGB color space.
4. The method of claim 1, wherein the plurality of objects comprises at least one of a golden jewelry, a silver coin, an idol made up of gold, and a diamond necklace.
5. A electronic device 100 for enhancing texture of an object present in a video, the electronic device 100 comprising:
a memory unit 106 storing a lookup table 108, wherein the memory unit 106 is coupled to an image capturing unit 102 and an image processing unit 104, wherein the image capturing unit 102 is configured to capture a video comprising plurality of frames corresponding to a plurality of objects, and wherein the image processing unit 104 is configured to:
extract Region of Interest (ROI) from a frame of the plurality of frames, wherein the ROI comprises a plurality of pixels having threshold values falling within a range of a predefined lower threshold value and a predefined upper threshold value, and wherein the threshold values are stored in the lookup table 108;
segment the plurality of objects in the frame into masked objects and unmasked objects, wherein the masked objects belong to the ROI;
enhance the masked objects by adjusting a threshold value corresponding to each pixel associated to each masked object based upon dynamic threshold values pre-stored in the lookup table 108; and
generate an enhanced image by combining the masked objects with the unmasked objects.
6. The electronic device 100 of claim 5, wherein the predefined lower threshold value and the predefined upper threshold value are associated with a RGB color space.
7. The electronic device 100 of claim 5, wherein the dynamic threshold values are associated with the RGB color space.
8. The electronic device 100 of claim 5, wherein the plurality of objects comprises at least one of a golden jewelry, a silver coin, an idol made up of gold, and a diamond necklace.
9. A non-transitory computer readable medium embodying a program executable in a computing device for enhancing texture of an object present in a video, the program comprising:
a program code for capturing a video comprising plurality of frames corresponding to a plurality of objects;
a program code for extracting Region of Interest (ROI) from a frame of the plurality of frames, wherein the ROI comprises a plurality of pixels having threshold values falling within a range of a predefined lower threshold value and a predefined upper threshold value, and wherein the threshold values are stored in a lookup table;
a program code for segmenting the plurality of objects in the frame into masked objects and unmasked objects, wherein the masked objects belong to the ROI;
a program code for enhancing the masked objects by adjusting a threshold value corresponding to each pixel associated to each masked object based upon dynamic threshold values pre-stored in the lookup table; and
a program code for generating an enhanced image by combining the masked objects with the unmasked objects.
| # | Name | Date |
|---|---|---|
| 1 | 2784-DEL-2015-AbandonedLetter.pdf | 2019-12-27 |
| 1 | Form 3 [04-09-2015(online)].pdf | 2015-09-04 |
| 2 | 2784-DEL-2015-FER.pdf | 2019-06-17 |
| 3 | 2784-del-2015-Correspondence Others-(17-12-2015).pdf | 2015-12-17 |
| 3 | Drawing [04-09-2015(online)].pdf | 2015-09-04 |
| 4 | 2784-del-2015-Form-1-(17-12-2015).pdf | 2015-12-17 |
| 4 | Description(Complete) [04-09-2015(online)].pdf | 2015-09-04 |
| 5 | 2784-del-2015-GPA-(17-12-2015).pdf | 2015-12-17 |
| 6 | 2784-del-2015-Form-1-(17-12-2015).pdf | 2015-12-17 |
| 6 | Description(Complete) [04-09-2015(online)].pdf | 2015-09-04 |
| 7 | 2784-del-2015-Correspondence Others-(17-12-2015).pdf | 2015-12-17 |
| 7 | Drawing [04-09-2015(online)].pdf | 2015-09-04 |
| 8 | 2784-DEL-2015-FER.pdf | 2019-06-17 |
| 9 | 2784-DEL-2015-AbandonedLetter.pdf | 2019-12-27 |
| 9 | Form 3 [04-09-2015(online)].pdf | 2015-09-04 |
| 1 | SEARCH2784_13-06-2019.pdf |