System And Method For Controlling Capture Of Images
Abstract:
Various aspects of a system and method to control capture of images are disclosed herein. In accordance with an embodiment the method includes capture of a first image of a user selected scene by an electronic device. The user selected scene comprises one or more objects. A scene mode from a pre stored set of scene modes is determined by the electronic device to capture a plurality of images of the user selected scene. The determination of the scene mode is based on an object type of the one or more objects and a geo location of the electronic device. The scene mode is determined when the first image is captured or when image data corresponding to the user selected scene is received.
Get Free WhatsApp Updates!
Notices, Deadlines & Correspondence
16535 Via Esprillo MZ 1036
San Diego California 92127
Specification
FIELD
[0001] Various embodiments of the disclosure relate to a system and method to
control capture of images. More specifically, various embodiments of the disclosure
relate to a system and method to control capture of images based on a geo-location of
an electronic device.
BACKGROUND
[0002] Advancements in the field of digital technology have extended the
functionalities of various electronic devices and associated applications. In certain
scenarios, a user may want to capture an image of an important moment or a
picturesque scene from a certain location by use of an electronic device, such as a
smartphone or a camera. The user may either manually select a scene mode or use
an in~built auto~scene detection mode that may be provided by a manufacturer of the
electronic device .. However, the scene captured by use of the in-built auto-scene
detection mode of the electronic device may not be an exact or ideal reproduction of
the picturesque scene. Advanced capabilities and functiona!ities may be required by
the electronic device to provide a professional photography experience to a user. An
enhanced system may be required that may capture at least one ideal image at a
significant moment with a specific degree of certainty.
1
wo 2017/030777 PCT/US2016/045097
[0003] Further !imitations and disadvantages of conventional and traditional
approaches will become apparent to one of skill ln the art, through comparison of
described systems with some aspects of the present disclosure, as set forth in the
remainder of the present application and with reference to the drawings.
2
wo 2017/030777 PCT/US2016/045097
SUMMARY
[0004] A system and a method to control capture of images substantially as
shown in, and/or described in connection with, at least one of the figures .. as set forth
more completely in the claims.
[0005] These and other features and advantages of the present disclosure may
be appreciated from a review of the following detailed description of the present
disclosure, along with the accompanying figures in which like reference numerals refer
to like parts throughout
3
wo 2017/030777 PCT/US2016/045097
BRIEF DESCRIPTION OF THE DRAWINGS
[0006] FIG. 1 is a block diagram that illustrates a network environment, in
accordance with an embodiment of the disclosure.
[0007] FIG. 2 is a block diagram that illustrates an exemplary electronic device, in
accordance with an embodiment of the disclosure.
[0008] FIG. 3 illustrates a first exemplary scenario for implementation of the
disclosed system and method to control capture of images, in accordance with an
embodiment of the disclosure.
[0009] FIG. 4A and 4B collectively depict a first flow cha1i that illustrates an
exemplary method to control capture of images, in accordance with an embodiment of
the disclosure.
[0010] FIG. 5 is second flow chart that illustrates another exemplary method to
control capture of images, in accordance with an embodiment of the disclosure.
4
wo 2017/030777 PCT/US2016/045097
DETAILED DESCRIPTION
[0011] The following described implementations may be found in disclosed
system and method that controls capture of images. Exemplary aspects of the
disclosure may comprise a method that may capture a first image of a user-selected
scene. The user-selected scene may comprise one or more objects. A scene mode
from a pre-stored set of scene modes may be determined to capture a plurality of
images of the user-selected scene. The scene mode may be determined based on an
object type of the one or more objects and a geo-location of the electronic device
when the first image is captured.
[0012] In accordance with an embodiment, the pre-stored set of scene modes
may comprise an indoor scene mode, a party scene mode, an outdoor scene mode, a
night portrait scene mode, a portrait scene mode, a beach scene mode., a snow scene
mode, a landscape scene mode, a waterfall scene mode, a birthday scene mode, a
sports action scene mode, a bird-watch scene mode, and/or a user-defined scene
mode. An image buffer may be provided that may be configured to store the captured
first image.
[0013] In accordance with an embodiment, the object type of the one or more
objects may be determined in the user-selected scene based on analysis of the
captured first image stored in the image buffer. The analysis may occur before the
capture of the plurality of images. An input may be received to capture the plurality of
images. Each of the plurality of images may be captured by use of a user-defined
photography setting for the determined scene mode. The photography setting may
comprise a set of photography setting parameters. The set of photography setting
5
wo 2017/030777 PCT/US2016/045097
parameters may comprise shutter speed, aperture size, lens focal length, flash
operation, red-eye correction, white balance, automatic gain setting, International
Organization of Standardization (ISO) setting to adjust sensitivity to light, and/or a
shooting mode to establish aperture priority with respect to shutter-priority or manual
control.
[0014] In accordance with an embodiment, each of the photography settings
associated with the plurality of images captured by the electronic device may be
tagged with metadata. The metadata may comprise a time of capture of the plurality of
images, an orientation of the electronic device, the geo-location of the electronic
device, the determined scene mode, and/or the object type of the one or more objects
in the user-selected scene.
[0015] In accordance with an embodiment, a user input may be received that
corresponds to a selection of one or more of the plurality of images associated with
corresponding one or more photography settings tagged with the metadata. The one
or more photography settings tagged with the metadata may be communicated to a
server based on the selection of the one or more of the plurality of images.
[0016] In accordance with an embodiment, a new user-defined scene mode that
corresponds to the user-selected scene may be created. The new user-defined scene
mode may be created based on the selection of one or more of the plurality of images.
The new user-defined scene mode may correspond to a particular group of
photography settings used to capture the user-selected scene by the electronic device
at the geo-location. The pre-stored set ot scene modes may be updated based on the
created new user -defined scene mode.
6
wo 2017/030777 PCT/US2016/045097
[0017] In accordance with an exemplary aspect of the disclosure, another method
may be provided that may be implemented in the electronic device. The method may
include receipt of image data of a user¥selected scene that may be visualized via the
electronic device. The user-selected scene may comprise one or more objects. A
scene mode from a pre-stored set of scene modes to capture one or more images of
the user-selected scene may be determined. The scene mode may be determined
based on an object type of the one or more objects and a gee-location of the
electronic device when the image data that corresponds to the user-selected scene is
received.
[0018] In accordance with an exemplary aspect of the disclosure, another method
may be provided that may be implemented in a server. The method may include
receipt of one or more photography settings tagged with metadata from the electronic
device. A new user-defined scene mode may be created based on the received one or
more photography settings. The new user-defined scene mode may correspond to the
particular group of photography settings used to capture the user-selected scene by
the electronic device at the gao-location. A pre-stored set of scene modes may be
updated at the server based on the created new user-defined scene mode.
[0019] In accordance with an embodiment, a user associated with the electronic
device or another electronic device may retrieve the created new user-defined scene
mode or the one or more photography settings from the server based on a time of
capture of the plurality of images, an orientation of the electronic device, the geelocation
of the electronic device, the determined scene mode, and/or the object type of
one or more objects determined by the electronic device in the user-selected scene.
7
wo 2017/030777 PCT/US2016/045097
[0020] FIG. 1 is a block diagram that illustrates a network environment, in
accordance with an embodiment of the disclosure. With reference to FIG. 1, there is
shown a network environment 100. The network environment 100 may include an
electronic device 102, one or more cloud-based resources, such as a server 104, a
communication network 106, a User Interface (UI) 108, and one or more users, such
as a user 11 0. The electronic device 102 may be communicatively coupled with the
server 104, via the communication network 106. The electronic device 102 may be
associated with the user 110.
[0021] The electronic device 102 may compnse suitable logic, circuitry,
interfaces, and/or code that may be configured to determine a scene mode from a prestored
set of scene modes at the electronic device 102, based on at !east a geo~
location of the electronic device 1 02. The electronic device 102 may be further
configured to store an image-capturing application. The image-capturing application
may render the Ul 108 at the electronic device 102. Examples of the electronic device
102 may include,. but are not limited to, a smartphone, a camera, a tablet computer, a
laptop, and/or a wearable electronic device (such as a smart glass).
[0022] The server 104 may comprise suitable logic, circuitry, interfaces, and/or
code that may be configured to receive requests from one or more subscribed
devices, such as the electronic device 1 02. The server 104 may be configured to store
multiple photography settings received from one or more electronic devices, such as
the electronic device 102. The server 104 may be a web server, a database server, a
file server, an application server, a cloud based sever, or a combination thereof. The
8
wo 2017/030777 PCT/US2016/045097
server 104 may be implemented by use of several technologies that are well known to
those skilled in the art
[0023] The communication network 106 may include a medium through which the
electronic device 102 may communicate with one or more servers, such as the server
104. Examples of the communication network 106 may include, but are not limited to,
the Internet, a cloud network, a Wireless Fidelity (\IVi-Fi) network, a Wireless Local
Area Network (WLAN), a Local Area Network (LAN), a plain old telephone service
(POTS), and/or a Metropolitan Area Network (MAN). Various devices in the network
environment 1 00 may be configured to connect to the communication network 1 06, in
accordance with various wired and wireless communication protocols. Examples of
such wired and wireless communication protocols may include, but are not limited to,
Transmission Control Protocol and Internet Protocol (TCP/!P), User Datagram
Protocol (UDP), Hypertext Transfer Protocol (HTTP), File Transfer Protocol (FTP),
ZigBee, EDGE, infrared (IR), IEEE 802.11, 802.16, cellular communication protocols,
such as Long Term Evolution (LTE), and/or Bluetooth (BT) communication protocols.
[0024] The Ul 108 may be rendered at a display screen of the electronic device
102. The Ul 108 may correspond to the image-capturing application stored at the
electronic device 102. The Ul 108 may comprise one or more Ul elements that may
enable the user 110 to configure a new scene mode, as per preferences of the user
110. Based on the configuration, various user-defined scene modes, different from the
default scene modes, may be created. Such user-defined scene modes may be
dependent upon lifestyle, user image-capturing behavior, and/or certain landmarks,
tourist locations or other locations, preferred by the user 110.
9
wo 2017/030777 PCT/US2016/045097
[0025] In accordance with an embodiment, the Ul 108 may facilitate configuration
of various photography settings for the pre-stored set of scene modes, defined by the
user 110. For example, the user 110 may configure certain number of photography
settings, such as a group of ten photography settings, for a certain scene mode, such
as the sports action scene mode. Each photography setting may comprise a different
set of photography setting parameters.
[0026] In operation, the electronic device 102 may be configured to detect intent
of an associated user, such as the user 110, to capture a plurality of images of a
scene selected by the user 110 (hereinafter referred to as "user-selected scene"). The
intent of the user 110 may be detected by the electronic device 102 based on one or
more events. For example, the user 110 may launch the image-c~pturing application
at the electronic device 102 and point the electronic device 102 towards the userselected
scene. The electronic device 102 may detect occurrences of such one or
more events (such as pointing of the electronic device 102 towards the user-selected
scene) to detect the intent of the user 110 to capture the plurality of images of the
user -selected scene.
[0027] In accordance with an embodiment, the electronic device 1 02 may be
configured to receive image data corresponding to the user-selected scene. The userselected
scene may comprise one or more objects. The image data may be received
when the electronic device 1 02 is pointed towards the user-selected scene. The
electronic device 102 may be configured to analyze the image data corresponding to
the user-selected scene from an image buffer. The image buffer may temporally store
the image data corresponding to the user-selected scene. The image buffer may be
10
wo 2017/030777 PCT/US2016/045097
implemented by a primary memory, such as a random access memory or a cache
memory, of the electronic device 102.
[0028] In accordance with an embodiment, the electronic device 1 02 may be
configured to determine an object type of the one or more objects, based on the
analysis. The object type may be determined when the electronic device 102 is
pointed towards the user-selected scene and/or when the intent of the user 110 is
detected to capture the plurality of images of the user-selected scene. In accordance
with an embodiment, the electronic device 102 may be configured to determine a
scene mode based on the determined object type of the one or more objects and a
gee-location of the electronic device 102. The determination of the scene mode and
the gee-location of the electronic device 1 02 may occur when the electronic device
102 is pointed towards the user-selected scene and/or when the intent of the user 110
is detected to capture the plurality of images of the user-selected scene.
[0029] In accordance with an embodiment, the electronic device 1 02 may be
configured to receive an input from the user 110 to capture the plurality of images. In
response to the input received from the user 110, the electronic device 1 02 may be
configured to capture a first image of the user-selected scene. The first image may
comprise one or more objects. The first image may be captured in a default scene
setting. In accordance with an embodiment. the first image may be captured
dynamically without the user input, based on the detection of the user intent to capture
the plurality of images. In accordance with an embodiment, the electronic device 102
may comprise the image buffer configured to store the captured first image of the
user-selected scene or the image data corresponding to the user-selected scene
11
wo 2017/030777 PCT/US2016/045097
before the capture of the first image. In accordance with an embodiment, the captured
first image may also be stored at a secondary memory, such as a hard disk drive
(HOD).
[0030] In accordance with an embodiment, the electronic device 1 02 may be
configured to analyze the captured first image stored in the image buffer. Based on
the analysis of the captured first image, the electronic device 102 may be configured
to determine an object type of the one or more objects. The object type may be
determined before the capture of other images of the plurality of images.
[0031] In accordance with an embodiment, the electronic device 1 02 may be
configured to determine a scene mode from the pre-stored set of scene modes. The
pre-stored set of scene modes may comprise one or more user-defined scene modes
and/or a manufacturer defined scene modes (hereinafter referred to as ~default scene
modes"). The electronic device i 02 may determine the scene mode based on the
determined object type of the one or more objects and a gee-location of the electronic
device 102 when the first image is captured. In accordance with an embodiment, the
determined scene mode may be used to capture the other images of the plurality of
images of the user-selected scene.
[0032] In accordance with an embodiment, the electronic device 1 02 may be
configured to utilize different photography settings associated with the determined
scene mode to capture the plurality of images. The photography settings may be userdefined
and stored at the electronic device 102. For example, the user 110 may
configure a certain number of photography settings, such as a group of ten
photography settings, prior to capture of the plurality of images. Each user-defined
12
wo 2017/030777 PCT/US2016/045097
photography setting may comprise a set of photography setting parameters. Examples
of the set of photography setting parameters may include, but are not limited to,
shutter speed, aperture mechanism or size, lens focal length, flash operation, red-eye
correction, white balance, and/or automatic gain setting, a shooting mode (which
establishes aperture priority with respect to shutter-priority), manual control, and ISO
setting (to adjust sensitivity to light for the electronic device 1 02), A variation of values
of one or more photography setting parameters of the set of photography setting
parameters may result in a distinct and/or varied effect in the captured plurality of
images. In accordance with an embodiment, different values for each of the set of
pl1otography setting parameters may be pre-defined by the user 110 for each of the
photography settings.
[0033] In accordance with an embodiment, the electronic device 1 02 may be
configured to tag metadata with each of the user-defined photography settings used to
capture the plurality of images. The metadata may comprise a time of capture of the
plurality of images, an orientation of the electronic device 102, the detected geo!
ocation of the electronic device 102. the determined scene mode, and/or the
determined object type of the one or more objects in the user-selected scene. In
accordance with an embodiment, tile electronic device 102 may furtl1er associate
each of the plurality of images with a corresponding user-defined photography setting
tagged with the metadata. An associative relationship between each of the plurality of
images and the corresponding tagged user-defined photography setting may be
established.
13
wo 2017/030777 PCT/US2016/045097
[0034] In accordance with an embodiment, after the capture of the plurality of
images, the electronic device 102 may be configured to store the captured plurality of
images with the determined scene mode. As described above, each image of the
plurality of images may be captured by use of different photography settings. For
example, a single user input, such as a touch-based input, provided by the user 110
may trigger the electronic device 102 to capture fifteen images in a quick succession.
The fifteen images may have different visual effects as compared to each other. The
different visual effects may be due to use of a different user-defined photography
setting for each of the fifteen images tor the determined scene mode. The userdefined
photography settings may be different from the photography settings (camera
settings) provided by the manufacturer of the electronic device 102. Thus, the same
user-selected scene, captured by use of different user-defined photography settings
may increase degree of certainty for capture of at least one optima! image out of the
fifteen images,
[0035] In accordance with an embodiment, the electronic device 1 02 may be
configured to control display of the plurality of images, captured via the Ul 108 at the
electronic device 102. The captured plurality of images may be displayed
simultaneously with the corresponding tagged photography settings. The
simultaneous display may enable any user, for example, a professional photographer,
or a novice user, to identify an ideal photography setting based on visualization of the
captured plurality of images. For example, at !east one of the captured images may be
an optima! image (a best shot) for the determined gee-location and the object-type of
the one or more objects in the user-selected scene. The user 110 may select the
14
wo 2017/030777 PCT/US2016/045097
photography setting used to capture the optimal image for later use. The selected
pl1otography setting may be shared with another electronic device associated with
another use, such as via a SMS, via the communication network 106. The selected
photography setting tagged with the metadata may be shared or uploaded to the
server 104 for use by the other user tor the determined geo-location.
[0036] In accordance with an embodiment, the electronic device 1 02 may be
configured to receive another user input that corresponds to a selection of one or
more of the plurality of images captured by the electronic device 102, via the Ul 108.
The electronic device 102 may be configured to communicate the tagged user-defined
photography settings associated with the selected one or more of the plurality of
images to the server 104. Similarly, other electronic devices may also communicate
other tagged user-defined photography settings associated with one or more of other
plurality of images to the server 104.
[0037] In accordance with an embodiment, the server 1 04 may be configured to
receive and store the tagged user-defined photography settings from the one or more
electronic devices, such as the electronic device 102. The server 104 may be
configured to create a new user-defined scene mode based on the received tagged
user-defined photography settings. The new user-defined scene mode may
correspond to a particular group of photography settings (such as the group of ten
photography settings,. as described above) used to capture the user-selected scene by
the electronic device 102 at the determined gee-location.
[0038] In accordance with an embodiment, the server 1 04 may be configured to
update a pre-stored set of scene modes at the server 104, based on the new user-
15
wo 2017/030777 PCT/US2016/045097
defined scene mode. For example, the new user-defined scene mode may be added
to the pre-stored set of scene modes at the server 1 04. In accordance with an
embodiment, the server 104 may communicate the new user-defined scene mode to
the electronic device 102. Such a communication may add the new user-defined
scene mode to the pre-stored set of scene modes at the electronic device 102. The
addition of the new user-defined scene mode may update the count of the scene
modes of the pre-stored set of scene modes at the electronic device 102. In
accordance with an embodiment, instead of the server 104, the electronic device 1 02
may be configured to create and/or update the new user-defined scene mode.
[0039] In accordance with an embodiment, the user 110 or another user,
associated with the electronic device 102 or another electronic device, respectively,
may retrieve the new user-defined scene mode with the tagged one or more userdefined
photography settings from the server 104. The retrieval may be based on one
or more of a time of capture of at least the first image of the plurality of images by the
another electronic device, a time of detection of the intent of the user 110 to capture
the plurality of images, the orientation of the another electronic device, the determined
gee-location of the another electronic device, the determined scene mode, the
determined object type of one or more objects in the first image of the user-selected
scene and/or the image data corresponding to the user-selected scene. In accordance
with an embodiment, the retrieval may occur when the first image of the plurality of
images is captured. In accordance with an embodiment, the retrieval may occur when
the electronic device 102 is pointed towards the user-selected scene and/or when the
intent of the user 110 is detected to capture the p!ura!lty of images of the user-
16
wo 2017/030777 PCT/US2016/045097
selected scene. In accordance with an embodiment, the retrieval may occur based on
an input provided by the user 110, via the Ul 108, at the time of configuration of the
user-defined photography settings. In accordance with an embodiment, the retrieval
may occur based on analysis of the user-defined photography settings stored at the
electronic device 102. The scenarios, under which the retrieval and/or other
operations may occur, are described in detail in Fig. 2.
[0040] FIG. 2 is a block diagram that illustrates an exemplary electronic device, in
accordance with an embodiment of the disclosure. FIG. 2 is explained in conjunction
with elements from FIG. 1. With reference to FIG. 2, there is shown the electronic
device 102. The electronic device 102 may comprise one or more processors (such as
a processor 202),. one or more memory units (such as a primary memory 204a and a
secondary memory 204b), and one or more input/output (1/0) devices (such as 110
device 206, sensing devices 208). The electronic device 102 may further comprise a
transceiver 210 and an image-capturing unit 212. The 110 device 206 may include a
display 214. With reference to FIG. 2, there is further shown the communication
network 1 06 of FIG. 1 .
[0041] The processor 202 may be communicatively coupled to the primary
memory 204a, the secondary memory 204b, the llO device 206, the sensing devices
208, the transceiver 210, and the image-capturing unit 212. The transceiver 210 may
be configured to communicate with one or more servers, such as the server 104, via
the communication network 106.
[0042] The processor 202 may comprise suitable logic, circuitry, intelfaces,
and/or code that may be configured to execute a set of instructions stored in the
17
wo 2017/030777 PCT/US2016/045097
primary memory 204a and/or the secondary memory 204b, The processor 202 may be
further configured to receive input that may launch the image-capturing application,
pre-stored in the primary memory 204a and/or the secondary memory 204b. The
processor 202 may be implemented based on a number of processor technologies
known in the art Examples of the processor 202 may be an X86-based processor,
X86-64-based processor, a Reduced Instruction Set Computing (RISC) processor, an
Application-Specific Integrated Circuit (ASIC) processor, a Complex Instruction Set
Computing (CISC) processor, a centra! processing unit (CPU), an Explicitly Parallel
Instruction Computing (EPIC) processor, a Very Long Instruction Word (VLIW)
processor, and/or other processors or circuits.
[0043] The primary memory 204a may comprise suitable logic, circuitry, and/or
interfaces that may be configured to temporarily store image data corresponding to the
user-selected scene when the e!ectronic device 102 is ,o ointed towards the user~
selected scene and/or when the intent of the user '110 is detected to capture the
plurality of images of the user-selected scenEL Tile primary memory 204a may be
further r,onfigured to temporarily store the captured first image of the plurality of
images for analysis, Examples of implementation of the primary memory 204a may
include, but are not limited to, Random Access Mem01y (RAM), Dynamic Random
Access Memory (DRAM), Static Random Access Memory (SRAM), Thyristor Random
Access Memory (T-RAM), Zero-Capacitor Random Access Memory (Z-RAM), cache
memory, and/or other volatile memory.
[0044] The secondary memory 204b may comprise suitable logic, circuitry, and/or
interfaces that may be configured to store a machine code and/or a set of instructions
18
wo 2017/030777 PCT/US2016/045097
executable by the processor 202. The secondary memory 204b may be configured to
store one or more user profile information and corresponding photography settings
configured by one or more users. The secondary memory 204b may be further
configured to store user-defined scene mode settings and other scene modes. The
secondary memory 204b may be further configured to store the set of scene modes.
The set of scene modes may be stored in an associative relationship with
corresponding gee-location data, such as certain landmarks, tourist locations or other
locations, preferred by the user 110. The secondary memory 204b may be further
configured to store operating systems and associated applications. Examples of
implementation of the secondary memory 204b may include, but are not limited to,
Read Only Memory (ROM), a flash memory, Hard Disk Drive (HDD), a Solid-State
Drive (SSD), a Secure Digital (SD) card, and/or a removable media drive.
[0045] The 1/0 device 206 may comprise suitable logic, circuitry, interfaces,
and/or code that may be configured to receive an input from and provide an output to
the user 110. The !/0 device 206 may include various input and output devices that
may be configured to facilitate a communication between the processor 202 and the
user 110. Examples of the input devices may include, but are not limited to, a shutter
button, a record button on the electronic device 102 (such as a camera), a software
button on the U! 108,. the image-capturing unit 212, a camcorder, a touch screen, a
microphone, a motion sensor, and/or a light sensor. Examples of the output devices
may include, but are not limited to, the display 214, a projector screen, and/or a
speaker.
19
wo 2017/030777 PCT/US2016/045097
[0046] The sensing devices 208 may comprise one or more sensors that include
a suitable logic, circuitry, interfaces, and/or code to detect physical or quantitative
attributes and provide corresponding output as sensor data. The physical or
quantitative attributes may include, but are not limited to, orientation, motion, contact,
proximity, geo-magnetic field, and/or ambient lighting. The one or more sensors in the
sensing devices 208 may be configured to detect an orientation and a gee-location of
the electronic device 102. The one or more sensors in the sensing devices 208 may
be further configured for tap detection and/or gesture detection. The one or more
sensors in the sensing devices 208 may be further configured to aid in capture of one
or more scenes, such as images and/or videos, by the image-capturing unit 212.
Examples of the one or more sensors may include, but are not limited to, an
accelerometer, a global positioning system (GPS) sensor, a cornpass or magnometer,
an ambient light sensor, a tricorder, a gyroscope, a proximity sensor, an irnage
sensor, a lux meter, a touch sensor, and/or an infrared sensor.
[0047] The transceiver 210 may comprise suitable logic, circuitry, interfaces,
and/or code that may be configured to communicate with one or more servers, such
as the server 104, via the communication network 106 (as shown in FIG. 1). The
transceiver 21 0 may implement known technologies to support wired or wireless
communication of the electronic device 1 02 with the communication network 1 06. The
transceiver 210 may include, but is not limited to, an antenna, a radio frequency (RF)
transceiver,. one or more amplifiers, a tuner, one or more oscillators., a digital signal
processor, a coder-decoder (CODEC) chipset, a subscriber identity module (SIM)
card, and/or a local buffer.
20
wo 2017/030777 PCT/US2016/045097
[0048] The transceiver 210 may communicate via wireless communication with
the communication net:vvork 106. The wireless communication may use one or more of
the communication standards, protocols and technologies, such as Global System for
Mobile Communications (GSM), Enhanced Data GSM Environment (EDGE),
wideband code division multiple access (W-CDMA), code division multiple access
(COMA), time division multiple access (TDMA), B!uetooth, Wireless Fidelity (Wi-Fi)
(such as IEEE 802.11 a, IEEE 802.11 b, IEEE 802.11g and/or IEEE 802.11 n), voice
over Internet Protocol (VoiP), \Ni-MAX, a protocol for email, instant messaging, and/or
Short Message Service (SMS).
[0049] The irnage-capturing unit 212 may comprise suitable logic, circuitry,
interfaces, and/or code that may be configured to capture one or more scenes, such
as a picturesque scene. The image-capturing unit 212 may refer to an in-built camera
or an image sensor of the electronic device 102, such as a smartphone. The imagecapturing
unit 212 may comprise a viewfinder that may be configured to compose
and/or focus the user-selected scene captlJred by the image-capturing unit 212. The
image-capturing unit 212 may be configured to store the captured plurality of images
that corresponds to the user-selected scene in a local buffer and/or the secondary
memory 204b, under the control ot the processor 202.
[0050] The display 214 may comprise suitable logic, circuitry, interfaces, and/or
code that may be configured to render the Ul 108 of the electronic device 1 02. The
display 214 may be realized through several known technologies, such as Cathode
Ray Tube (CRT) based display, Liquid Crystal Display (LCD), Light Emitting Diode
(LED) based display, Organic LED display technology, Retina display technology,
21
wo 2017/030777 PCT/US2016/045097
and/or the like. In accordance with an embodiment, the display 214 may be capable of
receiving input from the user 110. In such a scenario, the display 214 may be a touch
screen that enables the user 110 to provide the input The touch screen may
correspond to at least one of a resistive touch screen, a capacitive touch screen, or a
thermal touch screen. In accordance with an embodiment, the display 214 may
receive the input through a virtual keypad, a stylus, a gesture-based input, and/or a
touch-based input. In such a case, the input device may be integrated within the
display 214. In accordance with an embodiment, the electronic device 1 02 may
include a secondary input device apart from a touch screen based dis play 214.
[0051] In operation, the processor 202 may be configured to detect intent of the
user 110 to capture a plurality of images of the user-selected scene by use of the
image-capturing unit 212. For example, the user 110 may provide an input at the
electronic device 102, via the Ul 108 of the image-capturing application, to enable a
professional photography mode. The user 110 may then point the electronic device
102 towards the user-selected scene. The user 110 may uti!lze the viewfinder of the
image-capturing unit 212 to compose the user~selected scene. The processor 202
may detect occurrences of events (such as enab!ement of the professional
photography mode and pointing tile electronic device 102 towards tile user-selected
scene) to detect the intent of the user 110 to capture the plurality of images of the
user-selected scene.
[0052] In accordance with an embodiment, the electronic device 1 02 may be
configured to receive an input to capture the plurality of images. The processor 202
may be configured to capture a first image of the user-selected scene., such as the
22
wo 2017/030777 PCT/US2016/045097
scene selected by the user 110_, using a default scene setting. In accordance with an
embodiment, the processor 202 may be configured to determine the geo-location of
the electronic device 102. In accordance with an embodiment, the geo-locatlon may
be determined when the first image is captured by use of at least one of the sensing
devices 208, such as the GPS sensor. In accordance with an embodiment, the gaolocation
may be determined when the first image is captured by use of at least one of
the sensing devices 208, such as the GPS sensor. In accordance with an
embodiment, the geo-location may be determined when the electronic device 102 is
pointed towards the user-selected scene and/or when the intent of the user 110 is
detected to capture the plurality of images of the user-selected scene. The primary
memory 204a may comprise at least an image buffer configured to temporarily store
the captured first image and/or the image data corresponding to the user-selected
scene.
[0053] In accordance with an embodiment, the captured first image of the userselected
scene may comprise one or more objects. The electronic device 1 02 may be
configured to determine an object type of the one or more objects based on the
analysis of the captured first image or the image data corresponding to the userselected
scene stored in the image buffer. The image buffer of the first image may be
analyzed before the capture of other of the plurality of images.
[0054] In accordance with an embodiment, the processor 202 may be configured
to dynamically determine a scene mode to capture the plurality of images of the userselected
scene. In accordance with an embodiment, the scene mode may be
determined from a pre-stored set of scene modes, based on the determined geo-
23
wo 2017/030777 PCT/US2016/045097
location and the determined object-type of the one or more objects. In accordance
with an embodiment, the scene mode may be determined based on a time of capture
and/or a distance from the one or more objects of the first image. In accordance with
an embodiment, the scene mode may be determined based on a time when the
electronic device 102 is pointed towards the user-selected scene and/or when the
intent of the user 110 is detected to capture the plurality of images of the userselected
scene. In accordance with an embodiment, the scene mode may be
determined based on a distance from the one or more objects detected in the image
data corresponding to the user-selected scene. The pre-stored set of scene modes
may comprise one or more user-defined scene modes and/or manufacturer defined
scene modes (or "default scene modes"). Examples of the pre-stored set of scene
modes may include, but are not limited to, an indoor scene mode, a party scene
mode, an outdoor scene mode, a night portrait scene mode, a portrait scene mode, a
beach scene mode, a snow scene mode, a landscape, a sunset scene mode, a
theatre scene mode, a fireworks scene mode, a waterfall scene mode, a birthday
scene mode, a sports action scene mode, and/or a bird-watch scene mode.
[0055] In accordance with an embodiment, the processor 202 may be configured
to capture ttle plurality of images based on the determined scene mode. Each image
of the plurality of images may be captured by use of different photography settings
(user-defined photography settings) for the determined scene mode. In addition to the
user-defined photography settings, the photography settings may further include
system-generated photography settings (by the electronic device 1 02) and/or retrieved
pl1otography settings (from the server 104 ), as explained below.
24
wo 2017/030777 PCT/US2016/045097
[0056] In certain instances, the user-defined pt1otography settings may not be
available for certain scene modes, such as the determined scene mode. In such
instances, it may be desirable to use a photography setting pre-defined by other users
as an ideal setting for the determined gee-location and the determined scene mode. In
such instances, or as per user input, the processor 202 may be configured to retrieve
relevant photography settings (relevant for the user-selected scene) for the
determined scene mode from the server 104 by use of the transceiver 210, via the
communication network 106.
[0057] In accordance with an embodiment, the relevant photography settings
may be retrieved from the server 104, based on at least a time of capture of the first
image. For example, the user 110 may want to capture an ideal image of an iconic
landmark in a suitable lighting condition. The user 110 may want to capture at least
one image with a desired visual effect. The desired visual effect may be a scene
where the background of the iconic landmark is neither too dark (such as a darkshaded
sky), nor too bright (such as a radiant or brightly lit sky). Further, the user 11 0
may desire to capture the iconic landmark when it is lit by the colorful lights. The iconic
landmark may be !it by colorful artificial lights in evening or nighttime .. However, the
artificial lights may not be put on when there is enough natura! light in the morning
hours. Thus, images captured in the determined scene mode, such as a ~cityscape
scene mode", by use of a single user-defined photography setting (that comprises a
particular set of settings) at different time of day, may provide varied visual effects.
The processor 202 may be configured to receive an input to retrieve a relevant
pl1otography setting from the server 104 for an evening time, such as "", for the detected gee-location of the iconic landmark, The retrieved
pl1otography setting may correspond to a user¥defined photography setting that may
be shared by another user. The retrieved photography setting may comprise certain
pre-configured values for one or more setting parameters, such as ISO setting of
~1500", aperture of "f/3.5", and/or shutter speed of "1/60". The retrieved photography
setting may provide a right balance for exposure between natura! and artificial light, to
capture the image with desired visual effect
[0058] In accordance with an embodiment, the relevant photography settings
may be retrieved from the server 104 further based on an orientation of the electronic
device 102, detected by the sensing devices 208. In accordance with an embodiment,
the relevant photography settings may be retrieved at the time of capture of the first
image. In accordance with an embodiment, the relevant photography settings may be
retrieved when the electronic device 102 is pointed towards the user-selected scene
and/or when the intent of the user 110 is detected to capture the plurality of images of
the user-selected scene.
[0059] Similarly, the processor 202 may be configured to retrieve the relevant
photography settings further in combination of one or more other parameters, such as
the detected geo-!ocation of the electronic device 102, the determined scene mode,
and/or the determined object type of the one or more objects in the user-selected
scene. In accordance with an embodiment. a request may be sent from the electronic
device 102 to the server 104 to retrieve the relevant photography settings. The
request may include one or more search parameters for the retrieval of the relevant
photography settings. Examples of the search parameters may be the detected geo-
26
wo 2017/030777 PCT/US2016/045097
location of the electronic device 102, the determined scene mode, and/or the detected
one or more objects in the user-selected scene. The search parameters may further
include a time of capture of the first image, a time of detection of the intent of the user
110 to capture the plurality of images, an orientation of the electronic device 102,
and/or the determined object type(s) for the one or more objects in the user-selected
scene, The relevant photography settings may be retrieved by use of the Ul 108
rendered on the display 214 of the electronic device 102. In accordance with an
embodiment, the relevant photography settings may be retrieved when the
professional photography mode is enabled at the Ul 1 OR
[0060] In accordance with an embodiment, the processor 202 may be configured
to predict and subsequently generate one or more optimal photography settings. The
prediction of one or more optimal photography settings may be based on the time of
capture of the plurality of images, the orientation of the electronic device 102, the
detected goo-location of the electronic device 102, the determined scene mode,
and/or the determined object-type of the one or more objects.
[0061] !n accordance with an embodiment, the electronic device 1 02 may be
configured to recommend capture of one or more images by use of the generated one
or more optimal photography settings to the user 11 0. The one or more images may
be recommended to be captured in addition to a certain count of the photography
settings stored (for the determined scene mode) in the secondary memory 204b, Such
prediction and recommendation may occur based on an analysis of the user-defined
photography settings and/or the retrieved photography settings from the server 104.
For instance, based on the analysis, the electronic device 102 may determine that
27
wo 2017/030777 PCT/US2016/045097
quality of the plurality of images captured by use of the user-defined photography
settings and/or the retrieved photography settings is below an image quality threshold.
The image quality threshold may be predefined based on known techniques of image
quality assessment Examples of the known techniques of image quality assessment
may include, but are not limited to, a full reference method, a no reference method,
and/or a reduced reference method. In accordance with an embodiment, the quality of
the plurality of images may be determined based on various professional photography
techniques. Various rules, based on the knowledge of the professional photography
techniques, may be pre-configured via the Ul 108, and stored at the secondary
memory 204b. In an example, the rule may be an appropriate combination of aperture
value, a shutter speed value, and an exposure value to capture an optimal image.
[0062] In accordance with an embodiment, the processor 202 in the electronic
device 102, such as a smartphone, may be configured to utilize a photography setting
shared by another electronic device, such as another smartphone, to capture at least
an image of the user-selected scene. In accordance with an embodiment, the
processor 202 may be configured to capture the plurality of images for the determined
scene mode. The plurality of images for the determined scene mode may be based on
the received input For example, a single input may trigger capture of multiple images,
such as twenty images. Out of the twenty captured images, fifteen images may be
captured by use of different user-defined photography settings, three images may be
captured by use of the system-generated photography settings, and two images may
be captured by use of the relevant photography settings received from the server 104.
28
wo 2017/030777 PCT/US2016/045097
Thus, as described above, this may further increase the degree of certainty for capture
of one or more idea! images out of the twenty images.
[0063] In accordance with an embodiment, the processor 202 may define an
association between the captured plurality of images and the corresponding
photography settings. In accordance with an embodiment, the processor 202 may be
configured to tag the photography settings, used at the time of capture of the plurality
of images, with corresponding metadata. The metadata may correspond to information
related to the time of capture of the plurality of images, the orientation of the electronic
device 102, the detected geo-location of the electronic device 102, the determined
scene mode, and/or the detected one or more objects in the user-selected scene.
[0064] In accordance with an embodiment, the processor 202 may be configured
to display the captured plurality of images, via the Ul 108 at the electronic device 102.
The Ul 108 may enhance visualization, deletion, and/or navigation between the
captured plurality of images. Each image of the plurality of images may be associated
with the corresponding photography setting used at the time of capture of the image.
The captured image and its corresponding photography setting may be simultaneously
displayed on the U! 108. The user 110 may select or like a desired image or the
displayed corresponding photography setting among the plurality of images and
corresponding photography settings from the Ul 108. The processor 202 may be
configured to control display of the captured plurality of images at the U I 108 in a userfriendly
manner with attributes (such as a qualifier) to distinguish the plurality of
images captured with different photography settings from normal images.
29
wo 2017/030777 PCT/US2016/045097
[0065] In accordance with an embodiment, the processor 202 may be configured
to !earn from at !east the selected photography settings and corresponding metadata.
The learning from the selected photography settings and the corresponding metadata
may be utilized for the prediction of the one or more optimal photography settings. The
learning from the selected photography settings and the corresponding metadata may
be further utilized for the generation of the recommendations, as described above. In
accordance with an embodiment, the processor 202 may be configured to share the
photography settings (tagged with the metadata) with the server 104, by use of the Ul
108. The shared photography settings may be associated with one or more images
selected from the captured plurality of images.
[0066] FIG. 3 illustrates an exemplary scenario for the implementation of the
disclosed system and method to control capture of images, in accordance with an
embodiment of the disclosure .. FIG. 3 is explained in conjunction with elements from
FIG. 1 and FIG. 2. With reference to FIG. 3, there is shown a smartphone 302, a
schematic representation of a real·world scene, such as a scene 304, and a user
interface (UI) 306. There is further shown a plurality of images 308a to 308y and
corresponding photography settings 310a to 310y, rendered at the Ul 306.
[0067] In accordance with the exemplary scenario, the smartphone 302 may
have tunctiona!ities similar to that of the electronic device 102. The Ul 306 may
correspond to the Ul 108 of the electronic device 102 (FIG. 2). The smartphone 302
may comprise certain number of the photography settings, such as twenty
photography settings 310a to 310t, configured by the user 110. The twenty
photography settings 310a to 310t may correspond to a certain user-defined scene
30
wo 2017/030777 PCT/US2016/045097
mode, such as "candlelight dinner''. The user 110 may have pre-defined and stored
the different user-defined photography settings 310a to 310t, by use of the Ul 306.
The user 110 may want to capture an important moment, such as a toast-raising
ceremony at the anniversary dinner of his parents at a famous hilltop restaurant, as
shown in the scene 304. For the scene 304, determination of a certain visual effect or
background light of the scene may not be appropriate, as some objects (such as a
roof surface and background walls of the restaurant) may not be favorable to create a
desired visual effect For example, the roof surface may be a thatched roof and the
green color of paint of the background walls in the scene 304 may not be suitable for a
bounce flash. It may be difficult to adjust different photography settings parameters
manually between each shot. This may hamper the ability to capture the desired
image with the desired visual effect at the desired moment
[0068] In operation, the smartphone 302 may be configured to receive an input
by use of the Ul 306, to capture the plurality of images 308a to 308t The smartphone
302 may be configured to dynamically determine a scene mode, such as a userdefined
"hilltop candlelight dinner scene mode". The smartphone 302 may determine
the scene mode when the user 110 points the smartphone 302 towards the scene
304, to capture the plurality of images 308a to 308y of tt1e scene 304. Alternatively,
the scene mode may be detem1ined when the first image, such as the image 308a, is
captured. The determination of the scene mode from a set of scene modes pre-stored
at the smartphone 302 may be based on object types of the one or more objects in the
scene 304 and the geo-!ocation of the smartphone 302.
31
wo 2017/030777 PCT/US2016/045097
[0069] The smartphone 302 may be configured to determine whether the number
of captured images is less than the number of the user-defined photography settings.
In instances when the number of captured images is less than the number of the user¥
defined photography settings for the determined scene mode, the smartphone 302
may be configured to capture another image by use of another user-defined
photography setting. For instance, the number of images captured 308a to 308t may
be equal to the number of user-defined photography settings 310a to 310t. Each
image 308a to 308y in the determined scene mode may be captured by use of
different photography settings 310a to 310y. For example, a first image, such as the
image 308a, of the plurality of images 308a to 308y, may be captured with a userdefined
photography setting 310a. The user-defined photography setting 310a may
include a first set of photography setting parameters configured with certain values,
such as ISO setting of "800", shutter speed of "1160s", and flash exposure of "+2"
compensation. A second image of the plurality of images, such as the !mage 308b,
may be automatically captured with a user-defined photography setting 31 Ob. The
user-defined photography setting 310b may include a second set of photography
setting parameters configured with certain other values, such as ISO setting of "900",
shutter speed of "1/150s", and flash exposure of "+2" C{)mpensation. Similarly, twenty
different images 308a to 308t, by use of twenty different user-defined photography
settings 31 Oa to 31 Ot, may be captured in quick succession with different visual
effects, Such capture of the twenty images 308a to 308t with different visual effects
may not be possible by use of a "burst mode" known to a person with ordinary skill in
the art The "burst mode" may provide numerous images for the scene 304 but an
32
wo 2017/030777 PCT/US2016/045097
idea! scene mode may not be determined, as described above, Further, the "burst
mode" may not provide a capability to use a different user-defined photography setting
to capture each of the plurality of images, such as the twenty images 308a to 308t, for
the determined scene mode. Further, none of the captured images in the ~burst mode"
may provide an optimum image due to ambient visual interference, such as the green
walls, in accordance with the above exemplary scenario,
[0070] In accordance with an embodiment, the smartphone 302 may be
configured to capture additional images (such as additional five images 308u to 308y)
of the scene 304,. in addition to the already captured images (such as the twenty
images 308a to 308t), The capture of additional images may occur when the
smartphone 302 determines that an idea! image is not captured by use of the userdefined
photography settings. The smartphone 302 may be configured to analyze the
user-defined photography settings and subsequently predict and generate additional
photography settings different from the previously stored user-defined photography
settings. Thus, the captured plurality of images, such as twenty five images {the
twenty images 308a to 308t by use of user-defined photography settings 310a to 310t,
and the five images 308u to 308y by use of the system-generated photography
settings 310u to 310y), may provide a balanced set of images.
[0071] The captured plurality of images 308a to 308y may be displayed
simultaneously with corresponding photography settings 310a to 310y. The image
308w (as displayed via the U! 306) may be an optimal image that may exemplify the
desired visual effect for the determined object type, such as people in a restaurant,
and the gee-location, such as the hilltop restaurant, in the scene 304, The user 110
33
wo 2017/030777 PCT/US2016/045097
may like the optimal image 308w as an indication of the selection of the best shot The
pl1otography setting 31 Ow tagged with metadata and associated with the optimal
image 308w may be automatically selected. The other images 308a to 308v, 308x,
and 308y may further be automatically deleted in response to the liked photography
setting 310w. The selected photography setting 310w may be shared with another
smartphone or uploaded to the server 104, for use by another user. Thus, a
professional photography experience may be provided to the user 11 0 to capture an
ideal image, such as the image 308w, for the important moment with a certain degree
of certainty.
[0072] FIG. 4A and 48 collectively depict a first flow chart that illustrates an
exemplary method to control capture of images, in accordance with an embodiment of
the disclosure. With reference to FIGs. 4A and 48, there is shown a flow chart 400.
The flow chart 400 is described in conjunction with FIGs. 1, .2 and 3. The method
starts at step 402 and proceeds to step 404.
[0073] At step 404, an input may be received to capture the plurality of images for
a user-selected scene, such as the scene 304, visualized via the electronic device 102
by a user, such as the user 11 0. The input may be received via a user interface, such
as the Ul 108 or the Ul 306 (FIG. 3) . .At step 406, a first image, such as the image
308a, of a user-selected scene, such as the scene 304., visualized by the user 110
may be captured, The user-selected scene may comprise one or more objects.
[0074] At step 408, the captured first image may be stored in an image buffer. At
step 410, the captured first image stored in the image buffer may be analyzed by the
34
wo 2017/030777 PCT/US2016/045097
electronic device 102. The image buffer may be analyzed before the capture of the
plurality of images.
[0075] At step 412, an object type of each of the one or more objects and a geolocation
of the electronic device 102 may be determined when the first image is
captured. The determination of the object type of the one or more objects may be
based on the analysis of the captured first image stored in the image buffer. At step
414, a scene mode, such as the user created scene mode, "hilltop candlelight dinner
scene mode", from a pre-stored set of scene modes may be determined when the first
image is captured. The scene mode may be determined based on the determined
object type of the one or more objects and the gee-location of the electronic device
102. The scene mode may be determined to capture the plurality of images of the
user-selected scene in the determined scene mode.
[0076] In an instance, the first image may not be required to be captured. In such
an instance,. the object type of each of the one or more objects and the geo-!ocation of
the electronic device 102 may be determined when the electronic device 102 is
pointed towards the user-selected scene and/or when the intent of the user 110 is
detected to capture the plurality of images of the user-selected scene. Further, in such
an instance, the scene mode may also be determined, when the electronic device 102
is pointed towards the user-selected scene and/or when the intent of the user 110 is
detected to capture the plurality of images of the user-selected scene, as described
above.
[0077] At step 416, one image of the plurality of images for the user-selected
scene may be captured by use of a preset user-defined photography setting for the
35
wo 2017/030777 PCT/US2016/045097
determined scene mode. At step 418, it may be determined whether the number of
captured images is less than the number of different user-defined photography
settings stored at the electronic device 102 for the determined scene mode.
[0078] In instances when the number of captured images is less than the number
of the user-defined photography settings for the determined scene mode, the control
passes to step 420. In instances when the number of captured images is equal to the
number of the different photography settings for the determined scene mode, the
control passes to step 422.
[0079] At step 420, another image of the plurality of images may be captured by
another user-defined photography setting for the determined scene mode. The control
may pass back to the step 418 until the number of captured images is equal to the
number of the different user-defined photography settings. Each image of the plurality
of images may be captured by use of different photography settings, such as the
photography settings 310a to 310t, for the determined scene mode. The different
photography settings may be user-defined photography settings 310a to 31ot that may
comprise a set of photography setting parameters.
[0080] At step 422, the plurality of images captured by the electronic device 102
may be stored at the electronic device 102. At step 424, each of the user-
Documents
Application Documents
#
Name
Date
1
201817004985-STATEMENT OF UNDERTAKING (FORM 3) [09-02-2018(online)].pdf
2018-02-09
2
201817004985-REQUEST FOR EXAMINATION (FORM-18) [09-02-2018(online)].pdf