Claims:
We claim:

1. A system (100) for controlling playback of media content, comprising:
a media device (102) that comprises a media player (106) that presents media content on a display unit (104) of the media device (102);
an imaging sensor (114) operatively coupled to the media device (102), wherein the imaging sensor (114) captures one or more images of a viewing area (116) in which the media device (102) is positioned;
a motion sensor (122) that captures non-visual information to sense motion of an object in the viewing area (116) from a selected time period prior to playback of a restricted portion of the media content on the display unit (104) and deactivates the motion sensor (122) post completion of playback of the restricted portion;
an imaging-sensor control system (112) operatively coupled to the imaging sensor (114), the motion sensor (122) and the media device (102), wherein the imaging-sensor control system (112) activates the imaging sensor (114) for a designated period of time to capture the images of the viewing area (116) only upon receiving the non-visual information from the motion sensor (122) that indicates presence of the moving object in the viewing area (116) and deactivates the imaging sensor (114) post capturing the images of the viewing area (116); and
an image processing system (118) coupled to the media device (102) and the imaging sensor (114), wherein the image processing system (118) processes the captured images to determine presence of a restricted user in the viewing area (116), and transmits one or more control signals to the media device (102) to stop playback of the media content on the associated display unit (104) upon determining presence of the restricted user in the viewing area (116).

2. The system (100) as claimed in claim 1, wherein the system (100) comprises a database (120) that stores user profiles associated with a plurality of users registered with the media device (102), wherein a user profile of a registered user comprises one or more of facial information, age information, a thermal image, physical attributes, and a restricted content watching preference of the registered user.

3. The system (100) as claimed in claim 1, wherein the imaging sensor (114) comprises a camera (114), wherein the motion sensor (122) comprises one or more of a passive infrared sensor, an infrared thermopile sensor, an ultrasound sensor, a tomographic motion sensor, a microwave-based motion detector, and a thermographic camera.

4. The system (100) as claimed in claim 1, wherein the system (100) comprises a multimedia control system implemented in one or more of a parental control system, a workplace monitoring system, a security system, an automotive system, a smart home system, an automated teller machine, and a healthcare system.

5. A method for controlling playback of media content, comprising:
presenting media content on a display unit (104) of a media device (102);
capturing one or more images of a viewing area (116) in which the media device (102) is positioned using an imaging sensor (114) that is operatively coupled to the media device (102);
capturing non-visual information using a motion sensor (122) to sense motion of an object in the viewing area (116) from a selected time period prior to playback of a restricted portion of the media content on the display unit (104);
activating the imaging sensor (114) for a designated period of time to capture the images of the viewing area (116) only upon receiving the non-visual information from the motion sensor (122) that indicates presence of the moving object in the viewing area (116);
processing the captured images using an image processing system (118) to determine presence of a restricted user in the viewing area (116); and
transmitting one or more control signals to the media device (102) by the image processing system (118) to stop playback of the media content on the display unit (104) upon determining presence of the restricted user in the viewing area (116).

6. The method as claimed in claim 5, wherein the method comprises:
capturing one or more images of the viewing area (116) using the imaging sensor (114) during initial registration of one or more users with the media device (102);
processing the captured images to identify facial information and demographic information associated with each of the users in the viewing area (116);
capturing and one or more physical attributes of each of the users in the viewing area (116) using the motion sensor (122);
presenting one or more messages on the display unit (104) along with a set of preference options to capture a restricted content watching preference of each of the users;
generating user profiles for the users based on their corresponding facial information, demographic information, physical attributes, and restricted content watching preference;
securely storing the generated user profiles in a database (120), wherein securely storing the user profiles comprises applying one or more of anonymizing, pseudonymizing, encrypting, hashing, scrambling masking, tokeninzing, and data blurring to one or more of the facial information, demographic information, physical attributes, and restricted content watching preference.

7. The method as claimed in claim 6, wherein the method comprises identifying a registered user in the viewing area (116) based on the physical attributes information captured using the motion sensor (122) and the user profiles stored in the database (120) when the image processing system (118) fails to identify the restricted user from the captured images.

8. The method as claimed in claim 6, wherein the method comprises categorizing the registered user into one of a registered non-restricted user category and a registered restricted user category by a media player (106) in the media device (102) based on one or more of an age of the registered user, the restricted content watching preference of the registered user, and a parental rating associated with the media content.

9. The method as claimed in claim 8, wherein the method comprises determining if the media content comprises one or more restricted portions by the media player (106) by reviewing metadata markings associated with the media content prior to playback of the media content on the display unit (104).

10. The method as claimed in claim 9, wherein the method comprises:
identifying if a registered user is present in the viewing area (116) by matching facial information (116) obtained from the captured images with facial information stored in the database (120);
determining if the registered user in the viewing area (116) is a registered non-restricted user or a registered restricted user by the image processing system (118) based on age and a restricted content watching preference of the registered user stored in the database (120);
identifying the user in the viewing area (116) whose facial information is different from facial information stored in the database (120) as an unregistered user by the image processing system (118); and
categorizing the unregistered user in the viewing area (116) as an unregistered adult or an unregistered child based on age of the unregistered user determined from the captured images by the image processing system (118).

11. The method as claimed in claim 10, wherein the method comprises initiating playback of the media content by the media player (106) when an initial composition of audience in the viewing area (116) comprises only the registered non-restricted user.

12. The method as claimed in claim 11, wherein the method comprises:
activating the motion sensor (122) by a motion-sensor control system (124) from the selected time period prior to playback of the restricted portion of the media content to sense motion of the object in the viewing area (116);
transmitting a control signal to the imaging-sensor control system (112) to reactivate the imaging sensor (114) when the motion sensor (122) senses the moving object in the viewing area (116); and
deactivating the motion sensor (122) by the motion-sensor control system (124) post completion of playback of the restricted portion by the media player (106);
capturing one or more images of the viewing area (116) using the reactivated imaging sensor (114); and
processing the captured images to identify if the moving object in the viewing area (116) is one of a non-human object, the registered non-restricted user, the registered restricted user, the unregistered adult, and the unregistered child.

13. The method as claimed in claim 12, wherein the method comprises:
performing a first control action comprising continuing playback of the restricted portion by the media player (106) when the moving object is identified as the non-human object or the registered non-restricted user,
performing a second control action comprising transmitting a message to an admin user device seeking a permission from an admin user to continue playback of the restricted portion when the moving object is identified as the unregistered adult based on preselected preferences; and
performing a third control action when the moving object is identified as the registered restricted user or the unregistered child, wherein the third control action comprises one or more of skipping playback of the restricted portion, blurring a screen comprising the restricted portion, stopping playback of the restricted portion, switching off the media device (102), muting volume of the media device (102), and introducing a beep sound during playback of the restricted portion.

14. The method as claimed in claim 13, wherein the method comprises:
transmitting an alert from the media device (102) to the admin user device when the unregistered adult attempts to play the media content having one or more restricted portions on the media device (102), wherein the alert comprises one or more of a text alert, an audio alert, an image alert, and a video alert;
presenting one or more control options on a user interface screen of the admin user device for selection by the admin user, wherein the control options comprises a first option to approve playback of the media content and a second option to disapprove playback of the media content;
transmitting a control signal corresponding to the first option or the second option selected by the admin user from the admin user device to the media device (102); and
allowing playback of the media content when the control signal corresponds to the first option and preventing playback of the media content when the control signal corresponds to the second option.
, Description:RELATED ART

[0001] Embodiments of the present disclosure relate generally to controlling playback of media content. More particularly, the present disclosure relates to a system and method for controlling media content displayed on a user device based on a change in audience composition.
[0002] Generally, media devices such as set-top-boxes, smart televisions, smart phones, desktops, laptops, and tablets receive media content via one or more communication links and display the received media content on associated display units. Examples of such communication links include a satellite system, a cable system, an over the air system, and the internet. Some of the received media content may include restricted portions that include violence/and or adult content, which may not be appropriate for children.
[0003] Hence, some of these media devices include parental control systems for controlling access to restricted media content by children. Conventional parental control systems allow users to restrict access to particular types of media content based on certain characteristics, for example, content certifications, titles, ratings, times, and/or channels. However, such systems only block access to media files having restricted content when accessed using children’s credentials. Conventional parental control systems, thus, fail to provide efficient parental control in many real world scenarios where family or group viewings are common occurrences. For example, conventional parental control systems would fail in situations where a child may walk into a room when adult users may be watching movies with restricted content after the child has gone to sleep. In such a scenario, conventional parental control systems may not be able to determine that a viewing audience has changed and may continue to provide access to media with restricted portions.
[0004] Accordingly, certain parental control systems suggest use of cameras for continuously monitoring the audience in a designated viewing space. These parental control systems use the captured information for controlling access to restricted portions by children. For example, US patent US7370208 describes a parental control system employing a camera to sense facial features to identify age and gender of an audience. The patent describes restricting access to inappropriate internet sites, television programs, and chat rooms upon identifying the audience to include a child. While such systems may provide effective parental control, continuously monitoring a space using a camera would create significant user privacy and safety concerns. Additionally, continuous camera monitoring requires a significantly large storage space and an expensive processing system to continuously process captured images.
[0005] Accordingly, there is a need for an improved system that efficiently controls the play of restricted portions without intruding into user privacy and without requiring significant storage space and/or expensive processing systems.

BRIEF DESCRIPTION

[0006] It is an objective of the present disclosure to provide a system for controlling playback of media content. The system includes a media device that includes a media player that presents media content on a display unit of the media device, and an imaging sensor operatively coupled to the media device. The imaging sensor captures one or more images of a viewing area in which the media device is positioned. Further, the system includes a motion sensor that captures non-visual information to sense motion of an object in the viewing area from a selected time period prior to playback of a restricted portion of the media content on the display unit and deactivates the motion sensor (122) post completion of playback of the restricted portion. In addition, the system includes an imaging-sensor control system operatively coupled to the imaging sensor, the motion sensor and the media device. The imaging-sensor control system activates the imaging sensor for a designated period of time to capture the images of the viewing area only upon receiving the non-visual information from the motion sensor that indicates presence of the moving object in the viewing area and deactivates the imaging sensor (114) post capturing the images of the viewing area (116).
[0007] Moreover, the system includes an image processing system coupled to the media device and the imaging sensor. The image processing system processes the captured images to determine presence of a restricted user in the viewing area, and transmits one or more control signals to the media device to stop playback of the media content on the associated display unit upon determining presence of the restricted user in the viewing area. The system includes a database that stores user profiles associated with a plurality of users registered with the media device. A user profile of a registered user includes one or more of facial information, age information, a thermal image, physical attributes, and a restricted content watching preference of the registered user. The imaging-sensor control system activates the imaging sensor to capture one or more images of the viewing area prior to playback of the media content that includes restricted portions.
[0008] Moreover, the motion-sensor control system reactivates the motion sensor only at the selected time period prior to playback of another restricted portion in the media content. The imaging sensor includes a camera. The motion sensor includes one or more of a passive infrared sensor, an infrared thermopile sensor, an ultrasound sensor, a tomographic motion sensor, a microwave-based motion detector, and a thermographic camera. The system includes a multimedia control system implemented in one or more of a parental control system, a workplace monitoring system, a security system, an automotive system, a smart home system, an automated teller machine, and a healthcare system.
[0009] It is another objective of the present disclosure to provide a method for controlling playback of media content. The method includes presenting media content on a display unit of a media device. Further, the method includes capturing one or more images of a viewing area in which the media device is positioned using an imaging sensor that is operatively coupled to the media device. In addition, the method includes capturing non-visual information using a motion sensor to sense motion of an object in the viewing area from a selected time period prior to playback of a restricted portion of the media content on the display unit. Furthermore, the method includes activating the imaging sensor for a designated period of time to capture the images of the viewing area only upon receiving the non-visual information from the motion sensor that indicates presence of the moving object in the viewing area.
[0010] Moreover, the method includes processing the captured images using an image processing system to determine presence of a restricted user in the viewing area. The method further includes transmitting one or more control signals to the media device by the image processing system to stop playback of the media content on the display unit upon determining presence of the restricted user in the viewing area. The method further includes capturing one or more images of the viewing area using the imaging sensor during initial registration of one or more users with the media device. The method includes processing the captured images to identify facial information and demographic information associated with each of the users in the viewing area. The method also includes capturing physical attributes of each of the users in the viewing area using the motion sensor. In addition, the method includes presenting one or more messages on the display unit along with a set of preference options to capture a restricted content watching preference of each of the users. Moreover, the method includes generating user profiles for the users based on their corresponding facial information, demographic information, thermal image, physical attributes, and restricted content watching preference. Furthermore, the method includes securely storing the generated user profiles in a database, wherein securely storing the user profiles includes applying one or more of anonymizing, pseudonymizing, encrypting, hashing, scrambling masking, tokeninzing, and data blurring to one or more of facial information, demographic information, physical attributes, and restricted content watching preference. Further, the method includes identifying a registered user in the viewing area based on the physical attributes information captured using the motion sensor and the user profiles stored in the database when the image processing system fails to identify the restricted user from the captured images. The method includes categorizing the registered user into one of a registered non-restricted user category and a registered restricted user category by a media player in the media device based on one or more of an age of the registered user, the restricted content watching preference of the registered user, and a parental rating associated with the media content.
[0011] In addition, the method includes determining if the media content includes one or more restricted portions by the media player by reviewing metadata markings associated with the media content prior to playback of the media content on the display unit. The method includes identifying if a registered user is present in the viewing area by matching facial information obtained from the captured images with facial information stored in the database.
[0012] Further, the method includes determining if the registered user in the viewing area is a registered non-restricted user or a registered restricted user by the image processing system based on age and a restricted content watching preference of the registered user stored in the database. The method includes identifying the user in the viewing area whose facial information is different from facial information stored in the database as an unregistered user by the image processing system. The method includes categorizing the unregistered user in the viewing area as an unregistered adult or an unregistered child based on age of the unregistered user determined from the captured images by the image processing system.
[0013] Furthermore, the method includes initiating playback of the media content by the media player when an initial composition of audience in the viewing area comprises only the registered non-restricted user. The method also includes activating the motion sensor by a motion-sensor control system from the selected time period prior to playback of the restricted portion of the media content to sense motion of the object in the viewing area. The method includes transmitting a control signal to the imaging-sensor control system to reactivate the imaging sensor when the motion sensor senses the moving object in the viewing area. The method includes deactivating the motion sensor by the motion-sensor control system post completion of playback of the restricted portion by the media player.
[0014] The method includes capturing one or more images of the viewing area using the reactivated imaging sensor. The method further includes processing the captured images to identify if the moving object in the viewing area is one of a non-human object, the registered non-restricted user, the registered restricted user, the unregistered adult, and the unregistered child.
[0015] The method includes performing a first control action comprising continuing playback of the restricted portion by the media player (106) when the moving object is identified as the non-human object or the registered non-restricted user. The method includes performing a second control action comprising transmitting a message to an admin user device seeking a permission from an admin user to continue playback of the restricted portion when the moving object is identified as the unregistered adult based on preselected preferences. The method includes performing a third control action when the moving object is identified as the registered restricted user or the unregistered child, wherein the third control action comprises one or more of skipping playback of the restricted portion, blurring a screen comprising the restricted portion, stopping playback of the restricted portion, switching off the media device (102), muting volume of the media device (102), and introducing a beep sound during playback of the restricted portion.
[0016] The method also includes transmitting an alert from the media device to the admin user device when the unregistered adult attempts to play the media content having one or more restricted portions on the media device. The alert includes one or more of a text alert, an audio alert, an image alert, and a video alert. The method further includes presenting one or more control options on a user interface screen of the user device for selection by the admin user. The control options includes a first option to approve playback of the media content and a second option to disapprove playback of the media content. Moreover, the method includes transmitting a control signal corresponding to the first option or the second option selected by the admin user from the admin user device to the media device. In addition, the method includes allowing playback of the media content when the control signal corresponds to the first option and preventing playback of the media content when the control signal corresponds to the second option.

BRIEF DESCRIPTION OF DRAWINGS

[0017] These and other features, aspects, and advantages of the claimed subject matter will become better understood when the following detailed description is read with reference to the accompanying drawings in which like characters represent like parts throughout the drawings, wherein:
[0018] FIG. 1 is a block diagram illustrating an exemplary multimedia control system that automatically controls playback of media content displayed on a media device, in accordance with aspects of the present disclosure;
[0019] FIG. 2 is a flow diagram illustrating an exemplary method for initial registration of users with the media device of FIG. 1, in accordance with aspects of the present disclosure; and
[0020] FIGS. 3A and 3B are flow diagrams illustrating an exemplary method for automatically controlling playback of media content based on a change in a composition of an audience using the multimedia control system of FIG. 1, in accordance with aspects of the present disclosure.

DETAILED DESCRIPTION

[0021] The following description presents an exemplary system and associated method for controlling playback of media content displayed on a media device. Particularly, embodiments described herein disclose a multimedia control system that selectively activates an associated imaging sensor only upon identifying a change in composition of an audience in a viewing area immediately prior to playing a restricted portion of the media content. Further, the multimedia control system configures the imaging sensor to capture an image of the viewing area to determine if a restricted user is present in the viewing area, and accordingly, stop or continue play of media content.
[0022] According to aspects of the present disclosure, the present multimedia control system operates an imaging sensor in an inactive state most of the time when a user or a group of users is watching a media content using a media device. The multimedia control system selectively activates the imaging sensor only when a motion sensor senses movement of an object in a viewing area at a selected time period before or while the media device plays restricted media portions. Thus, the imaging sensor is not continuously active throughout the play of the media content. Instead, the multimedia control system selectively activates the imaging sensor only upon detecting an unexpected or sudden entry of a restricted user into the viewing area and appropriately controls the playback of restricted media portions without intruding into user privacy. Accordingly, unlike conventional parental control systems, the present multimedia control system can operate using comparatively lesser storage space and a cost-effective processing system as the imaging sensor is active only for a short time period and captures only a limited number of images.
[0023] It may be noted that different embodiments of the present multimedia control system may be used in many different application areas or systems. For example, in a parental control system, the multimedia control system includes motion sensors that sense entry of an object into a room where adult users may be watching movies with restricted content. The multimedia control system subsequently activates the imaging sensor to determine if the sensed object is a non-restricted user such as an adult or a restricted user such as a child. Further, the multimedia control system may stop the playback of media content upon detecting a restricted user.
[0024] In another example, the present multimedia control system can be used in a workplace monitoring system. For instance, the multimedia control system may employ a motion sensor to sense entry of a user into a conference room where confidential information is being presented using a media device. The multimedia control system then activates the imaging sensor to capture an image of the user and to determine if the user is an authorized user based on the captured image and stored information such as a list of meeting attendees and their corresponding images. The multimedia control system may automatically stop the playback of confidential information if the user is determined to be an unauthorized user.
[0025] In yet another example, the present multimedia control system can be also used in a security system. For instance, the multimedia control system includes an imaging sensor and a thermal sensor deployed within secured premises. Generally, the multimedia control system may operate the imaging sensor in an inactive state. The multimedia control system activates the imaging sensor only when the thermal sensor senses movement of an object within the secured premises for activating the imaging sensor to capture images of the secured premises and to identify if the object is a restricted user from the captured images. Further, the multimedia control system transmits an alert to a selected user device upon identifying that the object is a restricted user.
[0026] In another example, the present multimedia control system can be also used in a variety of automotive systems such as in vehicle personalization systems, user authentication systems, content personalization systems, and vehicle multimedia control systems. For instance, in a vehicle personalization system, the multimedia control system stores images of a plurality of users registered with a vehicle and their personalization preferences in an associated database. In real-world scenarios, a motion sensor deployed inside a vehicle senses entry of a registered user into the vehicle and enables activation of the camera to capture an image of the registered user. The multimedia control system then identifies the registered user based on the captured image and the stored images, and retrieves his/her personalization preferences from the database. In addition, the multimedia control system enables personalization of, for example, light settings, thermostats, heating, ventilation, and air conditioning systems, and seats heights and positions according to preferences of the registered user.
[0027] In another instance, the multimedia control system can also be used for monitoring entry of an unauthorized user into a vehicle. In this example, the motion sensor senses entry of a user into the vehicle and enables activation of the imaging sensor to identify if the user entering into the vehicle is a registered user. The multimedia control system transmits an alert to a designated user device, such as a mobile phone owned by a vehicle owner to notify entry of an unauthorized user into the vehicle. In yet another instance, the multimedia control system can also be used for personalizing entertainment content based on a group of users inside a vehicle. In this example, the motion sensor identifies entry of one or more registered users into the vehicle and enables activation of the imaging sensor to identify the registered users entering into the vehicle. The multimedia control system then recommends and plays personalized content according to a group preference of the identified users.
[0028] In addition, the multimedia control system can also be used for controlling playback of restricted media content within a vehicle. For example, a vehicle may stop at a traffic signal while a media player positioned inside the vehicle is about to play a restricted portion of a movie in the next few seconds. In this example, the multimedia control system activates one or more motion sensors deployed on the vehicle to monitor presence of moving objects outside and adjacent to the vehicle. Upon identifying such moving objects, the multimedia control system activates one or more in-vehicle cameras to identify if any outside users are in a watch zone from where the movie being played inside the vehicle is visible and/or audible and further to identify if such outside users are trying to watch the movie. The multimedia control system then automatically terminates the playback of restricted portion upon identifying presence of such users in the watch zone.
[0029] In another example, the present multimedia control system can be also used in a smart home system. For example, a microphone in the smart home system may detect a doorbell sound when a media player is about to play a restricted portion in the movie in next few seconds or minutes. In such a scenario, the multimedia control system activates the motion sensor to identify a sudden entry of any new person into a viewing area where the television is placed. Further, upon identifying the sudden entry of the new person into the viewing area, the multimedia control system activates the imaging sensor to identify if the new person is a restricted person. The multimedia control system terminates playback of the restricted portion upon identifying the new person as a restricted person.
[0030] In another example, the multimedia control system can also be used to provide step-by step instructions to guide a user to use a particular function of an automated teller machine (ATM). In this example, the motion sensor enables selective activation of the imaging sensor upon sensing simultaneous entry of multiple users into an ATM center. The imaging sensor, thus activated, captures images of the ATM center to identify if more than one person or any unusual incident such as theft is occurring. Upon identifying such an unusual incident, the multimedia control system terminates playback of the instructions and access to the ATM, and transmits an emergency alert to one or more previously registered contacts.
[0031] The multimedia control system may be also used in a healthcare system. For example, a media device may render a patients’ medical information including an audio, video, and/or textual data on a display unit mounted near the patient’s bed. In this example, the motion sensor continuously monitors movements within the patient’s room. Upon detecting movement in the patient’s room a selected period of time prior to display of restricted medical information, the motion sensor enables activation of the imaging sensor to identify entry of an unauthorized user. Upon identifying entry of an unauthorized user, the multimedia control system automatically pauses playback of the medical information on the display device. Alternatively, upon detecting entry of an authorized user such as a nurse, the multimedia control system automatically initiates playback of the patient information and/or the nursing protocols to be followed prior to attending the patient.
[0032] Thus, the present multimedia control system can be used in a variety of application areas where selective activation of an imaging sensor is preferred over continuous camera monitoring due to privacy and safety concerns. However, for clarity, the present multimedia control system will be described herein with reference to a parental control application when viewing multimedia content on a television.
[0033] FIG. 1 is a block diagram illustrating an exemplary multimedia control system (100) that automatically controls playback of media content displayed on a media device (102). In one embodiment, the media device (102) includes a display unit (104) for displaying media content received from one or more content servers. Examples of the media content include one or more of video content, audio content, image content, and texts. Examples of the media device (102) include a television, a smartphone, a desktop, a laptop, a tablet, or any other device that is capable of receiving and displaying media content.
[0034] In certain embodiments, the media device (102) includes a media player (106) that presents a list of media content on the display unit (104) of the media device (102) for user selection. Examples of the media content include one or more of television channel programs, over-the-top (OTT) content, video-on-demand (VoD) content, and any other content accessible via a broadcast network, the internet, and/or a local storage device. For example, upon selecting a particular OTT media content from the list presented by the media player (106), the media device (102) transmits a request to a content server (108) for streaming the selected media content. In response, the content server (108) transmits the selected media content to the media device (102) via a communications link (110). Examples of the communications link (110) include a satellite system, a cable system, an over the air system, or the internet.
[0035] In certain embodiments, the media device (102) receives the selected media content as multiple media segments from the content server (108) and queues the received media segments for playing. In one embodiment, the media device (102) pre-processes the received media content to identify and/or tag the restricted portions prior to playback by the media device (102). In an alternative embodiment, the media content received by the media device (102) from the content server (108) includes one or more metadata markings embedded in the received media content itself. The metadata markings identify a start time and an end time of each of restricted portions in the received media content. In yet another embodiment, the media content received by the media device (102) from the content server (108) does not include any metadata markings. In this implementation, the media device (102) separately receives a file having such metadata markings from the content server (108).
[0036] Upon receiving the media content and corresponding metadata markings from the content server (108), the media player (106) analyzes metadata markings to identify if the media content includes any restricted portions. Examples of restricted portions include contents showing violence/and or adult content. Further, the media player (106) allows playback of the media content on the display unit (104) upon identifying that the media content does not have any restricted portions.
[0037] Alternatively, the media player (106) transmits a control signal to an imaging-sensor control system (112) to activate an imaging sensor (114) to an active state when the media player (106) identifies that the media content includes one or more restricted portions. Further, the media player (106) displays a notification on the display unit (104) to alert audience in a viewing area (116) about activation of the imaging sensor (114). In one embodiment, the imaging sensor (114) is an optical sensor such as a camera positioned to capture images of a viewing area (116) in the vicinity of the media device (102). In one embodiment, both the camera (114) and the imaging-sensor control system (112) are integrated within the media device (102). However, in another embodiment, the camera (114) and the imaging-sensor control system (112) may be deployed as an independent unit that is physically separate, but is coupled to the media device (102) via the communications link (110).
[0038] In one embodiment, the activated camera (114) captures one or more images of the viewing area (116) such as a living room in a house. Further, the camera (114) provides the captured images as inputs to an image processing system (118). The image processing system (118) processes the captured images to identify one or more users in the living room (116) where the media device (102) is positioned.
[0039] For example, consider a family of four members including three adults and a child who have associated user profiles registered with the media device (102), such as a smart television (TV 102) positioned in the living room (116). Of these family members, there are two adults currently located in the living room (116) for watching a movie received from a content source including one of a TV channel, an OTT platform such as Netflix, Amazon Prime, and Hotstar, and a local storage device such as a universal serial bus (USB) flash drive or a hard disk drive. Another adult and the child in the family may be located in the kitchen and a bedroom, respectively.
[0040] In the previously noted example, the media player (106) in the TV (102) analyzes metadata markings of the received movie to identify if the movie includes restricted portions. Further, the media player (106) transmits an activation signal to the imaging-sensor control system (112) to activate the camera (114) when the media player (106) identifies that the movie has restricted portions. The camera (114) then captures one or more images of the living room (116), and is subsequently deactivated by the imaging-sensor control system (112). The image processing system (118) processes the captured images to identify the users in the living room (116).
[0041] Further, the image processing system (118) categorizes each of the users in the living room (116) into either a registered user category or an unregistered user category. For example, users in the registered user category may include family members who have associated user profiles registered with the TV (102). Users in the unregistered category may include strangers, guests, friends, neighbors, and relatives who do not have user profiles registered with the TV (102).
[0042] In one embodiment, the image processing system (118) categorizes a user in a captured image into the registered user category when facial information of the user obtained from the captured image matches with facial information stored in a database (120). Otherwise, the image processing system (118) categorizes the user into the unregistered user category when facial information of the user obtained from the captured image does not match with facial information stored in the database (120).
[0043] Referring back to one of the previously noted examples related to a couple of adults currently located in the living room (116) for watching the movie, the image processing system (118) identifies that both the users are registered users when their facial information matches with facial information stored in the database (120). Upon identifying adults belonging to the family in the living room (116), the media player (106) retrieves their restricted content watching preferences from their user profiles stored in the database (120). In one embodiment, the media player (106) terminates or skips playback of restricted portions of the movie when user profiles of at least one of the adults indicate negative preferences to watching restricted portions. However, the media player (106) plays the restricted portions when both user profiles have positive preferences to watching restricted portions.
[0044] However, at times, the child in the family may unexpectedly walk into the living room (116) while the adults are watching a restricted portion of the movie with the camera (114) in the inactive state. For mitigating this issue, the camera (114) is communicatively coupled to one or more motion sensors (122) that are non-intrusive and capture non-visual information to sense movement of an object into the living room (116). Sensing movement of the object while the media player (106) is playing or is scheduled to play a restricted portion enables the imaging-sensor control system (112) to selectively activate the camera (114) to identify if the sensed object is a child and accordingly stop playback of the restricted portions.
[0045] To that end, in one embodiment, the motion sensors (122) are positioned within the living room (116) that may include areas around the TV (102) from where the movie playing on the display unit (104) may be visible and/or audible. In certain embodiments, the motion sensors (122), the imaging sensor (114), and the media device (102) are all deployed in the same living room (116). Alternatively, these components (102, 114, and 122) may be deployed at different locations at home, but are communicatively coupled to each other as part of a smart home solution. However, for simplicity, these components (102, 114, and 122) are subsequently described to be deployed in the same living room (116). A number of motion sensors (122) required to monitor motion of objects in the living room (116) may vary based on dimensions of the living room (116) and a number of entry or exit points in the living room (116). However, for simplicity, the system (100) is described as having only one motion sensor (122). Examples of the motion sensor (122) include a passive infrared sensor, an infrared thermopile sensor, an ultrasound sensor, a tomographic motion detector, a thermographic camera, and a microwave-based motion detector.
[0046] In certain embodiments, the motion sensor (122) is communicatively coupled to a motion-sensor control system (124) and the imaging-sensor control system (112). In one embodiment, these systems (112 and 124) may be implemented by suitable code on a processor-based system, such as a general-purpose or a special-purpose computer. Accordingly, these systems (112 and 124), for example, include one or more general-purpose processors, specialized processors, graphical processing units, microprocessors, programming logic arrays, field programming gate arrays, integrated circuits, system on chips, and/or other suitable computing devices.
[0047] In one embodiment, the motion-sensor control system (124) initially operates the motion sensor (122) in an inactive state when the TV (102) is playing a non-restricted portion of the movie. However, the motion-sensor control system (124) activates the motion sensor (122) to an active state from a designated time period prior to playback of a restricted portion in the movie. For example, in one implementation, the system (124) activates the motion sensor (122) fifteen seconds prior to playback of a restricted portion in the movie.
[0048] The motion sensor (122), thus activated, continues to monitor if there is movement of an object within the living room (116) until completion of playback of the restricted portion. In one embodiment, the media player (106) continues to playback the restricted portion when the motion sensor (122) senses no movement during a particular duration starting from fifteen seconds prior to playback to completion of playback of the restricted portion. In certain embodiments, the motion sensor (122) further categorizes the sensed moving object as a human object or as a non-human object. To that end, the motion sensor (122) may include a thermographic camera that captures physical attributes of the moving object, such as size, stature, physique, gait information, and other physical information of the moving object.
[0049] Subsequent to capturing the physical attributes of the moving object, the motion-sensor control system (124) compares the captured physical attributes with first level generic physical attributes defined for various human and non-human objects that are stored in the database (120). The motion-sensor control system (124) then categorizes the moving object as a non-human object such as a pet animal when the captured physical attributes match with physical attributes defined for the pet animal. Alternatively, the motion-sensor control system (124) categorizes the moving object as a human when the captured physical attributes match with stored physical attributes defined for humans.
[0050] Further, upon categorizing the moving object as a human, the motion-sensor control system (124) compares the captured physical attributes with second level specific physical attributes associated with a plurality of users registered with the media device (102) to identify if the human in the living room (116) is a registered user or an unregistered user. For example, the motion-sensor control system (124) identifies the human in the living room (116) as an unregistered user when the captured physical attributes do not match with physical attributes stored in the database (120). However, when the captured physical attributes have a significant match, for example over 90 percent match, with a particular user’s physical attributes stored in the database (120), the motion-sensor control system (124) identifies the human in the living room (116) as a registered user. Moreover, the motion-sensor control system (124) determines if the registered user in the living room (116) is a child or an adult based on the physical attributes and/or a corresponding demographic information stored as part of a stored template and/or a corresponding user profile in the database (120).
[0051] In one embodiment, the media player (106) also continues to playback the restricted portion when the moving object is determined as a non-human object or a registered user who prefers to watch restricted portions. Alternatively, the media player (106) terminates playback of the restricted portion when the moving object is determined to be a child, an unregistered user, or a registered user who does not prefer watching restricted portions. In certain embodiments, post completion of playback of the restricted portion, the motion-sensor control system (124) may deactivate the motion sensor (122).
[0052] In one embodiment, instead of identifying a type and nature of the object moving in the living room (116) using data captured by the motion sensor (122), the multimedia control system (100) identifies the type of the moving object from one or more images captured by the imaging sensor (114). In this embodiment, post sensing the moving object in the living room (116), the motion-sensor control system (124) transmits a control signal to the imaging-sensor control system (112). Upon receiving the control signal, the imaging-sensor control system (112) reactivates the camera (114) for a designated period of time to capture one or more images of the living room (116) and deactivates the camera (114) post capturing the images.
[0053] In one embodiment, the image processing system (118) processes the captured images using one or more image processing algorithms to determine if the moving object in the living room (116) is a human or a non-human object such as a pet animal, a mobile toy, or an appliance such as a robotic vacuum that was previously absent from the living room (116). The image processing system (118) enables the media player (106) to continue playback of the restricted portion when the moving object in the living room (116) is determined as a non-human object. Alternatively, when the moving object in the living room (116) is determined as a human, the image processing system (118) identifies the human in the captured images.
[0054] For example, the image processing system (118) identifies if the human in the captured images is an adult who was initially watching the movie. For example, in a real-world scenario, an adult watching the movie might exit the living room (116) for a short period to attend a phone call and may re-enter the living room (116) after a while. In such a scenario, the image processing system (118) identifies if the human entering into the living room (116) is same as one of the adults who originally watched the movie using the captured images. In certain embodiments, the image processing system (118) enables the media player (106) to continue playback of the restricted portion when the human entering the living room (116) is same as one of the adults who was originally watching the movie and who prefers to watch restricted portions.
[0055] However, when the image processing system (118) identifies that the human entering into the living room (116) is not an adult who was originally watching the movie, the image processing system (118) determines if the human is another registered user. For example, the image processing system (118) determines if the human is either a child or another adult in the family based on their facial information stored in the database (120) and facial information obtained from the captured images. The image processing system (118) transmits one or more control signals to the media player (106) to stop playback of the restricted portion automatically when the human entering the living room (116) is determined as a child in the family. However, when the human is determined as another adult in the family who was not originally watching the movie, the image processing system (118) enables the media player (106) to stop or continue playback of the restricted portion depending on a restricted content watching preference stored in the database (120) for that particular adult in the family.
[0056] In one embodiment, the image processing system (118) identifies the human as an unregistered user such a guest visiting the family when facial information of the human does not match with any of facial information sets stored in the database (120). Further, the image processing system (118) determines demographic information such as age of the guest in the living room (116) by processing the captured images using one or more image processing algorithms. In addition, the image processing system (118) categorizes the guest as a child or an adult based on the determined demographic information. Moreover, the image processing system (118) transmits information related to the guest in the living room (116) to the media player (106). The media player (106) terminates playback of the restricted portion when the guest in the living room (116) is categorized as a child. However, when the guest in the living room (116) is categorized as an adult, the media player (106) may either continue playback, terminates the playback and seeks a permission from an authorized or admin user, for example, an adult family member to continue playback of the restricted portion based on based on preferences preselected by the admin user.
[0057] In certain real-world scenarios, the living room (116) may also have a child belonging to the family and/or a child who is a guest when the media player (106) receives an initial request for the movie having restricted portions. In such scenarios, before the media player (106) plays the movie, the image processing system (118) identifies presence of one or more children in the living room (116) from images captured using the camera (114). Upon detecting a child in the living room (116), the media player (106) does not initiate playback of the movie, and optionally transmits an alert to the TV (102) or to another device associated with the admin and/or one or more other identified users in the living room (116).
[0058] In certain other real-world scenarios, the living room (116) may also have a guest who is an adult when the media player (106) receives an initial request for the movie having restricted portions. In such scenarios, before the media player (106) plays the movie, the media player (106) shows an alert message on the display unit (104) to notify audience about presence of restricted portions in the movie. Additionally, the media player (106) shows one or more user selectable options from which a user can select a particular option to indicate a user preference such as whether the media player (106) should continue playback of restricted portions in the movie or automatically control playback of restricted portions. In alternative embodiment, the media player (106) automatically determines such a user preference without manual intervention based on settings pre-stored in the database (120).
[0059] In certain embodiments, the media player (106) automatically controls playback of restricted portions by performing a designated control action. The control action, for example, includes stopping playback of restricted portions, skipping playback of restricted portions, blurring a display screen such that restricted portions are not clearly visible, or switching off the media device (102). The control action may also include muting volume of the media device (102) such that restricted audio portions are not audible, or introducing beep sound during playback of restricted audio portions such that restricted audio portions are not clear to audience.
[0060] In one embodiment, the control action performed by the media player (106) varies based on a composition or a change in composition of audience in the living room (116). For example, the media player (106) blurs a display screen such that a restricted portion is not clearly visible upon detecting a sudden entry of a registered adult such as a family member into the living room (116). Alternatively, the media player (106) may automatically switch off the media device (102) upon detecting a sudden entry of an unregistered adult such as a guest into the living room (116). On the other hand, the media player (106) may automatically skip playback of the restricted portion upon detecting a sudden entry of a registered child belonging to a family or an unregistered child such as a guest into the living room (116).
[0061] It may be noted that though the camera (114) is not continuously active throughout playback of the media content, the camera (114) is still selectively activated on need basis for a short period based on a signal received from the motion sensor (122). The camera (114), thus automatically activated for the short period, captures one or more images of the viewing area (116) to identify if a restricted user is present in the viewing area (116) and control playback without intruding significantly into user privacy. A methodology associated with selective activation of the camera (114) for initial registration of users with the media device (102) and for later identification of such registered users is described in further detail with reference to FIG. 2.
[0062] FIG. 2 is a flow diagram illustrating an exemplary method (200) for initial registration of users with the media device (102) of FIG. 1. In one embodiment, the initial registration of users allows the image processing system (118) to perform real-time monitoring of a composition of audience in the living room (116). In particular, the image processing system (118) identifies users previously registered with the media device (102) and enables the media player (106) to either terminate or continue playback of restricted portions based on presence of unregistered users and/or preferences of registered users. The order in which the exemplary method is described is not intended to be construed as a limitation, and any number of the described blocks may be combined in any order to implement the exemplary method disclosed herein, or an equivalent alternative method. Additionally, certain blocks may be deleted from the exemplary method or augmented by additional blocks with added functionality without departing from the claimed scope of the subject matter described herein.
[0063] At step (202), the imaging-sensor control system (112) activates the camera (114) and the motion-sensor control system (112) activates the motion sensor (122) when a user switches on the media device (102). As noted previously, the camera (114), the motion sensor (122), and the media device (102) are all communicatively coupled to each other and may be placed in the living room (116) in a home.
[0064] At step (204), the activated camera (114) captures images of the living room (116). At step (206), the image processing system (118) processes the captured images to identify presence of one or more users and corresponding demographic information such as age of the users from the captured images.
[0065] At step (208), the image processing system (118) further classifies the user as a restricted user or a non-restricted user based on the identified demographic information and one or more predefined rules. The image processing system (118) classifies the user as a restricted user when age of the user is identified as equivalent to or less than a designated threshold, for example, eighteen. In another example, the image processing system (118) classifies the user as a non-restricted user when age of the user is identified as more than eighteen.
[0066] In another embodiment, the image processing system (118) provides an age information of the user, identified from the captured images, as an input to the media player (106). The media player (106) stores the age information in the database (120), but does not classify the user as a restricted user or a non-restricted user during the initial registration process. However, post-initial registration of the user with the media device (102), the media player (106) uses the age information to dynamically classify the user as a restricted user or a non-restricted user every time the user requests a media content. For example, the age of the user is twelve and a media content requested by the user has an associated parental rating of ‘G”, which is suitable for all users. In this example, the media player (106) classifies the user as a non-restricted user and playbacks the media content. However, in another example, the same user requests for a media content whose associated parental rating is “PG-13,” which is not suitable for children under age 13. In this example, the media player (106) classifies the user as a restricted user and denies playback of the media content.
[0067] At step (210), the media device (102) displays a message on the display unit (104) along with preference options to capture a restricted content watching preference of the user categorized as the non-restricted user. For example, the media device (102) displays a message “Do you prefer to watch restricted portions” and provides “Yes” or “No” options to the user categorized as the non-restricted user. Alternatively, the media device (102) displays selectable options to allow the non-restricted user to indicate different positive or negative preferences related to different types of media content such as violent content and adult content. Based on a selection of “Yes,” “No,” or selected option, the media device (102) continues or terminates playback of restricted portions when the user is present in the living room (116).
[0068] At step (212), the motion sensor (122) captures one or more physical attributes of the user. Examples of the physical attributes captured using the motion sensor (122) include stature, physique, and gait information associated with the user. At step (214), the media player (106) generates a user profile for the user. In one embodiment, the generated user profile includes one or more of facial information of the user, demographic information of the user, a thermal image, a category of the user such as the restricted user or the non-restricted user, the restricted content watching preference of the user, and physical attributes captured using the motion sensor (122).
[0069] At step (216), the media player (106) stores the generated user profile in the database (120) to complete an initial registration of the user with the media device (102). In one embodiment, the media player (106) securely stores the generated user profile in the database (120) by applying one or more privacy preserving data transformations including anonymizing, pseudonymizing, encrypting, hashing, scrambling masking, tokeninzing, and data blurring to user specific information such as facial information, demographic information, a thermal image, a user category, a restricted content watching preference, and physical attributes. Securing the user specific information through privacy preserving data transformations ensures that even in the event of a data compromise, personally identifiable information of none of the users is revealed to the hacker.
[0070] In one implementation, the media device (102) psuedonymizes user data by segregating the user specific information associated with a particular registered user into identifiable information and non-identifiable information. For instance, the media device (102) includes a name and second level specific facial information of the user as part of the identifiable information. Further, the media device (102) includes first level generic facial information, demographic information, a thermal image, a user category, a restricted content watching preference, and physical attributes of the user as part of the non-identifiable information. The media device (102) then stores the non-identifiable information in the database (120), and the identifiable information in a separate database (not shown in FIGS) subjected to stricter access controls and audits. In addition, the media device (102) pseudonymizes the non-identifiable information such that the non-identifiable information cannot be linked to the specific user without the identifiable information. Thus, even if a hacker gains access to the non-identifiable information, the hacker cannot easily link the non-identifiable information to the specific user. The media device (102) allows only an authorized person who holds a valid secret key to link the non-identifiable information to the specific user.
[0071] In another implementation, the media device (102) anonymizes user specific information such that even a person who originally anonymized user specific information cannot link back the non-identifiable information to the specific user. Alternatively, the media device (102) may employ one or more of encrypting, hashing, scrambling masking, tokeninzing, and data blurring to secure user specific information so as to comply with the mandated general data protection regulations (GDPR).
[0072] It may be noted that data for other members in the family can similarly be registered with and secured by the media device (102), as described previously with reference to the steps 202-216. In certain embodiments, post initial registration of users, the image processing system (118) identifies presence of the registered users in the living room (116) and enables the media player (106) to control playback of restricted portions in real-time based on preferences of the registered users as described subsequently with reference to FIGS. 3A and 3B.
[0073] FIGS. 3A and 3B are flow diagrams illustrating an exemplary method (300) for automatically controlling playback of media content based on a change in the composition of an audience. At step (302), the media device (102) receives media content along with metadata markings from a content source and queues the media content for playing. The media device (102), for example, includes a television (TV), a tablet, or a smartphone. Examples of the content source include a television channel, an OTT platform, a video-on-demand (VOD) platform, a broadcast network, the internet, or a local storage device. Examples of the media content include movies, home videos, news, and documentaries.
[0074] At step (304), the media player (106) analyzes metadata markings of the movie to identify if the content such as a movie includes any restricted portions. At step (306), the imaging-sensor control system (112) activates the camera (114) when the media player (106) identifies that the movie includes one or more restricted portions. Alternatively, when the media player (106) identifies that the movie does not include any restricted portions, the media player (106) plays the movie.
[0075] At step (308), the camera (114) captures one or more images of the living room (116) to include areas around the TV (102) from where the movie playing on the TV (102) may be visible and/or audible. At step (310), the imaging-sensor control system (112) deactivates the camera (114) post capturing the images of the living room (116). At step (312), the image processing system (118) processes the images captured by the camera (114) using one or more image processing algorithms to identify an initial composition of the audience in the living room (116).
[0076] Specifically, the image processing system (118) processes the captured images to identify if the initial composition of the audience includes one or more registered non-restricted users such as adults in a family, one or more registered restricted users such as children in the family, and/or unregistered users such as guests visiting the home. In one embodiment, the image processing system (118) identifies the registered users by comparing their facial information obtained from the captured images with facial information stored in the database (120). Further, the image processing system (118) identifies if the registered users in the living room (116) are restricted and/or non-restricted users based on their age and restricted content watching preferences information stored in the database (120).
[0077] In addition, the image processing system (118) identifies one or more users in the initial composition of the audience as unregistered users when their facial information obtained from the captured images is different from facial information set stored in the database (120). Moreover, the image processing system (118) categorizes each of the unregistered users into an adult guest or a child guest based on age information determined from the captured images.
[0078] At step (314), the media player (106) either plays the movie or provides a customized alert message on the display unit (104) based on the initial composition of audience identified by the image processing system (118). For example, the media player (106) provides a first alert message when the image processing system (118) identifies that the initial composition of the audience to include a child who may be a family member or a guest. For instance, the first alert message may correspond to, “The movie has restricted portions and cannot be played.”
[0079] In another example, the media player (106) provides a second alert message different from the first alert message when the image processing system (118) identifies that the initial composition of the audience does not include a child but includes an adult guest or an adult family member whose profile has a negative preference for watching restricted content. For instance, the second alert message may correspond to “The movie has restricted portions. Do you want to continue?” Additionally, the media player (106) provides selectable responses such as “Yes,” “No” and “Continue, but skip restricted portions.” The media player (106) subsequently controls playback of the movie based on the user-selected option. For example, the media player (106) terminates playback of the movie when the user selects the “No” option and continues playback of the movie when the user selects the “Yes” option. Alternatively, the media player (106) plays the movie but skips restricted portions when the user selects “Continue, but skip restricted portions” option.
[0080] In certain scenarios, the media player (106) allows registration of an admin user and password during an initial setup process. Additionally, the media player (106) may also allow the admin user to define designated actions, and/or specific options to be presented to an unregistered adult and/or other registered restricted and non-restricted users prior to playback of restricted media content on the TV (102). In one embodiment, the admin user may use a media control application, for example, provided by manufacturer of the TV (102) downloaded to his/her user device to preselect preferences and/or control playback of media content on the TV (102) from home or a remote location. Examples of the admin user device include a smart TV, smartphone, desktop, laptop, and tablet.
[0081] For example, the media control application may allow the admin user to configure the media player (106) to transmit an alert to the admin user device when an unregistered adult guest selects “Yes, want to continue” option to watch restricted content on the TV (102). These alerts, for example, may include a text alert, an audio alert, an image alert, and a video alert. In one embodiment, the TV (102) may also capture an image of the adult guest and transmit the captured image along with a message to “Approve” or “Deny” playback of restricted content on the TV (102) to the admin user device. In this embodiment, selection of the “Approve” or “Deny” option transmits a control signal corresponding to the selected option to the TV (102) to initiate playback of the restricted content or to output an alert message indicating that the restricted content cannot be played on the TV (102). Alternatively, if the initial composition of audience in the living room (16) only includes adult family members having positive preferences to watching restricted content, the media player (106) plays the movie without transmitting or displaying any alert messages.
[0082] While the media player (106) plays the movie, at step (316), the motion-sensor control system (124) activates the motion sensor (122) from a selected time period prior to playback of a restricted portion in the movie to sense movement of an object in the living room (116). In one embodiment, the motion-sensor control system (124) deactivates the motion sensor (122) immediately after playback of the restricted portion. The motion-sensor control system (124) reactivates the motion sensor (122) only at a designated time period prior to playback of another restricted portion in the movie. However, in another embodiment, the motion-sensor control system (124) operates the motion sensor (122) continuously in an active state to monitor any change in composition of the audience in the living room (116).
[0083] At step (318), the media player (106) continues playback of the movie when the motion sensor (122) senses no movement in the living room (116). However, when the motion sensor (122) senses movement of the object in the living room (116), at step (320), a type of the object moving in the living room (116) is identified. To that end, in one embodiment, the imaging-sensor control system (112) reactivates the camera (114) to capture images of the living room (116) upon receiving a signal from the motion sensor (122) and subsequently deactivates the camera (114) post capturing the images. The image processing system (118) processes the captured images to identify if the object moving in the living room (116) is a non-human object or a family member such as an adult who was originally watching the movie, an adult who was not originally present in the living room(116), or a child. Further, the image processing system (118) evaluates if the object is an adult guest or a child guest when the object is a human, but not a family member.
[0084] Alternatively, in lieu of reactivating the camera (114), the motion sensor (122) captures one or more physical attributes of the object upon sensing movement of the object in the living room (116). Examples of the physical attributes captured by the motion sensor (122) include size, stature, physique, and gait information associated with the object. Subsequently, the motion-sensor control system (124) determines if the object moving in the living room (116) is a registered restricted user or a registered non-restricted user based on the captured physical attributes and pre-stored information including physical attributes, demographic information, thermal images, and restricted content watching preferences of registered users stored in the database (120). However, when the motion-sensor control system (124) determines that the moving object is not a registered user, the motion-sensor control system (124) enables the imaging-sensor control system (112) to reactivate the camera for further evaluating if the moving object is an adult guest or a child guest.
[0085] At step (322), the media player (106) controls playback of the movie based on the identified type of the object moving in the living room (116). For example, the media player (106) continues playback of the movie when the object moving in the living room (116) is identified as a non-human object or as an adult family member who originally watched the movie. In another example, the media player (106) may either continue or terminate playback of the movie when the moving object is identified as another adult family member who was not originally present in the living room (116). In this example, the media player (106) continues or terminates playback when the adult family member has a positive preference and a negative preference, respectively to watching restricted content.
[0086] In yet another example, the media player (106) terminates playback of the movie when the moving object is identified as a child who belongs to a family or is a guest. In another example, the media player (106) terminates playback and seeks a permission from an authorized user, for example, the admin user to further continue playback when the moving object is identified as an adult guest.
[0087] In the present multimedia control system (100), the camera (114) is not continuously active throughout playback of the media content. The imaging-sensor control system (112) selectively activates the camera (114) only on need basis for a short period based on a signal received from the motion sensor (122). The camera (114), thus automatically activated for the short period, captures one or more images of the viewing area (116) to identify an unexpected or sudden entry of a restricted user into the viewing area and appropriately controls playback without intruding significantly into user privacy.
[0088] In certain scenarios, the captured images may not have clear facial information available for processing especially when a user is not facing the camera (114), which may lead to inaccurate identification of the user who may have suddenly entered into the living room (116). In such a scenario, the motion-sensor control system (124) attempts to identify the user by comparing his/her physical attributes such as size, stature, physique, gait, demographic information, and/or thermal images captured using the motion sensor (122) with corresponding information of registered users stored in the database (120). When the motion-sensor control system (124) also fails to identify the user, the camera (114) recaptures one or more images from a different angle to capture facial information of the user clearly. Subsequently, when the facial information of the user is clearly available in the captured images, the image processing system (118) processes the captured images to identify if the user is a restricted user or a non-restricted user. Otherwise, the image processing system (118) identifies the user as a restricted user by default when the facial information is not clear in the captured images and accordingly signals the media player (106) to terminate playback of restricted portions.
[0089] Thus, the present multimedia control system (100) provides more effective parental control system when compared to conventional parental control systems. As previously noted, conventional parental control systems would not prevent a child from watching restricted content if the child logs into the media device (102) via an adult user profile. In addition, conventional parental control systems do not address the risk of a sudden entry of a child into the living room (116) while adult users are watching restricted media portions without continuously monitoring the space via an intrusive camera that may hinder the privacy and security of the household.
[0090] In contrast, the present multimedia control system mitigates this privacy issue by utilizing a set of specialized hardware components such as one or more imaging sensors (114) and motion sensors (122) that limit the capture and storage of personally identifiable information. Specifically, the present multimedia control system (100) operates the imaging sensor (114) in an inactive state for the majority of the time when a user or a group of users is watching a media content using the media device (102). The multimedia control system (100) selectively activates the imaging sensor (114) only when the motion sensor (122) senses movement of an object in the viewing area (116) at a selected time period before or while the media device (102) plays restricted media portions. As the imaging sensor (114) is not continuously active throughout the play of media content, it captures only a limited number of images that use comparatively lesser storage space, lesser power, and a cost-effective processing system. In addition, the multimedia control system (100) secures and stores personally identifiable and other user specific information collected using the camera (114) and the motion sensor (122) by pseudonymizing the user specific information to comply with various GDPR requirements. Pseudonymizing the user specific information ensures that even if a hacker is able to maliciously accesses this information, identities of users are not revealed to the hacker.
[0091] Although specific features of various embodiments of the present systems and methods may be shown in and/or described with respect to some drawings and not in others, this is for convenience only. It is to be understood that the described features, structures, and/or characteristics may be combined and/or used interchangeably in any suitable manner in the various embodiments shown in the different figures.
[0092] While only certain features of the present systems and methods have been illustrated and described herein, many modifications and changes will occur to those skilled in the art. It is, therefore, to be understood that the appended claims are intended to cover all such modifications and changes as fall within the claimed scope of the invention.

LIST OF NUMERAL REFERENCES:

100 Multimedia Control System
102 Media Device
104 Display Unit
106 Media Player
108 Content Server
110 Communications Link
112 Imaging-sensor Control System
114 Imaging Sensor
116 Viewing Area
118 Image Processing System
120 Database
122 Motion Sensor
124 Motion-sensor Control System
200-216 Steps of method for initial registration of users with a media device
300-322 Steps of method for automatically controlling playback of media content