Description:FIELD OF THE INVENTION

[0001] The present invention relates to a grocery store management assistive device that is capable of optimizing the management of grocery store operations, such as product arrangement, quality monitoring, and maintaining appropriate storage conditions, thus improve operational efficiency, and ensure the proper storage and handling of grocery items in a retail environment.

BACKGROUND OF THE INVENTION

[0002] Grocery management plays a crucial role in ensuring that food products remain fresh, inventory is well-maintained, and waste is minimized. Efficient monitoring of stock levels, expiration dates, and product quality helps businesses reduce losses and improve customer satisfaction. However, managing a large inventory manually can be challenging, time-consuming, and prone to errors.

[0003] Traditional grocery management systems primarily depend on manual inspection, where store employees check product freshness, expiration dates, and stock levels. This approach often leads to inefficiencies; as human error can result in expired or spoiled products being sold or wasted. Additionally, inventory tracking is often done through periodic counts, which may not provide real-time updates, leading to stock shortages or overstocking. Without automated systems, businesses struggle to optimize their operations and reduce unnecessary losses.

[0004] WO2019124613A1 discloses a device for efficienating supermarket warehouse management and an operation method thereof according to the present invention, when a product inventory quantity according to product inventory information is smaller than a product critical quantity according to product critical information of product information, an out-of-stock notification for a product corresponding to the product information is transmitted to a supermarket manager terminal of a supermarket corresponding to supermarket identification information. Therefore, the present invention can assist a supermarket manager to manage inventory of the product more thoroughly.

[0005] US5884281A discloses an electronic grocery lister, which stores, displays and prints grocery list items. The device includes a computer which stores names of grocery items according to broad classifications. A user may scroll through the names of grocery items which are already loaded into the computer and viewable on a small screen. A user may mark those items he or she desires to purchase and, if wished, may retrieve and (in the second and third embodiments) print all entered items. A first embodiment is portable. A second embodiment is not portable, but includes a printer. A third embodiment includes a modem by which a user can shop on-line at grocery stores having the necessary computer hardware and software.

[0006] Conventionally, many devices are developed for managing grocery store operations. However, these devices lacks advanced capabilities such as autonomous tracking of product freshness, automatic removal of expired items, and real-time adjustments to storage conditions, which are essential for maintaining high standards of product availability and quality.

[0007] In order to overcome the aforementioned drawbacks, there exists a need in the art to develop a device that is capable of automating grocery store operations by efficiently managing product organization, monitoring product conditions, and maintaining optimal storage environments. Additionally, such a system should be able to autonomously track and arrange products based on freshness and quality while ensuring the timely detection and removal of expired items, thereby improving operational efficiency and maintaining high product standards.

OBJECTS OF THE INVENTION

[0008] The principal object of the present invention is to overcome the disadvantages of the prior art.

[0009] An object of the present invention is to develop a device that provide an automated solution for grocery store operations that efficiently handles tasks such as product organization, monitoring of product condition, and maintaining optimal storage environments.

[0010] Another object of the present invention is to develop a device that is capable of autonomously tracking and arranging products based on predetermined criteria such as product freshness and quality, thereby minimizing the need for manual labour.

[0011] Yet another object of the present invention is to develop a device that is capable of detecting expired products and autonomously remove and discard them to ensure the store maintains a high standard of product availability.

[0012] The foregoing and other objects, features, and advantages of the present invention will become readily apparent upon further review of the following detailed description of the preferred embodiment as illustrated in the accompanying drawings.

SUMMARY OF THE INVENTION

[0013] The present invention relates to a grocery store management assistive device that facilitate the automation of grocery store operations, ensuring effective management of tasks like arranging products, assessing their condition, and preserving ideal storage conditions for optimal performance.

[0014] According to an embodiment of the present invention, a grocery store management assistive device comprises of a housing configured with a plurality of motorized omnidirectional wheels for maneuvering the housing over a ground surface, a touch interactive display panel is mounted on the housing for enabling a user to provide input specifications regarding a desired operation to be performed in a grocery store, an artificial intelligence-based imaging unit mounted on the housing and paired with a processor for capturing and processing multiple images in vicinity of the housing to identify position of multiple products, a robotic arm installed on the housing for grabbing each of the product gradually to position in front of the housing, an OCR (Optical Character Recognition) sensor is integrated in the housing and synced with the imaging unit to analyze expiry dates inscribed on the products description, a pair of motorized clippers mounted on the housing, each by means of a robotic link to positon the clippers in proximity to the expired product to grab the expired product for positioning in a container provided on the housing for discarding said products from the shelves, a conical tray attached on the housing for accessing stored grains in an open packaging, an infrared sensor is integrated in the tray for detecting any insects in the stored grains, a speaker mounted on the housing to provide audible alerts regarding the insects to discard the packaged grains, a laser sensor is integrated in the tray for detecting size of the grains for ensuring product quality and consistency.

[0015] According to another embodiment of the present invention, the proposed device further comprises of a humidity sensor embedded within the housing to monitor moisture levels around open containers of the grocery products, a second robotic arm installed on the housing to acquire grip of a moisture-absorbing materials including but not limited to a silica gel bags, a chamber arranged on the housing to place into around the moistened products for preventing spoilage of the products, an extendable rod integrated with a motorized ball and socket joint is installed with the imaging unit for allowing monitoring of the shelves at varying heights to allow proper fetching and arranging of the products via the robotic arm and a battery is associated with the device for powering up electrical and electronically operated components associated with the device.

[0016] While the invention has been described and shown with particular reference to the preferred embodiment, it will be apparent that variations might be possible that would fall within the scope of the present invention.

BRIEF DESCRIPTION OF THE DRAWINGS

[0017] These and other features, aspects, and advantages of the present invention will become better understood with regard to the following description, appended claims, and accompanying drawings where:
Figure 1 illustrates a perspective view of a grocery store management assistive device.

DETAILED DESCRIPTION OF THE INVENTION

[0018] The following description includes the preferred best mode of one embodiment of the present invention. It will be clear from this description of the invention that the invention is not limited to these illustrated embodiments but that the invention also includes a variety of modifications and embodiments thereto. Therefore, the present description should be seen as illustrative and not limiting. While the invention is susceptible to various modifications and alternative constructions, it should be understood, that there is no intention to limit the invention to the specific form disclosed, but, on the contrary, the invention is to cover all modifications, alternative constructions, and equivalents falling within the spirit and scope of the invention as defined in the claims.

[0019] In any embodiment described herein, the open-ended terms "comprising," "comprises,” and the like (which are synonymous with "including," "having” and "characterized by") may be replaced by the respective partially closed phrases "consisting essentially of," consists essentially of," and the like or the respective closed phrases "consisting of," "consists of, the like.

[0020] As used herein, the singular forms “a,” “an,” and “the” designate both the singular and the plural, unless expressly stated to designate the singular only.

[0021] The present invention relates to a grocery store management assistive device that enable the seamless execution of grocery store tasks through automation, including organizing products, evaluating their quality, and maintaining appropriate environmental conditions for storage to enhance operational efficiency.

[0022] Referring to Figure 1, a perspective view of a grocery store management assistive device is illustrated, comprising a housing 101 configured with a plurality of motorized omnidirectional wheels 102, a touch interactive display panel 103 is mounted on the housing 101, an artificial intelligence-based imaging unit 104 mounted on the housing 101, a robotic arm 105 installed on the housing 101, a pair of motorized clippers 106 mounted on the housing 101, each by means of a robotic link 107, a container 108 provided on the housing 101, a conical tray 109 attached on the housing 101, a speaker 110 mounted on the housing 101, a second robotic arm 111 installed on the housing 101, a chamber 112 arranged on the housing 101.

[0023] The device disclosed herein comprising a housing 101 that is equipped with multiple motorized omnidirectional wheels 102, specifically designed to facilitate the movement of the housing 101 over a ground surface. These wheels 102, which operate under the control of a motor, enable the housing 101 to maneuver in various directions with ease, providing enhanced mobility and control. The motorized nature of the wheels 102 allows for precise adjustments to the housing 101 position, ensuring efficient and effective movement across the surface.

[0024] The omnidirectional wheels 102 comprises a wheel coupled with a motor via a shaft that is designed to move the housing 101 in any direction without changing the orientation of the housing 101 offering exceptional maneuverability to the housing 101. Upon actuation of the wheels 102 by the microcontroller, the motor starts to rotate in clockwise or anti-clockwise direction in order to provide movement to the wheels 102 via the shaft. The wheels 102 thus enables the housing 101 to move seamlessly in any direction, making it valuable for moving and positioning the housing 101 over a ground surface.

[0025] The housing 101 is installed with a touch interactive display panel 103 which facilitates the user in providing touch input specifications regarding a desired operation to be performed in a grocery store. The touch interactive display panel 103 as mentioned herein is typically an LCD (Liquid Crystal Display) screen that presents output in a visible form. The screen is equipped with touch-sensitive technology, allowing the user to interact directly with the display using their fingers. A touch controller IC (Integrated Circuit) is responsible for processing the analog signals generated when the user inputs details regarding a desired operation to be performed in a grocery store. A touch controller is typically connected to the microcontroller through various interfaces which may include but are not limited to SPI (Serial Peripheral Interface) or I2C (Inter-Integrated Circuit).

[0026] In the event if the user-desired operation corresponds to restacking of products within the grocery store, the microcontroller activates an artificial intelligence-based imaging unit 104 mounted on the housing 101. The imaging unit 104 disclosed herein comprises of an image capturing arrangement including a set of lenses that captures multiple images of the surroundings and the captured images are stored within memory of the imaging unit 104 in form of an optical data. The imaging unit 104 also comprises of the processor which processes the captured images. This pre-processing involves tasks such as noise reduction, image stabilization, or color correction. The processed data is fed into AI protocols for analysis which utilizes machine learning techniques, such as deep learning neural networks, to extract meaningful information from the visual data which are processed by the microcontroller to continuously sequentially monitor shelves of the store, to identify position of multiple products.

[0027] A robotic arm 105 is installed on the housing 101, designed to gradually grasp each product and position it in front of the housing 101. The robotic arm 105 operates with precision, ensuring that each product is handled and placed accurately for further processing or inspection. The robotic arm 105 used herein mainly comprises of motor controllers, arm 105, end effector and sensors. The arm 105 is the essential part of the robotic arm 105 and it comprises of three parts the shoulder, elbow and wrist. All these components are connected through joints, with the shoulder resting at the base of the arm 105, typically connected to the microcontroller. The elbow is in the middle and allows the upper section of the arm 105 to move forward or backward independently of the lower section. Finally, the wrist is at the very end of the upper arm 105 and attaches to the end effector. The end effector connected to the arm 105 acts as a hand and acquire a grip of the product gradually to position in front of the housing 101.

[0028] An OCR (Optical Character Recognition) sensor is integrated into the housing 101 and synchronized with the imaging unit 104 to analyze the expiry dates inscribed on the product descriptions. The OCR sensor reads the expiry dates, which are then compared with the current date by the microcontroller to determine the product's expiration range. Based on the detected expiration dates, the microcontroller instructs the robotic arm 105 to rearrange the products in order of expiration, from the soonest to the latest, ensuring proper organization and management of the products.

[0029] The OCR sensor captures an image of the text on the product packaging using its camera or imaging unit 104. It then processes the image through optical character recognition module to identify and extract the alphanumeric characters, including the expiry date. The sensor converts the visual data into machine-readable text, which is sent to the microcontroller. The microcontroller compares the extracted expiry date with the current date, determining the product's expiration status. Based on this information, the microcontroller directs the robotic arm 105 to rearrange the products according to their expiration dates, from the soonest to the latest.

[0030] A pair of motorized clippers 106 are mounted on the housing 101, each connected through a robotic link 107. Upon detection of an expired product, the microcontroller activates the robotic link 107, positioning the clippers 106 in close proximity to the expired product. The clippers 106 then grasp the expired product and position it into a designated container 108 located on the housing 101 for disposal. This mechanism ensures that expired products are efficiently removed from the shelves and properly discarded, maintaining product quality and compliance with expiry management protocols. The operation is automated to enhance the accuracy and efficiency of the disposal process.

[0031] The link works in the similar manner as of arm 105 and positions the clippers 106 in an appropriate position. The clippers 106 are coupled with a hinge that is activated by the microcontroller to provide back and forth movement of the clippers 106. The hinge typically refers a mechanical joint that allows rotational movement around a fixed axis using a motor or actuator which provides the rotational force required to move the joint. The motor is typically controlled by an electronic control unit that regulates its speed and direction. The hinge consists of a hinge mechanism that enables rotation around a fixed axis. It usually consists of two parts: a stationary component and a moving component. The stationary component is securely attached to one part of the clippers 106, while the moving component is connected to the other part that aids in providing back and forth movement to the unit for gripping clippers 106 to grip the expired product for positioning in the container 108 for discarding the products from the shelves.

[0032] A conical tray 109 is attached to the housing 101, designed to facilitate the access of stored grains in an open packaging. The tray 109 conical shape allows for easy collection and retrieval of grains, ensuring efficient dispensing or transfer of the contents from the packaging. An infrared sensor is integrated into the conical tray 109 to detect the presence of any insects within the stored grains. The sensor uses infrared technique to identify temperature variations caused by the movement of insects, allowing it to detect even small or hidden pests. Upon detecting insects, the sensor sends a signal to the microcontroller, which trigger an appropriate response, such as activating an alarm or taking corrective action.

[0033] The infrared sensor emits infrared light, which is reflected back by objects in its path. When insects move within the stored grains, their body heat causes a temperature variation, disrupting the infrared light reflection. The sensor detects this variation and converts the changes in infrared radiation into electrical signals. These signals are then processed by the microcontroller, which determines the presence of insects based on the detected heat signatures.

[0034] Based on the detection of insects by the infrared sensor, the microcontroller activates a speaker 110 mounted on the housing 101 to provide audible alerts. These alerts inform the user about the presence of insects in the stored grains, prompting them to discard the affected packaged grains. The speaker 110 ensures that the user is immediately notified, allowing for prompt action to maintain the quality and safety of the stored grains.

[0035] A laser sensor is integrated into the tray 109 to detect the size of the grains. The sensor emits a laser beam onto the grains, and the reflected light is measured to assess the size of the grains. In the event that the microcontroller detects any deviation from the promised size of the packet, the microcontroller activates the speaker 110 to alert the user. This ensures that the product's quality and consistency are maintained, providing real-time feedback and facilitating timely corrective actions.

[0036] The laser sensor emits a laser beam directed at the grains. The sensor measures the time it takes for the laser light to reflect back after hitting the grains. Based on the reflected light, the sensor calculates the size of the grains. The microcontroller processes this data to detect any discrepancies in the grain size compared to the specified parameters. If discrepancies are found, the system triggers the speaker 110 to notify the user.

[0037] A humidity sensor is embedded within the housing 101 to monitor moisture levels around open container 108 of grocery products. Upon detecting a rise in moisture levels beyond a predefined threshold, the microcontroller activates a second robotic arm 111, which works in the similar manner as of first robotic arm 105 and acquires and grips moisture-absorbing materials, such as silica gel bags, stored in a chamber 112 within the housing 101. The robotic arm 111 places the moisture-absorbing materials around the moistened products, thereby preventing spoilage and maintaining product quality. This ensures efficient management of the grocery store by safeguarding the products from excess moisture and extending their shelf life.

[0038] The humidity sensor detects the ambient moisture level by measuring changes in electrical resistance or capacitance caused by moisture in the surrounding air. The sensor sends this data to the microcontroller, which compares it to a predefined threshold. If the moisture level exceeds the threshold, the microcontroller triggers the second robotic arm 111. The arm 111 then retrieves the moisture-absorbing materials from the chamber 112 and positions them around the affected products to reduce excess moisture, ensuring the products are preserved appropriately.

[0039] The optical character recognition (OCR) sensor scans the printed information on grocery products, including but not limited to expiry dates, manufacturing dates, and ingredient compositions. The sensor captures the text and converts it into machine-readable data. Upon processing the scanned information, the microcontroller automatically updates the store's inventory records by linking the data to a database. This process ensures that the store's inventory is continuously monitored and accurately updated with real-time product details, such as product status, expiration dates, and ingredient information, facilitating efficient inventory management and reducing manual data entry errors.

[0040] The imaging unit 104 is configured to utilize computer vision protocols to detect spoilage in sprouts by analyzing color changes. The unit captures images of the sprouts, processing them through algorithms designed to identify variations in color indicative of spoilage. Upon detection of spoilage, the microcontroller activates the device to collect the affected portion of the sprouts. The robotic arm 105 then places the spoiled portion into a designated container 108 for disposal or further action, ensuring that only fresh and healthy sprouts remain for use, thereby maintaining product quality and reducing waste.

[0041] An extendable rod integrated with a motorized ball and socket joint is installed alongside the imaging unit 104, enabling the monitoring of shelves at varying heights. This arrangement allows for dynamic adjustment of the rod’s position to provide a clear view of products at different levels on the shelves. The motorized ball and socket joint permits flexible movement, facilitating precise positioning of the imaging unit 104 for optimal product scanning. Based on the captured data, the robotic arm 105 is directed to fetch and arrange the products efficiently, ensuring proper organization and retrieval of items from the shelves at varying heights.

[0042] The rod is pneumatically actuated, wherein the pneumatic arrangement of the rod comprises of a cylinder incorporated with an air piston and the air compressor, wherein the compressor controls discharging of compressed air into the cylinder via air valves which further leads to the extension/retraction of the piston. The piston is attached to the telescopic rod, wherein the extension/retraction of the piston corresponds to the extension/retraction of the rod. The actuated compressor allows extension of the rod to position the imaging unit 104 for allowing monitoring of the shelves at varying heights.

[0043] The motorized ball and socket joint mentioned here consists of a ball-shaped element that fits into a socket, which provides rotational freedom in various directions. The ball is connected to a motor, typically a servo motor which provides the controlled movement. The rod is attached to the socket of the motorized ball and socket joint, the microcontroller sends precise instructions to the motor of the motorized ball and socket joint. The motor responds by adjusting the ball and socket joint and rotates the ball in the desired direction, and this motion is transferred to the socket that holds the rod. As the ball and socket joint move, it provides the necessary movement to the rod.

[0044] Moreover, a battery is associated with the device for powering up electrical and electronically operated components associated with the device and supplying a voltage to the components. The battery used herein is preferably a Lithium-ion battery which is a rechargeable unit that demands power supply after getting drained. The battery stores the electric current derived from an external source in the form of chemical energy, which when required by the electronic component of the device, derives the required power from the battery for proper functioning of the device.

[0045] The present invention works in the best manner, where the housing 101 configured with the plurality of motorized omnidirectional wheels 102 for maneuvering the housing 101 over the ground surface. The touch interactive display panel 103 enables the user to provide input specifications regarding the desired operation to be performed in the grocery store. Then the artificial intelligence-based imaging unit 104 monitor shelves of the store, to identify position of multiple products. The robotic arm 105 grabs each of the product gradually to position in front of the housing 101. The OCR (Optical Character Recognition) sensor analyze expiry dates inscribed on the products description, that is compared with the current date by the microcontroller to detect expiration range of the product. Based on which the robotic arm 105 rearrange the products in order of the detected expiration range, from soonest to latest. The pair of motorized clippers 106 mounted on the housing 101, each by means of the robotic link 107. In case the product is already expired, the microcontroller actuates aid link to position the clippers 106 in proximity to the expired product to grab the expired product for positioning in the container 108 provided on the housing 101 for discarding the products from the shelves. The conical tray 109 attached on the housing 101 for accessing stored grains in the open packaging. The infrared sensor is integrated in the tray 109 for detecting any insects in the stored grains. Based on which the microcontroller actuates the speaker 110 mounted on the housing 101 to provide audible alerts regarding the insects to discard the packaged grains. The laser sensor is integrated in the tray 109 for detecting size of the grains, and in case the microcontroller detects any comprise in promised size of the packet, the microcontroller directs the speaker 110 to alert the user, thereby ensuring product quality and consistency. The humidity sensor embedded within the housing 101 to monitor moisture levels around open container 108 of the grocery products. Based on which the microcontroller actuates the second robotic arm 111 installed on the housing 101 to acquire grip of the moisture-absorbing materials including but not limited to the silica gel bags, stored in the chamber 112 arranged on the housing 101, to place into around the moistened products, in view of preventing spoilage of the products, thereby facilitating in efficient management of the grocery store. Further the extendable rod integrated with the motorized ball and socket joint is installed with the imaging unit 104 for allowing monitoring of the shelves at varying heights, to allow proper fetching and arranging of the products via the robotic arm 105. Further the imaging unit 104 is configured to utilize computer vision protocols to detect spoilage in sprouts by analyzing color changes, and when spoilage is detected, the device collects the affected portion and stores in the container 108.

[0046] Although the field of the invention has been described herein with limited reference to specific embodiments, this description is not meant to be construed in a limiting sense. Various modifications of the disclosed embodiments, as well as alternate embodiments of the invention, will become apparent to persons skilled in the art upon reference to the description of the invention. , Claims:1) A grocery store management assistive device, comprising:

i) a housing 101 configured with a plurality of motorized omnidirectional wheels 102 for maneuvering said housing 101 over a ground surface, wherein a touch interactive display panel 103 is mounted on said housing 101 for enabling a user to provide input specifications regarding a desired operation to be performed in a grocery store;
ii) a microcontroller linked with said display panel 103 for processing said specifications, wherein in case said user-desired operation corresponds to restacking of products within said grocery store, said microcontroller activates an artificial intelligence-based imaging unit 104 mounted on said housing 101 and paired with a processor for capturing and processing multiple images in vicinity of said housing 101, respectively to continuously sequentially monitor shelves of said store, to identify position of multiple products;
iii) a robotic arm 105 installed on said housing 101 for grabbing each of said product gradually to position in front of said housing 101, wherein an OCR (Optical Character Recognition) sensor is integrated in said housing 101 and synced with said imaging unit 104 to analyze expiry dates inscribed on said products description, that is compared with a current date by said microcontroller to detect expiration range of said product, based on which said microcontroller directs said robotic arm 105 to rearrange said products in order of said detected expiration range, from soonest to latest;
iv) a pair of motorized clippers 106 mounted on said housing 101, each by means of a robotic link 107, wherein in case said product is already expired, said microcontroller actuates aid link to positon said clippers 106 in proximity to said expired product to grab said expired product for positioning in a container 108 provided on said housing 101 for discarding said products from said shelves; and
v) a conical tray 109 attached on said housing 101 for accessing stored grains in an open packaging, wherein an infrared sensor is integrated in said tray 109 for detecting any insects in said stored grains, based on which said microcontroller actuates a speaker 110 mounted on said housing 101 to provide audible alerts regarding said insects to discard said packaged grains, wherein a laser sensor is integrated in said tray 109 for detecting size of said grains, and in case said microcontroller detects any comprise in promised size of said packet, said microcontroller directs said speaker 110 to alert said user, thereby ensuring product quality and consistency;
vi) a humidity sensor embedded within said housing 101 to monitor moisture levels around open container 108 of said grocery products, based on which said microcontroller actuates a second robotic arm 111 installed on said housing 101 to acquire grip of a moisture-absorbing materials including but not limited to a silica gel bags, stored in a chamber 112 arranged on said housing 101, to place into around said moistened products, in view of preventing spoilage of said products, thereby facilitating in efficient management of said grocery store.

2) The device as claimed in claim 1, wherein said optical character recognition (OCR) sensor scans printed information on said grocery products, including but not limited to expiry dates, manufacturing dates, and ingredient compositions, based on which said microcontroller automatically processes and updates a linked database for said store's inventory records.

3) The device as claimed in claim 1, wherein said imaging unit 104 is configured to utilize computer vision protocols to detect spoilage in sprouts by analyzing color changes, and when spoilage is detected, said device collects an affected portion and stores in said container 108.

4) The device as claimed in claim 1, wherein an extendable rod integrated with a motorized ball and socket joint is installed with said imaging unit 104 for allowing monitoring of said shelves at varying heights, to allow proper fetching and arranging of said products via said robotic arm 105.

5) The device as claimed in claim 1, wherein a battery is associated with said device for powering up electrical and electronically operated components associated with said device.