Sign In to Follow Application
View All Documents & Correspondence

A System And Method For Detecting, Counting, Identifying And Tracing Multiple Objects And Object Carrier

Abstract: ABSTRACT ‘A system and method for detecting, counting, identifying and tracing multiple objects and object carrier’ The present invention relates to a system and method for detecting, counting, identifying and tracing multiple objects and object carrier which comprises a conveyor belt (1), an object carrier (3) that includes plurality of objects (4) which are to be simultaneously detected and counted, an weighing machine beneath to be detected object carrier (3), a frame (2), a sensor (8) to detect the position of the object carrier (3), a top camera (6, 7) is installed on the horizontal post to capture the objects (4) provided inside the carrier (3), a side camera (7) positioned parallel to the either side of the carrier (3) to capture the unique marker ID of the carrier (3); wherein, said top (6) and side cameras (7) are triggered due to the actuating signal received from the sensor (8); an object detection module configured to access image captured from cameras (6, 7) and to identify and retrieve the objects (4) specification provided inside the carrier (3). The method is completed in less than 2 seconds of time with more than 99% of accuracy.

Get Free WhatsApp Updates!
Notices, Deadlines & Correspondence

Patent Information

Application #
Filing Date
15 April 2023
Publication Number
20/2023
Publication Type
INA
Invention Field
ELECTRONICS
Status
Email
Parent Application
Patent Number
Legal Status
Grant Date
2025-10-30
Renewal Date

Applicants

UPJAO AGROTECH LLP
6th Floor, 603, Abhijit-4, Opp. Municipal Commissioner Bunglow, Mithakali, Ahmedabad- 380009, Gujarat, India.

Inventors

1. Pranav Kumar Asthana
RAISO, HARDOI - 241204 U.P. INDIA.

Specification

Description:FORM 2
THE PATENTS ACT 1970
(39 of 1970)
&
The Patents Rules, 2003
COMPLETE SPECIFICATION
(See section 10 and rule 13)

1. TITLE OF THE INVENTION:

‘A system and method for detecting, counting, identifying and tracing multiple objects and object carrier’

2. APPLICANT:
(a) NAME : UPJAO AGROTECH LLP
(b) NATIONALITY : India
(c) ADDRESS : 6th Floor, 603, Abhijit-4, Opp.
Municipal Commissioner
Bunglow, Mithakali,
Ahmedabad-380009, Gujarat,
India.


3. PREAMBLE TO THE DESCRIPTION:
PROVISIONAL
The following specification describes the invention.
þ COMPLETE
The following specification particularly describes the invention and the manner in which it is to be performed.


Field of the Invention
The present invention relates to a system and method for detecting, counting, identifying and tracing multiple objects and object carrier. More particularly, present invention relates to a method and system for detecting, counting and identifying multiple objects and carrier containing objects in less than 2 seconds of time. Moreover, the present invention relates to fetching the objects specification of the stored objects inside the carrier, and the quantity of the objects which is easily extractable using vision-based tasks like object label, object dimension which will help to find the SKU (Stock Keeping Unit) of the object.

Background of the Invention
In the earlier times, stores, production plants and warehouses are generally confronted with the challenge of managing inventory. The detection systems of today's production plants and warehouses, for example, generally assume an inflexible sequence of operations whereby a disorganized stream of incoming objects is separated by human workers into a single stream of isolated objects presented one for a time to a human worker with a scanner that identifies the object. The objects are then loaded onto a conveyor and the conveyor then transports the objects to the desired destination, which can be a container, a conduit, a bag, or a destination conveyor.
A smart production plant or warehouse is a large building in which goods are stored that uses machines and computers to complete common production plant or warehouse operations previously performed by humans. The use of smart production plant or warehouse ensures that data is entered quickly and accurately for all aspects of inventory management held in the production plant or warehouse, thereby ensuring that the enterprise can get real-time inventory data in a timely manner and accurately and properly maintain and control the inventory of the enterprise. Smart production plant or warehouse is also convenient for batch control, storage time, etc. inventory units using coding. Efficient handling of many different types of items that exhibit a variety of object specification like shapes and/or sizes and/or quantities etc., can pose an increasingly complex technological challenge.
The current state of the art, detection systems depend on human labor. Most solutions depend on a worker conducting a sorting, by scanning an object from an intake area (chute, table, etc.) and placing the object in a pick location, or collection container.
In typical package counting systems, human workers typically count and sort each variety of packages or objects in the carrier according to a given variety of objects specification. For example, a worker needs to count and sort the canes of soft drink in carrier and take a record of which comprises different variety of canes.
Manual detecting and counting method have disadvantage as human error may occur during counting the objects which may leads problem in industries, production plants and warehouses. Further manual counting is time consuming as each object is required to count individually. Hence, manual operation of counting, identifying the objects provided inside the container or carrier is less accurate and time consuming.
The importance of identifying carrier, objects and type of objects brings transparency in system and makes the system tamper-proof and also the automatic information capturing helps to improve the efficiency of the production plant or warehouse.
However, there are some machines or devices installed in industry which automatically count the carrier individually. Some of the prior arts which discloses about the said system as described below.
One of the Patent Application number CN105956656 (A) disclosed about equipment for counting moving objects, which includes conveying belt, a feeding hopper which can put the objects on the conveying belt, is arranged above the feeding end of the conveying belt, a camera gun is arranged above the transmission direction of the conveying belt, and the equipment also comprises a server which is connected with the camera gun; and the server comprises a controller which is formed by an image acquisition module, an image saving and counting module, an outline identification module, a modeling module, a central point judgment module and a statistics module in sequence. According to the invention, the equipment can identify the moving objects on the conveying belt.
These prior art claims about a device for video recognition and counting and more particularly for counting the moving carrier. In this state of art, when the carrier that needs to be identified is counted into the hopper; hopper will disperse the carrier and then drop them onto the conveyor belt to move with the conveyor belt. The video image is transmitted to the server. After the server receives the video image, the controller processes, recognizes and counts the video image. After the carrier is transmitted, the total number of carriers can be automatically calculated. However, said art has a limitation that this type of system only counts the total number of carriers which are passed through the conveyor belt. Hence, said prior art neither counts the objects in a carrier, nor it suggest about recognizing objects, retrieve information from the carrier and identifying the varieties of objects with their respective specification.
Thus, the prior art does not have the capability to identify class or type of object carrier or object e.g. e.g. SKU when objects can take a random shape and hence not able to stop pilferage of carrier when objects are transferred through carrier.
Hence, to overcome above mentioned problems, it is desperately needed to invent a system and method for detecting, counting, identifying and tracing multiple objects and object carrier which will overcome above mentioned problems.

Object of Invention
The main objective of the present invention is to provide a system and method for detecting, counting, identifying and tracing multiple objects and object carrier.
Another objective of the present invention is to provide a system and method for detecting, counting, identifying and tracing multiple objects and object carrier which track the carrier along with their content and specification from packaging to dispatch.
Further objective of the present invention is to provide a system and method for detecting, counting, identifying and tracing multiple objects and object carrier which can fetch the objects specification of the stored objects inside the carrier, and the quantity of the objects which is easily extractable using vision-based tasks like object label, object dimension which will help to find the SKU (Stock Keeping Unit) of the objects.
Furthermore, objective of the present invention is to provide a system and method for detecting, counting, identifying and tracing multiple objects and object carrier which detect the information and specification of the multiple objects in carrier with more than 99% accuracy.
Another objective of the present invention is to provide a system and method for detecting, counting, identifying and tracing multiple objects and object carrier which complete the process in less than 2 seconds of time.
Another objective of the present invention is to provide a system and method for detecting, counting, identifying and tracing multiple objects and object carrier which is robust, low cost and removes the duplicity of item in same due to the unique marker ID provided to the carrier.
Further, objective of the present invention is to provide a system and method which can detect the objects with clumsy arrangement inside the carrier.
Yet another objective of present invention is to provide a system and method which prefixes weight of moving carrier. Further, any deviation in weight of carrier will be identified.
Yet another objective of present invention is to provide a system and method for detecting, counting, identifying and tracing multiple objects and object carrier which will observe the activities of objects and record. Furthermore, the present invention will also ensure receipt of particular carrier at particular place.
Yet another objective of present invention is to provide a system and method for detecting, counting, identifying and tracing multiple objects and object carrier which will overcome the drawbacks of the conventionally used methods.
Still another objectives and advantages of the present disclosure will be more apparent from the following description which is not intended to limit the scope of the present disclosure.
Summary of the Invention
The present invention relates to a system and method for detecting, counting, identifying and tracing multiple objects and object carrier. The system comprises of a transport system like a conveyor belt, a carrier that includes plurality of objects which are to be simultaneously detected and counted, a weighing machine located at downstream of the conveyor belt and operatively configured beneath of to be detected object carrier, a frame having two vertical posts and one horizontal post; wherein said vertical posts are located at both side of the conveyor belt and the free ends of vertical post are connected through the lateral ends of the horizontal post, a sensor installed at both the sides of the conveyor, detects the position of the carrier and send the triggering signals to plurality of cameras; wherein, said sensor is actuated due to its change in state when the carrier comes in between and blocks the path within the pre-defined time set in the timer and send signal to the plurality of cameras, a top camera is installed on the horizontal post to capture the objects provided inside the carrier, a side camera positioned parallel to the either side of the carrier to capture the unique marker ID of the carrier; wherein, said top and side cameras are programmatically triggered due to the actuating signal received from the sensor; an object detection module configured to access the image captured from the cameras and facilitated to the new pictures in RGB (Red Green Blue) color format to retrieve the object specification and stored in localization database, resize the selected images and convert it into grayscale image format; wherein, said RGB and grayscale images used for detection and objects specification retrieval in combination, and identify the category, quantity and variant of the objects which is stored in localization database. The method is completed in less than 2 seconds of time. System detects, identifies and counts the number of objects provided inside the carrier with more than 99% of accuracy.
Brief description of drawing

Figure 1 illustrates isometric view of a system for detecting, counting, identifying and tracing multiple objects and object carrier.
Figure 2 illustrates top view of a system for detecting, counting, identifying and tracing multiple objects and object carrier.
Figure 3 illustrates side view of a system for detecting, counting, identifying and tracing multiple objects and object carrier.
Figure 4 illustrates process of a system for detecting, counting, identifying and tracing multiple objects and object carrier.
Detailed Description of the Invention
Before explaining the present invention in detail, it is to be understood that the invention is not limited in its application to the details of the construction and arrangement of parts illustrated. The invention is capable of other embodiments, as described above and of being practiced or carried out in a variety of ways. It is to be understood that the phraseology and terminology employed herein is for the purpose of description and not to limitation. The invention may have various embodiments and they may be performed differently then as described in the following pages of the complete specification.
The particulars shown herein are for purposes of illustrative discussion of the embodiments of the present invention only and are presented in the cause of providing what is believed to be the one of the useful and readily understood description of the principles and conceptual aspects of the present invention. In this regard, no attempt is made to show structural details of the present invention in more detail than is necessary for the fundamental understanding of the present invention, the description taken with the drawings making apparent to those skilled in the art how the several forms of the present invention may be embodied in practice.
It is to be understood that the term "comprises" and grammatical equivalents thereof are used herein to mean that other components, ingredients, steps, etc. are optionally present. For example, an article "comprising" (or "which comprises") components A, B, and C can consist of (i.e., contain only) components A, B, and C, or can contain not only components A, B, and C but also contain one or more other components.
For avoidance of doubt, in the context of the description, it is to be understood that the term “RGB” refers to Red Green Blue and the term “SKU” refers to Stock Keeping Unit.
The present invention discloses about the system for detecting, counting, identifying and tracing multiple objects and object carrier which comprises a conveyor belt (1) mounted on the top of a workbench (5), an object carrier (3) that includes plurality of objects (4) which are to be simultaneously detected and counted, a weighing machine (not shown) located at downstream of the conveyor belt (1) and operatively configured beneath of to be detected object carrier (3), a frame (2) having two vertical posts and one horizontal post, a sensor (8) installed at both the sides of the conveyor belt (1), a top camera (6) is installed on the horizontal post of the frame (2) to capture the objects (4) provided inside the object carrier (3), a side camera (7) positioned parallel to the either side of the object carrier (3) to capture the unique marker ID of the object carrier (3).
It is to be understood that the term “workbench”, “sensor” and “object carrier” are not limited to be described herein. The term “workbench” can be referred to some platform or base or table etc upon which the majority of the components to be described herein are mounted. The term “sensor” herein refers in respect of detecting elements that detects the presence of rate in the area of detection for image capture, carrier count and objects characteristics or specification retrieval. Further, the numbers of camera are not limited to be described herein. The plurality of cameras can be installed in the frame as per the desired objective for industrial purpose. The term “object carrier” can be referred to container, crate, etc.
Referring to figures 1, 2 and 3, the present invention includes the conveyor belt (1) is mounted on the top of the workbench (5) and said conveyor belt (1) is driven by the motor (not shown) for carrying and transporting the object carrier (3) from one place to another. The timing relationship of the conveyor belt (1) is defined by positions of the functioning components within a machine cycle. The operational speed of the conveyor belt (1) can be managed through the various factors depends on the person which is required to operate said machine for its desired operation and also responsible for all the consecutive process operation asynchronously or sequentially.
Further, the frame (2) is mounted upon the workbench (5) comprises of two vertical posts and one horizontal post. One end of said vertical posts is pivoted in the workbench (5) at both the sides of the conveyor belt (1). And the free ends of vertical posts are connected through the lateral ends of the horizontal post to make the complete frame around the conveyor belt (1).
It is understood to the person skilled in art that the structure and size of the frame is not limited in described herein. The total area of the frame can be varied thereupon as per the varieties of carrier which are conveyed or as per the industrial applications. Further, the frame can be a chamber, or open ended cubic box like structure.
The carrier (3) includes plurality of objects (4) which are to be simultaneously detected and counted. The object carriers (3) are passed onto the conveyor belt (1) to transport from one place to another.
Continue referring figure 1, 2 and 3, the senor (8) setup is mounted on the workbench at both the sides of the conveyor belt (1). The top camera (6) is installed on the horizontal post of the frame (2) to capture the objects provided inside the object carrier (3). The side camera (7) is positioned parallel to the either side of the object carrier (3) to capture the unique marker ID of the object carrier (3). Said sensor (8) detects the object carrier (3) which carries multiple objects (4). Here, the sensor (8) is setup in such a way that the sensor receives the reflected light emitted from the panel, as it’s placed directly opposite or in a right angle with the line joining the senor plane and the reflective panel plane. Said sensor (8) is actuated due to its change in state whenever the object carrier (3) conveyed by the conveyor belt (1) comes in between and blocks the path within the pre-defined time set in the timer and send the actuating signal to the cameras (6, 7). Programmatically, predefined timer is set for the top camera (6). There are electrical lines setup between the senor (8) and the cameras (6, 7) that whenever there is change in state of the senor (8), simultaneously the pulsating signal has been transmitted from the senor (8) through the electrical lines towards the cameras (6, 7). The top and side cameras (6, 7) are programmatically triggered whenever an actuating signal received from the senor (8). They capture images of the objects (4) and object carrier (3) respectively in BGR (Blue Green Red) format. Said BGR formatted images are converted into RGB format. Here, converting the images from BGR to RGB format is useful to retrieve object information. For each respective images captured by the cameras (6, 7), a similar ID is generated which is based on time and date. It is to be understood that the ID generation is not limited to be in respect of date and time only. Each RGB (Red Green Blue) formatted images are stored in a local database in the identification of generated ID.
During the triggering period of the respective cameras (6, 7), the top camera (6) captures the top view of the object carrier (3) and simultaneously, the side camera (7) captures the side view of the object carrier (3). Both the cameras (6, 7) simultaneously process the images in two different threads. One is for top camera detection and another is for side camera detection.
Now, an object detection module configured to access the images captured from the top camera (6) and the side camera (7) and facilitated to the new pictures in RGB (Red Green Blue) color format to retrieve the objects specification and store in localization database, resize the selected images and converting the RGB (Red Green Blue) images into grayscale images format for detection. Said grayscale images and RGB (Red Green Blue) images are used for detection and information retrieval in combination for the objects provided inside the object carrier (3) and markers provided on the side face of the object carrier (3) respectively and simultaneously identifies the category and quantity of the objects (4) which is stored in localization database. The object detection module specifies the objects (4) from the image and creates a rectangular box around it. For example, if carrier contains pre-defined numbers of objects, then the object detection module creates rectangular box around each of those pre-defined numbers of objects. In an embodiment, dimension range of objects is stored in the system. Rectangle or square box “but not limited to” is created around the detected mask(s) to calculate the dimension of the object. After obtaining the rectangular boxes around the objects, the outline or contours are detected to extract the objects with its proper orientation from that respective rectangular box. It will cover the section of the image where the target object is present. In said process, if the pre-defined dimension falls within a pre-defined range, system is allotted the object carrier (3) with respective specification of objects (4).
In another embodiment of the present invention, using colored patches on the images of the objects (4) in the carrier (3), variants of objects (4) can be distinguished. For that, the RGB images are converted into different color space having three color channels. The color channels can be explicated using a cylindrical structured color-space; where on the circular plane of the cylinder each of the color consists of different angular area, and as it move away from the axis of the cylinder, the grayness of the color is reduced which is defined by another channel, whose operation is way from the axis towards the perimeter, the intensity of the color is defined in the third channel of the color-space, which resembles to the height of the imaginary cylinder. Based on that, color of the objects (4) is detected and based on color variants of the objects (4) contained inside the carrier (3) is identified, said information is stored into database.
Simultaneously, said object detection module detects markers provided on the side face of the object carrier (3). Once the object carrier (3) from the side is detected, then each marker is classified and creates a marker ID based on classification result. Said marker ID and information identified from the said object detection module is saved in database which helps to track the object carrier (3) when the object carrier (3) is exit after packaging.
In another embodiment, to find the weight of the carrier (3), the weighing machine (not shown) is provided at downstream of the conveyor belt (1) and operatively configured beneath of to be detected object carrier (3), where the object carrier (3) is weighed to find the weight of object carrier (3) and objects (4) provided inside the carrier (3). The weight of the object carrier (3) is measured just after the cameras (6 and 7) are triggered to ensure the correct object carrier’s (3) weight is being taken into database. The system ensures to raise an alert when the weight of the carrier containing objects has more or less than predefined quantity range.
Example 1:
The method of invention is illustrated more in details in the following example. The example describes and demonstrates embodiments within the scope of the present invention. This example is given solely for the purpose of illustration and is not to be construed as limitations of the present invention, as many variations thereof are possible without departing from spirit and scope.
Referring the Figure 4, in the operation for detecting, counting, identifying and tracing multiple objects and object carrier in accordance with the present invention, an object carrier (3) containing an objects (4) was passed through a conveyor belt (1) which driven through motor (not shown). The object carrier (3) conveyed by the conveyor belt (1) comes in between and blocks the path within the pre-defined time set in the timer, the sensor (8) was actuated due to its change in state and the pulsating signal was transmitted from the senor (8) through the electrical lines towards plurality of cameras (6, 7). The top and side cameras (6, 7) were programmatically triggered by an actuating signal received from the senor (8). They captured images of the objects (4) and object carrier (3) respectively in BGR (Blue Green Red) format. Now, during the triggering period of the respective cameras (6, 7), the top camera (6) captured the top view of the object carrier (3) and simultaneously, the side camera (7) captured the side view of the object carrier (3) as shown in Figure 4.1. Both the cameras (6, 7) simultaneously processed the images in two different threads. Said BGR formatted images were then converted into RGB format for retrieving objects (4) information. Then after, for each respective images captured by the cameras (6, 7), similar ID was generated. Said RGB images were then stored in a local database in the identification of generated ID.
Now, an object detection module accessed the images captured from the top camera (6) and the side camera (7). Then, the object detection module resized and converted said new images into grayscale image for further identification of the objects (4) presented inside the carrier (3) and stored into database. Said grayscale images and RGB (Red Green Blue) images were used for detection and information retrieval in combination for the objects (4) provided inside the carrier (3) and markers provided on the side face of the carrier (3) respectively as shown in Figure 4.2 and simultaneously identified quantity of the objects (4) which was then stored in localization database. Once the object carrier (3) was detected as shown in figure 4.2, the object detection module specified the objects (4) from the image and created a rectangular box around it as shown in Figure 4.3. After that, the outline or contours were detected to extract the objects with its proper orientation from that respective rectangular box. Then after, segmentation was provided which covered the section of the image where the target object is present and system was allotted the object carrier (3) with respective specification of object as shown in Figure 4.4. Here, system completed the process of identification of category and quantity of the objects and stored the data into local database.
Now, for distinguishing variants of the objects (4) using colored patches on the images of the objects (4) in the carrier (3), the RGB images were converted into different color space having three color channels as shown in Figure 4.5. Based on that, color(s) of the objects (4) was detected and based on color variants of the objects (4) contained inside the carrier (3) was identified and said information was stored into database.
Simultaneously, said object detection module detected markers provided on the side face of the object carrier (3). Once the object carrier (3) from the side was detected, each marker was classified and created a marker ID based on classification result. Said marker ID and information identified from the said object detection module was saved in database.
This process of detecting, counting, retrieval of information, the quantity of the objects in the carrier was completed in less than 2 seconds of time.
The present invention is for detecting, counting, identifying and tracing multiple objects and object carrier tracks each and every objects from the carrier along with their content and specification from packaging to dispatch, fetches the objects specification of the stored objects inside the carrier, the quantity of the object is easily extractable using vision based tasks like object label, object dimension helps to find the SKU (Stock Keeping Unit) of the objects, detects the information and specification of the multiple objects in carrier with more than 99% of accuracy, robust, low cost and removes the duplicity of item in same due to the unique marker ID provided to the carrier and detects the objects with clumsy arrangement inside the carrier. This system can be installed or used in most of the production, manufacturing companies for example pharma, construction, agriculture, food industries and etc. This system can be installed for images acquisition within the production/manufacturing unit, loading unit, unloading unit commute, reception but not limited to. The present invention captures images at multiple places in the supply chain and connects the information for tracking and tracing purposes and extraction of meaningful and actionable item.
Comparison of the present invention with existing technology:
RFID QR Present invention
Detection principle In RFID system, when the carriers are moved on the conveyor belt with the high speed and object carriers are packed in line with very little or no gap between each other, then RFID system performs malfunction by detecting two or more object carrier id’s at the same time causing an issue. The system of QR requires line of sight to scan up to certain distance and read using image processing. While, the present invention requires line of sight scan with distance of reading is higher than QR code and reads using image processing.
Cost The system of RFID is costly as it required costly tags on each carrier and high-end readers for tracking. The system of QR is cost effective than RFID as the unique as system relies on cameras to read. While, the present invention is cost effective than QR codes as even low-end cameras can make the system work.
Robustness of technology In RFID technology, liquid and metals can impact the signal and affect performance. Moreover, in QR technology, if one of the markers of the QR code gets damaged, the reading of that QR code becomes impossible. While, in the present technology, markers maintain most of their designs even in harsh water conditions like washing, rain, etc. Even after some damage due to above mentioned reasons, markers are still readable enough to be detected.
Accuracy The system of RFID is less accurate as it requires very organized and standard operating procedure. However, the system of QR is more accurate than RFIDs as slight disturbance in the system e.g. reading process can be managed by acquisition and detection system While, present invention is more accurate than the other systems as the system has better tolerance while acquiring the information in adverse conditions
Bulk Scanning i.e. reading multiple carrier at a time from single reader Difficult Easy Easy
Ease of use The system of RFID is difficult to use, because starting from application of tags on object carrier and handling such object carrier is difficulty and then said system has to be operated very carefully as per the protocols. If there is slight deviation, then this system causes failure of the platform. The QR systems are easier to handle carrier than RFIDs, however this system have to make sure that markers are 100% enact in original form. If there is slight damage in markers, then this system would lead to failure of system. While, the present invention is quiet easy to handle than existing system of QR codes, as slight damage of markers can be handled, even reading from distance and sun light would not cause any issue.

The present invention specifically provides following advantage:
? Through this method and system, counting of carrier and counting of objects provided inside the carrier is done with more than 99% accuracy.
? Identification of carrier as well as objects in the carrier is done using a vision based low-cost robust solution.
? For single carrier scanning from top view, to map the top view info with the side view carrier id, marker tag-based vision-based identification is much simpler and precise as compared to the existing technology like RFID based systems to RFID based systems, as it doesn’t limit have that single carrier precision. As, while scanning a RFID reader cannot identify the objects, so marker dependent vision system is much more precise.
? Models are properly optimized along with the use of industrial cameras, so that the system is robust for 24*7 operations in an industrial condition.
? The top and side view models are optimized so as to provide an inference time of less than 2 seconds along with the camera image captures.
? The cameras are triggered and synchronized by the sensor, so the camera or the carrier and SKU detection systems are energy efficient, thus at sensor triggers only, cameras pull the shutters and the further processes are done.
? The vision-based system can operates at various speeds of the general packaging chain, so it doesn't need to compromise on the packaging side.

Reference numerals:
Conveyor Belt (1)
Frame (2)
Carrier (3)
Objects (4)
Workbench (5)
Top camera (6)
Side camera (7)
Sensor (8)
, Claims:We Claim: -
1. A system for detecting, counting, identifying and tracing multiple objects and object carrier comprises:
a conveyor belt (1) is configured on the top of a workbench (5) driven by a motor for transporting an object carrier (3),
a frame (2) pivoted on the workbench (5) at the sides of the conveyor belt(1),
the object carrier (3) having plurality of objects (4),
a sensor (8) installed at both the sides of the conveyor belt (1); wherein, the senor (8) is configured to detects the position of the object carrier (3) and send the triggering signals to the plurality of cameras,
the plurality of cameras comprises of a top camera (6) and a side camera (7),
the top camera (6) is installed on top inner side of the frame (2) to capture the objects (4) provided inside the carrier (3),
the side camera (7) positioned parallel to the either side of the object carrier (3) to capture the unique marker ID of the object carrier (3); wherein, said top and side cameras are programmatically triggered due to the actuating signal received from the sensor (8),
an object detection module configured to access the image captured from the cameras (6, 7) and facilitated to the new pictures in RGB color format to retrieve the object specification and stored in localization database, resize the selected images and convert it into grayscale image format for detection and objects specification retrieval in combination, and identify the category, quantity and variant of the objects (4) which is stored in localization database.
2. The system for detecting, counting, identifying and tracing multiple objects and object carrier as claimed in claim 1, wherein the frame (2) is selected from a group of chamber, open ended cubic box like structure, but not limited to.
3. The system for detecting, counting, identifying and tracing multiple objects and object carrier as claimed in claim 1, wherein sensor (8) is actuated due to its change in state when the object carrier (3) comes in between and blocks the path within the pre-defined time set in the timer and send signal to the plurality of cameras (6, 7).
4. The system for detecting, counting, identifying and tracing multiple objects and object carrier as claimed in claim 1, further comprising of an weighing machine located at downstream of the conveyor belt (1) and operatively configured beneath of to be detected object carrier (3), and raise alert when the weight of the carrier (3) containing objects (4) have more or less than predefined quantity range.
5. A method for detecting, counting, identifying and tracing multiple objects and object carrier comprises following steps:
(a) carrying a object carrier (3) on a conveyor belt (1) which driven through motor;
(b) detecting the object carrier (3) when object carrier (3) comes in between sensor plane and reflective plane of a sensor (8);
(c) sending the actuating signal from senor (8) for triggering a top camera (6) and side camera (7) to capture the image;
(d) capturing the image from the top camera (6) and side camera (7) in Blue Green Red colour format and converting into Red Green Blue colour format by object detection module and storing into localization database in the identification of generated ID;
(e) resizing and converting the image received form step (d) into grayscale image by the object detection module for further identification of the objects (4) presented inside the carrier (3);
(f) passing both Red Green Blue (RGB) image from step (d) and grayscale image from step (e) towards object detection module to simultaneously detect the objects (4) inside the carrier (3) and markers presented on the side face of the object carrier (3);
(g) segmenting the object image received in step (f) by bounding box where the objects (4) are present through the object detection module;
(h) accompanying the mask inside a rectangle or square box to identify the dimension and quantity of the detected objects received from step (g) by the object detection module;
(i) passing the RGB (Red Green Blue) image format received from step (d) to object detection module for distinguishing variant of the objects (4);
(j) converting the received image from step (i) into different color space having three color channels by the object detection module to identify the variant of the detected objects (4) and storing the object information into the localization database.
6. The method for detecting, counting, identifying and tracing multiple objects and object carrier as claimed in claim 3, wherein the method of detecting, counting and identifying multiple objects (4) and object carrier (3) are completed in less than 2 seconds of time.
7. The method for detecting, counting, identifying and tracing multiple objects and object carrier as claimed in claim 5 step (d), wherein generated ID is the date and time of the image when it is captured but not limited thereto.
8. The method for detecting, counting, identifying and tracing multiple objects and object carrier as claimed in claim 5 step (f), wherein markers contains unique ID of the object carrier (3).

Dated this on 14th of April, 2023.

Documents

Application Documents

# Name Date
1 202321027746-STATEMENT OF UNDERTAKING (FORM 3) [15-04-2023(online)].pdf 2023-04-15
2 202321027746-STARTUP [15-04-2023(online)].pdf 2023-04-15
3 202321027746-PROOF OF RIGHT [15-04-2023(online)].pdf 2023-04-15
4 202321027746-POWER OF AUTHORITY [15-04-2023(online)].pdf 2023-04-15
5 202321027746-FORM28 [15-04-2023(online)].pdf 2023-04-15
6 202321027746-FORM-9 [15-04-2023(online)].pdf 2023-04-15
7 202321027746-FORM FOR STARTUP [15-04-2023(online)].pdf 2023-04-15
8 202321027746-FORM FOR SMALL ENTITY(FORM-28) [15-04-2023(online)].pdf 2023-04-15
9 202321027746-FORM 18A [15-04-2023(online)].pdf 2023-04-15
10 202321027746-FORM 1 [15-04-2023(online)].pdf 2023-04-15
11 202321027746-FIGURE OF ABSTRACT [15-04-2023(online)].pdf 2023-04-15
12 202321027746-EVIDENCE FOR REGISTRATION UNDER SSI(FORM-28) [15-04-2023(online)].pdf 2023-04-15
13 202321027746-EVIDENCE FOR REGISTRATION UNDER SSI [15-04-2023(online)].pdf 2023-04-15
14 202321027746-DRAWINGS [15-04-2023(online)].pdf 2023-04-15
15 202321027746-DECLARATION OF INVENTORSHIP (FORM 5) [15-04-2023(online)].pdf 2023-04-15
16 202321027746-COMPLETE SPECIFICATION [15-04-2023(online)].pdf 2023-04-15
17 Abstract.jpg 2023-05-13
18 202321027746-IntimationUnderRule24C(4).pdf 2024-05-22
19 202321027746-Response to office action [07-06-2024(online)].pdf 2024-06-07
20 202321027746-OTHERS [07-06-2024(online)].pdf 2024-06-07
21 202321027746-FORM FOR STARTUP [07-06-2024(online)].pdf 2024-06-07
22 202321027746-FER.pdf 2025-03-10
23 202321027746-Information under section 8(2) [17-03-2025(online)].pdf 2025-03-17
24 202321027746-FER_SER_REPLY [30-07-2025(online)].pdf 2025-07-30
25 202321027746-CLAIMS [30-07-2025(online)].pdf 2025-07-30
26 202321027746-US(14)-HearingNotice-(HearingDate-14-10-2025).pdf 2025-09-15
27 202321027746-Correspondence to notify the Controller [07-10-2025(online)].pdf 2025-10-07
30 202321027746-IntimationOfGrant30-10-2025.pdf 2025-10-30

Search Strategy

1 202321027746_SearchStrategyNew_E_SearchHistoryE_03-03-2025.pdf

ERegister / Renewals