Abstract: The invention relates to system (100) and method (500) for package delivery and management. The system (100) includes a primary unmanned aerial vehicle (UAV) (200) configured to deliver a plurality of packages from a source location to a destination based on a plurality of delivery parameters that are pre-configured or pre-defined for one or more categories of the plurality of packages. The primary UAV (200) includes a camera (201) configured to capture an image of a symbol mentioned on a package of the plurality of packages, and a controller (210) configured to identify a category of the one or more categories for the package based on the image of the symbol using an image processing technique and a Deep Learning (DL) classification model (206). The controller (210) configures or defines the plurality of delivery parameters based on the category of the package.
Generally, the invention relates to automated package delivery. More specifically, the invention relates to a system and method for package delivery and management using unmanned aerial vehicle.
BACKGROUND
[002] At present, Unmanned Aerial Vehicles (UAV) or drones are gaining popularity as they are most appropriate choice for resolving the last-mile urban delivery problem. For delivery services, drones are being increasingly used in delivery systems. Delivery drones are those drones that transport packages to designated locations. The delivery drones are remotely controlled through ground station control. Drone operators may concurrently monitor multiple flying bots to ensure the proper delivery of the packages. Further, the use of conventional Global Positioning System (GPS) for reaching the destination may create limitations in the congested urban areas as generally house multi-story buildings. Moreover, accuracy limitations restrict correct floor recognition in a multi-story building and correct house within a floor.
[003] Various systems and methods are available for package delivery via aerial vehicles. However, the available systems deliver the packages to a common delivery location typically present which may be present in an open space. Therefore, the available systems lack in safety measures against theft, vulnerable to harsh environmental conditions (such as, rain, snow, winds, etc.), vulnerable to hazards (such as, fire, liquid-spillage, etc.), and vulnerable to damage by pets. Also, the existing systems lack in detecting address-issue packages and consecutively notifying the concerned authorities. Additionally, the existing systems may not use deep learning techniques to identify symbols mentioned on the packages to identify category of the products.
[004] Moreover, the existing systems with secure drone-delivery pads suffer from the limitations such as, expensive setup, maintenance of landing pads or storage boxes, privacy invasion by camera-based drones in vicinity of the home, and higher installation time.
SUMMARY
[005] In one embodiment, a system for package delivery and management is disclosed. The system may include a primary Unmanned Aerial Vehicle (UAV). The primary UAV may be configured to deliver a plurality of packages from a source location to a destination based on a plurality of delivery parameters that may be pre-configured or pre-defined for one or more categories of the plurality of packages. The primary UAV may further include a camera configured to capture an image of a symbol mentioned on a package of the plurality of packages. The primary UAV may further include a controller configured to identify a category of the one or more categories for the package based on the image of the symbol using an image processing technique and a Deep Learning (DL) classification model. The controller may configure or define the plurality of delivery parameters based on the category of the package.
[006] In another embodiment, a method for package delivery and management is disclosed. The method may include capturing, for each of a plurality of packages, an image of a symbol mentioned on a package of the plurality of packages using a camera attached to the primary UAV. The method may further include identifying, for each of a plurality of packages, a category of the one or more categories based on the image of the symbol using an image processing technique and a Deep Learning (DL) classification model, by a controller. The controller may configure or define the plurality of delivery parameters based on the category of the package. The method may further include delivering the plurality of packages from a source location to a destination based on the plurality of delivery parameters that may be pre-configured or pre-defined for one or more categories of the plurality of packages.
[007] It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the invention, as claimed.
BRIEF DESCRIPTION OF THE DRAWINGS
[008] The present application can be best understood by reference to the following description taken in conjunction with the accompanying drawing figures, in which like parts may be referred to by like numerals.
[009] FIG. 1 illustrates a functional block diagram of a system for package delivery and management using Unmanned Aerial Vehicles (UAV), in accordance with some embodiments of the present disclosure.
[010] FIG. 2 illustrates a block diagram of a primary Unmanned Aerial Vehicle (UAV) configured to deliver packages, in accordance with some embodiments of the present disclosure.
[011] FIG. 3 illustrates a block diagram of a storage rack system within a shared delivery space, in accordance with some embodiments of the present disclosure.
[012] FIG. 4 illustrates a block diagram of a secondary Unmanned Aerial Vehicle (UAV), in accordance with some embodiments of the present disclosure.
[013] FIG 5 illustrates an exemplary process for package delivery and management, in accordance with some embodiments of the present disclosure.
[014] FIG. 6 is a block diagram of an exemplary computer system for implementing embodiments consistent with the present disclosure.
DETAILED DESCRIPTION OF THE DRAWINGS
[015] The following description is presented to enable a person of ordinary skill in the art to make and use the invention and is provided in the context of particular applications and their requirements. Various modifications to the embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments and applications without departing from the spirit and scope of the invention. Moreover, in the following description, numerous details are set forth for the purpose of explanation. However, one of ordinary skill in the art will realize that the invention might be practiced without the use of these specific details. In other instances, well-known structures and devices are shown in block diagram form in order not to obscure the description of the invention with unnecessary detail. Thus, the present invention is not intended to be limited to the embodiments shown, but is to be accorded the widest scope consistent with the principles and features disclosed herein.
[016] While the invention is described in terms of particular examples and illustrative figures, those of ordinary skill in the art will recognize that the invention is not limited to the examples or figures described. Those skilled in the art will recognize that the operations of the various embodiments may be implemented using hardware, software, firmware, or combinations thereof, as appropriate. For example, some processes can be carried out using processors or other digital circuitry under the control of software, firmware, or hard-wired logic. (The term “logic” herein refers to fixed hardware, programmable logic and/or an appropriate combination thereof, as would be recognized by one skilled in the art to carry out the recited functions.) Software and firmware can be stored on computer-readable storage media. Some other processes can be implemented using analog circuitry, as is well known to one of ordinary skill in the art. Additionally, memory or other storage, as well as communication components, may be employed in embodiments of the invention.
[017] Referring now to FIG. 1, a block diagram of an exemplary system 100 for package delivery and managements using Unmanned Aerial Vehicle (UAV) is illustrated, in accordance with some embodiments of the present disclosure. The system 100 may be used to transport a variety of goods from one location to another location. The system 100 may be associated with a courier service, a package delivery service, or any suitable system. Further, the system 100 includes a warehouse 101, which may be one of a manned or an unmanned package dispatch or pickup center. The warehouse 101 may include a plurality of items of different categories including food items, groceries, tools, electronics, documents, and the like. In some embodiments, the warehouse 101 is at a ground location (i.e., source location). Alternatively, in some embodiments, the warehouse 101 is a master manned or unmanned vehicle, which may include various compartments to store the items. The warehouse 101 may be connected to server 107 via a network 105.
[018] The system 100 may further include a primary UAV 102. Size of the primary UAV 102 may vary based on requirement and application where the system 100 is installed. The primary UAV 102 may be configured to pick up a package form the warehouse 101. The package may include at least one item. In some embodiments, the package may be picked up based on a user request or based on an order placed by a user 110. For example, in some embodiments, the item may be a food item ordered by the user 110. The primary UAV 102 may then fly an authorized route based on a plurality of delivery parameters based on category of the items or products. The primary UAV 102 may include a plurality of containers adapted to hold packages of different categories and sizes. Further, the primary UAV 102 may deliver the package to a storage rack room 103. The storage rack room 103 may correspond to a storage racks system. It should be noted that the primary UAV 102 may include various sensors/cameras and a controller in order to perform various functions, for example capturing aerial image, performing thermal assessment, preserving the items in the containers, identifying tags on packages, identifying delivery location, identifying shelves, identifying a type of a package, and the like. The primary UAV 102 is explained in detail in conjunction with FIG. 2. Further, the primary UAV may be connected to the server 107 via the network 105.
[019] The system 100 further includes a storage rack room 103 within a shared delivery space. The shared delivery space may be at residential location or commercial location. For example, a common space or infrastructure for a multistory building. In some embodiments, the storage rack room 103 may correspond to a storage rack system. In some embodiments, the storage rack system may interact with the primary UAV 102 and the warehouse 101 via the network 105. The storage rack room 103 may include at least one rack comprising a plurality of shelves. Size of the storage rack may vary based on number of users. In some embodiments the rack may include a plurality of boxes.
[020] The primary UAV 102, when outside the storage rack room 103, captures an aerial image or a video of the shared delivery space. The image or the video may then be sent to a server, for example the server 107. After entering the storage rack room 103, the primary UAV 102 may deposit the packages of different users on the shelves and send corresponding shelf number and image of the package to users via a message. In some embodiments, the shelf or box may be chosen based on user details. By way of an example, one or more shelves or boxes may be reserved for a particular user. The storage rack system also includes embedded system to perform various operations such as, to process the delivery address mentioned on the packages, providing various instructions to users, and the like. Additionally, the storage rack system may include a display panel, an optical sensor, and a loudspeaker. The storage rack system may be explained further in greater detail in conjunction with FIG. 3. The storage rack system may transmit or receive information from/to a server 108 via the network 105.
[021] The system 100 may further include a secondary UAV 104. The primary and the secondary UAVs 102, 104 may be any type of UAV, e.g., a drone, a helicopter, a quadcopter, octocopter, a fixed-wing UAV, or the like. The secondary UAV 104 may be used at the delivery location for delivering the package from the storage rack room 103 to a specific location. The user 110 may send a request to deliver the package to a location within a pre-defined distance range. For example, in some embodiments, the secondary UAV 104 may deliver the package from the storage rack room 103 to user’s apartment 109. The secondary UAV 104 may include more or less features similar to the primary UAV 102. Various modules within the secondary UAV 104 may be shown in FIG. 4. The secondary UAV 104 may communicate with the storage rack system via the network 105. Also, the secondary UAV 104 may be connected to the server 108 via the network 105, to send or receive information.
[022] The user device 106 within the system 100 may include, but not limited to, a desktop, a computer, a laptop, a tablet, a smart phone, a wearable device or an automobile with one or more processors, or any other wired or wireless processor-driven device. The user device 106 may be used by the user 110. The user device 106 may include a user interface. In some embodiments, the user interface may be used by the user 110 to provide inputs, for example an input to track location of the package or to send a request to the warehouse 101 (for placing an order), and the secondary UAV 104 (to deliver the package at some specific location, or for doorstep delivery). In some another embodiment, a variety of information, such as notifications related package dispatch, pick-up, delivery, reminders to empty the shelf, One Time Password (OTP) may be displayed to the user 110 via the user interface. In some embodiments, an estimated time of arrival of the package may also be provided to the user 110 via a text message. The user device 106 may be connecter to server 107 via the network 105.
[023] The warehouse 101, the primary UAV 102, the storage rack room 103, the secondary UAV 104, the user device 106, the server 105, and the server 108 may exchange information via the network 105. The network 105 may correspond to a public or a private communication network. For example, in some embodiments, the warehouse 101, the primary UAV 102, the storage rack room 103, and the user device 106 may exchange information via the public communication network, such as Internet. In such embodiments, the storage rack room 103, the secondary UAV 104, and the user device 106 may exchange information via the private communication network, such as private Local Area Network (private LAN). The network 105, for example, may be any wired or wireless communication network and the examples may include, but may be not limited to, the Internet, Wireless Local Area Network (WLAN), Wi-Fi, Long Term Evolution (LTE), Worldwide Interoperability for Microwave Access (WiMAX), and General Packet Radio Service (GPRS).
[024] In some embodiments the server 107 may include a database to store the information. The data store may be public cloud storage. Further, the server 108 may include a database to store the information, and the database may be private cloud storage. Additionally, in some embodiments a single server instead of the servers 107 and 108 may be used.
[025] Referring now to FIG. 2, a block diagram of an exemplary primary UAV 200 (analogous to the primary UAV 102) configured for package delivery is illustrated, in accordance with some embodiments of the present disclosure. The primary UAV 200 may be configured to deliver the packages from a warehouse at a source location to a destination location. As discussed above, the warehouse may be a manned unmanned warehouse or a vehicle. The destination location may be a shared delivery space. As explained in FIG. 1, the shared delivery space may be at residential location or commercial location. For example, a common room or infrastructure for a society building. The primary UAV 200 may include a camera 201 to capture aerial images or videos of shared delivery space. The primary UAV 200 after reaching the shared delivery space may capture an aerial image when it is still in the air and at sufficient height, such that the shared delivery space and surrounding are clearly visible. The image may be sent to public cloud storage for future use.
[026] Once the primary UAV 200 enters the storage-rack room situated within the shared delivery location, the primary UAV 200 may detect a storage-rack camera. After finding the storage rack camera, the package is suitably rotated by the primary UAV 200 using at least one motor (not shown in FIG. 2). The package may be rotated to ensure a sharp or un-blurred image and video of the printed delivery address mentioned on the package. In other words, multiple views of the package may be presented to the storage-rack camera by rotating the package in front of the storage-rack camera. The primary UAV 102 may also detect an empty-shelf using sensors 204. The primary UAV 200 may deposit the package at the empty shelf.
[027] Further, the primary UAV 200 may include a notification module 205. After delivering the package on an empty-shelf, the primary UAV 200 may notify the user/recipient, via a message, about the delivered package along with the captured aerial picture and the shelf-number at which the package has been placed. The message may be a text message, an audio note, or both. Further, the primary UAV 200 may include a thermal camera 202 to detect temperature of an item within the package. The temperature detection of the item may be crucial in order to determine product quality, especially, in case of perishable food or medicines. The temperature of the item may be calculated as an average temperature taken by the thermal camera 202 from different sides of the item or from different angles.
[028] It should be noted that the primary UAV 200 may perform temperature assessment twice, i.e., at source location as well as at destination location. In other words, temperature assessment of the item may be performed before taking off from the source location, and after reaching the destination. Both the temperatures may be compared to ensure that the product’s temperature is within a predefine tolerance range, using the thermal camera 202. A notification, using the notification module 205, may be sent to shipment authorities and/or the recipient if the temperature of the product is increased above or dropped below the predefined tolerance range.
[029] Further, the primary UAV 200 may include a visible light camera 203 for identifying the symbols mentioned on the items. The primary UAV 102 also includes a classification model 206 to classify images of symbols or captions, and to broadly categorize them into different categories. The classification model 206 may correspond to a deep classification module. Exemplary categories may include, but not limited to, food, chemical/drugs, regular consumer products, biological hazard, fragile category, toxic, flammable, this side up, keep away from heat and sun, keep dry, and the like. The primary UAV 200 uses image processing technique and neural network models for image classification. Also, based on the classification of the items, delivery parameters, and container type and size may be chosen. For example, a temperature-controlled container for frozen food products or chemicals, and pressure-controlled container for compressed goods etc. This way, both pressure and temperature constraints may be considered. The delivery parameters may include a suitable delivery time, a flight altitude, speed of the vehicle, flight path, package handling (keep the package based on type of the item), requirement of strobe lights 207, number of intermediate hops based on the distance covered on a single battery without overheating. The delivery parameters may be pre-configured or pre-defined. Also, the configurations may be changed manually or overridden by owner/sender/shipment authorities before and during the flight. Flight altitude may be chosen such that to ensure the safety of the item, and keep a safe distance from the general population. The primary UAV 200 may autonomously suggest optimal speed by considering the safety of delivery items to avoid chances of spilling liquid items) and for the fastest delivery time.
[030] Also, the primary UAV 200 may determine need of radiation shielding enclosures for handling dangerous goods, and appropriate sanitization after every cycle. In order to determine the need, the primary UAV 200 may detect a toxic, radioactive, or biological hazard instruction on the package. The primary UAV 200 and its containers 208 may be subject to UV or any other sanitization process after completing the delivery of a chemical, toxic, radioactive, or a biologically hazardous item.
[031] The containers 208 may include radiation shielding containers, temperature controlled containers, pressure-controlled containers, and water-proof containers Further, suitable time for delivering the packages may be determined using metrological weather data, such as atmospheric temperature, chances of rain, wind speed, etc. By way of an example, a flight path that is away from residential areas may be chosen by the primary UAV 200, especially for transporting dangerous goods. The primary UAV 200 may use appropriate strobe lights 207 depending on the type of delivery items. The strobe lights 207 may be used to indicate nature of delivery goods for easy identification.
[032] Further, primary UAV 200 may also use thermal and visible-light cameras for verifying the insulation of the package. The primary UAV 200, using the thermal and visible-light cameras 202, 203 may capture visible and thermal image or video of the package from different angles. The images captured by the visible-light camera 203 may be scanned for faults like wear-tear of the packages, improper packaging, or deterioration of the package. The faults may occur due to excessive weight, sharp material, and non-uniform shapes of the items. Also, there may be other reasons for deterioration of the package as well. The images captured by the thermal camera 202 may be used to detect bivariate gas temperature indicating leakage. The primary UAV 200 uses deep learning models and image processing techniques for verifying the insulation of the package.
[033] It should be noted that the classification model and the controller 210 may identify categories of the packages based on the image of the symbol, which may be captured using the visible length camera 203 or the Near Infrared (NIR) camera 209, using the image processing technique. Further, the controller 201 may configure or define the delivery parameters based on the category of the package. In some embodiments, the controller 210 may further configure or define the delivery parameters based on metrological data received by the primary UAV 200.
[034] Referring now to FIG. 3, a block diagram of a storage rack system 300 (analogous to the storage rack room 103) within a shared delivery space is illustrated, in accordance with some embodiments of the present disclosure. The storage-rack system 300 includes a storage-rack 301 and an embedded system. The storage-rack 301 further includes a plurality of shelves 301a. The plurality of shelves 301a may be numbered shelves. In some embodiments, the term storage rack system and storage rack room is used interchangeably. Further, in one embodiment, height of the storage-rack 301 may be equal to height of the storage rack room. Size of the storage rack 301 may vary based on application of the system 100. The storage rack system 300 may include a camera 302, a display 303, a speaker 304, a barcode scanner 305, a tag assigning module 306, a Near Infrared (NIR) sensor 307, a controller 308, and a thermal sensor 310.
[035] The camera 302 may capture a sharp or un-blurred image and/or video of a printed delivery address provided on the package. In some embodiments, the image and/or video of the deposited package may also be captured using the camera 302 which may then be shared with the user through a user device. Further, the barcode scanner 305 based on the captured image may be used to verify the printed delivery address or barcode using information stored in cloud storage. When an issue in reading information from the printed delivery address or barcode is identified, the tag assigning module 306 may label the package as an address issue package. Further, a notification module (not shown in FIG. 3) may transmit a message to concerned authorities. In particular, the bar code scanner 305 may parse the barcode/ the text of printed delivery address, via an Optical Character Recognition (OCR) technique. This way, the storage rack system 300 may retrieve the recipient details, for example delivery address, name of the recipient, etc. The storage-rack system 300 after successful retrieval of the delivery address from the package displays a suitable message on the display screen 303 along with a confirmation tone/ message on the speaker 303.
[036] In some embodiments, the storage-rack system 300 uses the recipients’ details (i.e., address or name) to fetch communication details of the recipient from the cloud-storage network. The tag assigning module 306 labels a package as address-issue package in case of any reading issue such as, delivery address is not found in the cloud storage, unable to read the address due to worn-off barcode or text, incorrect package delivery and the like. In some embodiments, in case of an address-issue package, an image and/or video of the package may also be captured using the camera 302 which may be shared with intended recipient or concerned authorities.
[037] In some embodiments, the storage rack system 300 uses a vision-lock mechanism for theft protection. For example, recipients collecting a package from the storage rack room need to clearly show their face to the camera 302. Alternatively, the camera 306 may monitor a person entering the storage rack room and the shelf from which the package is picked up. In some other embodiments, the users need to enter One Time Password (OTP) receiver on the user device from the storage rack system or the primary UAV. After successful authentication only the users may be able to collect the packages from the storage rack. Further, a message of collecting package may also be delivered the user device. The storage rack system 300 may provide vision lock steps that needs to be followed by the recipients via the speaker 304 and the display device 303 (i.e., in the form of audio, video, and/or text). In case the vision lock steps are not followed by the recipients, the storage rack system 300 may generate an alarm and subsequently inform the concerned authorities.
[038] Referring now to FIG. 4, a block diagram of a secondary UAV 400 (analogous to the secondary UAV 104) is illustrated, in accordance with some embodiments of the present disclosure. The secondary UAV 400 includes a plurality of modules 401- 409. The secondary UAV 400 includes a camera 401 (same as the camera 302), a thermal camera 402 (same as the thermal camera 202), a visible light camera 403 (same as visible light camera 203), sensors 404 (same as the sensors 204), a notification module 405 (similar to the notification module 205), a classification model 406 (similar to the classification model 206), an NIR sensor 407, strobe lights 408 (same as the strobe lights 207), containers 409 (similar to the containers 208), and a controller 410 (same as the controller 210),. There may be one or more secondary UAVs similar to the secondary UAV 400. The secondary UAV 400 may complete package deliveries for shorter distance for example, from storage-rack room to individuals or to different apartments within the destination location.
[039] By way of an example, a user may initiate a request for a doorstep delivery when the user is not available at home. In this case, the secondary UAV 400 may retrieve the recipient’s package from the storage rack and deliver it to doorstep.
[040] In another example, the secondary UAV 400 may deliver the packages from the storage rack to the entrance of the storage room/storage system. This may be specifically aimed to help the recipients to retrieve their packages from higher inaccessible shelves or in situations where direct access to the delivered package is restricted. Therefore, the recipient may have the package delivered to the entrance of the storage-rack room with help of the secondary UAV 400.
[041] It should be noted that the system for package delivery 100 may be implemented in programmable hardware devices such as programmable gate arrays, programmable array logic, programmable logic devices, or the like. Alternatively, the package delivery system 100 and associated primary UAV 102 may be implemented in software for execution by various types of processors. An identified engine/module of executable code may, for instance, include one or more physical or logical blocks of computer instructions which may, for instance, be organized as a component, module, procedure, function, or other construct. Nevertheless, the executables of an identified engine/module need not be physically located together but may include disparate instructions stored in different locations which, when joined logically together, comprise the identified engine/module and achieve the stated purpose of the identified engine/module. Indeed, an engine or a module of executable code may be a single instruction, or many instructions, and may even be distributed over several different code segments, among different applications, and across several memory devices.
[042] As will be appreciated by one skilled in the art, a variety of processes may be employed for package delivery. For example, the exemplary system 100 and associated primary UAV 102 may deliver the package, by the process discussed herein. In particular, as will be appreciated by those of ordinary skill in the art, control logic and/or automated routines for performing the techniques and steps described herein implemented by system 100 and associated primary UAV 102 either by hardware, software, or combinations of hardware and software. For example, suitable code may be accessed and executed by the one or more processors on the system 100 to perform some or all of the techniques described herein. Similarly, application specific integrated circuits (ASICs) configured to perform some or all the processes described herein may be included in the one or more processors on the system 100.
[043] Referring now to FIG.5, an exemplary process for package delivery and management is depicted via a flow diagram 500, in accordance with some embodiments of the present disclosure. FIG. 5 is explained in conjunction with FIG. 1- FIG. 4.
[044] At step 501, an image of a symbol mentioned on a package of the plurality of packages may be captured by a primary UAV (similar to the primary UAV 102 and the primary UAV 200). The image of the symbol may be captured for each of the plurality of packages. In particular, the image may be captured using a camera attached to the primary UAV. It should be noted, in some embodiments, the camera may be a visible light camera (similar to the visible light camera 203) or a Near Infrared (NIR) camera.
[045] A step 502, a category of the one or more categories may be identified for each of a plurality of packages based on the image of the symbol using an image processing technique. To determine the category, the primary UAV may include a Deep Learning (DL) classification model (for example, the classification model 206 and a controller (same as the controller 210). The controller may configure or define the plurality of delivery parameters based on the category of the package. In some embodiments, the controller may further configure or define the plurality of delivery parameters based on metrological data received by the primary UAV. It should be noted that the plurality of delivery parameters may include at least one of a container type, a package handling parameter, a suitable time for delivery, a flight altitude, a speed of the primary UAV, a flight path, an appropriate strobe light, and a number of intermediate hops. The container type may include at least one of a hazardous substance suitable container, a temperature controlled container, a pressure controlled container, a waterproof container, and an airtight container.
[046] At step 503, the plurality of packages from a source location may be delivered to a destination based on the plurality of delivery parameters. The plurality of delivery parameters may be pre-configured or pre-defined for one or more categories of the plurality of packages.
[047] In some embodiments, a set of thermal images of the package may be captured by the primary UAV. To, capture the set of thermal images, the primary UAV may include a thermal camera (same as the thermal camera 202). Then, temperature assessments of the package at the source location and at the destination may be performed based on the set of thermal images of the package. Further, a change in temperature of the package may be determined based on the temperature assessments of the source location and at the destination. In case the change in temperature is not within a predefined tolerance range, a notification may be provided to the concerned authorities.
[048] Additionally, in some embodiments, a plurality of images of the package from a set of different views may be captured. Based on the captured images, a wear-tear of the package may be identified.
[049] Further, in some embodiments, at least one of an aerial image and an aerial video of a shared delivery space within a field of view of the primary UAV may be captured. It should be noted that the shared delivery space may be the destination. The shared delivery space may include a storage rack system having a plurality of shelves. Moreover, an image of an empty shelf from the plurality of shelves may also be captured to place the package. The empty shelf may be determined based on the image of the empty shelf. Consequently, in some embodiments, a delivery notification may be provided to the user upon placing the package on the empty shelf. The delivery notification may include the at least one of the aerial image and the video of the shared delivery space, and an identification of the empty shelf where the package is placed.
[050] In some embodiments, multiple views of the package may be presented to a storage-rack camera in front of the storage-rack camera. It should be noted that the storage-rack camera may capture a set of images of the package.
[051] The disclosed methods and systems may be implemented on a conventional or a general-purpose computer system, such as a personal computer (PC) or server computer. Referring now to FIG. 6, an exemplary computing system 600 that may be employed to implement processing functionality for various embodiments (e.g., as a SIMD device, client device, server device, one or more processors, or the like) is illustrated. Those skilled in the relevant art will also recognize how to implement the invention using other computer systems or architectures. The computing system 600 may represent, for example, a user device such as a desktop, a laptop, a mobile phone, personal entertainment device, DVR, and so on, or any other type of special or general-purpose computing device as may be desirable or appropriate for a given application or environment. The computing system 600 may include one or more processors, such as a processor 601 that may be implemented using a general or special purpose processing engine such as, for example, a microprocessor, microcontroller or other control logic. In this example, the processor 601 is connected to a bus 602 or other communication medium. In some embodiments, the processor 601 may be an Artificial Intelligence (AI) processor, which may be implemented as a Tensor Processing Unit (TPU), or a graphical processor unit, or a custom programmable solution Field-Programmable Gate Array (FPGA).
[001] The computing system 600 may also include a memory 603 (main memory), for example, Random Access Memory (RAM) or other dynamic memory, for storing information and instructions to be executed by the processor 601. The memory 603 also may be used for storing temporary variables or other intermediate information during execution of instructions to be executed by the processor 601. The computing system 600 may likewise include a read only memory (“ROM”) or other static storage device coupled to bus 602 for storing static information and instructions for the processor 601.
[002] The computing system 600 may also include a storage device 604, which may include, for example, a media drives 605 and a removable storage interface. The media drive 605 may include a drive or other mechanism to support fixed or removable storage media, such as a hard disk drive, a floppy disk drive, a magnetic tape drive, an SD card port, a USB port, a micro USB, an optical disk drive, a CD or DVD drive (R or RW), or other removable or fixed media drive. A storage media 606 may include, for example, a hard disk, magnetic tape, flash drive, or other fixed or removable medium that is read by and written to by the media drive 605. As these examples illustrate, the storage media 606 may include a computer-readable storage medium having stored there in particular computer software or data.
[003] In alternative embodiments, the storage devices 604 may include other similar instrumentalities for allowing computer programs or other instructions or data to be loaded into the computing system 600. Such instrumentalities may include, for example, a removable storage unit 607 and a storage unit interface 608, such as a program cartridge and cartridge interface, a removable memory (for example, a flash memory or other removable memory module) and memory slot, and other removable storage units and interfaces that allow software and data to be transferred from the removable storage unit 607 to the computing system 600.
[004] The computing system 600 may also include a communications interface 609. The communications interface 609 may be used to allow software and data to be transferred between the computing system 600 and external devices. Examples of the communications interface 609 may include a network interface (such as an Ethernet or other NIC card), a communications port (such as for example, a USB port, a micro USB port), Near field Communication (NFC), etc. Software and data transferred via the communications interface 609 are in the form of signals which may be electronic, electromagnetic, optical, or other signals capable of being received by the communications interface 609. These signals are provided to the communications interface 609 via a channel 610. The channel 610 may carry signals and may be implemented using a wireless medium, wire or cable, fiber optics, or other communications medium. Some examples of the channel 610 may include a phone line, a cellular phone link, an RF link, a Bluetooth link, a network interface, a local or wide area network, and other communications channels.
[005] The computing system 600 may further include Input/Output (I/O) devices 611. Examples may include, but are not limited to a display, keypad, microphone, audio speakers, vibrating motor, LED lights, etc. The I/O devices 611 may receive input from a user and also display an output of the computation performed by the processor 601. In this document, the terms “computer program product” and “computer-readable medium” may be used generally to refer to media such as, for example, the memory 603, the storage devices 604, the removable storage unit 607, or signal(s) on the channel 610. These and other forms of computer-readable media may be involved in providing one or more sequences of one or more instructions to the processor 601 for execution. Such instructions, generally referred to as “computer program code” (which may be grouped in the form of computer programs or other groupings), when executed, enable the computing system 600 to perform features or functions of embodiments of the present invention.
[006] In an embodiment where the elements are implemented using software, the software may be stored in a computer-readable medium and loaded into the computing system 600 using, for example, the removable storage unit 607, the media drive 605 or the communications interface 609. The control logic (in this example, software instructions or computer program code), when executed by the processor 601, causes the processor 601 to perform the functions of the invention as described herein.
[007] Thus, the present disclosure may overcome drawbacks of traditional systems discussed before. The disclosed method and system in the present disclosure offers various benefits, such as the use of vision-lock mechanism provides theft-protection. Further, the disclosed system may be robust and immune to harsh environmental conditions such as rain, snow, winds, etc. Additionally, the disclosed system provides protection against hazards like fire, liquid-spillage, pets etc. Moreover, the disclosure detects address-issue packages and notifies to concerned authorities. The disclosed system is simple and economical. The simplicity of the system allows easy implementation across communities (i.e., residential and commercial localities) of varied sizes. The disclosure also offers flexibility of package collection from the shared-delivery location.
[008] Further, the primary UAV within the system 100 is capable of detecting temperature specifications (for example, heat/sun sensitive instructions on the delivery item), pressure specification instructions on the delivery item, detecting water-sensitive instructions on the delivery items. Therefore, the primary UAV may select a suitable container based on the instruction on the delivery item.
[009] It will be appreciated that, for clarity purposes, the above description has described embodiments of the invention with reference to different functional units and processors. However, it will be apparent that any suitable distribution of functionality between different functional units, processors or domains may be used without detracting from the invention. For example, functionality illustrated to be performed by separate processors or controllers may be performed by the same processor or controller. Hence, references to specific functional units are only to be seen as references to suitable means for providing the described functionality, rather than indicative of a strict logical or physical structure or organization.
[010] Although the present invention has been described in connection with some embodiments, it is not intended to be limited to the specific form set forth herein. Rather, the scope of the present invention is limited only by the claims. Additionally, although a feature may appear to be described in connection with particular embodiments, one skilled in the art would recognize that various features of the described embodiments may be combined in accordance with the invention.
[011] Furthermore, although individually listed, a plurality of means, elements or process steps may be implemented by, for example, a single unit or processor. Additionally, although individual features may be included in different claims, these may possibly be advantageously combined, and the inclusion in different claims does not imply that a combination of features is not feasible and/or advantageous. Also, the inclusion of a feature in one category of claims does not imply a limitation to this category, but rather the feature may be equally applicable to other claim categories, as appropriate.
CLAIMS
We Claim:
1. A system (100) for package delivery and management, the system (100) comprising:
a primary unmanned aerial vehicle (UAV) (200) configured to deliver a plurality of packages from a source location to a destination based on a plurality of delivery parameters that are pre-configured or pre-defined for one or more categories of the plurality of packages, wherein the primary UAV (200) comprises:
a camera (201) configured to capture an image of a symbol mentioned on a package of the plurality of packages; and
a controller (210) configured to identify a category of the one or more categories for the package based on the image of the symbol using an image processing technique and a Deep Learning (DL) classification model (206), wherein the controller (210) configures or defines the plurality of delivery parameters based on the category of the package.
2. The system (100) of claim 1,
wherein the controller (210) further configures or defines the plurality of delivery parameters based on metrological data received by the primary UAV (200),
wherein the plurality of delivery parameters comprises at least one of a container type, a package handling parameter, a suitable time for delivery, a flight altitude, a speed of the primary UAV, a flightpath, an appropriate strobe light, and a number of intermediate hops, and
wherein the container type comprises at least one of a hazardous substance suitable container, a temperature-controlled container, a pressure-controlled container, a waterproof container, and an airtight container.
3. The system (100) of claim 1, wherein the primary UAV further (200) comprises a thermal camera (202) configured to capture a set of thermal images of the package, and wherein the controller (210) is further configured to:
perform temperature assessments of the package at the source location and at the destination based on the set of thermal images of the package;
determine a change in temperature of the package based on the temperature assessments of the source location and at the destination; and
provide a notification if the change in temperature is not within a predefined tolerance range.
4. The system (100) of claim 1, wherein the camera (201) is further configured to capture a plurality of images of the package from a set of different views, and wherein the controller (210) is further configured to identify a wear-tear of the package based on the plurality of images of the package.
5. The system (100) of claim 1, further comprising a shared delivery space comprising a storage rack system (300) having a plurality of shelves (301a), wherein the destination is the shared delivery space, and wherein the camera (201) is further configured to:
capture at least one of an aerial image and an aerial video of the shared delivery space within a field of view of the primary UAV (200), and
capture an image of an empty shelf from the plurality of shelves (301a) to place the package, wherein the controller (210) is configured to determine the empty shelf based on the image of the empty shelf.
6. The system (100) of claim 5, wherein:
the primary UAV (200) is configured to provide a delivery notification to a user, upon placing the package on the empty shelf, wherein the delivery notification comprises the at least one of the aerial image and the video of the shared delivery space, and an identification of the empty shelf where the package is placed; and
the storage rack system (300) further comprises a storage-rack camera (302), wherein the primary UAV (200) is configured to present multiple views of the package to the storage-rack camera (302) by rotating the package in front of the storage-rack camera (302), and wherein the storage-rack camera (302) capture a set of images of the package, and wherein the storage rack system (300) is configured to retrieve a delivery address from the set of images using an Optical Character Recognition (OCR) technique.
7. The system (100) of claim 6, wherein:
the storage rack system (300) validates the delivery address against a plurality of delivery addresses corresponding to a plurality of users of the shared delivery space, and wherein a user corresponding to the delivery address is notified about the receiving of the package along with the set of images of the package; and
the storage-rack camera (302) is configured to employ a vision lock technique to identify the recipient when the recipient physically collects the package from the shared delivery space.
8. The system (100) of claim 6, further comprising a secondary UAV (400) for delivering the package from the storage-rack system (300) to the delivery address.
9. A method (500) for package delivery and management, the method (500) comprising:
capturing (501), by a camera (201) installed on a primary Unmanned Aerial Vehicle (UAV) (200), an image of a symbol mentioned on a package of a plurality of packages;
identifying (502), by a controller (210) of the primary UAV (200), a category of one or more categories for the package based on the image of the symbol using an image processing technique and a Deep Learning (DL) classification model (206);
configuring or defining (503), by the controller (210), a plurality of delivery parameters for the package based on the category of the package; and
delivering (504), by the primary UAV (200), the package from a source location to a destination based on the plurality of delivery parameters.
10. The method (500) of claim 9, wherein configuring or defining (503) further comprises configuring or defining the plurality of delivery parameters based on metrological data received by the primary UAV (200).
11. The method (500) of claim 9,
wherein the plurality of delivery parameters comprises at least one of a container type, a package handling parameter, a suitable time for delivery, a flight altitude, a speed of the primary UAV (200), a flight path, an appropriate strobe light, and a number of intermediate hops, and
wherein the container type comprises at least one of a hazardous substance suitable container, a temperature-controlled container, a pressure-controlled container, a waterproof container, and an airtight container.
12. The method (500) of claim 9, further comprising:
capturing, by a thermal camera (202) installed on the primary UAV (200), a set of thermal images of the package;
performing, by the controller (210), temperature assessments of the package at the source location and at the destination based on the set of thermal images of the package;
determining, by the controller (210), a change in temperature of the package based on the temperature assessments of the source location and at the destination; and
providing, by the controller (210), a notification if the change in temperature is not within a predefined tolerance range.
13. The method (500) of claim 9, further comprising:
capturing, by the camera (201), a plurality of images of the package from a set of different views; and
identifying, by the controller (210), a wear-tear of the package based on the plurality of images of the package.
14. The method (500) of claim 9, further comprising:
capturing, by the camera (201), at least one of an aerial image and an aerial video of a shared delivery space within a field of view of the primary UAV (200), wherein the shared delivery space is the destination, and wherein the shared delivery space comprises a storage rack system (300) having a plurality of shelves (301a);
capturing, by the camera (201), an image of an empty shelf from the plurality of shelves (301a) to place the package;
determining, by the controller (210), the empty shelf based on the image of the empty shelf; and
providing, by the controller (210), a delivery notification to a user, upon placing the package on the empty shelf, wherein the delivery notification comprises the at least one of the aerial image and the video of the shared delivery space, and an identification of the empty shelf where the package is placed.
15. The method (500) of claim 14, further comprising:
presenting, by the primary UAV (200), multiple views of the package to a storage-rack camera (302) installed on the storage rack system (300), by rotating the package in front of the storage-rack camera (302), and wherein the storage-rack camera (302) captures a set of images of the package, and wherein the storage rack system (300) is configured to retrieve a delivery address from the set of images using an Optical Character Recognition (OCR) technique.
16. The method (500) of claim 15, further comprising, one of:
validating, by the storage rack system (300), the delivery address against a plurality of delivery addresses corresponding to a plurality of users of the shared delivery space, and wherein a user corresponding to the delivery address is notified about the receiving of the package along with the set of images of the package;
employing, by the storage rack system (300), a vision lock technique to identify the recipient when the recipient physically collects the package from the shared delivery space; or
delivering, by a secondary UAV (400), the package from the storage-rack system (300) to the delivery address.
| # | Name | Date |
|---|---|---|
| 1 | 202111060042-IntimationOfGrant11-03-2025.pdf | 2025-03-11 |
| 1 | 202111060042-STATEMENT OF UNDERTAKING (FORM 3) [22-12-2021(online)].pdf | 2021-12-22 |
| 2 | 202111060042-PatentCertificate11-03-2025.pdf | 2025-03-11 |
| 2 | 202111060042-REQUEST FOR EXAMINATION (FORM-18) [22-12-2021(online)].pdf | 2021-12-22 |
| 3 | 202111060042-REQUEST FOR EARLY PUBLICATION(FORM-9) [22-12-2021(online)].pdf | 2021-12-22 |
| 3 | 202111060042-CLAIMS [27-10-2022(online)].pdf | 2022-10-27 |
| 4 | 202111060042-PROOF OF RIGHT [22-12-2021(online)].pdf | 2021-12-22 |
| 4 | 202111060042-DRAWING [27-10-2022(online)].pdf | 2022-10-27 |
| 5 | 202111060042-POWER OF AUTHORITY [22-12-2021(online)].pdf | 2021-12-22 |
| 5 | 202111060042-FER_SER_REPLY [27-10-2022(online)].pdf | 2022-10-27 |
| 6 | Reply From DRDO-(30-06-2022).pdf | 2022-06-30 |
| 6 | 202111060042-FORM-9 [22-12-2021(online)].pdf | 2021-12-22 |
| 7 | 202111060042-FORM 18 [22-12-2021(online)].pdf | 2021-12-22 |
| 7 | 202111060042-FER.pdf | 2022-05-11 |
| 8 | 202111060042-LETTER TO DRDO-(28-04-2022).pdf | 2022-04-28 |
| 8 | 202111060042-FORM 1 [22-12-2021(online)].pdf | 2021-12-22 |
| 9 | 202111060042-COMPLETE SPECIFICATION [22-12-2021(online)].pdf | 2021-12-22 |
| 9 | 202111060042-FIGURE OF ABSTRACT [22-12-2021(online)].jpg | 2021-12-22 |
| 10 | 202111060042-DECLARATION OF INVENTORSHIP (FORM 5) [22-12-2021(online)].pdf | 2021-12-22 |
| 10 | 202111060042-DRAWINGS [22-12-2021(online)].pdf | 2021-12-22 |
| 11 | 202111060042-DECLARATION OF INVENTORSHIP (FORM 5) [22-12-2021(online)].pdf | 2021-12-22 |
| 11 | 202111060042-DRAWINGS [22-12-2021(online)].pdf | 2021-12-22 |
| 12 | 202111060042-COMPLETE SPECIFICATION [22-12-2021(online)].pdf | 2021-12-22 |
| 12 | 202111060042-FIGURE OF ABSTRACT [22-12-2021(online)].jpg | 2021-12-22 |
| 13 | 202111060042-FORM 1 [22-12-2021(online)].pdf | 2021-12-22 |
| 13 | 202111060042-LETTER TO DRDO-(28-04-2022).pdf | 2022-04-28 |
| 14 | 202111060042-FER.pdf | 2022-05-11 |
| 14 | 202111060042-FORM 18 [22-12-2021(online)].pdf | 2021-12-22 |
| 15 | 202111060042-FORM-9 [22-12-2021(online)].pdf | 2021-12-22 |
| 15 | Reply From DRDO-(30-06-2022).pdf | 2022-06-30 |
| 16 | 202111060042-FER_SER_REPLY [27-10-2022(online)].pdf | 2022-10-27 |
| 16 | 202111060042-POWER OF AUTHORITY [22-12-2021(online)].pdf | 2021-12-22 |
| 17 | 202111060042-DRAWING [27-10-2022(online)].pdf | 2022-10-27 |
| 17 | 202111060042-PROOF OF RIGHT [22-12-2021(online)].pdf | 2021-12-22 |
| 18 | 202111060042-REQUEST FOR EARLY PUBLICATION(FORM-9) [22-12-2021(online)].pdf | 2021-12-22 |
| 18 | 202111060042-CLAIMS [27-10-2022(online)].pdf | 2022-10-27 |
| 19 | 202111060042-REQUEST FOR EXAMINATION (FORM-18) [22-12-2021(online)].pdf | 2021-12-22 |
| 19 | 202111060042-PatentCertificate11-03-2025.pdf | 2025-03-11 |
| 20 | 202111060042-STATEMENT OF UNDERTAKING (FORM 3) [22-12-2021(online)].pdf | 2021-12-22 |
| 20 | 202111060042-IntimationOfGrant11-03-2025.pdf | 2025-03-11 |
| 1 | SearchE_11-05-2022.pdf |