Sign In to Follow Application
View All Documents & Correspondence

Computer Vision Enabled System And Method Aiding Photovoltaic Installations And Maintenance

Abstract: A method and a system to aid the designing of a photovoltaic solar system using an integrated tool. The method involves the steps of navigating a mobile device, enabled with a computer vision, over a rooftop or an open space, receiving the augmented reality display data of the target zone on the mobile device, creating a 3D model of a virtual solar power plant on the mobile device, transmitting of created 3D model to an integrated application that is configured to calculate appropriate PV module array layout, installation capacity, energy generation detail and other installation requirements. <>

Get Free WhatsApp Updates!
Notices, Deadlines & Correspondence

Patent Information

Application #
Filing Date
12 April 2016
Publication Number
41/2017
Publication Type
INA
Invention Field
ELECTRICAL
Status
Email
nishantk@ediplis.com
Parent Application

Applicants

Tata Power Solar Systems Ltd.
78, Electronics City, Phase I Hosur Road, Bangalore

Inventors

1. Suraj Mohan
78, Electronics City, Phase I Hosur Road, Bangalore - 560100

Specification

Claims:We Claim:
1. A system for designing and engineering of a PV module comprising:
a computer vision enabled mobile device, said device is configured to model and display virtual solar power plant;
a processor in disposed within said mobile device, said processor configured to generate 3D models from said virtual solar power plant display; and
a server in communication with said processor, said server is configured to receive said 3D model.

2. The system for designing and engineering of a PV module of claim 1, wherein said mobile device is a smart phone.

3. The system for designing and engineering of a PV module of claim 1, wherein said mobile device is a tablet.

4. The system for designing and engineering of a PV module of claim 1, wherein said mobile device is an Unmanned Aerial Vehicle (UAVs).

5. The system for designing and engineering of a PV module of claim 1, wherein said mobile device is enabled with at least one sensor.
6. The system for designing and engineering of a PV module of claim 1, wherein said mobile device is enabled with wireless communication unit.

7. The system for designing and engineering of a PV module of claim 1, wherein said server is disposed with at least one processor.

8. The system for designing and engineering of a PV module of claim 7, wherein said processor receives instructions from an architecture software.

9. The system for designing and engineering of a PV module of claim 8, wherein said architecture software is computer aided design software (CAD) configured to create an array layout from said 3D model.

10. The system for designing and engineering of a PV module of claim 1, wherein said server encloses meteo files configured to generate energy estimation report for said array layout.

11. The system for designing and engineering of a PV module of claim 1, wherein said server encloses a cost template configured to generate budget report for said array layout.

12. A method for designing and engineering of a PV module, said method comprising:
navigating of a computer vision enabled mobile device over a target zone;
measuring of said target zone with the help of at least one sensor disposed within said mobile device;
displaying of said measured target zone on said mobile device, said display is in the form of augmented reality view;
generating of a virtual solar power plant 3D model by a processor disposed within said mobile device, said processor fetch instructions from particular set of design application;
creating of an array layout from said 3D models by a server in communication with said processor, said server fetch instructions from CAD software;
generating of energy estimation plan using meteo file enclosed within said server; and
generating budget report using cost template enclosed within said server.

13. The method for designing and engineering of a PV module of claim 12, wherein said CAD software is further customized to get post-bid engineering drawing.

14. The method for designing and engineering of a PV module of claim 13, wherein said post-bid engineering drawings further includes dimensions of said PV module.
15. The method for designing and engineering of a PV module of claim 13, wherein said post-bid engineering drawings furthermore includes tilt angle of said PV module. , Description:FIELD OF INVENTION

[001] The invention generally relates to design and installation of photovoltaic systems and their maintenance, more specifically to an integrated tool involving a computer vision enabled mobile device and an integrated application to aid in designing, engineering and maintenance of a photovoltaic system (PV system).
BACKGROUND OF INVENTION

[002] Photovoltaic module installation is a complex process where system installation demands various pre installation analyses. First and foremost step is to ensure that the roof area or other installation site is capable of handling the desired system size. Based on roof design, size and other parameters an optimal position where sunlight and weather conditions are most favorable is chosen for the PV system installation.

[003] Once the array layout is designed, the optimal size of the PV system needs to be determined. The system is installed based on the installation requirements and procedures from the manufacturer’s specifications. Further, energy generation plan needs to be created to calculate the maximum energy that can be generated by the installed PV system.

[004] The existing methods for area measurement and corresponding PV system designing are complicated and time consuming. One big drawback of the current systems is that they rely on system involving manual measurement techniques that are prone to considerable errors and ultimately may result in an erroneous design. Though some attempts have been made at automating the measurement and designing processes but given that these processes rely on many independent applications, the desired accuracy and ease of designing is far from achieved.

[005] Firstly, to ensure that the roof area or other installation site is capable of handling the desired system size it is important to navigate the site and take imagery of the site. There are many methods in existence to do so; one such known process includes the use of Google maps to get a satellite imagery of the installation site where the images are blurred and said to have a resolution lesser than 256*256 pixels.

[006] Apart from the Googlemaps which use GPS to location the place, there are methods and systems which are designed to capture and display the objects around, virtually without using GPS or any such signals. The system enables users to interact in real time with an augmented or virtual reality. The created augmented view can be referred as site imagery.

[007] Based on such images, a rough estimation of material requirement is calculated. A separate tool may be used for computing estimated energy generation plan which again gives the rough estimation of energy generation.

[008] Combination of such various pieces of technology which are not made to work in synchronization with each other always ends up in giving estimation far away from the reality.

[009] To overcome the present drawbacks, there is a need for a system which is a fine blend of all the required technologies integrated together, that makes the use of the system more simple and ends up in giving more accurate results.


OBJECT OF INVENTION

[0010] The object of the invention is to provide a system and method which aids the design, engineer and maintenance of PV systems using an integrated tool where, the integrated tool includes a computer vision enabled mobile device with a display.

[0011] Further, another object of the present invention is to provide an integrated solution to aid the design, engineer and maintenance of a rooftop solar system rather than individual pieces of technologies.

[0012] Yet another object of the present invention is to aid the designing and installation of a PV system for an open ground space.

STATEMENT OF INVENTION
[0013] Accordingly the invention provides a system and method for designing and engineering of a PV module where the system comprising of a mobile device enabled with computer vision which navigates over the a target zone and displays the augmented view of the area. Various design specifications are embedded in the device which helps in modeling a virtual solar power plant installation on the target zone, using the virtual power plant display a 3D model design of the solar power plant is generated. Generated 3D model is sent to the server via any wireless communication protocol. 3D model received by the server is further used to extract an array layout. The system further includes the generation of energy estimation plan using meteo file enclosed within the server and also the generation of budget report using cost template enclosed within the same server.

[0014] These and other aspects of the embodiments herein will be better appreciated and understood when considered in conjunction with the following description and the accompanying drawings.
BRIEF DESCRIPTION OF FIGURES

[0015] This invention is illustrated in the accompanying drawings, throughout which, like reference letters indicate corresponding parts in the various figures.

[0016] The embodiments herein will be better understood from the following description with reference to the drawings, in which:

[0017] Fig. 1 depicts/illustrates architecture of the navigating mobile device.

[0018] Fig. 2 shows a flowchart depicting / illustrating a method that aids designing and engineering of a PV system.

[0019] Fig. 3 depicts / illustrates a system that aids designing and engineering of rooftop PV system.

[0020] Fig.4 shows a block diagram representing the process of generation of overall photovoltaic solar system design, dimension and cost estimation.

[0021] Fig. 5 shows a rooftop building installed with a photo-voltaic solar system.


DETAILED DESCRIPTION OF INVENTION

[0022] The embodiments herein and the various features and advantageous details thereof are explained more fully with reference to the non-limiting embodiments that are illustrated in the accompanying drawings and / or detailed in the following description. Descriptions of well-known components and processing techniques are omitted so as to not unnecessarily obscure the embodiments herein. The examples used herein are intended merely to facilitate an understanding of ways in which the embodiments herein may be practiced and to further enable those of skill in the art to practice the embodiments herein. Accordingly, the examples should not be construed as limiting the scope of the embodiments herein.

[0023] The embodiments herein below provide a method and system that aids the designing and maintenance of a PV system using and tool. The method involves the steps of navigating a computer vision enabled mobile device over a rooftop or an open space (target zone), obtaining the measurements of physical spaces of the target zone, modeling of a virtual solar power plant on the device, navigating through the created virtual solar power plant and generating 3D model of the same virtual power plant. Further generated 3D model is transferred to an integrated application, through any wireless communication protocol, that is configured to calculate appropriate PV module array layout, installation capacity, energy generation detail and other installation requirements. Furthermore, the system may be used to constantly check and preserve the state of the PV installations.

[0024] Referring now to the drawings, where similar reference characters denote corresponding features consistently throughout the figures, there are shown preferred embodiments.

[0025] Any suitable device with a processor and a display known in the art or developed in the future including, but not limited to, smart phone, tablets, smart watch, wearable glass, etc may be configured to run an application that communicates with the hardware capabilities of the computer vision enabled device. In an alternate embodiment, the computer vision enabled device itself may be configured to run the application.

[0026] In an exemplary embodiment 100, a smart phone 102 with a display 120 embedded with the above said application through the processor 104 is shown in Fig 1. The Fig shows architecture of the navigating mobile device 102 and its communication with the integrated application inside a server 114 and database 116. The device 102 has a processor 104, custom sensors 106, depth sensors 108, wireless communication unit 110, memory 112 and image processing unit 118 such device referred in this document as “computer vision enabled device”.

[0027] The device 102 can be held manually and may be used to navigate the physical world similar to how we do as humans, the device 102 is enabled with the computer vision which helps to detect its position relative to the world around it without using GPS or other external signals. The custom sensors 106 help the device 102 to track its motion which makes the device 102 to understand its position and orientation in real time. The device 102 may use the visual cues stored in the memory 112 to help recognize the upcoming obstacles and self-correct the errors in motion tracking. The depth sensors 108 plays a major role in making the device 102 understand the shape of the world around. Understanding the depth helps the device 102 to take the measurements of the target zone and display it in an augmented reality way or to display the 3D mapping of the target zone.

[0028] Once the target zone is displayed on the screen 120, using particular set of design specifications saved in the memory 112 and by the use of image processing unit 118, a virtual solar power plant may be modeled on the device display 120 with the help of the specific presentation and design tools stored in the memory 112. Further, the application through the processor 104, allows the device 102 to navigate within the virtual power plant created which helps in visualizing the measurements of the power plant. The generated 3D model of virtual solar power plant may be transferred, to a server 114 with a database 116, through the wireless communication unit 110.

[0029] The wireless communication units may vary in a wide range including Wi-Fi, Bluetooth, Zigbee, etc. Most preferable means, but not limited, would be through Wi-Fi.

[0030] In another embodiment, the generated 3D model may be printed with help of connected 3D printers to represent an alias model of the solar plant.

[0031] Fig 2 shows a flowchart 200 of a method that aids designing and engineering of a PV system. The method includes the steps of navigating the mobile device across the target zone (block 202). Here the mobile device is equipped with special vision sensors to measure the target zone and show its augmented reality display (block 204) on the mobile device. The mentioned target zone may be a rooftop of any building or any open space.

[0032] In an exemplary embodiment, the mobile device is equipped with special set of sensors including custom sensors to track device’s motion and depth sensors to understand the shape of the objects around which intern helps in getting the measurements of the target zone.

[0033] The 3dimensional display of the target zone is displayed on the device, using a particular set of design specifications and with the help of image processing unit, a virtual solar power plant is modeled on the device (block 206) and thus, a 3D model of the solar power plant with visual measurements is generated (block 208). 3D modeling is a process of developing a mathematical representation of a surface by designating and manipulating its width, height and depth. Obtained 3D model is sent to the server which involves an integrated application; the roof part of the 3D model is then extracted by integrated application for creating an array layout (block 210) which helps in solar system sizing and creating a preliminary PV system layout for the target zone. In general terms, array layout may be defined as a simplest representation of arrangement of Solar-panels using rectangular shaped units with specific rows, columns and spacing between the units, to get a maximum capacity feasibility at the target zone (Roof top / Open Space).

[0034] In one embodiment, integrated application involves multiple software’s and predefined file templates which helps in designing and engineering of a PV module. Here, the integrated application involves an architecture software to create an array layout from the 3D model, a weather generating file and a predefined cost template.

[0035] Further, after creating a preliminary PV system layout based on the array layout of the target zone, energy generation plan of the PV system can be obtained (block 222) by adding a meteo file into the integrated application. Meteo data files may generate month wise average insolation/solar radiation value of a particular place based on which energy generation plan is obtained. Obtained energy generation plan includes energy commitment (kWh) estimated for specific future years. Energy generation plan further includes performance ratio (PR) of the PV system layout, which is a product of energy commitment (kWh), area of the PV module and efficiency of the module. With the above obtained energy commitment value, maximum capacity of the PV system to be installed in the target zone can be quantified (block 224) along with the energy generation plan.

[0036] Further, the integrated application involves a predefined cost template decided based on the array layout structure and energy estimation plan. With the help of the present cost template, budget report Of the PV module is generated (block 226).

[0037] Furthermore, the method 200 may be used to constantly check and preserve the state of the solar power plant after installations.

[0038] Fig 3 represents a building rooftop 302 and system 300 that aids designing of a rooftop PV system. The system 300 includes a mobile device 102 with a display 120 and a server 114 containing integrated application along with a database 116.

[0039] In one embodiment, the automated process of designing a solar system starts by navigating the mobile device 102 across the building rooftop/target zone 302.
[0040] The mobile device here can refer to any suitable device known in the art or developed in the future that including, but not limited to, smart phone, tablets, unmanned aerial vehicle (UAVs), etc. The mobile device 102 which is equipped with the special vision sensors (not shown in the Fig) measures the target zone and shows its augmented reality on the mobile display 120. The advantage of using a smart phone or a tablet in the process of designing a PV system is its simplicity to hold the device and navigate the place similar to how we do as humans.

[0041] Further, once the target zone 302 is displayed on the screen 120, using particular set of design specifications and by the use of image processing system, a virtual solar power plant may be modeled on the device display 120 from which 3D model of the solar power plant is obtained. The model represents the optimal solar power plant for the designated target zone 302. Obtained 3D model is a mathematical representation of the solar power plant, obtained by designating and manipulating surface width, height and depth. These 3D models are sent to a server 114 through any wireless communication means known in the prior art or developed in the future.

[0042] The server 114 contains a processing unit inside which, the integrated application take the roof part of the 3D model and creates a grid form called array layout filled with rectangular units of photovoltaic panels. The present modification may be done using an integrated CADD software application. Unlike the existing methods of designing PV system, the present system may have a provision to edit the created CADD drawings for post-bid engineering design activity.

[0043] Furthermore, the integrated application may contain the option of receiving a meteo data file through an API (Application programming interface), wherein such Meteo files may generate month wise average insolation/solar radiation value of a particular place. Meteo file may be integrated into the system in a predefined template to get an energy generation plan or energy estimation report. Using the energy generation plan, Performance ratio (PR) and energy commitment (in kWh) can be estimated for the next 25 years for the building roof 302. Using energy commitment value, maximum capacity of the PV system to be installed on the rooftop 302 can be quantified along with the energy generation plan

[0044] Once the capacity of the PV system to be installed on the rooftop 302 is quantified, a predefined cost template is integrated into the system to get the overall budget report. The whole process of designing from taking rooftop images till generating the budget report for a rooftop solar system is automated. Further customization can be done using the Specific Solar panel dimension as a template in CADD for generating the Photo Voltaic array layout.

[0045] In another alternative embodiment, the system disclosed herein may be used to aid installation of PV systems in open spaces wherein the mobile device 102 utilizes the landscape features to determine the target zone. The remaining process remains the same as provided herein.

[0046] Fig. 4 shows a block diagram representation of a process of generation of a PV system design, dimension, energy generation and cost estimation. From a mobile device 402 enabled with the computer vision which helps to detect its position relative to the world around and special vision sensors, augmented reality display of the target zone is obtained. Obtained 3D mapped display is applied with particular set of design specifications 404 and by the use of image processing unit (not shown in the Fig), a virtual solar power plant may be modeled on the device, which is a 3D model of the solar power plant. Obtained 3D model is transferred wirelessly to the remote server and is fed to CADD software 406 to obtain an array layout of the 3D model. To get the dimension of the solar panel used in the PV system or more precisely to get the dimensions of array layout, CADD software 406 is customized in a way that engineering drawings are created to suffice the pre and post bid engineering design activities. Such obtained array layout of solar panel may be considered as result 1. A meteo file 408 which generates month wise average insolation/solar radiation value of a particular place integrated into the system to get an energy estimation report. The energy estimation report provides the total energy that can be generated by the PV system and hence energy estimation report is considered as result 2.
[0047] Further, a predefined cost template 410 is integrated into the system to give out a budget report which gives an accurate number on the total budget involved in the installation of PV system. This budget report may be considered as result 3. The combination of result 1, result 2 and result 3 may be utilized to fully design and install the PV system for the target zone.

[0048] Fig 5 represents a rooftop building installed with a photo-voltaic solar system. Once the PV system design, energy generation plan, budget plan and the panel dimensions are obtained from the automated process described above, a PV system 512 is manufactured with the obtained specifications to a specific building rooftop 510. Furthermore, the integrated system including computer vision enabled device and other applications may be used to constantly check and preserve the state of the PV system 510.

[0049] The foregoing description of the specific embodiments will so fully reveal the general nature of the embodiments herein that others can, by applying current knowledge, readily modify and/or adapt for various applications such specific embodiments without departing from the generic concept, and therefore, such adaptations and modifications should and are intended to be comprehended within the meaning and range of equivalents of the disclosed embodiments. It is to be understood that the phraseology or terminology employed herein is for the purpose of description and not of limitation. Therefore, while the embodiments herein have been described in terms of preferred embodiments, those skilled in the art will recognize that the embodiments herein can be practiced with modification within the spirit and scope of the embodiments as described herein.

Documents

Application Documents

# Name Date
1 Form 5 [12-04-2016(online)].pdf 2016-04-12
2 Form 3 [12-04-2016(online)].pdf 2016-04-12
3 Drawing [12-04-2016(online)].pdf 2016-04-12
4 Description(Complete) [12-04-2016(online)].pdf 2016-04-12
5 201641012912-Power of Attorney-130616.pdf 2016-07-22
6 201641012912-Form 1-130616.pdf 2016-07-22
7 201641012912-Correspondence-F1-PA-130616.pdf 2016-07-22
8 abstract 201641012912.jpg 2016-09-23
9 Form 18 [08-11-2016(online)].pdf 2016-11-08
10 Form-18(Online).pdf 2016-11-09
11 201641012912-FORM 3 [28-08-2019(online)].pdf 2019-08-28
12 201641012912-FER.pdf 2019-12-18
13 201641012912-FORM 4(ii) [17-06-2020(online)].pdf 2020-06-17
14 201641012912-OTHERS [20-07-2020(online)].pdf 2020-07-20
15 201641012912-FORM 3 [20-07-2020(online)].pdf 2020-07-20
16 201641012912-FER_SER_REPLY [20-07-2020(online)].pdf 2020-07-20
17 201641012912-CORRESPONDENCE [20-07-2020(online)].pdf 2020-07-20
18 201641012912-COMPLETE SPECIFICATION [20-07-2020(online)].pdf 2020-07-20
19 201641012912-CLAIMS [20-07-2020(online)].pdf 2020-07-20
20 201641012912-ABSTRACT [20-07-2020(online)].pdf 2020-07-20
21 201641012912-FORM 3 [20-10-2020(online)].pdf 2020-10-20
22 201641012912-US(14)-HearingNotice-(HearingDate-22-04-2024).pdf 2024-03-27
23 201641012912-Correspondence to notify the Controller [19-04-2024(online)].pdf 2024-04-19

Search Strategy

1 SearchStrategyofamendedstageAE_16-03-2023.pdf
1 Search_Strategy_201641012912_06-12-2019.pdf
2 SearchStrategyofamendedstageAE_16-03-2023.pdf
2 Search_Strategy_201641012912_06-12-2019.pdf