At Unleash live, we asked ourselves, what if it could be done quicker with fewer resources?
When wild fires passed through Northern California’s town of Paradise in early November, Unleash live wanted to help early responders to gain operational clarity fast to assist in recovery efforts and accelerate the process for homeowners.
Through the incredible work of Butte County together with DJI, Dronedeploy, Survae and Scholar Farms, the county assembled a high resolution dataset of the affected area.
With the Camp dataset, Unleash live analysed 17,000 acres of high resolution imagery of Paradise providing valuable insight such as the count, gps location and square footage of the affected structures, the location and count of intact structures and count of vehicles damaged.
Unleash live achieved this outcome in near to real time. Drones flying, data ingesting through WiFi/4G network or satellite (with post flight upload as a fallback option), AI video analytics were applied in flight and actionable insights were alerted fast on ground mobiles and tablets.
Through our partnership with DJI Enterprise and Emergency Services, we trained a custom AI algorithm, which identifies property affected by fire in live geo-referenced video feeds or geo-referenced images.
To build the AI, various police and emergency services uploaded high resolution datasets to Unleash live in early 2018. With our AI cloud server infrastructure, powered by high performance Nvidia GPUs and AWS, we were able to train a neural network and deploy it to our AI sandbox within a few weeks.
Early tests with emergency crews on the ground, streaming live video back to Unleash live, proved accuracy of more than 80% of inference. We then also tested the AI on fire footage from other areas, such as the Santa Rosa fires and the fires around Athens in Greece. These early tests were very encouraging for the team. The AI could be extended across any future large scale fire.
Once we had access to the Camp fire high resolution imagery shot by DJI drones, we selected several large test areas and deployed our AI algorithm.
We ran the AI against various subset locations to assess the accuracy. Below is an example of our first pass output.
Within minutes the Unleash live Fusion Atlas presents the output. The affected homes are marked with pins on a layered map in any browser or tablet. This gives operational clarity to responders as well as utilities, councils and families.
Others may want to obtain a visual comparison of before and after, as well as AI overlays. All can be done through our difference detection tools.
At Unleash live, together with our partners, we are now working to overcome these challenges with our unique video AI analytics capability and further refinement of our AI development work. In the case of video, not every single frame needs to id the object. A good fix within say every 1 second is sufficient to push the overall inference accuracy. All this will help extend our AI analysis to many further enterprise use cases.
The work to help emergency services and councils worldwide is extremely exciting for our team, we invite everyone to contribute to make this capability even more valuable. Tell us what you would do to help better decision making in vast geographically dispersed areas.
Get in touch with one of our specialist team members to learn how your business can take advantage of live streaming video and AI analytics today.