Recognition & Reasoning: How AI is Helping Infrastructure Industry Go Digital
Published on : Tuesday 30-11--0001
For years, humans have recognised images better than computers. Our error rate has been steadily at 5 per cent while computer algorithms were at 30 per cent. However, with the rise of computer vision and deep learning, the gap between humans and computers has slowly closed. Within the last two years, researchers have seen computer algorithms show an error rate of less than 5 per cent, surpassing humans. These advancements bring significant potential to many different industries.
In the infrastructure industry, users have applied reality modelling in countless projects to improve all workflows. A 3D model can provide real-world, digital context with the information that stakeholders need to design, construct, and operate assets, helping improve decision making.
Within the last five years, artificial intelligence, or AI, has gone mainstream, no longer relating to just the technology industry. It is being adapted and applied to increase its value across all sectors, such as customer service, business intelligence, marketing and sales, and even the legal service. To keep up this trend, the infrastructure industry has begun exploring the use of machine learning technology in reality modelling workflows across all types of projects.
Implementing Machine Learning
Often, people confuse AI, machine learning, and deep learning. While having very different meanings, the terms are all interconnected. AI is the most generic term, applying to anytime a computer does something smart or reasons with the data. This ability to reason distinguishes AI from other types of computer programming. Programming a computer to speak is not AI; however, if you were to program the computer to give a speech and understand its meaning, that process would be AI. It includes many subjects, including optimisation, expert systems, robotics, language processing, computer vision, and machine learning. We see examples of machine learning every day, as most smartphone cameras can identify faces and focus in on them. Deep learning, a subset of machine learning, is when a computer can act like the human brain, with multiple layers of artificial neurons helping that process.
Reality modelling researchers are successfully using machine learning for object detection on large scale 3D reality meshes. These practices, however, are just the beginning. As users continue to implement AI and machine learning into their reality modelling workflows, they are looking to eventually use deep learning. Researchers have been training these very large deep learning neuro-networks to do all kinds of things, such as image and feature recognition, object detection, and language processing. It will be crucial in developing AI for users of reality modelling applications, and it will help the infrastructure industry in going digital.
Seeing Structural Defects
Today, reality modelling applications use machine learning to overcome many industry challenges. Machine learning make it possible for computer vision and image recognition to identify problems with projects or individual pieces of equipment before they happen. By implementing computer vision, researchers are teaching computers to see like humans. The computer can classify objects, meaning it can say if a single image is a tree or if it is a car. The next step is teaching the computer to detect objects, asking the computer to identify trees and cars in the same image. The computer should be able to tell the difference between the two objects. Lastly, the computer can segment the object. This step involves drawing around the exact shape of an object, whether the image is in 2D or 3D.
Recently, organisations have used this type of computer vision to detect faults in concrete. Many others use the technology to identify cracks, including their shape and depth. By segmenting a crack, researchers can figure out the exact shape, size, and scale of the crack, along with other pieces of critical information for the engineers.
Visualising Advantages in the Field
One exciting feature about image recognition is the ability to train the multi-layered artificial neural network with thousands of images to recognise an object. Once the model is trained, it can be used to recognise the similar object in a new image. With this feature, researchers can build semantic 3D models. This model would be classified so engineers know the details of what they are seeing in the model, while maintaining the high-quality colour and texture of a regular 3D model. This feature is incredibly helpful for infrastructure inspections.
This type of model was featured during CH2M Fairhurst’s project in Europe. The project team wanted to design and create a 3D model for an upgraded road. To complete this project, the team needed a model without trees on either side of the road, as they were planning to widen the road to add more lanes. Team members also wanted to create a new surrounding landscape, so they needed to remove the trees to better visualise their options. Their team provided a dataset to the research team, who first classified the trees on both sides of the road and then removed them. Normally, users would have to go into the program and manually remove all the trees. This time-consuming process was eliminated using reality modelling.
Skand Pty Ltd also recently used this type of model for its project at the Royal Melbourne Institute of Technology (RMIT). Located in Melbourne, Victoria, Australia, the university wanted to integrate drone imagery and analysis into its award-winning forty-year asset lifecycle program. Starting with the university’s Brunswick campus, Skand used a drone to capture images of the 65,000-metre site. The project team then used a web program to incorporate the information into RMIT’s existing building envelope project inspection brief, turning the 2D images into meaningful datasets mapped to a 3D reality model. The program also used computer vision and machine learning to identify and categorise defects, such as cracks, moss, algae, bird nests, and other forms of corrosion and building material degradation. Skand not only wanted to provide a platform to integrate drone imagery into RMIT’s asset lifecycle program, but also deliver a superior quality of model and mapping of defects for better asset maintenance planning. By combining machine learning and reality modelling applications with 3D visualisation and reporting into a single service, Skand created a cost-effective integration of drone imagery and analysis with RMIT’s asset lifecycle program. The final results were improved safety, as users could conduct roof and façade inspection without needing to leave the ground, and reduced time, as the works were carried out using computers. The solution also saved significant value, as the Skand solution is about 60 per cent cheaper than traditional inspection methods.
The Endless Possibilities
There are many ways that the infrastructure industry can apply computer vision, or AI in general, to keep the industry moving forward. One place is with reality modelling applications and their ability to classify images in reality meshes. The industry wants to eventually use neuro-networks that have already learned objects from other images. Researchers want to have a way for users to select objects in their images so that the reality modelling application will learn the objects and automatically detect them in the future.
Another way that AI can help the industry is by using it to advance reality modelling applications themselves. AI could then improve both the technology and the user’s experience. Progress is also being made in how this technology can be leveraged to maximise the value of reality modelling and improve productivity. Recently, Bentley announced its Early Access Program for ContextCapture Insights, a reality modelling solution that automatically detects and locates objects using 3D machine-learning technology. It provides automation to help reduce time and costs associated with the analysis of real-world conditions from reality data. By creating 3D models, users will have better visibility into their project’s progress and end-goals. Using reality modelling applications to create the models will accelerate the design process while keeping everyone informed of changes.
Reality modelling using AI can be applied to many different areas of the infrastructure industry, and help with all stages of an asset’s lifecycle. As the technology continues to advance, it becomes clear that there is no limit to what reality modelling can do.
Captions:
Pix 1: Skand Pty Ltd building envelope inspection project powered by machine learning and reality modelling for RMIT University Brunswick Campus. Image courtesy of Skand Pty Ltd.
Pix2: ContextCapture Insights allows users to automatically detect and locate objects using a unique 3D machine learning technology.
