Crossrail trials augmented reality

  • Client: Crossrail
  • BIM Tools: Structure Sensor scanner; Metaio software; iBeacon transmitters; smartphones

Innovative tracking and positioning technologies have enabled Crossrail to implement augmented reality BIM models and remote sensor software on mobile devices in the field.

A six-month trial at Custom House Station in east London, overseen by Crossrail’s BIM in Delivery Working Group, involved field managers using iPads installed with augmented reality software to view planned construction works in 3D overlaid onto a view of the real site seen through the device’s camera.

The software, provided by Metaio, enabled users to view the planned sequence of work for all the main pre-fabricated concrete structural elements in 3D and check them against the 4D construction sequence main contractor Laing O’Rourke was completing on site.

It included the functionality to select a structural element and update information on the iPad screen, for example the installation date, snagging comments, or requests for information raised against an aspect of work, with all the information synced back to the central office.

A hybrid of positioning technology was used to lock onto the iPad position and correctly display the 3D model. The built-in camera incorporates a sensor that can recognise the edges of columns or rooms, the software then interpolates the data to create a point cloud on the fly, which it compares to the 3D model to pull up the correct perspective view. The model locks into position and becomes more steady when sufficient points have been picked up by the sensor.

Crossrail was able to further improve the level of positioning accuracy by trialling the Structure Sensor IO infra-red scanning technology for the iPad, which is able to sense depth in three dimensions.

At Custom House, planned works could be overlaid on the actual view using an iPad

Launched to market following a Kickstarter funding campaign, the Structure Sensor device attached to the iPad is able to capture dense geometry and simulate real world physics. The Metaio software used this data created to provide a more accurate method of  positioning.

Crossrail’s use of augmented reality during the trial resulted in 45% efficiency gains in terms of construction progress monitoring and verification, by collecting data and verifying it within the software, rather than utilising traditional paper-based processes.

The software has even greater potential going forward, explains Stephen Smith, information applications manager at Crossrail: “Our focus is now starting to shift away from the superstructure to the more complex fit-out of stations and tunnels and as we move into that phase of project. We are evaluating how augmented reality can apply, there is every indication it is capable of handling the larger datasets involved. We are also planning to use it to map other structural works and MEP systems.”

Crossrail has been working with as many as seven different positioning technologies on project sites, used in different combinations depending on the level of visibility, access, cost and other factors. These communicate with about 40 trial mobile devices deployed across eight main station projects, plus the Wallasea Island habitat reclamation project off the coast of Essex. There are plans to deploy another 40 devices over next few months.

“We see mobility as the missing link on projects,” says Smith. “We have a well-structured central data environment, now it is about extending that into the field and linking the data with our office and back end. We have a challenge given that a lot of our sites are underground, and don’t always have access to 3G, 4G or wi-fi connections. As a result, we try to ensure all products we look to roll out have data caching capabilities and the ability to sync up when engineers return to the central office.”

The Structure Sensor device allows iPads to capture geometry and simulate real world objects

Crossrail recently completed a trail of the iBeacon positioning system at its Bond Street Station site, utilising Bluetooth 4.0 low energy proximity sensing to identify the movement of people and machines to improve safety on site.

Bluetooth 4.0 is a very low power, low-cost transmitter embedded in most modern smartphones, including iphone above iOS 8 and recent Android phones.

The system installed at Bond Street, with support from Crossrail’s Innovate 18 technological support programme, involved setting up a local positioning network that triangulates between operatives’ Bluetooth phones, and Bluetooth transmitters positioned on plant and machinery, and a network of beacons set up across the site.

“The aim of the trial was to understand the capabilities of using local positioning networks to improve the safety of operatives site and encourage safer behaviour,” says Smith.

As part of it, new software was developed to manage and set up different zones on sites, for example safe zones, restricted areas, or exclusion zones, as well as rules for how the transmitters react when entering into those zones.

“We had to ensure zone management in the software is simple because construction workfaces tend to move frequently,” says Smith. “The  trial successfully revealed movements in and out of zones and we are confident it can help in future. One way of using it would be to collect the movements of operatives and the number of times they enter a restricted zone, and if the number exceeded a level considered acceptable we could address it through behavioural training on site.”

The technology also has potential to track and identify the errant behaviour of individual users, but at present Crossrail has no plans to use that function due to privacy concerns.

We see mobility as the missing link on projects. We have a well-structured central data environment, now it is about extending that into the field and linking the data with our office and back end– Stephen Smith, Crossrail

Story for BIM+? Get in touch via email: [email protected]

Latest articles in Projects