Lars Ratzmann

The Smart Window - Augmented Reality, a safety-relevant aspect in ship navigation

The joint project "Smart Window" offers an exciting future perspective for modern ship navigation. Together with partners from industry and research, ISIT scientists have developed an intelligent solution for implementing an augmented reality display on a ship's bridge.

Fehrmann Mockup

The goal was to process and filter the enormous amounts of data from sensor networks and computer-aided assistance and navigation systems in the ship's command in such a way that their visual representation is possible without any restrictions to the usual processes on the bridge. This is intended to make a significant contribution to increasing safety in shipping.

The central optical element of the AR display is a scanning full-color laser projection system based on a MEMS scanner made at ISIT and consisting of silicon. If the two axes of this optical component are operated in resonance, a laser reflected from the mirrored scanner surface can illuminate sufficiently large areas and project any image content with the appropriate electronic control.

Suitable foils or glass laminates are required for successful visualization of the projected content in the ship's window. The complete transparency of such foils is mandatory. This ensures that the extended safety-related information, which is superimposed on the field of vision of the viewer at the bridge control station, does not obscure the view of reality or the horizon at sea. The goal and at the same time the challenge was to bring the reality of the environment into congruence with augmented content and to meet the harsh environmental conditions or the special requirements of the maritime industry.

The relevance of the project results from the constantly increasing demands on logistics and shipping in the course of increasing globalization. In addition, there are relatively few regulations on waterways compared to air, road and rail transport. The Smart Window project offers all the more opportunities to further optimize safety in maritime transport.