Tham Chee Onn and Lim Jia Da testing the navigation research simulator.
Centre profile
The Centre of Excellence in Maritime Safety (CEMS) at Singapore Polytechnic was established in 2018 in collaboration with the Singapore Maritime Institute and the Maritime and Port Authority of Singapore (MPA). Its mission is to research and develop technologies that enhance navigational and operational safety, reinforcing Singapore's high port and ship safety standards.
Problem statement
Singapore is home to the world’s second-busiest port, and handled a record 39 million shipping containers in 2023. Though the country has tried to promote a culture of safety, the high traffic along its strait makes it hard to avoid collisions that can lead to oil spills and death.
Vishakha Lall and Tham Chee Onn are part of the CEMS team that developed the AI-based tool that improves how seafarers are tested during their certification process.
In Singapore, seafarers seeking certification or promotion must undergo a simulator test with the MPA to evaluate their competency, including readiness to respond to emergencies such as engine failures.
Instructors currently need to manually review long video recordings of performances during assessments, which is time-consuming and can lead to oversights. As a result, they may overlook critical details and fail to identify candidates' stress levels, which could affect how they react to a crisis.
Impact Achieved
In 2022, the centre began developing software compatible with simulators that automatically detect navigation violations, like steering a ship into shallow waters or veering too close to another vessel.
The tool assesses whether candidates calmly follow the correct procedures during emergencies. For example, in the event of an engine failure, the candidate must coordinate with the crew in the engine room, communicate with the port operator to alert nearby vessels, and manually steer the ship simultaneously. The AI software employs computer vision to monitor the candidate's execution of these steps and uses electroencephalograms to measure their stress levels.
Tham Chee Onn using an eye tracking device with electroencephalogram sensors that monitor his eye movements and stress levels
To build the software, CEMS brought together AI and data science researchers with maritime experts. About 200 seafarers were engaged to gather data using the simulator. CEMS director Daniel Zhang highlighted the “beauty” of the centre: While his team builds the algorithms, it’s the “currency and knowledge” from industry professionals and Singapore Maritime Academy (SMA) experts that ensure the tool’s relevance.
The tool is currently being tested at SMA for seafarer training, with the goal of being adopted by the MPA for their assessments. A speech detection model is also being developed to evaluate candidates' use of key terminology during communications with the crew.
“The collaboration on AI assessment of navigation and ship handling competency for our harbour pilots is a great move to study the human elements that are critical to maritime safety”, said Captain Jimmy Koh, head of pilotage and digital transformation at PSA Marine, which has sent its crew to participate in the simulator exercises.
CEMS presented the project to the IMO in London earlier this year. Zhang noted that the reception was very positive, prompting plans to provide an update to the United Nations agency next year.
The Philippines' maritime agency has expressed interest in using the software to assess their seafarers, Zhang added, a significant development considering that over a quarter of the world's seafarers come from the Philippines.
“We are pioneering this work in the maritime sector,” Zhang said. “This levels up our game by setting up a Singapore standard for the world.”