Machine vision and AI for precise object detection at sea
- Customer
- SEA.AI
- Location
- Linz, Austria
- Date
- 2025
The Watchkeeper system from SEA.AI increases safety for small and medium-sized boats on the high seas: it detects potential dangers using state-of-the-art vision technology. The Basler dart delivers precise images despite difficult lighting conditions. The system identifies objects in the water and significantly reduces the risk of collisions with unknown or unlit obstacles.
Machine vision provides clear images for AI algorithms
Lighting conditions on the high seas are extreme: they are characterized by intense reflections and glare on the surface of the water, strong contrasts, and rapid changes in light. These pose major challenges for the camera, as it still has to deliver precise images. These images are the only way to provide the AI in the Watchkeeper system with a reliable basis for clear identification and classification.
High Dynamic Range for precise images in changing light conditions
HDR cameras (High Dynamic Range) are able to master the challenging lighting conditions on the high seas:
Coping with extreme differences in brightness
Standard cameras cannot capture the huge range of brightness present at sea at the same time. Either bright areas are overexposed or dark areas are underexposed. HDR cameras are designed to show details in both the brightest and darkest areas of a scene at the same time.
Reducing gloss and reflections
The surface of water is a strong reflector of sunlight. HDR techniques can help soften these reflections in the image by combining different exposures and thus controlling the overexposed areas.
Basler dart: The camera for precise object detection
The Basler dart series is ideal for use in the Watchkeeper series:
Superior image quality: dart cameras equipped with HDR technology deliver crystal-clear images even in poor lighting conditions.
Board-level format: The compact design and low weight ensure easy integration into the system setup
High resolution of 8 MP at a frame rate of 30 frames per second.
The dart camera is connected to an NVIDIA Jetson board. This hardware combination enables the execution of real-time AI algorithms on board without the need for a cloud connection. The Basler dart delivers high-resolution HDR video, which is processed locally to detect, classify, and track floating objects.
More information about the Basler dart camera seriesInto the water: "maritime" training for the AI
Only through specific training can the AI precisely recognize objects in complex maritime environments. In contrast to generic recognition systems, SEA.AI's algorithms interpret the maritime context.
Identification & Classification of floating objects
The Watchkeeper AI recognizes and tracks relevant floating hazards in dynamic environments:
First of all, floating objects are identified by feature extraction, in which contours, shapes, and movement patterns are recognized.
They are then classified using predefined criteria to distinguish between ships, buoys, or flotsam.
Finally, the system tracks the movement of the objects across several images in order to record their position and speed.
Vision technology & AI: improving the level of safety at sea
The intelligent combination of modern vision technology and artificial intelligence significantly improves safety standards on the water. The high-quality Basler dart provides precise images for the AI algorithms, enabling fast and accurate decision-making on board. This system therefore offers two key safety benefits: Not only do crews receive immediate alerts, they can also quickly identify what type of object is in front of them.
By using thermal imaging cameras, Watchkeeper enables objects to be detected and tracked in real time, even at night.
About SEA.AI
SEA.AI warns crews early and reliably of objects on the surface of the water. Using state-of-the-art camera technology combined with artificial intelligence, SEA.AI detects and classifies objects, including those that conventional systems (such as radar or AIS) miss: unreported watercraft, floating obstacles, buoys, inflatable boats, kayaks, and people overboard.