Color 3D Point Clouds with Basler blaze
The spatial depth data from the Basler blaze 3D camera can be merged with the RGB data from a color camera, such as the Basler ace. The result is a colored point cloud (RGB-D for short) in which each 3D point is assigned a color value. In fact, our human brain also combines the disparity information between the views of our two eyes with color information and prior knowledge about the detected objects to obtain the scene structure.
Would you like to learn more about this solution?
Our Application Note „Merging Color Data of Basler 2D Cameras with Basler blaze Depth Data“ explains how by combining a 3D camera with a color camera, depth values can be displayed in true RGB colors.
Advantages of RGB-D: When does the combined use make sense?
Robust object detection and classification with increased accuracy of correct matches, especially for similarly shaped objects
Example: Can you tell in the left part of the point cloud whether it is an apple or an orange? This is only possible in RGB color. Conversely, a 2D camera would not be able to tell the difference between the photo of an apple and the real apple.
Color information helps improve scene details where depth information is lacking
Example: During depalletizing, two cartons are so close together on the pallet that they are recognized as one by the 3D camera. In the higher-resolution RGB data, however, a gap can be detected.
Reliable scene segmentation, if necessary enhanced by the use of deep learning (here: integration of prior scene knowledge), for example for the use of mobile robots
Example: Finding the floor in 3D is supported by color: asphalt gray probably belongs to road (floor).
Here, too, a combination can be helpful
Higher system reliability, for example in obstacle detection for automated guided vehicles
Reduced computational load: Find a container in 2D and analyze its fill level in this reduced ROI with 3D
Promotes scene understanding in humans, making it easier to set up and operate complex 3D systems
