What is the Role of Software in Image Processing?
Software plays a crucial role in digital image processing. A captured digital image is transferred, displayed, and stored through various software functions. Additionally, the analysis of digital images is carried out by software.
Throughout this process, we outline the journey of an image in digital image processing and highlight the software functions involved at each stage.
The path of the image software
Different software functions are active at various stages, from the capture of the image to the final result. These functions are often hidden within image processing suites, such as the pylon Software Suite .
Image acquisition
Software also plays a role in preparing for image acquisition. Camera parameters such as exposure time,gain and offset are typically controlled by software.
The initial pre-processing steps in the camera are often performed on the raw sensor data after image acquisition. For example, image distortions can be corrected, or the properties of the sensor can be adjusted. These software components are called camera firmware .
Image transmission
Transferring image data quickly and reliably from the camera chip to the image processing computer is a complex task. Software components also play a crucial role in the process. They implement the rules, known as protocols, that govern the interaction between the camera and the computer. A widely used standard for such protocols is GenICam.
Receiving the image in the processing unit
After the image is received by the computer, software called GenTL Producer transmits it to software applications for further processing.
Forwarding for processing
Any processing software can connect to GenTL Producer through software called GenTL Consumer and receive the image for further processing.
Image Processing
The image processing then extracts the necessary information from the image. The first step is to highlight certain image features, such as edges. Additionally, threshold values can be applied. This makes it easier to recognize, count, and locate objects in the image. In some cases, it may also be necessary to precisely measure object dimensions, distances or image areas. Such functions are included, for example, Basler's flexible software add-ons, pylon vTools.
In addition, neural networks recognize structures on the image. This allows actions such as classifying objects or entire images as faulty or error-free. Often it is a matter of recognizing text or deciphering codes on an image.
Image analysis is a complex task that demands the highest levels of speed and accuracy from the device. This requires very efficient software architectures.
Variants of image processing
The path of the image from the camera to the processing computer, as described here, can vary depending on the image processing system.
Smart cameras
For example, with smart cameras, the image is processed directly within the camera itself.
A smart camera for barcode recognition only transmits the decoded value of the barcode to the connected processing unit, not the image containing the barcode.
Frame grabber
In high-speed vision systems, the image is often received by special image acquisition cards, known as frame grabbers, in the processing computer.
These powerful components often carry out the initial processing steps on the image data before forwarding the image to the processing computer. This helps reduce the performance demands on the downstream processing unit.
Alternatively, all processing can occur within the frame grabber, such as image classification using a neural network. This is facilitated by VisualApplets, which enable FPGAs to be programmed through a graphical user interface without the need for hardware programming. In this case, the frame grabber would send the result of the image analysis to the processing computer along with the image.
Summary
Digital image processing refers to image processing through software.
This applies to the control of the image sensor, the pre-processing of the raw image data, the transfer of the image between different subsystems, and extends to analysis and storage.
Powerful vision software is critical to the overall result of a vision system.
Our Basler software
The pylon Software Suite offers everything required for commissioning: certified drivers, powerful and user-friendly programming interfaces, and convenient camera setup tools. Additionally, pylon vTools facilitate easy integration of image processing functions.
