Multispectral Image Sensor
- Home
- Products & Solutions
- Image Sensor
- Image Sensor for Industrial Use [Overview]
- Multispectral Image Sensor
Overview
Sony's multispectral image sensor has a multispectral filter formed on the photodiode of each pixel, making it possible to capture multiple wavelengths of light simultaneously, from visible light to near-infrared light. Because these sensors can capture the composition of different substances as well as subtle color differences that are imperceptible to the human eye, they can be used in applications like material sorting, contaminant detection inspection, and quality management.
Features
Image sensors equipped with multispectral filters
Normal color image sensors have three types of color filters on the photodiode of each pixel - red, green, and blue - but Sony’s IMX454 multispectral image sensors have 8 types of filters on the photodiodes to take in light from different wavelengths. Typical multispectral cameras have a built-in spectral element, such as a prism or diffraction grating. They function by scanning a subject or camera at a constant speed to take pictures, which limits the types of scenes that can be photographed. With the IMX454, users can capture 2D images in one shot, just like with a normal camera. This means it can be used in many kinds of scenarios.
Image data of 41 wavelengths can be captured in just one shot
By combining the IMX454, which has a multispectral filter, with Sony's specially designed signal processing software, image data of 41 wavelengths (from 450 nm to 850 nm, in 10 nm intervals) obtained from 8 types of filters can be captured in just one shot. This makes it possible to capture more specific information at a high resolution, providing more wavelength choices across the visible light and near-infrared spectrums and opening the door to a variety of applications.
Providing the wide variety of functions that multispectral cameras require
Multispectral cameras have a less established history than color or monochrome cameras, and there is still something to be desired in terms of the necessary environment for their development and introduction. Given this, Sony made advance arrangements for the functions that the development and introduction of the IMX454 requires, and provided a software program that includes all of them.
- Optimized standard camera functions for multispectral applications
Defect correction, noise reduction, AE (Auto Exposure) control functions, and other essential, standard camera functions that are generally supported for color or monochrome image sensors have been optimized for multispectral image sensors. This has facilitated the efficient development of multispectral cameras.
- Semantic segmentation function
Semantic segmentation is an image recognition method that uses machine learning to label each pixel within the image data to divide the regions more precisely. Performing segmentation using the wavelength information for each pixel makes it possible to identify the material composition of a subject quickly and reliably, regardless of its form and even if the color looks the same to the human eye. This enables differentiation of materials by color and estimation of the area or volume of individual materials.
- Color image generation function
In some cases, users may need to synthesize a color image from identification results based on a multispectral image, or they may require a color image to combine with existing software designed for color images. To address these needs, Sony has built a color image generation function that creates color images that are easy to comprehend visually, based on image data from multiple different wavelengths. This function makes it possible to obtain images with natural-feeling color, without setting up a separate camera.
Product Lineup
| Model Name | Image size | Effective pixels | |
|---|---|---|---|
 |
IMX454LXR-C | Diagonal 6.46 mm (Type 1/2.8) | Approx. 2.13 megapixels |
Specifications
| Model Name | IMX454LXR-C | |
|---|---|---|
| Image size | Diagonal 6.46 mm (Type 1/2.8) | |
| Effective pixels | 1945 (H) × 1097 (V) | |
| Approx. 2.13 megapixels | ||
| Unit cell size | 2.9 μm (H) × 2.9 μm (V) | |
| Optical blacks | Horizontal | Front 0 pixels, rear 0 pixels |
| Vertical | Front 10 pixels, rear 0 pixels | |
| Frame rate (Max.) All-pixel readout mode |
10bit | 120 frame/s |
| 12bit | 60 frame/s | |
| Input drive frequency | 37.125 MHz / 74.25 MHz | |
| Supply voltage | Analog | 2.9 V |
| Digital | 1.2 V | |
| Interface | 1.8 V | |
| Shutter mode | Rolling shutter | |
| Output interface | sub LVDS Serial（2 ch / 4 ch / 8 ch） MIPI（2 lane / 4 lane） |
|
| Package | 114-pin LGA 12.0 mm (H) × 9.3 mm (V) |
|
|
IMX454 product overview
|
||
An example of IMX454 relative spectral sensitivity characteristics after signal processing
(displaying 7 out of 41 wavelengths)
*This data has undergone signal processing in the software that comes with the sensor.
Data may vary depending on the conditions and environment.
Technology
Find out more about multispectral imaging technology
Applications
Find out more about multispectral image sensor applications
Download
IMX454 Product Overview
This document summarizes the product overview, features, and specifications.
Related Links
Product Selector for Industrial Image Sensors
Product & Service Inquiries
Click here to request for a datasheet/quotation (RFQ)!
* This button will redirect you to the salesforce.com Co., Ltd. website,
which we have entrusted.
E-mail Newsletters
Find the latest information on our newsletter for industrial and security applications.