Sony's upcoming sensors, the IMX500 and IMX501, are the first Sony sensors with AI Processing

Sony is one of the largest players known for their amazing image-processing sensors in smartphones. They introduced the IMX586 sensor, which introduced the 48-megapixel craze and now the IMX686 which brought in a bigger 64mp sensors previously not seen in smartphones. 

While Sony is known for their phone sensors, they also make their own cameras, including DSLRs and mirrorless cameras. Sony is a major player that doesn't stop innovating, and their newest contraption? The all new IMX 500 and IMX 501 with image processing.

These sensors are not meant for smartphones, but rather their own premium mirrorless cameras. The AI integration is usually programmed through the camera's software, but with these new processors, the AI integration is part of the sensor. Sony told that their reason for this is that the spread of IoT (Internet of Things) has made devices connected to the cloud, which results in information systems being processed by the AI through the cloud. However, the major problems of these cloud-based services include privacy concerns, increased transmission latency which could hinder real-time processing and increased power consumption.

The new sensors, the IMX500 and 501 feature a logic chip and a pixel chip. The logic chip deals with the AI functionality and image processing, and the pixel chip acquires the signal on the logic chip via the AI on the sensor, thus removing the need for high power consumption, and external memory; which in turn, enables more sophisticated AI to be developed. As for security and privacy concerns, it outputs metadata instead of image information, making it less worrying for those who are prioritizing their privacy and security. The logic sensor also has a high-speed processing of 3.1 milliseconds, thus enabling it to track videos recorded faster than any other sensor. 

The pixel chip of both sensors is equipped with the following specifications: 

• Backside Illumination (BSI) 
• 12.3MP information capture
• Optical Format: 1/2.3" (with 7.857mm diagonal)
• 1.55 µm (micron-pixel) size
• 4k video @ 60fps (no AI) 4k @ 30fps (with AI)

In addition to these, the sensors are equipped with DSP (digital signal processing) which is dedicated for the AI processing, eliminating the need for external memory.

The sensors are to be launched next year. Samples of the sensors are to be released by Sony between April (IMX500) and June (IMX501) of this year respectively. According to Sony, the sensors will cost around 10,000 yen for the IMX500, and 20,000 yen for the IMX501 respectively.

Sources: Sony.com, XDAdevelopers.com

Left: IMX500 
Right: IMX 501