How AI gets into the refrigerator

Embedded Vision for the detection of wine bottles – quickly and cost-effectively integrated

The way to prototype with MIPI camera modules

Embedded vision for smart technology

Embedded vision systems are essential components for the development of smart electronic devices. Through integrated image capture and data processing, user behavior can be analyzed and the technology constantly optimized. To demonstrate the powerful functionalities and advantages of such a system, NOTAVIS has developed a smart wine cooler prototype with integrated MIPI cameras in cooperation with DAB-Embedded.

Detect bottles and analyze user behavior

A complete embedded vision system consisting of MIPI camera modules, a CPU board and corresponding lighting was integrated within the wine refrigerator. The purpose of the system is to identify bottles that are removed from the cooler. Due to the computing power of the processor board, data can be collected over a period of time and user behavior can be analyzed with the device in an AI-based way.

The challenge: Clear view for MIPI cameras

The integration of the cameras proved to be the greatest challenge of the project. The prototype wine cooler was equipped with a drawer system consisting of metal bars. This design offered the best compromise between ideal space utilization and compact unit dimensions, as well as good visibility of the assortment for viewers. Another advantage was that all bottles were visible to the cameras from above and below. However, accuracy in object detection depended on perfect positioning of the sensors.

The solution: Position cameras on top and bottom

After several tests with different camera positions, one solution proved to be optimal. One camera each, including lighting, was integrated in an automatically extending arm in the lid and base of the wine cooler. This allows all bottles on the shelves to be displayed from above or below. This setup had to be implemented as uncomplicatedly as possible and based on standard components – both for the prototype and for the later series version.

MIPI camera modules for best performance

Advanced electronics in an ultra-compact design

Vision Components' MIPI cameras are barely larger than the image sensors themselves, making them perfect for the small spaces inside the prototype. To ensure the clarity of the images, the wine cooler's extensions are equipped with position detection sensors. The cameras, in turn, feature electromagnetic adjustment of the optics to adjust the focus accordingly.

Image processing & analysis directly on CPU board

Within the prototype, the cameras are each connected to a CPU board, which can be optimally integrated into the lid or base of the wine cooler due to compact size. The single-board computers control the optics and image acquisition, analyze the image data, and pass only the results to the refrigerator's main electronics. Extensive AI algorithms are also performing locally on the embedded systems without an Internet connection.

Schnell zur Serienreife & übertragbar auf weitere Anwendungen

The VC MIPI camera modules are available for a long time and optimally suited for series production because of their industrial quality. An individual mainboard is developed for series production. The development and the camera drivers can be integrated directly, allowing the final solution to be completed quickly, easily and cost-efficiently.

DAB-Embedded

DAB-Embedded is an independent Belgian development service provider, specialized in design and development of electronic products including software. The main focus is on electronics for industry, multimedia and consumer products as well as hardware for processing image and video data.

How could the FPGA accelerator be integrated into your project?

We will help you finding the perfect solution.