Renesas expands in Self Driving AI

  • March 28, 2022
  • William Payne

Japanese semiconductor developer Renesas Electronics is partnering hardware acceleration specialist Fixstars to develop new solutions for automotive deep learning. The companies are establishing an Automotive SW Platform Lab to develop software and operating environments for Renesas automotive devices.

The new Lab will support early development and ongoing operation of advanced driver-assistance systems (ADAS) and autonomous driving (AD) systems. The two companies will develop technologies aimed at software development for deep learning and building operating environments that have the ability to continuously update learned network models to maintain and enhance recognition accuracy and performance.

As part of their collaboration, Renesas and Fixstars are launching a cloud-based evaluation environment that supports early development of ADAS and AD systems built on Renesas R-Car Automotive SoC platform: GENESIS for R-Car. The new environment will allow instant initial evaluations when selecting devices. It uses the GENESIS cloud-based device evaluation environment from Fixstars as its platform.

According to Renesas, time spent poring over specifications can be time consuming and inefficient. Evaluation based on actual use cases is essential when selecting devices. Users typically need to obtain an evaluation board and basic software to evaluate devices, and technical expertise is also required in order to build an evaluation environment. The new GENESIS for R-Car cloud-based evaluation environment is designed not to require specialised technical expertise.

GENESIS for R-Car is designed to allow engineers to confirm the processing execution time in frames per second (fps) and recognition accuracy percentage of R-Car V3H’s CNN accelerators on sample images using generic CNN models, such as ResNet or MobileNet. It also allows engineers to select the device and network they wish to evaluate and perform operations remotely on an actual board. Engineers can use the GENESIS environment to confirm evaluation results in tasks such as image classification and object detection, with the option to use their own images or video data. This should simplify the initial evaluation to determine whether R-Car V3H is suitable for the customer’s system. Future plans include the rollout of a service that will allow customers to use their own CNN models for evaluations.

“Fixstars possesses both advanced software technology for deep learning and optimisation technology that allows more efficient utilisation of hardware,” said Takeshi Kataoka, Senior Vice President, General Manager of the Automotive Solution Business Unit at Renesas. “I am confident that our collaboration will enable us to provide strong support for software development optimised for automotive applications and allow our customers to fully leverage the superior performance of Renesas’ automotive devices.”

“After developing a deep learning application, it is not possible to maintain high recognition accuracy and performance without constantly updating it with the latest learning data,” said Satoshi Miki, CEO of Fixstars. “Fixstars plans to focus on these machine learning operations (MLOps) for the automotive field, as we work together with Renesas to develop a deep learning development platform optimised for Renesas devices.”