SMARC platforms based on the NXP i.MX 8M Plus processors are an ideal fit for embedded AI applications. Equipped with an extensive ecosystem with application-ready 3.5-inch carrier board, Basler cameras and AI software stack, fast proof of concept is possible.
Implementing Arm technology hasn’t always been so easy. Previously, it was usually much more difficult to use the latest processor technology from the Arm environment as a finished system than to implement the x86 environment. This is a result of the historically large range of individually tailored custom designs, so the ecosystem of system platforms was not that extensive.
However, with a modular approach based on the SMARC computer-on-modules specification, it is now also possible to obtain standard form factors from the x86 box PC range with Arm processors. For example, now a 3.5-inch board that can be equipped with SMARC 2.1 modules as required. With each launch of a new SMARC module, the portfolio of possible configurations is automatically expanded with a slight time lag. The latest flagship processor is the new NXP i.MX 8M Plus processor.
ATTRACTIVE FEATURES
Technical highlights of the SMARC modules with i.MX 8M Plus processor are the four powerful Arm Cortex-A53 processor cores with the additional neural processing unit (NPU), which adds up to 2.3 TOPS of AI computational power. Thanks to the integrated image signal processor (ISP), they are specifically interesting for AI inference and machine learning applications and can process the data of the two integrated MIPI CSI interfaces very efficiently.
A key application field here is gesture-based control systems, for example., enabling touchless login into medical applications on intensive care computers for adjusting the administration of infusions. In addition, the multimedia functions cover 3D/2D graphics acceleration as well as video decoding and encoding including H.265 so that camera streams can be sent directly to the network. High resolutions are becoming increasingly important both in inspection and in monitoring systems for enabling better evaluation of details.
The NPU can help with the pre-processing so that the raw data does not overload the network. High-quality DSP for audio and voice functions is also interesting. Through the combination with the arithmetic logic units, user-specific speech recognition with around 40,000 different words is possible, for example. And that, unlike commercial solutions such as Alexa, Google, or Siri, purely locally and completely without any cloud connection, which can be very useful for contactless voice commands.
In addition, real-time control is possible via the Cortex-M7. And via Gigabit Ethernet with time-sensitive networking (TSN). For the first time, high data security and reliability are ensured by the in-line ECC function of the processor, which can implement error correction code based on LPDDR4 memory for up to 6GB of capacity. The Cortex-M7 can also be used as a fail-safe unit, which is crucial for customer applications to be designed with fault tolerance in accordance with IEC 61508/IEC61511.
If engineers look at this all-round service package and implement further application-specific functions via PCIe Gen 3 as well as 2x USB 3.0 and 2x SDIO, they have a highly reliable and robust Linux, Android, or FreeRTOS platform, which, depending on the variant, can even be used in the industrial temperature range of -40 °C to 85 °C. The low energy consumption of 2–6 W and the onboard eMMC with storage capacity of 128 GB and ability to be operated in robust pSLC mode to extend the service life of the robust memory even more are other attractive highlights.
DIVERSE APPLICATION AREAS
SMARC modules with i.MX 8M Plus platform are thus focused on reliable industrial applications in combination with embedded vision, machine learning, and AI as well as advanced multimedia applications. They thereby target Industry 4.0/IIoT, visual inspection and monitoring systems, and smart infrastructures and smart cities. Other applications can be found in agriculture and construction as well as in building automation and measurement technology.
The target markets are thus extremely diverse. One of the largest application fields is in the wide range of HMIs because virtually every device today has a graphical user interface and extended multimedia functions for increasingly immersive experiences, in low-power and mobile device areas too. Support of up to three independent displays also makes the new processor module predestined for multidomain applications.
The NXP i.MX 8M Plus processor platform is therefore a perfect replacement for all existing i.MX6 applications that are getting on in years. It also scales the existing SMARC-based X86 portfolio based on AMD and Intel processors towards more energy-efficient, compact, and mobile solution platforms. Added to that are mobile handheld devices and in-vehicle applications. Thanks to the camera and AI integration, the modules are also suitable for a multitude of different vision applications, for which it is helpful, if embedded and camera vendors together offer extended services.
INDUSTRY 4.0 APPLICATIONS WITH REAL-TIME NETWORKING
Thanks to the standardized feature set new SMARC modules with processors from the i.MX8 M Plus platform offer numerous attractive features for real-time control of safety-critical applications and networked Industry 4.0 systems such as robots or autonomous logistics vehicles. These begin with the integrated watchdog, which can be used for failure detection in redundant machine control systems.
Distributed edge systems with real-time synchronization can also be established via the real-time clock and the TSN-capable Gigabit Ethernet port. For example, in networked manufacturing cells or the process industry. The NXP TrustZone offers a secure execution environment for enhanced protection against cyberattacks, the risk of which increases through networking. This is based on an encryption module (CAAM) for hardware-accelerated ECC and RSA encryption, the Resource Domain Controller (RDC) for the isolated execution of critical software, and the secure High Assurance Boot mode, which prevents execution of unauthorized software during the boot procedure.
EMBEDDED VISION SYSTEMS A FOCUS MARKET
The availability of the SMARC modules with i.MX 8M Plus is another milestone for embedded vision systems. There are already proof of concepts like one for retail deep learning applications from congatec, Basler and NXP Semiconductors in 2019. Integrated AI software, with which automated cash systems can be realized in retail, runs on this platform. With the growing popularity of contactless technologies as a result of the pandemic, such a development platform is now more relevant than ever and the NXP i.MX 8M Plus processor with the new NPU and the powerful image signal processor for even more powerful AI-based image evaluation in real time offers an even more attractive feature set for such applications.
The ISP can process video streams of 375 megapixels per second (MP/s). This corresponds to 180 Full HD images per second with, for example, image contrast optimization or lens distortion correction. With the integrated neural processor and the support for OpenGL ES 3.1, Vulcan VX extensions, OpenCL 1.2 FP, and OpenVG 1.1, vision applications receive a uniquely high processing performance.
With COM & Carrier to Customer-Specific Design
SMARC modules – like all computer-on-modules – are attractive for developers because application-ready carrier boards designed to the SMARC standards are already available. This practically eliminates the hardware development, which also significantly accelerates the software development and ultimately leads to a faster time to market. In the further course of the product life cycle, performance variants can also be created through simple replacement of the module, and for extremely long-term availability, it is possible to switch to the next generation at a minimal NRE cost when a processor is discontinued.
Ultimately, this means that the ROI can be significantly extended. For this reason, COMs have also assumed a leading position in the market for embedded computer boards and systems. Another attractive feature of SMARC is the fact that this standard supports Arm and x86. As a result, potential migration paths are extended even further. SMARC modules from congatec can currently be scaled via 24 module variants. However, if the system performance is sufficient, it will still be able to be reordered in professional applications for a long time to come. Many embedded vendors offer an extended availability of 15 years for SMARC modules with NXP i.MX 8M Plus processor.
congatec | www.congatec.com
Dan Demers is Director of Sales & Marketing, congatec Americas. Dan Demers holds a B.B.S degree in International Business from Grand Valley State University, Grand Rapids, Michigan and an M.B.A. from Ashford University, Clinton, Iowa. Mr. Demers has over 22 years of experience in embedded computing having worked with Fortune 500 companies in the Industrial, Medical, and Communications markets.
