Honeywell is developing an artificial intelligence (AI)-enabled multi-modal intelligent agent so workers in the retail industries can interact naturally with their handheld devices.

For Honeywell mobile devices powered by Qualcomm, the agent will let those in the distribution centre and retail industries interact naturally with handheld devices through voice, pictures and barcodes.

This AI-powered option is built to function as a digital resource for the modern labour force and designed to enable today’s stretched workers to tap quickly into answers and outcomes, helping result in time savings, greater accuracy and interactive results.

Workers will be able to enter data into the technology and then receive practical answers to queries such as “Do we have the gluten-free variant of this product in stock?” or “Where can I find this particular item in the store?”

Depending on the question, users will receive responses in the form of an image, video, spoken response, text answer or a combination of several modalities. This functionality is designed to enable workers to complete their work more efficiently while simultaneously navigating other tasks, such as assisting customers in a retail setting or performing multi-step workflows in a distribution centre. It will be available to users through a software development kit that can integrate with an organisation’s existing applications and systems.

“Utilising our strengths in on-device generative AI, high-performance and low power computing, this collaboration with Honeywell underscores our commitment to pioneering innovations that will propel the expansion of the connected intelligent edge,” said Nakul Duggal, group general manager at Qualcomm (www.qualcomm.com). “Honeywell’s new multi-modal intelligent agent represents a significant step forward in utilising advanced edge AI to streamline operations and elevate customer interactions across industries. This initiative enables us to drive digital transformation, enhancing how businesses interact with their environments through intelligent and responsive technology.”

Jason Urso, Honeywell Industrial Automation chief technology officer, added: “By pairing Honeywell’s easy-to-use mobile devices and intelligent software with Qualcomm’s industry-leading edge AI processors, Honeywell is making workers’ jobs easier while also helping businesses produce the stellar experience they want for their customers. With AI, Honeywell is amplifying what’s possible for businesses with mobile workers today.”

The multi-modal intelligent agent is expected to be available early next year. To learn more about how Honeywell is leveraging AI across key industries, visit: automation.honeywell.com/us/en/solutions/productivity.