NTT Corporation has unveiled and detailed a new AI inference chip.
NTT announced and demonstrated this LSI (see below for definition) at Upgrade 2025, the company’s annual research and innovation summit, held once again in San Francisco from April 9-10, 2025.
Described as a large-scale integration (LSI) for the real-time AI inference processing of ultra-high-definition video up to 4K resolution and 30 frames per second (fps).
The technology utilises an NTT-created AI inference engine that boosts computing efficiency for use cases such as beyond visual line of site drone operations for public infrastructure inspections.
This low-power innovation is designed for Internet of Things edge and power-constrained terminal deployments in which conventional AI inferencing requires the compression of ultra-high-definition video for real-time processing.
For example, when this LSI is installed on a drone, the drone can detect individuals or objects from up to 150 meters (492 feet) above the ground, the legal maximum altitude of drone flight in Japan, whereas conventional real-time AI video inferencing technology would limit that drone’s operations to about 30 meters (98 feet). One use case includes advancing drone-based infrastructure inspection for operations beyond an operator’s visual line of sight, reducing labor and costs.
In edge and power-constrained terminals, AI devices are limited to power consumption an order of magnitude lower than that of GPUs used in AI servers; tens of watts by the former compared to hundreds of watts by the latter. The LSI overcomes these restraints by implementing an NTT-created AI inference engine.
This engine reduces computational complexity while ensuring detection accuracy, improving computing efficiency using interframe correlation and dynamic bit-precision control. Executing the object detection algorithm You Only Look Once (YOLOv3) using this LSI is possible with a power consumption of less than 20 watts.
Commercialisation & productisation
NTT plans to commercialise this LSI within the fiscal year 2025 through its operating company NTT Innovative Devices Corporation.
Researchers are studying the application of this LSI to the data-centric infrastructure (DCI) of the Innovative Optical and Wireless Network (IOWN) Initiative led by NTT and the IOWN Global Forum.
DCI uses the high-speed and low-latency capabilities of the IOWN All-Photonics Network to address the challenges of modern networking infrastructure including obstacles to scalability, limitations in performance and high energy consumption.
Additionally, NTT researchers are collaborating with NTT DATA, Inc. on the advancement of this LSI in relation to its proprietary Attribute-Based Encryption (ABE) technologies. ABE enables fine-grained access control and flexible policy setting at the data layer, with shared-secret encryption technologies allowing for secure data sharing that can be integrated into existing applications and data stores
