On-device intelligence is a new wave of automation and intelligence driven by machine learning and deep learning, enabled by recent technological advancements such as neural networks, highly parallel GPUs, and 5G. It allows organizations to train AI models and deploy them in production on devices, leveraging the power of on-device intelligence. This requires advanced hardware like GPUs, accelerators, and AI chips, and frameworks like Tensorflow Lite, Pytorch Mobile, and ML Kit by Google.