Assuming hardware is the major constraint for enabling real-time mobile intelligence, the industry has mainly dedicated their efforts to develop specialized hardware accelerators for machine learning and inference. In this presentation, we show that by drawing on a recent real-time AI optimization framework CoCoPIE that achieves effective compression- compiler co-design, it is possible to enable real-time artificial intelligence on mainstream end devices without special hardware.