Inference in Your Pocket: Google Releases Offline AI Edge Eloquent App

Cloud computing is retreating before the concept of Edge AI. On April 7, Google released the Eloquent app—an offline dictation tool that automatically cleans speech from pauses, filler words, and slips of the tongue.

From a technical standpoint, this is an important milestone. All natural language processing (NLP) and transcription occur locally on the smartphone's processor, without sending the audio stream to Google's servers. This solves two problems at once: network latency and corporate data privacy. We are seeing a logical continuation of the trend set a few days ago by LG with its AI chips in TVs: basic algorithms are becoming an integral part of the user's local operating system.

Source: Google AI / TechCrunch