A partnership with ElevenLabs allowed the operator to parse the call's audio stream (SIP/RTP) in real time. By saying the trigger "Hey Magenta," a subscriber can request on-the-fly translation of the other person's speech, contextual help, or a summary of the conversation. Technically, this is a breakthrough that eliminates the need for third-party software. However, integrating NLP (Natural Language Processing) models at the telecom provider level raises massive privacy questions: Zero Trust architecture crumbles when the operator's switch itself legally "listens" to and analyzes the content of your conversation.
Source: Deutsche Telekom / Wired
TelecomDeutsche TelekomElevenLabsNLPPrivacy