Johan Schalkwyk is a computer scientist known for his work in artificial intelligence, particularly in speech technology and large language models. He has held significant roles at Google, contributing to areas such as voice search and multimodal AI, and currently serves as a strategic advisor at Sense, focusing on AI for the energy transition, and recently joined Meta Superintelligence Labs. [1] [2] [36]
Johan Schalkwyk earned a Master of Engineering (M.Eng.) degree in Robotics, with a focus on reinforcement learning, from the University of Pretoria. He completed the program in 1993 with a GPA of 4.0. [39]
Johan Schalkwyk spent a significant portion of his career at Google, where he was recognized as a Google Fellow in AI. His work at Google spanned several key areas within artificial intelligence and machine learning. As the Speech Area Tech Lead, he directed strategic research investments in speech recognition and synthesis technologies. This leadership contributed to innovations such as the development of the world's first voice-enabled search experience, Google Voice Search, launched in 2008. He also played a role in advancing concepts like on-device processing and the application of neural models across various Google products, including Google Assistant and YouTube, expanding support to over 80 languages. Later, at Google DeepMind, he was involved in the development of multimodal perception and advancements in Large Language Models, including contributions to the Gemini family of models. [1] [2]
In May 2024, Schalkwyk joined Sense, a company specializing in embedded intelligence for homes and the electrical grid, as a Strategic Advisor on Artificial Intelligence. In this role, he focuses on leveraging AI and machine learning to support the global energy transition. His advisory work at Sense aims to develop new tools for utilities and consumers using data and machine learning to manage energy demand, improve efficiency, and enhance grid safety. Sense utilizes machine learning to provide consumers with real-time insights into their home energy usage and offers utilities grid intelligence for tasks such as fault identification, power flow tracking, and planning for electrification. [1] [37] [38]
In June 2025, Mark Zuckerberg announced the creation of Meta Superintelligence Labs (MSL), a new organization within Meta Platforms focused on developing artificial superintelligence. Johan Schalkwyk was named as one of the key new team members joining this initiative. MSL was established to house various teams working on foundation models, including the Llama software, products, and Fundamental Artificial Intelligence Research projects. The formation of MSL and the recruitment of top AI talent like Schalkwyk are part of Meta's efforts to compete in the rapidly evolving AI landscape. [40] [41]
Johan Schalkwyk has co-authored numerous research papers in the field of computer science, focusing on areas such as speech recognition, natural language processing, and machine learning. His publications span several decades and appear in prominent conferences and journals.
Key publications include contributions to:
His work includes contributions to the OpenFst library, a toolkit for constructing and manipulating weighted finite-state transducers, which are widely used in speech and language processing applications. [26] [20]