Tokyo Lab Launches Open Source AI Model Founded By Ex-Google Staff
Sakana AI, a Tokyo-based startup led by former Google researchers, has unveiled AI models using a unique methodology inspired by the principles of evolution. This development, reported by Reuters, introduces a novel concept in AI research and development called "model merging." This technique amalgamates existing AI models to produce new, more advanced versions through a process reminiscent of natural selection and breeding. Sakana AI's approach has led to the creation of several generations of models, with the most successful variants from each generation selected to serve as the basis for subsequent iterations.
The innovative strategy employed by Sakana AI involves combining the strengths of various AI models to generate offspring that exceed their predecessors in performance. This method has resulted in the production of hundreds of model generations, marking a significant leap in the development of AI technologies. According to David Ha, a founder of Sakana AI, the company is set to release three Japanese language models, two of which will be open-sourced to the public. This initiative is not only a testament to Sakana AI's commitment to advancing AI research but also a strategic move to foster greater innovation and collaboration within the AI community.
The pedigree of Sakana AI's founders, David Ha and Llion Jones, is notable, with both individuals having made significant contributions to the field of AI while at Google. Jones co-authored the influential 2017 research paper "Attention Is All You Need," which introduced the transformative "transformer" deep learning architecture. This architecture has since become a cornerstone for developments in generative AI, including the widely recognized chatbot ChatGPT. Ha, on the other hand, boasts an impressive background as the head of research at Stability AI and a researcher within Google's Brain team. The departure of all authors of the pivotal Google paper from the organization underscores the shifting landscape of AI research, with talent migrating to startups that promise innovation and growth.
Sakana AI is on a mission to establish Tokyo as a leading center for AI innovation, mirroring the influence of OpenAI in San Francisco and DeepMind in London. With a significant $30 million in seed financing secured in January, led by Lux Capital, the startup is well on its way to achieving its goal. This investment not only underscores the potential of Sakana AI's novel approach to AI development but also highlights the growing interest of venture investors in backing enterprises that are at the forefront of AI research and development.
The release of Sakana AI's models, particularly the open-sourcing of two Japanese language models, represents a pivotal moment for the AI community. This initiative not only contributes to the democratization of AI technologies but also sets the stage for further advancements in the field.
Sign in with Google