G42 Debuts JAIS 70B To Boost Arabic Natural Language Processing

Inception, a G42 company known for its advanced AI models and applications, has introduced the JAIS 70B large language model (LLM). This model, with 70 billion parameters, is designed to support developers working on Arabic-based natural-language processing (NLP) solutions. It aims to boost the integration of Generative AI services across various sectors, improving customer service, content creation, and data analysis capabilities.

The release also includes a comprehensive suite of JAIS foundation and fine-tuned models. These consist of 20 models in eight different sizes, ranging from 590 million to 70 billion parameters. They are specifically fine-tuned for chat applications and trained on up to 1.6 trillion tokens of Arabic, English, and code data. This extensive range offers tools that include the first Arabic-centric model small enough to run on a laptop.

Dr. Andrew Jackson, CEO of Inception, highlighted the significance of AI in modern technology. "AI is now a proven value-adding force, and large language models have been at the forefront of the AI adoption spike," he said. He emphasised that JAIS was developed to preserve Arabic heritage and culture while making AI accessible to Arabic-speaking nations.

Neha Sengupta, Principal Applied Scientist at Inception, discussed the training process for these models. "For models up to 30 billion parameters, we successfully trained JAIS from scratch, consistently outperforming adapted models in the community," she stated. However, she noted that training models with 70 billion parameters or more posed significant computational complexity and environmental impact.

This new family of JAIS models reinforces Inception's commitment to delivering high-quality AI foundation models for Arabic-speaking regions. The suite includes both small, compute-efficient models for targeted applications and larger models designed for enterprise-level precision.

The introduction of these advanced tools is expected to accelerate the adoption of Generative AI services in various industries. By offering a range of model sizes and capabilities, Inception aims to cater to diverse needs within the tech community.

The JAIS 70B model represents a significant advancement in AI technology tailored for Arabic NLP solutions. Its development underscores Inception's dedication to innovation and cultural preservation through cutting-edge technology.

This extensive release provides developers with versatile tools that can be utilised across different platforms and applications. The availability of smaller models that can run on laptops makes advanced AI more accessible than ever before.

In summary, Inception's launch of the JAIS 70B LLM and its accompanying suite marks a pivotal moment in AI development for Arabic-speaking regions. The company's focus on preserving cultural heritage while advancing technological capabilities sets a new standard in the field.

With inputs from WAM