MTS AI, one of the largest artificial intelligence technology development centers in Russia, has released an updated version of its large business language model Cotype PRO. The new model can process long user context – up to 20 pages, allowing it to provide personalized and accurate answers with low computational power consumption.
“The increased memory capacity for context without data loss is a feature of Cotype Pro, which is already being successfully used in more than 10 pilot projects in the corporate sector and government agencies to create end-to-end search systems for internal documentation and databases, generate technical instructions and corporate letters, optimize website content for SEO, and analyze and summarize meeting results,” said Sergey Ponomarenko, Senior Manager of LLM Products at MTS AI.
Cotype PRO was created using a unique two-stage fine-tuning method and custom benchmarks developed by MTS AI specialists. This approach has allowed achieving high quality performance of the large language model, which runs on a single NVIDIA A100 GPU, in contrast to competing solutions that require 4 GPUs.
The large contextual window gives the Cotype PRO language model the ability to process a significant amount of information at once. That is, the user can upload a 20-page contract or other document. As a result, the model better understands the context and provides more accurate answers, which is extremely important when analyzing corporate documents and regulations.
