Providing Multiple LLMs: A Convenient and Easy Way to Use Various LLMs with Global Intelligence Platform - AI One
Introduction
When choosing and using Large Language Models (LLMs) for business, it is important they fit well with your services. If they are hard to use, they won't be very helpful. SK telecom is not only enhancing LLMs from different providers but also creating its own models called A.X LLM. Before, developers had to use different endpoints and API keys to access these models, which made things complicated. To make it simpler, we created the Global Intelligence Platform (GIP), offering all these models through one easy-to-use endpoint.
What is GIP?
The GIP, developed by a subsidiary branch of SK telecom, serves as a gateway that enables businesses to utilize multiple LLMs with ease and cost-efficiency. It is specifically designed to assist SK telecom and other enterprises in accessing a broad range of AI models without the inconvenience of managing individual providers.
The primary feature of GIP allows customers to access various AI models from providers such as OpenAI, Anthropic, and Azure OpenAI via a single endpoint. This streamlined approach eliminates the need for individual sign-ups or contracts with each provider, thereby simplifying the process. Future enhancements will include the capability to automatically select the most appropriate AI model for each task and to switch to an equally performing alternative model in the event of an outage, thereby ensuring seamless and continuous operation.
Here are the considerations for supplying multiple LLMs through GIP.
Compatibility: The GIP API must seamlessly integrate with existing APIs provided by LLM providers. This compatibility ensures that customers can transition with minimal cost and effort.
Security: While security requirements can vary depending on the service, the highest standards must always be met. GIP enhances security through measures such as dedicated line and Zero Day Retention, thereby eliminating the risk of data leakage or misuse.
Safety: Ensuring the stability of model responses is crucial when utilizing various models. Despite ongoing improvements, models can still produce inappropriate responses due to hallucination. To address this, GIP incorporates SK telecom's Safety API, which consistently enhances the safety of responses, regardless of the model used.
SK telecom's AI Portal, AI One
To further enhance accessibility for developers, SK telecom has introduced a dedicated AI model portal, AI One. While GIP already simplifies the use of various AI models, AI One takes convenience to the next level with features such as Single Sign-On (SSO) through corporate accounts and AI model budget management. This approach not only maximizes user convenience but also allows SK telecom to gauge internal demand and incorporate smarter features into its services through the application of LLMs. Additionally, it enables the monitoring of overall AI model usage and facilitates detailed planning for future model procurement, thereby improving the management of LLM demand and supply.
Conclusion
There is a Korean proverb that says, "A sack of pearls only becomes a treasure when they are strung together." In a similar vein, no matter how many diverse LLMs SK telecom secures and develops, their value is significantly diminished without the appropriate tools to facilitate their easy utilization. SK telecom is committed to developing platforms and tools such as GIP and AI One that enable the effective use of LLMs. If you are encountering similar challenges with LLM utilization, please do not hesitate to contact us. We are prepared to collaborate and address these issues together through our advanced solutions, GIP and AI One!