[ad_1]
Kong not too long ago unveiled a set of six open-source AI plugins for its Kong Gateway 3.6, which supply integration with a number of LLMs and considerably advance AI expertise accessibility for builders and platform groups.
In accordance with Kong, the purpose of this launch is to boost developer productiveness by simplifying the mixing means of LLMs into numerous merchandise. It ensures a safe, compliant, and controllable setting for AI requests inside organizations.
“Immediately marks a major milestone in our journey in the direction of democratizing AI for builders and enterprises worldwide. By open-sourcing this suite of modern AI capabilities, together with no-code AI plugins, we’re eradicating the obstacles to AI adoption and making it attainable for builders to leverage a number of LLMs effortlessly and ship AI-powered purposes sooner. On the similar time, we’re offering governance and visibility to all of the AI site visitors that’s being generated by a company,“ stated Marco Palladino, CTO and co-founder of Kong Inc.
Kong’s introduction of AI capabilities into its Kong Gateway by way of the “ai-proxy” plugin permits the incorporation of a number of LLMs, reminiscent of these supplied by OpenAI, Azure AI, and others, offering a unified interface that enables builders to change between fashions with out altering their software code. It additionally simplifies the administration of AI credentials by centralizing them throughout the Kong Gateway. This method enhances safety by abstracting credential administration away from purposes, enabling simpler credential rotation and updates, based on Kong.
The “ai-proxy” plugin extends its performance into the realm of analytics by enabling the gathering of detailed Layer 7 AI metrics,which incorporates monitoring request and response token counts, and utilization information throughout totally different LLM suppliers and fashions. With help for integration with analytics platforms like Datadog and New Relic, alongside Kong Gateway’s native logging plugins, builders achieve beneficial insights into the utilization patterns of their AI integrations.
Moreover, the introduction of no-code AI integration plugins, largely the “ai-request-transformer” and “ai-response-transformer,” empower customers to inject AI capabilities straight into API requests and responses, enabling functionalities like real-time API response translation for broader internationalization efforts with out the necessity for coding.
Kong additionally launched plugins specializing in the creation, ornament, and governance of AI prompts. The “ai-prompt-template” plugin permits for the centralized administration of immediate templates, enabling swift updates and compliance with authorized templates without having to change software code. The “ai-prompt-decorator” and “ai-prompt-guard” plugins present mechanisms for guaranteeing that AI prompts are each according to organizational insurance policies and guarded in opposition to unauthorized or delicate content material.
[ad_2]