Oracle brings OCI Generative AI service, adds GenAI to tech stack

Spread the love

New Delhi: Oracle has announced the general availability (GA) of the Oracle Cloud Infrastructure (OCI) Generative AI service. OCI Generative AI service is a fully managed service, which seamlessly integrates large language models (LLMs) from Cohere and Meta Llama 2 to address a wide range of business use cases. It now includes multilingual capabilities that support over 100 languages, an improved GPU cluster management experience, and flexible fine-tuning options.

Customers can use OCI Generative AI service in the Oracle Cloud and on-premises via OCI Dedicated Region. Oracle’s AI focus is on solving real-world business use cases, and enabling widespread adoption in the enterprise, according to Greg Pavlik, SVP of AI and Data Management, Oracle Cloud Infrastructure.

“To do this, we are embedding AI across all layers of the technology stack by integrating generative AI into our applications and converged database, and offering new LLMs and managed services—all supported by a fast and cost-effective AI infrastructure,” said Pavlik.

“Instead of providing a tool kit that requires assembling, we are offering a powerful suite of pre-built generative AI services and features that work together to help customers solve business problems smarter and faster,” added Pavlik.  

The latest models from Cohere and Meta Llama 2 will be available in a managed service that can be consumed via API calls. It will help customers address business issues, focused on text generation, summarisation, and semantic similarity tasks. In addition, customers will be able to embed generative AI easily and securely into their technology stack, with tight data security and governance.  

Customers may further refine these models using their own data with retrieval augmented generation (RAG) techniques, so the models will understand their unique internal operations.

Now in beta, OCI Generative AI Agents service with an RAG agent combines the power of LLMs and enterprise search built on OCI OpenSearch to provide contextualised results that are enhanced with enterprise data. This agent enables users to converse with diverse enterprise data sources through natural language without the need for specialist skills. The information retrieved is current—even with dynamic data stores—and the results are provided with references to the source data.

The initial beta release supports OCI OpenSearch. Upcoming releases will support a wider range of data search, and aggregation tools, and provide access to Oracle Database 23c with AI Vector Search and MySQL HeatWave with Vector Store. Oracle will also deliver prebuilt agent actions across its suite of SaaS applications including Oracle Fusion Cloud Applications, NetSuite, and Oracle Health.