In-database Inference

SELECT ai.set_func_model('openai_embed', 'nomic-embed-text');

SELECT ai.openai_tokenize('have a test');

SELECT ai.openai_detokenize(array[15365, 23456, 29889, 11, 9906, 1917, 0]);

SELECT ai.openai_list_models();
                                                                             openai_list_models  
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------
{"{'id': 'bge-large', 'created': datetime.datetime(2023, 2, 28, 18, 56, 42, tzinfo=datetime.timezone.utc), 'owned_by': 'openai'}","{'id': 'deepseek-r1-distill-qwen-1.5b', 'created': datetime.datetime(2023, 2, 28, 18, 56, 42, tzinfo=datetime.timezone.utc), 'owned_by': 'openai'}"}
(1 row)

SELECT ai.openai_list_models_with_raw_response();
                                                                     openai_list_models_with_raw_response
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------
{"data": [{"id": "deepseek-v3-0324", "object": "model", "created": 1677610602, "owned_by": "openai"},{"id": "nomic-embed-text", "object": "model", "created": 1677610602, "owned_by": "openai"}], "object": "list"}
(1 row)

SELECT ai.openai_embed('have a test');
                           openai_embed
------------------------------------------------------------------------
[0.012326963, 0.015280011, -0.17099911,..., -0.005275759, -0.03978255] 
(1 row)

SELECT ai.openai_embed(array['have a test1', 'have a test2']);
                                                                                     openai_embed
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
[{"index": 0, "embedding": [-.02023241, .01978845, -.1544127, ..., -.006075094, -.057604033]}","{"index": 1, "embedding": [-.0066108834, -.0045409035, -.15522258, ..., .0038487795, -.03174798]}]
(1 row)

SELECT ai.openai_embed_with_raw_response('have a test');
                                                                     openai_embed_with_raw_response
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
 {"data": [{"index": 0, "object": "embedding", "embedding": [.012326963, .015280011, ..., -.005275759, -.03978255]}], "model": "nomic-embed-text:latest", "usage": {"total_tokens": 3, "prompt_tokens": 3, "completion_tokens": 0, "prompt_tokens_details": null, "completion_tokens_details": null}, "object": "list"}
(1 row)

SELECT ai.openai_embed_with_raw_response(array['have a test1', 'have a test2']);
                                                                     openai_embed_with_raw_response
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
 {"data": [{"index": 0, "object": "embedding", "embedding": [-.02023241, .01978845, ..., -.006075094, -.057604033]}, {"index": 1, "object": "embedding", "embedding": [-.0066108834, -.0045409035, ..., .0038487795, -.03174798]}], "model": "nomic-embed-text:latest", "usage": {"total_tokens": 8, "prompt_tokens": 8, "completion_tokens": 0, "prompt_tokens_details": null, "completion_tokens_details": null}, "object": "list"}
(1 row)

SELECT ai.openai_chat_complete(
'[
{"role": "system", "content": "You are a helpful assistant."},
{"role": "user", "content": "Do your know Huawei Cloud?"},
{"role": "assistant", "content": "Huawei Cloud is a cloud service provider."}
]'::jsonb
);
                                                                           openai_chat_complete
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
 Yes, **Huawei Cloud** is a significant player in the global cloud computing market, offering comprehensive cloud services powered by Huawei's expertise in ICT infrastructure. Here's what I know about it:
 ### Core Offerings:
 1. **IaaS/PaaS/SaaS Solutions**:
    - Compute, storage, networking (e.g., Elastic Cloud Server, Object Storage Service).
    - Databases (GaussDB), AI/ML platforms (ModelArts), big data services, and container orchestration.
    - Industry-specific SaaS solutions (e.g., finance, healthcare, manufacturing).
 2. **Global Infrastructure**: 
    - Data centers in over 30 regions (including Asia-Pacific, Latin America, Africa, and Europe), with ~86 Availability Zones (AZs).
 3. **AI & Advanced Tech**:
    - **Pangu Models**: Large-scale AI models for industries like healthcare, mining, and meteorology.
    - AI-native development tools and platforms like **CodeArts Snap** (AI-assisted coding).
 4. **Hybrid & Multi-Cloud**:
    - Supports hybrid deployments (e.g., HCS Online/Stack) and integrations with third-party clouds.
 5. **Security & Compliance**: 
    - End-to-end security (hardware to application layers).
    - Compliance with global standards (GDPR, C5, etc.).
 6. **Industry Ecosystems**:
    - Partner programs (e.g., Huawei Cloud Startup Program) and industry-specific solutions (e.g., smart cities, autonomous driving). ### Key Strengths:    
    - **Hardware-Software Integration**: Optimization through in-house chips (e.g., Ascend AI processors) and hardware. 
    - **Edge Computing**: Kunpeng-based edge solutions for low-latency applications.
    - **Digital Sovereignty**: Tools for data localization and regulatory adherence.
 ### Recent Updates (2023–2024): 
    - **Pangu 3.0**: Enhanced multi-modal industrial AI models.
    - **MetaStudio**: Digital twin/metaverse development suite.
    - **Green Initiatives**: Focus on sustainable data centers.
 ### Need more details?
    Tell me what you're curious about:
       - Specific services (e.g., AI tools, databases, pricing)? 
       - How it compares to AWS/Azure? 
       - Use
(1 row)

SELECT ai.openai_chat_complete('Do your know Huawei Cloud?');
                                                                           openai_chat_complete
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
 Yes, I'm familiar with **Huawei Cloud**, which is the cloud services division of **Huawei Technologies**. Here's a quick overview:
 ### Key Highlights:
 1. **Services Offered**:
    - **Compute**: Infrastructure as a Service (IaaS) and Platform as a Service (PaaS) for scalable computing.
    - **Storage**: High-performance storage solutions for data centers and cloud environments.
    - **Networking**: Next-generation networking and security services.
    - **AI/Big Data**: Integration with AI models, big data analytics, and cloud-native applications.
    - **Enterprise Solutions**: Customized cloud solutions for businesses, including hybrid and multi-cloud architectures.
 2. **Key Features**:
    - **Global Reach**: Operates in over 170 countries, providing cloud services worldwide.
    - **Security & Compliance**: Certifications like ISO 27001, SOC 2, and compliance with GDPR and other standards.
    - **AI Integration**: Partnerships with AI companies like **Tengda** for AI-driven cloud solutions.
    - **5G & Edge Computing**: Supports 5G networks and edge computing for low-latency applications.
 3. **Use Cases**:
    - Enterprise scalability, AI-driven analytics, IoT, and hybrid cloud deployments.

 ### Why Choose Huawei Cloud?
 - **Reliability**: Proven infrastructure and disaster recovery capabilities.
 - **Flexibility**: Support for both public and private cloud environments.
 - **Innovation**: Integration with cutting-edge technologies like AI and 5G.

 If you're looking to deploy applications or scale infrastructure, Huawei Cloud offers a robust platform with strong enterprise support. Let me know if you need specific details! 
(1 row)

SELECT ai.openai_chat_complete_with_raw_response(
'[
{"role": "system", "content": "You are a helpful assistant."},
{"role": "user", "content": "Do your know Huawei Cloud?"},
{"role": "assistant", "content": "Huawei Cloud is a cloud service provider."}
]'::jsonb
);

                                                                   openai_chat_complete_with_raw_response
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
{"id": "chatcmpl-a9298cb4ef", "model": "hosted_vllm/deepseek-r1-671b", "usage": {"tpot": 68, "ttft": 228, "total_tokens": 698, "prompt_tokens": 27, "completion_tokens": 671}, "object": "chat.completion", "choices": [{"index": 0, "message": {"role": "assistant", "content": "\nYes, I'm familiar with **Huawei Cloud** (officially **HUAWEI CLOUD**). Here's a concise overview of its key aspects: \n\n### Key Features & Offerings:\n1. **Global Infrastructure**: \n - 30+ regions and 84 availability zones worldwide. \n - Compliant with local regulations (e.g., GDPR in Europe). \n\n2. **Hybrid & Multi-Cloud Solutions**: \n - **Huawei Cloud Stack**: On-premises extension for hybrid cloud. \n - Partnerships for interoperability (e.g., with AWS, Azure). \n\n3. **AI-Centric Services**: \n - **Pangu Models**: Large AI models for industry-specific applications. \n - AI development platforms (**ModelArts**) and inferencing tools. \n\n4. **Industry-Specific Solutions**: \n - Focus on **smart manufacturing**, **finance**, **healthcare**, and **smart cities**. \n\n5. **Advanced Technologies**: \n - Cloud-native ecosystem (Kubernetes, serverless). \n - **Big Data**, **IoT**, and **5G integration**. \n\n6. **Developer Ecosystem**: \n - Open-source contributions (e.g., openEuler OS, MindSpore AI framework). \n - Extensive SDKs/APIs and low-code tools. \n\n### Competitive Edge:\n- **Cost-Effectiveness**: Competitive pricing, especially in Asia-Pacific markets. \n- **Security/Compliance**: Emphasis on data sovereignty and end-to-end encryption. \n- **5G Synergy**: Unique integration with Huawei's 5G infrastructure. \n\n### Market Position:\n- **#2 in China** (behind Alibaba Cloud), top 5 global IaaS market share. \n- Rapid growth in emerging markets (Asia, Latin America, Africa). \n\n### Controversies:\n- Geopolitical challenges (U.S. trade restrictions) impacting global expansion. \n\nHuawei Cloud is a strategic choice for enterprises needing AI/5G-driven solutions, especially in regions with strong Huawei presence. Let me know if you'd like deep dives into specific services!", "reasoning_content": "\nOkay, the user asked if I know Huawei Cloud. They probably want a quick confirmation or basic info. \n\nLooking at the history, my previous reply was super short-just calling it a \"cloud service provider.\" That's accurate but kinda barebones. Maybe the user expected more detail, since Huawei Cloud is a major player. \n\nThe user didn't specify their knowledge level, so they could be a newbie checking options or a tech pro comparing providers. Since they didn't ask for specifics, I'll keep it broad but add layers: technical depth (AI, infrastructure) and practical angles (use cases, global reach). \n\nHmm, should I mention controversy? Like US-China tensions affecting Huawei? Probably not-unless the user asks. They seem neutral, so stick to facts. \n\nNoting they're Tier 1: that's a credibility signal for enterprise users. Adding revenue rank (#2 in China) too-it's impressive but not overselling. \n\nBalancing conciseness with usefulness: bullet points in reply will help, but avoid jargon avalanches. They can always ask follow-ups.\n"}, "finish_reason": "stop", "provider_specific_fields": {}}], "created": 1763017779450, "message": ""}
(1 row)

SELECT ai.openai_chat_complete_with_raw_response('Do your know Huawei Cloud?');
                                                                     openai_chat_complete_with_raw_response
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
{"id": "chatcmpl-cdff97c366", "model": "hosted_vllm/deepseek-r1-671b", "usage": {"tpot": 69, "ttft": 185, "total_tokens": 736, "prompt_tokens": 15, "completion_tokens": 721}, "object": "chat.completion", "choices": [{"index": 0, "message": {"role": "assistant", "content": "\nYes, I'm familiar with **Huawei Cloud**! Here's a comprehensive overview: \n\n### **What is Huawei Cloud?** \nHuawei Cloud is the global cloud service arm of Huawei Technologies, launched in 2011. It's one of China's largest and the world's fastest-growing cloud providers (Top 5 globally by market share). \n\n### **Key Strengths** \n1. **Full-Stack Services**: \n - **IaaS**: Virtual machines, storage, networking. \n - **PaaS**: Databases (GaussDB), AI development (ModelArts), container services (CCI/CCE). \n - **SaaS**: Collaboration tools (WeLink), industry-specific solutions. \n\n2. **AI & Big Data Leadership**: \n - **Pangu AI Models**: Large language models (LLMs) rivaling GPT-3.5, tailored for industries (e.g., finance, healthcare). \n - **ModelArts**: One-stop AI development platform supporting training/deployment. \n\n3. **Global Infrastructure**: \n - 88 availability zones across 30 regions (Asia-Pacific, LATAM, Africa, Europe). \n - Compliant with GDPR, CCPA, and local regulations (e.g., China's DSL). \n\n4. **Hybrid & Multi-Cloud Solutions**: \n - **Huawei Cloud Stack**: On-premises private cloud integration. \n - Partnerships for seamless multi-cloud management. \n\n5. **Industry-Specific Solutions**: \n - Smart cities, autonomous driving, manufacturing (Industrial IoT), and fintech (distributed databases). \n\n### **Competitive Edge** \n- **Security**: End-to-end encryption + \"Zero Trust\" architecture. \n- **Cost Efficiency**: Aggressive pricing, especially in emerging markets. \n- **5G + Cloud Synergy**: Edge computing optimized for 5G latency (e.g., Intelligent EdgeFabric). \n- **Open Source**: Major contributor to Kubernetes, Spark, and EdgeGallery. \n\n### **Market Position** \n- Dominant in China (≈20% market share), expanding globally. \n- Key clients include governments, telecoms (e.g., China Mobile), and enterprises (Ping An, SAIC Motor). \n\n### **Free Tier & Trials** \nHuawei Cloud offers free", "reasoning_content": "\nHmm, the user is asking about Huawei Cloud. They might be researching cloud service providers for personal or professional use, or perhaps evaluating options for a project. Since they kept it very general (\"Do you know\"), I should give a solid foundational overview.\n\nI recall Huawei Cloud is China's largest cloud provider with a global reach. Key highlights to cover: their \"Everything as a Service\" model, AI focus with Pangu models, infrastructure strength (they have hyper-scale regions), and industry solutions. The compliance point is crucial too - multinational users always care about data sovereignty. \n\nBetter structure this clearly: start with positioning, then major tech strengths (compute/storage/AI), deployment flexibility (hybrid/multi-cloud), and close with why businesses pick them. The free credits note could hook users exploring cost options. Should mention Pangu separately - it's becoming a major USP against Western clouds. \n\nUser seems technical given they named a specific cloud platform, but keeping explanations accessible. No signs of urgency in their tone, so a comprehensive (but not overwhelming) response fits. Might follow up with questions about their use case next.\n"}, "finish_reason": "timeout", "provider_specific_fields": {}}], "created": 1763017897477, "message": "Reach time limitation! Use stream request to avoid timeout."}
(1 row)

SELECT ai.openai_moderate('You're such a fool.');

SELECT ai.chunk_text_recursively('
A data warehouse is a centralized data storage system specifically designed to collect, store, process, and analyze large volumes of data from multiple heterogeneous data sources. By integrating information from different operating systems, transaction systems, and external data sources, it enables enterprises to perform complex data analysis and reporting. Unlike traditional database systems, data warehouses emphasize historical data and query efficiency, typically supporting business intelligence (BI) and decision support systems (DSS).
', 100, 10, array[',', '.']);
                                                                           chunk_text_recursively
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
{"(0, 'A data warehouse is a centralized data storage system specifically designed to collect, store')","(1, ', store, process')","(2, ', and analyze large volumes of data from multiple heterogeneous data sources')","(3, '. By integrating information from different operating systems')","(4, ', transaction systems, and external data sources')","(5, ', it enables enterprises to perform complex data analysis and reporting')","(6, '. Unlike traditional database systems')","(7, ', data warehouses emphasize historical data and query efficiency')","(8, ', typically supporting business intelligence (BI) and decision support systems (DSS).')"}
(1 row)

SELECT ai.similarity('I like apple.', 'I like pen.');
similarity
------------
 .5875276
(1 row)

SELECT ai.vector_cosine_similarity('[1.0, 2.0, 3.0]', '[-2.0, 5.0, -3.0]');
vector_cosine_similarity
------------------------
-.043355495
(1 row)

SELECT ai.classify('The football match between Team A and Team B was thrilling. The game ended with a 3-2 victory for Team A, and the players celebrated with their fans.', array['Sports', 'Technology', 'Culture']);
classify
---------
Sports
(1 row)

SELECT ai.extract('Name: John Smith, Gender: Male, Age: 30, Email: john.smith@example.com, Phone: +1 555-1234, Experience: Highly experienced professional', array['Name', 'Gender', 'Email']);
                                  extract
----------------------------------------------------------------------------
{"Name": "John Smith", "Email": "john.smith@example.com", "Gender": "Male"}
(1 row)

SELECT ai.mask('Name: John Smith, Gender: Male, Age: 30, Email: john.smith@example.com, Phone: +1 555-1234, Experience: Highly experienced professional', array['Name', 'Gender', 'Email']);
                                                                mask
-------------------------------------------------------------------------------------------------------------------------------
Name: [#####], Gender: [#####], Age: 30, Email: [#####], Phone: +1 555-1234, Experience: Highly experienced professional
(1 row)

SELECT ai.fix_grammar('She do not like him.');
      fix_grammar
-----------------------
She does not like him.
(1 row)

SELECT ai.summarize('
Huawei Cloud GaussDB is a high-performance, distributed database service launched by Huawei, supporting multiple database engines including relational databases (such as MySQL and PostgreSQL) and non-relational databases. GaussDB delivers elasticity, high availability, and auto-scaling capabilities to meet enterprises'' demanding requirements for database performance, reliability, and flexibility.
As Huawei Cloud''s flagship database, GaussDB integrates an advanced distributed architecture that supports automatic fault recovery and data backup to ensure data security. Simultaneously, it optimizes query performance and reduces operational costs through intelligent scheduling and resource management technologies. GaussDB also excels in high concurrency and high throughput, making it ideal for large-scale data processing and high-load applications across industries such as finance, e-commerce, and manufacturing.
Furthermore, through deep integration with other Huawei Cloud services, GaussDB delivers comprehensive data processing solutions to empower enterprises in digital transformation and intelligent management. It not only fulfills fundamental database requirements but also supports AI and big data applications, further enhancing the value of enterprise data.
');
                                                                                      summarize
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Huawei Cloud GaussDB is a high-performance, distributed database service supporting relational and non-relational databases, offering elasticity, high availability, and auto-scaling to meet enterprise needs for performance, reliability, and flexibility. It integrates an advanced distributed architecture for automatic fault recovery, data backup, and optimized query performance with cost reduction. Its high concurrency and throughput make it suitable for large-scale data processing and high-load applications in industries like finance and e-commerce. Integrated with other Huawei Cloud services, it provides comprehensive data processing solutions, supporting AI and big data to drive digital transformation and intelligent management.
(1 row)

SELECT ai.rank('The Future Development of Artificial Intelligence.', 
array['The rapid advancement of artificial intelligence has already made a significant impact across multiple industries, including healthcare and finance.', 
'Machine learning and deep learning are core technologies of artificial intelligence, and an increasing number of companies are beginning to apply these technologies.', 
'Forecast data for the global technology market in 2023 indicates that the cloud computing market is experiencing steady growth.']);
                                                                                     rank
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
{"Forecast data for the global technology market in 2023 indicates that the cloud computing market is experiencing steady growth.": 3.0, "The rapid advancement of artificial intelligence has already made a significant impact across multiple industries, including healthcare and finance.": 8.0, "Machine learning and deep learning are core technologies of artificial intelligence, and an increasing number of companies are beginning to apply these technologies.": 7.0}
(1 row)

SELECT ai.sentiment('You are such a kind person.');
sentiment
-----------
positive
(1 row)

SELECT ai.textfilter('The food at this restaurant is delicious!', 'Is this a negative review?');
textfilter
-----------
f
(1 row)