What Is PanguLM?
Introduction
ModelArts Studio is a comprehensive model development platform that supports the creation of various models and applications, offering engines for data, model, and application development.
- Data engineering toolchain
Data serves as the foundation for large model training, providing the essential knowledge and information necessary for these models. As an important part of the PanguLM service, the data engineering toolchain provides data acquisition, cleaning, synthesis, labeling, evaluation, combination, publishing, and management.
This toolchain efficiently collects and processes data in various formats to meet the requirements of different training and evaluation jobs. It optimizes raw data by providing automatic quality check and data cleaning capabilities to ensure data quality and consistency. Additionally, the data engineering toolchain provides robust data storage and management capabilities, providing high-quality data support for large model training.
- Model development toolchain
The model development toolchain is the core module of the PanguLM service, offering a one-stop solution from model creation to deployment.
This toolchain provides functions such as model training, compression, deployment, evaluation, and inference. With efficient inference performance and cross-platform migration tools, the model development toolchain can ensure efficient application of models in different environments.
- Agent development toolchain
The agent development toolchain is another important module of the PanguLM service. It supports prompt engineering and intelligent agent creation. This toolchain offers tools for designing and managing input prompts to optimize model performance, enhancing the accuracy and relevance of outputs. Additionally, visual orchestration tools and an application development toolchain accelerate the development of large model applications to meet complex service requirements.
Relationship Between Third-Party Large Models and ModelArts Studio
ModelArts Studio supports third-party models, allowing you to use your own data for incremental training and fine-tuning. You can also compress, evaluate, and deploy trained models, as well as create your own agents.
ModelArts Studio is a one-stop platform for developing large models, launched by the PanguLM service. It integrates data management, model development, and agent development, offering comprehensive toolchains throughout the entire lifecycle of large model development. The data engineering toolchain provides more than 80 AI operators to meet multi-scenario requirements, greatly improving data processing efficiency and providing high-quality data for large model training. The model development toolchain supports fine-tuning, compression, evaluation, and deployment of third-party models, greatly lowering the threshold for large model development. The agent development toolchain provides visualized process orchestration based on large language models (LLMs) and abundant function plug-ins, greatly improving the development efficiency of large model applications. Additionally, ModelArts Studio manages data, models, and agents on a unified portal. You can quickly learn about the asset usage, version information, and source tracing information, facilitating unified asset management.
Feedback
Was this page helpful?
Provide feedbackThank you very much for your feedback. We will continue working to improve the documentation.See the reply and handling status in My Cloud VOC.
For any further questions, feel free to contact us through the chatbot.
Chatbot