Huawei PanGu: Difference between revisions
→Updates: copy-editing, removed repeated content. |
→Updates: rephrase. |
||
Line 41: | Line 41: | ||
=== Updates === |
=== Updates === |
||
On August 5, 2023, [[Huawei]] partnered with [[European Centre for Medium-Range Weather Forecasts |
On August 5, 2023, [[Huawei]] partnered with [[European Centre for Medium-Range Weather Forecasts]] (ECMWF) to launch a global weather forecasting AI model. This model used Huawei Cloud solutions and the PanGu-Weather Model with [[MindSpore]]. It is accessible on the ECMWF website and aims to provide accurate weather data.<ref>{{cite web |last1=Li |first1=Deng |title=Huawei Pangu-Weather Model debuts European ECMWF website |url=https://www.huaweicentral.com/huawei-pangu-weather-model-debuts-european-ecmwf-website/ |website=HC Newsroom |publisher=HC Newsroom |access-date=13 February 2024}}</ref><ref>{{cite web |last1=Mishra |first1=Yash |title=Huawei Cloud will build large-scale high-precision regional weather forecast Pangu model |url=https://www.huaweicentral.com/huawei-cloud-will-build-large-scale-high-precision-regional-weather-forecast-pangu-model/ |website=HC Newsroom |publisher=HC Newsroom |access-date=13 February 2024}}</ref> |
||
On December 19, 2023, [[Huawei|Huawei Cloud]] announced it's financial services on its PanGu powered AI Finance platform in the global market. The tech giant introduced the product at its 2023 Huawei Cloud Fintech Summit as an aim to reshape the digital finance industries with efficient characteristics, to boost Fintech firms in the global market. It incorporates a variety of advanced features and technologies using AI, huge data analytics, and blockchain.<ref>{{cite web |last1=Birch |first1=Scott |title=Huawei Cloud and Pangu AI model reshaping finance industry |url=https://fintechmagazine.com/tech-ai/huawei-cloud-and-pangu-ai-model-reshaping-finance-industry |website=FinTech Magazine |publisher=FinTech Magazine |access-date=13 February 2024}}</ref> |
On December 19, 2023, [[Huawei|Huawei Cloud]] announced it's financial services on its PanGu powered AI Finance platform in the global market. The tech giant introduced the product at its 2023 Huawei Cloud Fintech Summit as an aim to reshape the digital finance industries with efficient characteristics, to boost Fintech firms in the global market. It incorporates a variety of advanced features and technologies using AI, huge data analytics, and blockchain.<ref>{{cite web |last1=Birch |first1=Scott |title=Huawei Cloud and Pangu AI model reshaping finance industry |url=https://fintechmagazine.com/tech-ai/huawei-cloud-and-pangu-ai-model-reshaping-finance-industry |website=FinTech Magazine |publisher=FinTech Magazine |access-date=13 February 2024}}</ref> |
Revision as of 08:26, 11 July 2024
![]() | |
Developer(s) | Huawei |
---|---|
Initial release | 3.0, July 7, 2023 |
Stable release | 5.0
/ June 21, 2024 |
Available in | Chinese, English, Russian |
Typ | Large language model |
License | Proprietary |
Huawei PanGu, PanGu, PanGu-Σ or PanGu-π (Chinese: 盘古大模型; pinyin: pángǔ dà móxíng) is a multimodal large language model developed by Huawei. It was announced on July 7, 2023, positioned as a contender to other multimodal large language models.[1]
The name of the large learning language model, PanGu, was derived from the Chinese mythology and folklore of Pangu, a primordial character related to the creation of the world.[2]
History
Early development
In April 2023, Huawei released a paper detailing the development of PanGu-Σ, a colossal language model featuring 1.085 trillion parameters. Developed within Huawei's MindSpore 5 framework, PanGu-Σ underwent training for over 100 days on a cluster system equipped with 512 Ascend 910 AI accelerator chips, processing 329 billion tokens in more than 40 natural and programming languages.[3]
PanGu-Σ incorporates Random Routed Experts (RRE) and the Transformer decoder architecture, allowing easy extraction of sub-models for various applications like conversation, translation, code production, and natural language interpretation. The model achieves 6.3 times faster training throughput compared to MoE models with the same hyper-parameters. In the Chinese domain, it outperforms previous state-of-the-art models across 16 tasks in a zero-shot setting. Trained on datasets from 40 domains, including Chinese, English, Bilingual, and code, PanGu-Σ excels in few-shot natural-language understanding, open-domain discussion, question answering, machine translation, and code creation.[4][5]
Launch
During the Huawei Developer Conference on July 7, 2023, Huawei introduced PanGu 3.0, a large language model (LLM), tailored for sectors like government, finance, manufacturing, mining, and meteorology utilizing Huawei Cloud solutions. In the subsequent month, Huawei launched the Celia Virtual Assistant with advanced AI features, capable of generating long text replies based on user voice commands and set to release with HarmonyOS 4.0 for eligible devices.[6][7]
The LLM was designed for enterprises seeking advantages in the AI industry, focusing on task execution over creative work, unlike traditional models used for general purposes like chatbots, poetry, and visual content creation.[8]
Using the same technology as ChatGPT, Huawei's LLM features a hierarchical architecture, allowing customers to adapt the model to various tasks and train it on their own datasets, making it versatile across various industries.[9]
Aktualisierungen
On August 5, 2023, Huawei partnered with European Centre for Medium-Range Weather Forecasts (ECMWF) to launch a global weather forecasting AI model. This model used Huawei Cloud solutions and the PanGu-Weather Model with MindSpore. It is accessible on the ECMWF website and aims to provide accurate weather data.[10][11]
On December 19, 2023, Huawei Cloud announced it's financial services on its PanGu powered AI Finance platform in the global market. The tech giant introduced the product at its 2023 Huawei Cloud Fintech Summit as an aim to reshape the digital finance industries with efficient characteristics, to boost Fintech firms in the global market. It incorporates a variety of advanced features and technologies using AI, huge data analytics, and blockchain.[12]
On June 21, 2024 at HDC 2024, Huawei announced upgraded PanGu 5.0 alongside HarmonyOS NEXT. This version integrated with Harmony Intelligence, which features a smarter Celia (Xiaoyi) and focuses on generative AI updates to its LLM platform for creating new content, such as text, code, or images. Aiming to make PanGu accessible to a wide range of developers and businesses, it offered scalable options: smaller models requiring less computational power for those with limited resources, and larger models with increased capacities for complex tasks requiring more processing power.[13]
Technical specifications
PanGu Large Model 3.0 built for industry is structured with a 5+N+X three-tier structure. The first layer – L0 is PanGu's five basic large models to provide a variety of skills to meet industry scenarios, such as Natural language large models, Visual large models, Multimodal large models, Prediction large models and Scientific computing large models. The second layer – L1 is N large industry models. With this, it provides industry-wide large models that are trained using industry public data, including government affairs, finance, manufacturing, mining, weather, and more. It also uses industry customers’ own data on Pingu's L0 and L1, it trains its own proprietary large models for customers. And the last third layer, the L2 layer, gives customers more detailed scenario models. It's more focused on a specific application scenario or specific business and delivers customers with out-of-the-box model services.[14]
The updated Huawei PanGu Model 5.0 by Huawei Cloud business division has three prime features for different business scenarios, multi-style model, and intelligence. Huawei divided the AI model platform into four series with different parameter scales such as:
- PanGu E Series: PanGu Embedded version support smart apps on phones, tablets, PCs, and other devices with a 1 billion parameter level.
- PanGu P Series: PanGu Professional 10-billion parameter level and is perfect for low-latency and low-cost reasoning conditions.
- PanGu U Series: PanGu Ultra Includes two variants between 135-billion and 230-billion parameters where both are capable of managing complex tasks and also work as a base for large models.
- PanGu S Series: Super PanGu is the apex level edition that includes trillion-level parameters and can manage AI technology-related scenarios such as cross-domain or multi-tasks.[15]
See also
References
- ^ "Reshaping Industries with AI: Huawei Cloud launches Pangu Models 3.0 and Ascend AI Cloud services". CITI Newsroom. CITI Newsroom. Retrieved February 13, 2024.
- ^ Nair, Arya M. (July 8, 2023). "Huawei rolls out latest version of its deep learning AI model, Pangu - GCC Business News". Retrieved May 29, 2024.
- ^ Upadhyay, Shyam Nandan. "Huawei Researchers Develop LLM With 1.085 Trillion Parameters". AnalyticsIndiaMag. AnalyticsIndiaMag. Retrieved February 13, 2024.
- ^ "Huawei Researchers Unveil Pangu-Σ: Trillion-Parameter Language Model with Sparse Architecture". Multiplatform.ai. Multiplatform.ai. Retrieved February 13, 2024.
- ^ Tickoo, Aneesh. "Huawei Researchers Develop Pangu-Σ: A Large Language Model With Sparse Architecture And 1.085 Trillion Parameters". marktechpost.com. marktechpost.com. Retrieved February 13, 2024.
- ^ "Huawei Pangu AI models for Government, finance, manufacturing, mining, meteorology". HC Newsroom. HC Newsroom. Retrieved February 13, 2024.
- ^ Sarkar, Amy. "Huawei launches Voice Assistant with large Pangu AI model". HC Newsroom. HC Newsroom. Retrieved February 13, 2024.
- ^ "Revolutionizing Global AI Landscape: Huawei's PanGu Megamodel Set to Transform Industries Worldwide". LinkedIn. Grosso Link Sàrl. Retrieved February 13, 2024.
- ^ Jarrett, Miranda. "Huawei to revolutionise applications of AI with new Pangu model". Dao Insights. Dao Insights. Retrieved February 13, 2024.
- ^ Li, Deng. "Huawei Pangu-Weather Model debuts European ECMWF website". HC Newsroom. HC Newsroom. Retrieved February 13, 2024.
- ^ Mishra, Yash. "Huawei Cloud will build large-scale high-precision regional weather forecast Pangu model". HC Newsroom. HC Newsroom. Retrieved February 13, 2024.
- ^ Birch, Scott. "Huawei Cloud and Pangu AI model reshaping finance industry". FinTech Magazine. FinTech Magazine. Retrieved February 13, 2024.
- ^ Writer, Staff (June 22, 2024). "Huawei Unveils New Harmony OS And AI Model In Continued Drive For Tech Self-reliance". Elnion. Retrieved July 7, 2024.
- ^ "Huawei launches latest AI model, Pangu 3.0". Business Today (Malaysia). Business Today (Malaysia). Retrieved February 13, 2024.
- ^ Matsui, Emiko (June 21, 2024). "Huawei Cloud unveils Pangu Large Model 5.0". Huawei Central. Retrieved July 7, 2024.