AccScience Publishing / IJAMD / Volume 1 / Issue 2 / DOI: 10.36922/ijamd.3681
Submit to IJAMD
Cite this article
107
Download
1405
Views
Journal Browser
Volume | Year
Issue
Search
Forthcoming Issue
Current Issue
View All
News and Announcements
View All
PERSPECTIVE ARTICLE

A unified industrial large knowledge model framework in Industry 4.0 and smart manufacturing

Jay Lee1 ,  Hanqi Su1*
Show Less
1 Center for Industrial Artificial Intelligence, Department of Mechanical Engineering, A. James Clark School of Engineering, University of Maryland, College Park, Maryland, United States of America
IJAMD 2024, 1(2), 41–47; https://doi.org/10.36922/ijamd.3681
Submitted: 16 May 2024 | Accepted: 4 June 2024 | Published: 24 July 2024
© 2024 by the Author(s). This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution 4.0 International License ( https://creativecommons.org/licenses/by/4.0/ )
Download PDF
Cite
XML
Abstract

The recent emergence of large language models (LLMs) demonstrates the potential for artificial general intelligence, revealing new opportunities in Industry 4.0 and smart manufacturing. However, a notable gap exists in applying these LLMs in industry, primarily due to their training on general knowledge rather than domain-specific knowledge. Such specialized domain knowledge is vital for effectively addressing the complex needs of industrial applications. To bridge this gap, this paper proposes a unified industrial large knowledge model (ILKM) framework, emphasizing its potential to revolutionize future industries. In addition, ILKMs and LLMs are compared from eight perspectives. Finally, the “6S Principle” is proposed as the guideline for ILKM development, and several potential opportunities are highlighted for ILKM deployment in Industry 4.0 and smart manufacturing.

Keywords
Industrial large knowledge model
Large language model
Machine learning
Industrial artificial intelligence
Industry 4.0
Smart manufacturing
Funding
None.
Conflict of interest
Jay Lee is an Editorial Board Member of this journal, but was not in any way involved in the editorial and peer-review process conducted for this paper, directly or indirectly. Separately, other authors declared that they have no known competing financial interests or personal relationships that could have influenced the work reported in this paper.
References
  1. Lasi H, Fettke P, Kemper HG, Feld T, Hoffmann M. Industry 4.0. Bus Inf Syst Eng. 2014;6(4):239-242. doi: 10.1007/s12599-014-0334-4

 

  1. Yan J, Meng Y, Lu L, Li L. Industrial big data in an industry 4.0 environment: Challenges, schemes, and applications for predictive maintenance. IEEE Access. 2017;5:23484-23491. doi:10.1109/access.2017.2765544

 

  1. Lee J, Davari H, Singh J, Pandhare V. Industrial artificial intelligence for industry 4.0-based manufacturing systems. Manuf Lett. 2018;18:20-23. doi: 10.1016/j.mfglet.2018.09.002

 

  1. Sharp M, Ak R, Hedberg T. A survey of the advancing use and development of machine learning in smart manufacturing. J Manuf Syst. 2018;48:170-179. doi: 10.1016/j.jmsy.2018.02.004

 

  1. Wang J, Ma Y, Zhang L, Gao RX, Wu D. Deep learning for smart manufacturing: Methods and applications. J Manuf Syst. 2018;48:144-156. doi: 10.1016/j.jmsy.2018.01.003

 

  1. Lee J, Bagheri B, Kao HA. A cyber-physical systems architecture for industry 4.0-based manufacturing systems. Manuf Lett. 2015;3:18-23. doi: 10.1016/j.mfglet.2014.12.001

 

  1. Sisinni E, Saifullah A, Han S, Jennehag U, Gidlund M. Industrial internet of things: Challenges, opportunities, and directions. IEEE Trans Ind Inform. 2018;14(11):4724-4734. doi: 10.1109/tii.2018.2852491

 

  1. Zhao WX, Zhou K, Li J, et al. A Survey of Large Language Models. arXiv.org. doi: 10.48550/arXiv.2303.18223

 

  1. Chang Y, Wang X, Wang J, et al. A survey on evaluation of large language models. ACM Trans Intell Syst Technol. 2024;15(3):1-45. doi: 10.1145/3641289

 

  1. Raptis TP, Passarella A, Conti M. Data management in industry 4.0: State of the art and open challenges. IEEE Access. 2019;7:97052-97093. doi: 10.1109/access.2019.2929296

 

  1. Shafiq SI, Szczerbicki E, Sanin C. Proposition of the methodology for data acquisition, analysis and visualization in support of industry 4.0. Procedia Comput Sci. 2019;159:1976-1985. doi: 10.1016/j.procs.2019.09.370

 

  1. Jan Z, Ahamed F, Mayer W, et al. Artificial intelligence for industry 4.0: Systematic review of applications, challenges, and opportunities. Expert Syst Appl. 2023;216(216):119456. doi: 10.1016/j.eswa.2022.119456

 

  1. Goertzel B. Artificial general intelligence: Concept, state of the art, and future prospects. J Artif General Intell. 2014;5(1):1-48. doi: 10.2478/jagi-2014-0001

 

  1. Yandrapalli V. Revolutionizing supply chains using power of generative AI. Int J Res Publication Rev. 2023;4(12):1556-1562. doi: 10.55248/gengpi.4.1223.123417

 

  1. Lahat D, Adali T, Jutten C. Multimodal data fusion: An overview of methods, challenges and prospects. Proc IEEE. 2015;103(9):1449-1477. doi: 10.1109/jproc.2015.2460697

 

  1. Zhang S, Dong L, Li X, et al. Instruction Tuning for Large Language Models: A Survey. arXiv.org. doi: 10.48550/arXiv.2308.10792

 

  1. Gao Y, Xiong Y, Gao X, et al. Retrieval-Augmented Generation for Large Language Models: A Survey. arXiv.org. doi: 10.48550/arXiv.2312.10997

 

  1. Christiano PF, Leike J, Brown T, Martic M, Legg S, Amodei D. Deep Reinforcement Learning from Human Preferences. California: Neural Information Processing Systems; 2017.

 

  1. Ouyang L, Wu J, Jiang X, et al. Training language models to follow instructions with human feedback. Adv Neural Inf Process Syst. 2022;35:27730-27744.

 

  1. Yang F, Zhao P, Wang Z, et al. Empower Large Language Model to Perform Better on Industrial Domain-Specific Question Answering. In: Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing: Industry Track. Singapore. Association for Computational Linguistics; 2023. p. 294-312. doi: 10.18653/v1/2023.emnlp-industry.29

 

  1. Shazeer N, Mirhoseini A, Maziarz K, et al. Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of- Experts Layer. arXiv:170106538. doi: https://arxiv.org/abs/1701.06538

 

  1. Beurer-Kellner L, Fischer M, Vechev M. Prompting is programming: A query language for large language models. Proc ACM Program Lang. 2023;7:1946-1969. doi: 10.1145/3591300

 

  1. Reynolds L, McDonell K. Prompt Programming for Large Language Models: Beyond the Few-Shot Paradigm. In: Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems; 2021. doi: 10.1145/3411763.3451760

 

  1. Vaswani A, Shazeer N, Parmar N, et al. Attention is All You Need. United States: Neural Information Processing Systems; 2017.

 

  1. Chen M, Tworek J, Jun H, et al. Evaluating Large Language Models Trained on Code. arXiv:210703374; 2021. doi: https://arxiv.org/abs/2107.03374

 

  1. Xu FF, Alon U, Neubig G, Hellendoorn VJ. A Systematic Evaluation of Large Language Models of Code. In: Proceedings of the 6th ACM SIGPLAN International Symposium on Machine Programming; 2022. doi: 10.1145/3520312.353486
Share
Back to top
International Journal of AI for Materials and Design, Electronic ISSN: 3029-2573 Print ISSN: 3041-0746, Published by AccScience Publishing
We use cookies on our website to ensure you get the best experience.
Read more about our cookies here
Accept