IEEE

Knowledge Distillation Using Deep Learning Techniques: A Survey

Abstract: In Deep Neural Networks (DNNs), optimization is necessary for adjusting model parameters to reduce the loss function, which directly affects the model’s performance. Effective optimization ...
IEEE

In-Context Learning in Large Language Models (LLMs): Mechanisms, Capabilities, and Implications for Advanced Knowledge Representation and Reasoning

Abstract: The rapid growth of Large Language Models (LLMs) and their in-context learning (ICL) capabilities has significantly transformed paradigms in artificial intelligence (AI) and natural language ...