Educational Personalized Learning Path Planning
with Large Language Models

Large Language Models (LLMs) have revolutionized the field of natural language processing with their ability to understand and generate human-like text. Recent surveys and comprehensive reviews have highlighted the capabilities and impact of LLMs like GPT-4 and LLama-2-70B in various domains, including education Zhou et al. (2022a, 2021a); Naveed et al. (2023); Wornow et al. (2023). These models leverage extensive training data and sophisticated architectures, such as transformers with attention mechanisms, to perform a wide range of language tasks with high accuracy and efficiency Voria et al. (2024); Zhou et al. (2022b); Zhou and Long (2023).

Prompt engineering has emerged as a powerful technique to harness the potential of LLMs by crafting specific input prompts that guide the model’s behavior without altering its underlying parameters. This approach has been shown to enable zero-shot and few-shot learning, reducing the need for task-specific training data and preserving the model’s general knowledge Hu and Wang (2024). In the context of education, prompt engineering can generate adaptive learning content and personalized feedback by incorporating learner-specific information into the prompts, making LLMs a valuable tool for personalized learning path planning Hu and Wang (2024); Zhou et al. (2021b).

Learning Path Planning (LPP) focuses on creating tailored educational experiences that adapt to the unique needs, preferences, and prior knowledge of individual learners. Traditional approaches to LPP, such as those using genetic algorithms, have been employed to optimize learning paths by considering factors like topic difficulty, duration, and learner performance Elshani and Nuçi (2021). These methods aim to enhance learning efficiency and outcomes by providing a sequence of educational content that is best suited to the learner’s current state and goals.

Recent advancements in LPP have leveraged knowledge graphs, machine learning, and artificial intelligence to create more dynamic and responsive learning environments. For instance, contextual knowledge graphs built using text mining and semantic graph completion techniques can provide personalized learning recommendations by analyzing the relationships between different learning concepts Abu-Rasheed et al. (2024). Moreover, integrating AI with educational frameworks, such as the FOKE framework, has demonstrated the potential to create interactive and explainable learning experiences that adapt in real-time to learner feedback and performance Hu and Wang (2024).

Overall, the integration of LLMs with advanced LPP techniques presents a promising avenue for developing sophisticated personalized learning systems that can significantly improve learner engagement and achievement.

The core of our method involves designing a series of prompts that guide the LLM to generate personalized learning paths. The prompts are crafted to capture essential learner-specific information and educational goals, ensuring that the recommendations are both relevant and effective. Below, we outline the primary prompts used in our approach:

Each prompt in our method is carefully designed to elicit specific information from the learner or to provide targeted recommendations. The inputs typically include learner-specific data such as current knowledge levels, challenges faced, and educational goals. The outputs are tailored recommendations or explanations that guide the learner through their personalized learning journey.

The use of LLMs combined with prompt engineering in PLPP offers several advantages:

1. Adaptability: LLMs can generate diverse and contextually relevant responses based on the input prompts, making the learning paths highly adaptable to individual needs. 2. Interactivity: The multi-turn dialogue approach allows for continuous refinement of the learning paths, ensuring that the recommendations remain relevant as the learner progresses. 3. Transparency: Embedding explanations within the prompts enhances the transparency of the recommendations, helping learners understand and trust the suggested paths.

In summary, our method leverages the strengths of LLMs and prompt engineering to create a flexible, interactive, and transparent PLPP system that can significantly improve personalized learning experiences.

We designed our experiments to assess the ability of the models to generate personalized learning paths that are both effective and user-friendly. The baseline method used straightforward prompts without any customization, while our proposed method utilized the carefully crafted prompts described in the Method section.

Data Collection: We collected a dataset comprising learner profiles, including their prior knowledge, learning goals, and feedback on educational content. The dataset was split into training and testing sets to evaluate the performance of the models.

Metrics: The primary metrics for evaluation included:

• •

  Accuracy: The correctness of the recommended learning paths.

• •

  User Satisfaction: Measured through surveys where learners rated the relevance and usefulness of the recommendations.

• •

  Quality of Learning Paths: Assessed based on the coherence and logical sequencing of the recommended concepts.

The experimental results are summarized in Table 1. Our method consistently outperformed the baseline across all metrics on both LLama-2-70B and GPT-4 models.

The experimental results clearly indicate that our proposed method significantly enhances the performance of PLPP systems. The increase in accuracy suggests that our prompt engineering approach helps the models generate more precise and relevant learning paths. Higher user satisfaction scores reflect that learners found the personalized paths more aligned with their individual needs and goals. Additionally, the improved quality of learning paths demonstrates that our method produces more coherent and logically sequenced recommendations.

To further validate our method’s effectiveness, we conducted an additional analysis focusing on the long-term impact of personalized learning paths on learner performance. We tracked a subset of learners over a period of three months to assess the sustained impact of the recommended paths. The results, summarized in Table 3, show a significant improvement in learner performance and retention rates, reinforcing the effectiveness of our approach.

The data indicates that learners who followed the personalized paths generated by our method not only performed better in assessments but also showed higher retention rates compared to those following the baseline paths. This highlights the long-term benefits of using prompt-engineered LLMs for educational purposes.

In conclusion, our experiments demonstrate the efficacy of integrating prompt engineering with LLMs for PLPP. The proposed method not only improves the accuracy and quality of learning paths but also enhances user satisfaction by providing clear, personalized, and trustworthy educational recommendations. Future work will focus on further refining the prompts and exploring additional metrics to capture the full impact of personalized learning path planning.