Constructing Automated Lesson Plan Generators from Visual Sketches Using a Multimodal Generative AI Approach
DOI:
https://doi.org/10.52060/mp.v11i1.3938Abstract
The high administrative burden in developing lesson plans poses a significant challenge to teacher efficiency. Although Generative Artificial Intelligence technology offers potential solutions, its adoption is often hampered by general system outputs that are not structured in accordance with curriculum regulations. This study aims to develop a precise and applicable AI-based learning plan generator using a Design-Based Research approach. The novelty of this study lies in its multimodal development method, which integrates visual-to-code interface conversion, the use of structured data templates, and the injection of a national curriculum knowledge base. The research procedure consists of five phases of the DBR cycle, from problem analysis to design reflection. The results show that the developed system is capable of automatically generating planning documents that include components of identification, learning design, learning experiences, and assessment in accordance with the Ministry of Education and Culture guidelines. The ecological validity of the product was proven through the implementation phase in a real context, where 141 independent access transactions were recorded through the digital distribution platform. The high level of user adoption, including through paid schemes, indicates that this product has high practical value and relevance as a solution for teacher administrative efficiency in the era of digital transformation.
References
Amankwah-Amoah, J., Abdalla, S., Mogaji, E., Elbanna, A., & Dwivedi, Y. K. (2024). The impending disruption of creative industries by generative AI: Opportunities, challenges, and research agenda. International Journal of Information Management, 79, 102759. https://doi.org/10.1016/j.ijinfomgt.2024.102759
Bayoudh, K., Knani, R., Hamdaoui, F., & Mtibaa, A. (2022). A survey on deep multimodal learning for computer vision: Advances, trends, applications, and datasets. The Visual Computer, 38(8), 2939–2970. https://doi.org/10.1007/s00371-021-02166-7
Cannas, V. G., Ciano, M. P., Saltalamacchia, M., & Secchi, R. (2024). Artificial intelligence in supply chain and operations management: A multiple case study research. International Journal of Production Research, 62(9), 3333–3360. https://doi.org/10.1080/00207543.2023.2232050
Emad Abou Elgheit. (2025). Generative AI as a Disruptive Innovation: Implications for Marketing Strategic Transformations. Foresight and STI Governance, 19(1). https://doi.org/10.17323/fstig.2025.24831
Fowler, S., & Leonard, S. N. (2024). Using design based research to shift perspectives: A model for sustainable professional development for the innovative use of digital tools. Professional Development in Education, 50(1), 192–204. https://doi.org/10.1080/19415257.2021.1955732
Gopal, A., Chen, P., Oh, W., Xu, S. X., & Sarker, S. (2024). On Crafting Effective Theoretical Contributions for Empirical Papers in Economics of Information Systems: Some Editorial Reflections. Information Systems Research, 35(3), 917–935. https://doi.org/10.1287/isre.2024.editorial.v35.n3
Gui, Y., Wan, Y., Li, Z., Zhang, Z., Chen, D., Zhang, H., Su, Y., Chen, B., Zhou, X., Jiang, W., & Zhang, X. (2025). UICopilot: Automating UI Synthesis via Hierarchical Code Generation from Webpage Designs. Proceedings of the ACM on Web Conference 2025, 1846–1855. https://doi.org/10.1145/3696410.3714891
Kementerian Pendidikan Dasar dan Menengah. (2024a). Panduan Mata Pelajaran dan Perangkat Ajar Kurikulum Nasional. Kurikulum Kemendikdasmen. https://kurikulum.kemendikdasmen.go.id/panduan-mapel
Kementerian Pendidikan Dasar dan Menengah. (2024b). Pembelajaran Mendalam: Menuju Pendidikan Bermutu untuk Semua. Kementerian Pendidikan Dasar dan Menengah. https://kurikulum.kemendikdasmen.go.id/file/1742214136_manage_file.pdf
Kovanovic, V., Azevedo, R., Gibson, D. C., & Ifenthaler, D. (2023). Unobtrusive Observations of Learning Processes. In V. Kovanovic, R. Azevedo, D. C. Gibson, & D. lfenthaler (Eds.), Unobtrusive Observations of Learning in Digital Environments: Examining Behavior, Cognition, Emotion, Metacognition and Social Processes Using Learning Analytics (pp. 3–6). Springer International Publishing. https://doi.org/10.1007/978-3-031-30992-2_1
Kwok, T. C. K., Kiefer, P., & Raubal, M. (2024). Unobtrusive interaction: A systematic literature review and expert survey. Human–Computer Interaction, 39(5–6), 380–416. https://doi.org/10.1080/07370024.2022.2162404
Matthews, S. H., Wang, D. (David), & Kelemen, T. K. (2024). No access? No problem! Taking stock of unobtrusive measures for executives’ deep-level characteristics. The Leadership Quarterly, 35(1), 101754. https://doi.org/10.1016/j.leaqua.2023.101754
Michel, L., & Van Hentenryck, P. (2025). Constraint-Based Local Search. In Handbook of Heuristics (pp. 389–426). Springer, Cham. https://doi.org/10.1007/978-3-032-00385-0_7
Mittal, U., Sai, S., Chamola, V., & Sangwan, D. (2024). A Comprehensive Review on Generative AI for Education. IEEE Access, 12, 142733–142759. https://doi.org/10.1109/ACCESS.2024.3468368
Napier, P., & Wada, T. (2024). Bridging the Skills Gap: The Design Education Landscape with AI and Experiential Learning. Design Management Journal, 19(1), 19–30. https://doi.org/10.1111/dmj.12094
Ng, D. T. K., Chan, E. K. C., & Lo, C. K. (2025). Opportunities, challenges and school strategies for integrating generative AI in education. Computers and Education: Artificial Intelligence, 8, 100373. https://doi.org/10.1016/j.caeai.2025.100373
Qin, Z., Chen, D., Zhang, W., Yao, L., Huang, Y., Ding, B., Li, Y., & Deng, S. (2025). The Synergy Between Data and Multi-Modal Large Language Models: A Survey From Co-Development Perspective. IEEE Transactions on Pattern Analysis and Machine Intelligence, 47(10), 8415–8434. https://doi.org/10.1109/TPAMI.2025.3576835
Rustiyana, R., Estede, S., Asmara, A., Litaay, M. L., Haryono, H., Rianty, E., & Juansa, A. (2025). Paradigma Baru Pendidikan Kontemporer: Teori, Isu, dan Relevansinya Pendidikan Abad 21. Star Digital Publishing.
Samala, A. D., Rawas, S., Wang, T., Reed, J. M., Kim, J., Howard, N.-J., & Ertz, M. (2025). Unveiling the landscape of generative artificial intelligence in education: A comprehensive taxonomy of applications, challenges, and future prospects. Education and Information Technologies, 30(3), 3239–3278. https://doi.org/10.1007/s10639-024-12936-0
Villegas-Ch, W., Govea, J., Albuja, R., Buenaño-Fernández, D., & Mera-Navarrete, A. (2024). Optimizing Automated Educational Systems: Adaptive Syllabus Generation and Precise Assessment Using Artificial Intelligence. IEEE Access, 12, 173390–173409. https://doi.org/10.1109/ACCESS.2024.3503532
Wang, Y., Luo, H., & Fang, W. (2025). An integrated approach for automatic safety inspection in construction: Domain knowledge with multimodal large language model. Advanced Engineering Informatics, 65, 103246. https://doi.org/10.1016/j.aei.2025.103246
Wei, J., Wang, X., Schuurmans, D., Bosma, M., Ichter, B., Xia, F., Chi, E., Le, Q. V., & Zhou, D. (2022). Chain-of-Thought Prompting Elicits Reasoning in Large Language Models. Advances in Neural Information Processing Systems, 35, 24824–24837. https://doi.org/10.52202/068431-1800
Yang, Y., Xu, C., Hou, W., McElligott, A. G., Liu, K., & Xue, Y. (2025). Transformer-based audio-visual multimodal fusion for fine-grained recognition of individual sow nursing behaviour. Artificial Intelligence in Agriculture, 15(3), 363–376. https://doi.org/10.1016/j.aiia.2025.03.006
Zhang, X., Zhang, P., Shen, Y., Liu, M., Wang, Q., Gašević, D., & Fan, Y. (2024). A Systematic Literature Review of Empirical Research on Applying Generative Artificial Intelligence in Education. Frontiers of Digital Education, 1(3), 223–245. https://doi.org/10.1007/s44366-024-0028-5
| Keywords | : |
Keywords:
Generative AI, Multimodal Design Approach, Lesson Plan Generator
|
| Galleys | : | |
| Published | : |
2026-06-02
|
| Issue | : |
Copyright (c) 2026 Jurnal Muara Pendidikan
This work is licensed under a Creative Commons Attribution 4.0 International License.
