{"id":4303,"date":"2026-01-29T11:13:49","date_gmt":"2026-01-29T10:13:49","guid":{"rendered":"https:\/\/u-paris.fr\/linguistique\/?page_id=4303"},"modified":"2026-07-08T14:06:02","modified_gmt":"2026-07-08T12:06:02","slug":"m1s2-theory-and-practice-of-large-language-models","status":"publish","type":"page","link":"https:\/\/u-paris.fr\/linguistique\/en\/m1s2-theory-and-practice-of-large-language-models\/","title":{"rendered":"Theory and Practice of Large Language Models (Master S2 Class)"},"content":{"rendered":"<p>[et_pb_section fb_built=\u00a0\u00bb1&Prime; _builder_version=\u00a0\u00bb3.22.1&Prime;][et_pb_row _builder_version=\u00a0\u00bb3.22.1&Prime;][et_pb_column type=\u00a0\u00bb4_4&Prime; _builder_version=\u00a0\u00bb3.22.1&Prime;][et_pb_post_title meta=\u00a0\u00bboff\u00a0\u00bb _builder_version=\u00a0\u00bb3.22.1&Prime;][\/et_pb_post_title][et_pb_text _builder_version=\u00a0\u00bb3.22.1&Prime;]<\/p>\n<h4>Basic information<\/h4>\n<ul>\n<li>Credits: 6<\/li>\n<li>Format: 4 hours weekly<\/li>\n<li>2026-2027 instructors: <a href=\"https:\/\/pages.llf-paris.fr\/~gwisniewski\/\" target=\"_blank\" rel=\"noopener noreferrer\">Guillaume Wisniewski<\/a><\/li>\n<li>2026-2027 schedule: TBD<\/li>\n<li><a href=\"https:\/\/moodle.u-pariscite.fr\/course\/view.php?id=70783\" target=\"_blank\" rel=\"noopener noreferrer\">Moodle page<\/a><\/li>\n<\/ul>\n<h4>Description<\/h4>\n<p>This lecture delves into the foundational theories and practical applications of advanced NLP techniques. Students will explore the architecture and training methods of (large) language models such as GPT and BERT. Through a combination of lectures, hands-on projects, and case studies, learners will understand how to implement, fine-tune, and deploy these models. Key topics include model scalability, ethical considerations, scientific questions raised by LLMs, analysis of neural representations, prompting, and retrieval-augmented generation (RAG). The course aims to equip students with both the theoretical knowledge and practical skills required to leverage large language models in various domains. By the end of the course, participants will be adept at handling complex NLP tasks and contributing to cutting-edge AI research.<\/p>\n<h4>Prerequisites<\/h4>\n<p>A very good knowledge of python is required: the course includes many practical exercises using the main NLP (Hugging Face \ud83e\udd17 &amp; spacy), deep learning (pytorch) and data science libraries (seaborn, pandas &amp; matplotlib).<br \/>Knowledge of the fundamentals of statistical learning (train\/test separation, linear classifier, loss function, etc.) is also required.<\/p>\n<h4>Learning outcomes<\/h4>\n<p>On successful completion of this course, students should:<\/p>\n<ul>\n<li>be able to explain the inner workings of models such as ChatGPT;<\/li>\n<li>know the main methods for developing \u201cmodern\u201d NLP systems: fine-tuning &amp; prompting;<\/li>\n<li>understand the scientific issues raised by LLMs;<\/li>\n<li>be able to describe the capabilities and limitations (particularly ethical and social) of LLMs.<\/li>\n<\/ul>\n<p>[\/et_pb_text][\/et_pb_column][\/et_pb_row][\/et_pb_section]<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Basic information Credits: 6 Format: 4 hours weekly 2026-2027 instructors: Guillaume Wisniewski 2026-2027 schedule: TBD Moodle page Description This lecture delves into the foundational theories and practical applications of advanced NLP techniques. Students will explore the architecture and training methods of (large) language models such as GPT and BERT. Through a combination of lectures, hands-on&hellip; <a class=\"continue\" href=\"https:\/\/u-paris.fr\/linguistique\/en\/m1s2-theory-and-practice-of-large-language-models\/\">Lire la suite<span> Theory and Practice of Large Language Models (Master S2 Class)<\/span><\/a><\/p>\n","protected":false},"author":609,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"_et_pb_use_builder":"on","_et_pb_old_content":"","_et_gb_content_width":"","footnotes":""},"coauthors":[114],"class_list":["post-4303","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/u-paris.fr\/linguistique\/wp-json\/wp\/v2\/pages\/4303","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/u-paris.fr\/linguistique\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/u-paris.fr\/linguistique\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/u-paris.fr\/linguistique\/wp-json\/wp\/v2\/users\/609"}],"replies":[{"embeddable":true,"href":"https:\/\/u-paris.fr\/linguistique\/wp-json\/wp\/v2\/comments?post=4303"}],"version-history":[{"count":4,"href":"https:\/\/u-paris.fr\/linguistique\/wp-json\/wp\/v2\/pages\/4303\/revisions"}],"predecessor-version":[{"id":7004,"href":"https:\/\/u-paris.fr\/linguistique\/wp-json\/wp\/v2\/pages\/4303\/revisions\/7004"}],"wp:attachment":[{"href":"https:\/\/u-paris.fr\/linguistique\/wp-json\/wp\/v2\/media?parent=4303"}],"wp:term":[{"taxonomy":"author","embeddable":true,"href":"https:\/\/u-paris.fr\/linguistique\/wp-json\/wp\/v2\/coauthors?post=4303"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}