{"id":8956,"date":"2024-04-18T15:07:59","date_gmt":"2024-04-18T13:07:59","guid":{"rendered":"https:\/\/euroccitaly.it\/?p=8956"},"modified":"2024-04-19T10:11:44","modified_gmt":"2024-04-19T08:11:44","slug":"networking-with-eurocc-cyprus-an-intermediate-course-to-increase-the-efficiency-of-llms-with-pytorch","status":"publish","type":"post","link":"https:\/\/euroccitaly.it\/en\/networking-en\/networking-with-eurocc-cyprus-an-intermediate-course-to-increase-the-efficiency-of-llms-with-pytorch\/","title":{"rendered":"Networking with EuroCC Cyprus: an &#8216;intermediate&#8217; course to increase the efficiency of LLMs with PyTorch"},"content":{"rendered":"<p><span style=\"font-weight: 400;\">On April 19, 2024, we will participate in the training event &#8220;Accelerating Generative AI with PyTorch&#8221;, organized by the <\/span><a href=\"https:\/\/eurocc.cyi.ac.cy\/\" target=\"_blank\" rel=\"noopener\"><span style=\"font-weight: 400;\">Cyprus Competence Centre<\/span><\/a><span style=\"font-weight: 400;\">, featuring <\/span><b>Ivan Gentile<\/b><span style=\"font-weight: 400;\">, a data scientist from IFAB (International Foundation Big Data and Artificial Intelligence for Human Development).<\/span><\/p>\n<p><span style=\"font-weight: 400;\">The event will take place at the Cyprus Institute from 10:00 AM to 1:00 PM. Below is the agenda.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Speakers:<\/span><\/p>\n<ul>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Mr. Christodoulos Stylianou, Research Engineer (CaSToRC, The Cyprus Institute)<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Mr Ivan Gentile, Data Scientist (IFAB &#8211; NCC Italy)<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Dr Charalambos Chrysostomou, Associate Research Scientist (CaSToRC, The Cyprus Institute)<\/span><\/li>\n<\/ul>\n<p><span style=\"font-weight: 400;\">The tutorial aims to provide optimization techniques for Llama, a foundational Large Language Model (LLM) based on the Transformer Architecture, analogous to the GPT series. Noted for their human-like text generation capabilities, these models encounter challenges regarding efficiency and scalability due to their complexity and computational demands. The session intends to augment the operational efficiency of these models through PyTorch-native optimization strategies, including model compilation, GPU quantization, speculative decoding, and tensor parallelism. Participants will have the chance to evaluate the proposed optimizations in real-time on a real supercomputer.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Pre-requisites:<\/span><\/p>\n<ul>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Basic knowledge of Deep Learning, and programming in Python<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Additionally, some experience in using HPC systems is helpful (Linux shell, Slurm) but not mandatory<\/span><\/li>\n<\/ul>\n<p><span style=\"font-weight: 400;\">Participants are expected to provide a laptop with which they can access the HPC system.<\/span><\/p>\n<p><a href=\"https:\/\/eurocc.cyi.ac.cy\/accelerating-generative-ai-with-pytorch-training-event-2024\/\" target=\"_blank\" rel=\"noopener\"><span style=\"font-weight: 400;\">Go to the web page dedicated to the event &gt;<\/span><\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>On April 19, 2024, we will participate in the training event &#8220;Accelerating Generative AI with PyTorch&#8221;, organized by the Cyprus Competence Centre, featuring Ivan Gentile, a data scientist from IFAB (International Foundation Big Data and Artificial Intelligence for Human Development). The event will take place at the Cyprus Institute from 10:00 AM to 1:00 PM&#8230;.<\/p>\n","protected":false},"author":1,"featured_media":8951,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":"","_members_access_role":[],"_members_access_error":""},"categories":[18],"tags":[],"class_list":["post-8956","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-networking-en"],"_links":{"self":[{"href":"https:\/\/euroccitaly.it\/en\/wp-json\/wp\/v2\/posts\/8956","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/euroccitaly.it\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/euroccitaly.it\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/euroccitaly.it\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/euroccitaly.it\/en\/wp-json\/wp\/v2\/comments?post=8956"}],"version-history":[{"count":2,"href":"https:\/\/euroccitaly.it\/en\/wp-json\/wp\/v2\/posts\/8956\/revisions"}],"predecessor-version":[{"id":8959,"href":"https:\/\/euroccitaly.it\/en\/wp-json\/wp\/v2\/posts\/8956\/revisions\/8959"}],"wp:attachment":[{"href":"https:\/\/euroccitaly.it\/en\/wp-json\/wp\/v2\/media?parent=8956"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/euroccitaly.it\/en\/wp-json\/wp\/v2\/categories?post=8956"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/euroccitaly.it\/en\/wp-json\/wp\/v2\/tags?post=8956"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}