Phd Position: Riemannian Geometry In Reinforcement Learning – Ai4I

PhD Position:iemannian Geometry in Reinforcement Learning – AI4IDeadlineDecember 17th **** at 12 (noon – CET)CurriculumHostile and Unstructured Environments (CODE *****), Topic number 1Hosting InstitutionAI4I – The Italian Institute of Artificial IntelligenceFunding SchemeThis doctorate grant is fully funded by The Italian institute of Artificial Intelligence (AI4I) in collaboration withUniversità degli Studi di GenovaPosition DescriptionThe Italian Institute of Artificial Intelligence (AI4I), in collaboration with Università degli Studi di Genova, invites applications for a PhD position in Riemannian Geometry in Reinforcement Learning as part of the PhD Programme in Hostile and Unstructured Environments.Reinforcement learning (RL) methods have been applied in a broad range of application domains, and represent one of the most successful learning paradigms for fine-tuning modern foundational models.However, most of RL methods work under the assumption that the states, actions and policy belong to Euclidean spaces.This PhD thesis is aimed at exploring how non-Euclidean geometries can be leveraged into the representation of states and actions in RL algorithms, and how such geometries impact the policy learning formulation.The first objective is to relax the Euclidean assumption on the formulation of a general RL problem via a Riemannian perspective.Later, the thesis will explore how methods like policy gradient need to be reformulated accordingly, and which advantages and challenges this new perspective brings in.Moreover, from a top-down approach, the next objective will be to leverage the Riemannian geometry of the Wasserstein space to understand, analyze and formulation policy learning methods based on Riemannian gradient flows and Wasserstein metrics.The thesis will explore applications of the developed methods in the control of physical systems such as robots or quadrotors, as well as the fine-tuning of foundational models, among others.RequirementsMust have skills:Excellent Master's degree in computer science, physics, mathematics, electrical or mechatronics engineering, or a related fieldStrong background in machine learning and roboticsGood programming skills in PythonFluent in spoken and written EnglishA team player, but also can work autonomouslyExperience with scientific writingGood to have skills:Background on (applied) differential geometryPublication of peer-reviewed research papersReferences3. G. Tennenholtz and S. Mannor, "Uncertainty Estimation Using Riemannian Model Dynamics for Offline Reinforcement Learning", NeurIPS, ****.Number of Positions Available1Application DocumentsOne-page cover letter including a short (two-paragraph) research proposal related to the PhD topic and aligned with your professional interests.Bachelor's and Master's diplomas with transcripts and grades.Main Research SiteAI4I –The Italian Institute of Artificial Intelligence for IndustryCorso Castelfidardo 22, ***** Torino, ItalyWhat We OfferAccess to high-performance computing resources and advanced research infrastructure.Opportunities for international collaboration and contributions to high-impact publications.A dynamic and interdisciplinary research environment.Financial support for attending international conference and Winter/Summer schools.Start Date1st March ****How to ApplyApplications for this position are managed by Università degli Studi di Genova.Please apply via the university's official PhD admissions portal:AI4I – The Italian Research Institute for Artificial IntelligenceAI4I has been founded to perform transformative, application-oriented research in Artificial Intelligence.AI4I is set to engage and empower gifted, entrepreneurial, young researchers who commit to producing an impact at the intersection of science, innovation, and industrial transformation.Highly competitive pay, bonus incentives, access to dedicated high-performance computing, state-of-the-art laboratories, industrial collaborations, and an ecosystem tailored to support the initiation and growth of startups stand out as some of the distinctive features of AI4I, bringing together people in a dynamic international environment.AI4I is an Institute that aims to enhance scientific research, technological transfer, and, more generally, the innovation capacity of the Country, promoting its positive impact on industry, services, and public administration.To this end, the Institute contributes to creating a research and innovation infrastructure that employs artificial intelligence methods, with particular reference to manufacturing processes, within the framework of the Industry 4.0 process and its entire value chain.The Institute establishes relationships with similar entities and organizations in Italy and abroad, including Competence Centers and European Digital Innovation Hubs (EDIHs), so that the center may become an attractive place for researchers, companies, and start-ups.Job detailsTitlePhD Position: Riemannian Geometry in Reinforcement Learning – AI4I:00 (Europe/Rome) :00 (CET)AI4I has been founded by the Italian Government to perform transformative application-oriented research in Artificial Intelligence.#J-*****-Ljbffr