Arnaud Ruymaekers

Computer scientist and PhD Student
at the Università di Genova.

About me

I'm Arnaud Ruymaekers, a PhD student in computer science at the Università di Genova. I currently work within the PiMLB unit (Physics informed Machine Learning for biological Behavior) of the Malga lab (Machine Learning Genova Center).

  • Name: Arnaud Ruymaekers
  • Age: 26
  • Occupation: PhD Student

My research focuses on model-based reinforcement learning applied to olfactory navigation in turbulent environments. I primarily work with Partially Observable Markov Decision Processes (POMDPs) to develop solutions that simulate animal behaviors, helping to improve our understanding of how their sense of smell functions.

I completed my Master's degree at the Università di Genova in March 2024, where I conducted my thesis on olfactory navigation. Before that, I earned a Bachelor's degree in Data Science and Knowledge Engineering from Maastricht University. During my undergraduate studies, I participated in the Honours Program Ke@Work, which gave me the opportunity to gain hands-on experience at Open Line. I spent two years there as an intern, completing my Bachelor's thesis at the company, and subsequently continued working as a consultant for three years. In this role, I specialized in Business Intelligence as a Data Engineer.

I have a strong passion for programming and a broad curiosity for various topics in computer science. During my Bachelor's degree, I primarily worked with Java, but during my internship at Open Line, I gained experience with Python and SQL for database manipulation. I also worked extensively with ETL tools in the Microsoft Azure suite, particularly Databricks and PySpark, handling large-scale data processing. At Open Line, I also deepened my understanding of source control and development cycles, contributing to the design of a robust DevOps release pipeline aimed at maximizing data availability while ensuring a smooth development process for the Business Intelligence team.

Projects


Experience

  • PhD Student

    Malga (Machine Learning Genova Center) at Università di Genova

    PhD Program in Computer Science and Systems Engineering

    I am currently working on my PhD in Computer Science at the Università di Genova. My research focuses on model-based reinforcement learning applied to olfactory navigation in turbulent environments. I primarily work with Partially Observable Markov Decision Processes (POMDPs) to develop solutions that simulate animal behaviors, helping to improve our understanding of how their sense of smell functions.

  • Research Contract

    Malga (Machine Learning Genova Center) at Università di Genova

    I worked within the PiMLB unit (Physics-informed Machine Learning for Biological Behavior) at Malga (Machine Learning Genova Center). Within this group, I focused on olfactory navigation, particularly on model-based algorithms. These algorithms aim to find optimal strategies for agents to locate the source of an odor. This research consists in a follow-up to the research I have performed for my Master's thesis.

  • ICT Consultant

    Open Line

    I helped maintain and further develop the Business Intelligence (BI) infrastructure of the company using Microsoft Azure services. The BI team was responsible for the Extract, Transform, and Load (ETL) process of the company's data. The ETL process was built using Databricks, DataFactory, and the SSIS package within Microsoft Visual Studio.

    I also developed software frameworks to accelerate data processing across various databases. These frameworks were designed to simplify the daily operations of the BI team.

    Additionally, I managed and improved the CI/CD pipeline within the team's DevOps environment to ensure the smooth and efficient deployment of new features.

  • Intern - Honour's Program (Ke@Work)

    Open Line and Maastricht University

    As part of the Honours program in the Data Science and Knowledge Engineering Bachelor's at Maastricht University, I integrated into the Business Intelligence (BI) team at Open Line. During my internship, I worked on projects related to Data Science and Optimization.

    I developed a model for time-series forecasting to predict the volume of calls various teams would receive over specific periods.

    My largest project, which also served as my Bachelor's thesis, focused on an Operations Research problem. I developed an Integer Linear Programming (ILP) solution to suggest improvements in the virtualization of storage. These suggestions were regularly monitored to apply necessary changes. The algorithm's recommendations resulted in significant cost savings on a monthly basis.

    Additionally, the solutions I proposed needed to be efficient enough to run daily as part of the morning Extract, Transform, and Load (ETL) process. This integration allowed the solutions to leverage fresh data each day, providing the most up-to-date suggestions and predictions.

  • Treasurer - Student Association Board Member

    MSV Incognito - Maastricht University

    As the treasurer for the student association for two years (boards 25 and 26), I successfully managed the organization's finances, ensuring smooth execution of highly successful events. I balanced keeping event prices as low as possible for students, since the organization is non-profit, while also maintaining enough funds to plan even more exciting events.

    During my time at MSV Incognito, I also led the yearbook committee, guiding a team responsible for capturing event photos and writing entertaining summaries to create lasting memories for all the students in the yearbook.

  • Student Ambassador

    Maastricht University

    As a student ambassador for Maastricht University, I promoted my study program (Data Science and Knowledge Engineering) and the university to prospective students. As part of this role, I assisted during Open Days by sharing my experience as a student and tutoring a programming exercise for high school students. I also guided prospective students participating in the "Student for a Day" activity, helping them experience a typical day at the university and giving them a glimpse of what they could potentially be part of in the coming years.

Education

  • PhD Student

    Malga (Machine Learning Genova Center) at Università di Genova

    PhD Program in Computer Science and Systems Engineering

    I am currently working on my PhD in Computer Science at the Università di Genova. My research focuses on model-based reinforcement learning applied to olfactory navigation in turbulent environments. I primarily work with Partially Observable Markov Decision Processes (POMDPs) to develop solutions that simulate animal behaviors, helping to improve our understanding of how their sense of smell functions.

  • Master of Science (MSc) in Computer Science

    Università di Genova

    Track: Data Science & Engineering - Artificial Intelligence

    During my Master's degree, I deepened my knowledge in data science and machine learning, exploring topics such as Computer Vision, Natural Language Processing, Speech Processing and Recognition, Multi-Agent Systems, and Computer Games. The various projects I worked on for these subjects can be found on the Project Page.

    I also joined the PiMLB unit (Physics-informed Machine Learning for Biological Behavior) at the Malga Lab (Machine Learning Genova Center) to work on my Master's thesis.

    Thesis Title: "Navigating by Scent: A Model-Based Approach to Olfactory Navigation using Partially Observable Markov Decision Processes" (Supervisors: Prof. A. Seminara; Prof. A. Verri) (Open in new tab )
    Short Summary: A solution to the olfactory navigation problem using a model-based reinforcement learning framework: Partially Observable Markov Decision Processes (POMDPs). A multithreaded, GPU-accelerated implementation of the Point-Based Value Iteration (PBVI) solver was developed, which led to the observation of casting and surging behaviors. Additionally, some potential shortcomings of the technique were identified.
    Final Grade: 110/110 (cum Laude)

  • Bachelor of Science (BSc) in Data Science and Knowledge Engineering

    Maastricht University

    During my Bachelor's, I learned the fundamentals of Computer Science and applied Mathematics in this field. I also explored the areas of Data Science and Machine Learning.
    The programming languages I worked with during the degree included Java, SQL, Matlab, and Python.

    I participated in the Honour's program Ke@Work for two years, where I was placed at Open Line as an intern. My Bachelor's thesis was also written as part of this program and was tailored to meet the company's needs.

    Thesis Title: "Pareto Optimal State Search Using Simulated Annealing" (Supervisor: Dr. G. Stamoulis)
    Short Summary: An Operation Research problem solved by Simulated Annealing and Integer Linear Programming.
    Final Grade: 8.43/10

  • Exchange Year in the USA

    Shakopee High School (WEP)

    I was an exchange student for a year with the organization WEP, spending part of my senior year of high school to become fluent in English and prepare for my studies at Maastricht University.
    During this year, I took courses such as AP Calculus and Web Design, among others. I also participated in the Robotics Club and was a member of the Swimming team.

  • High School

    Athenée Royal de Waremme

    Option: Science with advanced Math (8h/week)
    During high school, I followed the Science track with an advanced Math placement. In addition, I was part of an advanced Dutch-language program, which included more Dutch classes than the standard curriculum.