Projects

Machine learning, software development and robotics.

Projects

03 PROJECTS

Lernnavi — Disengagement Prediction

Predicting disengagement on a Swiss learning platform.

Lernnavi has no course end date or dropout label. The task is to distinguish sustained inactivity from school holidays.

Method

A two-stage pipeline predicts whether learners return after three weeks, then whether they enter an interruption of at least four weeks. Logistic regression, LightGBM and LSTM models are compared using twelve-week sequences, ablations and fairness analysis.

Results

The best Stage 2 model achieves an AUC-ROC of 0.9125, as reported in the README. Calendar features are important. Differences across cantons require careful interpretation; predictions are intended to support human decisions.

LightGBMPyTorch / LSTMFairness
Code & report ↗

Reinforcement Learning from Human Feedback

Comparing PPO-RLHF and DPO on CartPole and Pendulum.

How does the amount of preference data affect the learning of a control policy?

Method

Comparison of PPO-RLHF with a reward model and DPO without an explicit reward model. Paired trajectories and Bradley–Terry preferences are used, followed by evaluation on twenty distinct seeds in CartPole and Pendulum.

Results

Evaluation across twenty distinct seeds in discrete and continuous control environments. A group project with Martina Gatti and Bryan Gotti (EPFL, EE-568). Notebooks, poster and report are available in the repository.

PyTorchPPO / DPOGymnasium
Code & report ↗

Autonomous Forklift

An autonomous forklift with QR code recognition and web controls.

Automate the transport of a package to a destination encoded in a QR code.

Method

Camera-based QR recognition, ESP32/ESP8266/Arduino electronics, stepper motors and Mecanum wheels. Autonomous operation with gamepad and web controls.

Results

Hardware and software prototype built by a team of six for the EPFL CS-356 course. The repository documents the fabrication, components and operation of the system.

ESP32-CAMArduinoWeb control
Code & report ↗
All GitHub repositories ↗