MY THOUGHTS ON "BE LIKE A GOLDFISH, DON'T MEMORIZE!"
Training large language models (LLMs) on vast datasets is a double-edged sword. While we want them to learn general patterns, we must strictly avoid the verbatim memorization of sensitive data from the training corpus. A ‘24 NEURIPS paper titled “Be like a Goldfish, Don’t Memorize!” (Hans et al. 2024) introduces a surprisingly simple approach to address this issue: the Goldfish Loss.
CYCLING TO HEŘMÁNKY NAD ODRU📍
I wanted to visit Silesia for a loooong time, as part of my family origins lie there and the stories about the beautiful landscape and rich culture have long captivated me. In October I had 20 days off from work and set out for an autumn adventure. My goal was simple: reach my grandma’s birthplace in Heřmánky 281 by bike 1, visit the best of Czech Republic along the way, and end my trip in Poland. This journey led me through fairytale forests, across the rolling hills of Moravia and over the Fichtel Mountains.
TIMELAPSE OF WRITING A THESIS IN 180 DAYS🎓
While procrastinating on my thesis research, I came across a timelapse of a research paper in the making by Tim Weninger. I wanted to create a video similar to his but for my own thesis.🥳
ISOMETRIC ILLUSION✨
While doing my attractors project, I accidentally came across the drawings by M.C. Escher. I have seen some of his drawings earlier at a friend’s house, but didn’t realize that they were actually created by him. I stuck with the idea of creating impossible objects in Blender by myself but couldn’t think of a proper scene setup.