ASEP Capstone (in progress)
My capstone is the first project where the idea, the design and the build are all mine. It grew out of my ASEP internship, where I first started working with vision-language models (VLMs), and it is supported by SPS and the ASEP program.
The problemVLMs are often presented as the thing that will make robots more versatile, because in theory they can understand a scene and navigate it as it changes. That claim has not been tested very thoroughly, especially in environments that move and shift around the robot.
The solutionBuilding on designs from past research, I am testing whether a VLM can navigate dynamic environments zero-shot, with no task-specific training. Where it can't, I want to find out which changes actually help.
I’ve gone through a lot of iterations on this project, and the biggest change has been in how I make decisions. On earlier projects my goal was to get the thing working at any cost. Here I set boundaries for the experiment at the start, and every design choice has to fit inside them. If a fix makes the robot look better but breaks the rules of the test, it doesn’t count.
Working this way is slower, but I trust the results more, and I have started to think about my work as an experiment and not only as a build.