Mobile devices and mobile services have been around long enough for the research community to start thinking about the next step in studying them: larger user groups and longer periods of time. Strictly quantitative methods are not very useful when it comes to studying user experience so we need to find scalable ways to support our qualitative methods to be able to take this next step. This paper reflects on automatic gathering of context data as one such way.