Current European policies and the growing focus on sustainability show a clear need for defining and measuring aspects of sustainability at the food product level. The aim of this study was to develop an indicator-based framework to monitor the sustainability of fruits and vegetables. The framework includes production, packaging, transport, and distribution, and considers economic, ecological, and social aspects. The framework aims to be used by the food production and distribution sector and is intended to use specific data from the value chain for higher relevance for the food industry. Results of a sustainability assessment of carrots are presented, as the first example of application of the framework. Future research should focus on the framework’s validity when applied to other products and other countries.