Chrome Extension for Losing Weight

Example of a chrome extension that takes a screenshot of the page and calculates the nutritional value of the meal.

How it works

For example, let’s say that you are planning a trip to a restaurant, but you want to be mindful of the number of calories and nutritional value of meals you’re going to choose. With this little chrome extension you can take a screenshot of the meal that you like. And with OpenAI Vision API we can learn how many calories, carbohydrates and proteins are in this specific meal. Because a lot of websites don’t list this information in their menu.

A chrome extension like this can work on any website where they have a visible menu, where you can take a screenshot of the mean like this.

You can see that the output of this extension is not structured, it is kind of random. So if you want to develop an app that actually summarizes the number of calories consumed during the day - we can use Model Tuning to standardize the output format. And that is something we can discuss in a later video. Thank you for watching :)

References