Fitterfly Announces Home Digital Therapeutic That Uses AI to Analyze Images of Meals

Fitterfly

The digital therapeutics market is a growing segment of the pharmaceutical industry. As technology becomes not only more advanced, but more integrated into people’s daily lives, researchers are developing new ways for them to incorporate personal technology items in personal, home health routines.

Fitterfly announced that it has partnered with Google Cloud to develop Fitterfly Klik. This AI-powered feature will be part of the company’s digital food diary and allows users to take pictures of their food and receive detailed nutritional information. The app uses AI to identify the food items in the picture, determine portion sizes, and then provide detailed information about ingredients, macro- and micro-nutrient information, and other important health data.

The program was designed to be used by people managing type II diabetes, although it’s also useful for anyone managing their weight or heart disease.

In a press release, Fitterfly X-Labs head Ammar Jagirdar said, “With Gemini 1.5 Flash on Vertex AI connected with the Fitterfly Food Database, Klik makes meal logging possible in a few seconds, even with multiple dishes on a plate. Multimodal models today are surpassing traditional image classification methods in accuracy, even on a complex problem like food. Klik will reduce friction and help our users take another step in building healthier lifestyles."

In the same press release, Fitterfly co-founder and CEO Dr. Arbinder Singal said, “Indians eat more than 32 cuisines and a food cam AI was difficult to develop for both identification and serving size estimation. Paired with our industry leading food database, Klik is a step towards helping millions of people in making better choices and enabling better health outcomes. We will be making Klik available for our app users as well as via API to our insurance partners and the pharmaceutical industry."

Bikram Singh Bedi, Vice President and Country MD at Google Cloud India, added, "Combined with Fitterfly's dataset and Gemini's multimodal capabilities, both teams collaborated toidentify the right model to help bring this powerful idea to life in an extremely short duration. Leveraging Gemini Flash, Fiiterfly's Kilk is able to deliver exceptional quality, an expansive context window, and cutting-edge multimodal capabilities which will be very helpful for their users."

Klik is part of Fitterfly’s efforts to reimagine diabetes care. In January of this year, the company issued a report detailing how it plans to bring diabetes care in the digital care space throughout the year.²

At the time, Singal explained the company’s efforts, saying, “With every passing year we are seeing an increasing adoption and better outcomes of diabetes digital therapies in new age Indians. At Fitterfly, we are investing in customer centric innovations like AI Nutrition coaching and DTx plug-in for insurers, aggregators, pharma companies and hospitals towards a large impact and our vision of helping 1 billion people get better health outcomes in the next 10 years."

Fitterfly COO and co-founder Shailesh Gupta also said, “Digital therapeutics is poised to become the first line of therapy across the world and India is no exception. We are working on several projects which will make these therapies affordable to all people with diabetes irrespective of economic strata."

Sources

1. Fitterfly Partners with Google Cloud to Launch 'Klik'–An AI Food Cam Feature to Help People with Diabetes. Fitterfly. July 17, 2024. Accessed July 19, 2024. https://www.prnewswire.com/in/news-releases/fitterfly-partners-with-google-cloud-to-launch-klik---an-ai-food-cam-feature-to-help-people-with-diabetes-302198911.html
2. Fitterfly's Reimagining Diabetes Care Report 2024: Growing Adoption and Better Health Outcomes with Digital Therapeutics. Fitterfly. January 17, 2024. Accessed July 19, 2024. https://www.prnewswire.com/in/news-releases/fitterflys-reimagining-diabetes-care-report-2024-growing-adoption-and-better-health-outcomes-with-digital-therapeutics-302036605.html