Posted by Thomas Ezan – Sr Developer Relation Engineer (@lethargicpanda)
We’re excited to announce Gaze Hyperlink because the winner of the Finest Android App for our Gemini API Developer Competitors!
This revolutionary app demonstrates the potential of the Gemini API in offering a communication system for people with Amyotrophic lateral sclerosis (ALS) who develop extreme motor and verbal disabilities, enabling them to kind sentences with solely their eyes.
About Gaze Hyperlink
Gaze Hyperlink makes use of Google’s Gemini 1.5 Flash mannequin to foretell the person’s supposed sentence primarily based on just a few key phrases and the context of the dialog.
For instance if the context is “Is the room temperature okay?” and the person replies “sizzling AC two” the app will leverage Gemini to generate the complete sentence “I’m sizzling, are you able to flip the AC down by two levels?”.
The Gaze Hyperlink workforce took benefit of Gemini 1.5 Flash multilingual capabilities to let the app generate sentences in English, Spanish and Chinese language, the three languages presently supported by the app.
We have been actually impressed by the Gaze Hyperlink app. The workforce used the Gemini API mixed with ML Equipment Face Detection to empower people with ALS offering them with a strong communication system that’s each accessible and reasonably priced.
With Gemini 1.5 Flash presently supporting 38 languages, it’s attainable for Gaze Hyperlink so as to add help for extra languages sooner or later. As well as, the mannequin’s multimodal talents might allow the workforce to boost the person expertise by integrating picture, audio and video to enhance the context of the dialog.
Construct with the Gemini API
The results of the combination of the Gemini API in Gaze Hyperlink is inspiring. In case you are engaged on an Android app right now, we encourage you to study concerning the Gemini API capabilities to see how one can efficiently add generative AI to your app and delight your customers.
To get began, go to the Android AI documentation!
