Skip to content

Add cooking assistance with Gemini Live and grocery list feature#5

Open
marinacoelho wants to merge 8 commits into
mainfrom
marina/add-live-and-grounding-maps
Open

Add cooking assistance with Gemini Live and grocery list feature#5
marinacoelho wants to merge 8 commits into
mainfrom
marina/add-live-and-grounding-maps

Conversation

@marinacoelho
Copy link
Copy Markdown
Contributor

This PR adds the following screens / features:

  • Live Cooking Assistant screen: this screen is launched from the recipe screen. It starts a live session with Gemini Live, having the currently opened recipe as context. The prompt instructs the assistant to help with cooking that recipe, identify missing ingredients, and add them to the grocery list if the user asks the assistant to do so (prompt stored in Remote Config, as Server Prompt Templates are not yet available for live models).
  • Grocery List screen: the app now has a fourth tab that takes the user to a grocery list, where they can manually add ingredients they need to shop. Alternatively, users can ask the live cooking assistant to add ingredients as they're getting assisted in the cooking (this feature uses tool calling through Firebase AI Logic). Users can also tap on the "Add ingredients to Grocery List" button on any recipe to have the list of ingredients added to the list.
AssistantButton AssistantScreen GroceryList IngredientsButton

@marinacoelho marinacoelho requested a review from thatfiredev May 18, 2026 11:14
Copy link
Copy Markdown

@gemini-code-assist gemini-code-assist Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request introduces a Live Cooking Assistant feature utilizing Firebase AI Live sessions and a new Grocery List management system integrated with Firestore. Key changes include the addition of the LiveAssistantScreen and GroceryListScreen, refactoring the AIRemoteDataSource to use template models, and updating project dependencies like AGP and Kotlin. Feedback highlights critical performance concerns regarding image analysis and bitmap compression being performed on the main thread, which could lead to UI lag. Additionally, the reviewer noted several hardcoded strings that require internationalization and recommended adding error logging to a currently empty catch block in the live session setup.

Comment thread gradle/libs.versions.toml Outdated
Comment thread app/build.gradle.kts Outdated
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants