Extract and Verify Book Titles from Bookshelf Photos using GPT-4o and Google Books

*Use Case: * Analyze images with multiple subjects. In this use case I have a bookshelf and am extracting and verifying book titles/authors from a bookshelf photo.

*How it works: *

1. Webhook receives an image url from a front end in which a user can upload a picture. In this use case, it is an image of a book shelf.
2. Edit Field (Set): Saves image in a consistent location so AI can find it.
3. Analyze Image: Image is analyzed. Extracts titles from the book spines
4. Code: Splits extracted subjects to single item to be able to validate each item separately. Books are individualized to their own entity
5. *HTTP Request *validates each subject. Queries Google Books to validate books in case only partial titles were found.
6. Edit Field (Set): Tidies the result.
7. Code: Aggregates and deduplicates Titles and authors are aggregate into a list
8. Respond to Webhook returns list to front end

How to use: Use with a frontend that can capture images and receive back the result. For this use case Supabase was used to store images from which the image analyzer could reference.