Have you ever stood in entrance of a redwood and puzzled, “Wouldn’t it be great if this was poetry instead of a tree?” Neither did Joyce Kilmer. Kelin Carolyn Zhang and Ryan Mather, nevertheless, have got down to bridge the hole between AI tech and poetry with their charming brainchild — the Poetry Camera. The open supply machine combines cutting-edge expertise with creative imaginative and prescient, leading to a creation that pushes the boundaries of each fields.
At first look, the Poetry Camera looks like one other gadget within the ever-evolving panorama of digital gadgets. However, upon nearer inspection, it turns into evident that that is no extraordinary digital camera. Instead of merely capturing pictures, the Poetry Camera takes the idea of pictures to new heights by producing thought-provoking poetry (or, properly, as thought-provoking as AI poetry can get) primarily based on the visuals it encounters.
Zhang and Mather, the masterminds behind this challenge, have seamlessly blended their experience in expertise and artwork to create a technically spectacular and aesthetically charming machine.
The story of the Poetry Camera started as a private ardour challenge for Zhang and Mather, who discovered themselves captivated by the concept of merging their love for expertise with their appreciation for the humanities. In the early levels of improvement, they spent numerous hours tinkering with varied elements and experimenting with completely different AI fashions to carry their imaginative and prescient to life.
“The project’s origin is when I got access to GPT-3. My first instinct was to play Dungeons & Dragons with it because I’m a nerd. I figured ‘if this thing could play Dungeons & Dragons, that would be impressive.’ And yeah, it did work for that. This was back when you had to do prompt engineering. So it took some elbow grease to get it to work. But I also had this idea of maybe making some camera as a project,” says Mather. “What if you took a camera, but it was a reaction to Instagram culture? What if text comes out instead of a photo? … Everyone prefers the book version over the movie, so it’s like that for capturing moments.”
As they refined their prototype, Zhang and Mather started to share their creation with family and friends at social gatherings. The reactions they acquired had been nothing in need of astonishing. People had been fascinated by the idea of a digital camera that would generate poetry primarily based on what it noticed. The machine shortly grew to become the focus, sparking vigorous discussions and igniting the creativeness of all who encountered it.
These preliminary reactions had been a strong motivator for Zhang and Mather to proceed refining their invention. They realized that the Poetry Camera had the potential to bridge the hole between expertise and artwork in a manner that resonated with folks. As phrase of the Poetry Camera unfold, the duo had been inundated with inquiries from curious people desirous to expertise the machine for themselves. This curiosity led them to think about the potential for remodeling their challenge into a possible business product, making the magic of the Poetry Camera accessible to a broader viewers.
The tech
At the guts of this modern machine lies a Raspberry Pi, a credit score card-sized single-board pc that packs a strong punch. This tiny but mighty part serves because the mind of the Poetry Camera, enabling it to seize pictures and talk with OpenAI’s GPT-Four to generate poetry.
A Raspberry Pi captures the picture after which employs pc imaginative and prescient algorithms to investigate the visible information. The AI fashions then interpret the picture, figuring out key components, colours, patterns and feelings throughout the body. This info serves as the inspiration for the poetry-generation course of.
Zhang pointed the digital camera at our Zoom interview:
Ryan Mather and Kelin Carolyn Zhang in an interview together with your correspondent. Image Credits: Screenshot from Zoom
And out got here a poem:
The poem generated and printed by Poetry Camera (transcribed beneath). Image Credits: Poetry…
