Welcome Back to the /promptcollective!
Join us again as we dive into AI's realm, exploring a new blend of technology and creativity. Here, we see how GPT-4's ability to understand images merges with the talents of human composers.
GPT-4's New Vision
GPT-4 isn't just about words anymore; it now understands images too. But it does more than just see pictures; it interprets them. Think of GPT-4 as an expert in art and details, capable of diving deep into the stories and meanings behind photos, whether they're historic or scientific.
We at the /promptcollective are always on the lookout for how AI and human creativity can work together. Recently, we wondered: Can GPT-4 turn a picture into another medium? And the first thing that came to mind is if can turn a picture into music?
From Picture to Music
We asked GPT-4 to look at an image and describe music that matches it. GPT-4 can't actually 'hear,' but it can use the image to create a detailed description of what the music could be like. It’s pretty much crafting a descriptive musical blueprint from the essence of an image.
The Collaborative Concerto
The music ideas from GPT-4 are just the start. A human composer then takes these ideas and transforms them into a full musical piece, filled with emotion and personal touches.
Our composer, equipped with GPT-4's outline, faces the challenge of infusing it with uniqueness, but also with working within a framework defined by a piece of tech. This process resembles the approach of some artists, who use technological limitations to foster new expressions.
Our Experiment: The "Cactus Towers"
We showed GPT-4 a photo of Copenhagen's “Cactus Towers” and asked for a music concept. GPT-4 provided a detailed description, but no sheet music. The composer didn’t see the image but used GPT-4's description to create a track. Here’s the picture and the description of the music piece.
And then we left it to the composer to work from there, and now:
World Premiere: A Human-AI Photographic and Musical Collaboration
Experience the first-of-its-kind human-AI collaborative symphony. Listen with headphones or speakers or however, you normally listen to your favorite tunes and immerse yourself in “Structures in Symmetry.“ Here at the /promptcollective we think it’s a certified “Bainger.”
Finding New Paths in Music
GPT-4 usually aims for broadly appealing ideas, but in this experiment, the composer's creativity was key. Embracing AI's suggestions and working within certain limits led to fresh, unexpected musical paths.
Something I Loved This Week
Rapid advancements are transforming the AI video field. Check out pika.art and their vision to empower everyone to direct their own stories, bringing out the creator in each of us. They've recently raised $55 million to embark on this ambitious journey.
Until Next Time
Thanks for being with us. At the /promptcollective, founded by Jes Brandhøj and Hannes Jakobsen, we're all about blending AI with creativity. Want to join the adventure? Contact us at join@promptcollective.xyz.
And don’t forget to subscribe for more creative journeys!
The /promptcollective