Unlocking the Power of GPT-4 Vision with Zapier and MindStudio: Unleash Incredible Automations!
In this video, I am going to show you how to build something so amazing. We're going to be able to upload a set of handwritten notes from a meeting, use AI to interpret what's in those notes, convert that to actual text, and then distribute the notes from the meeting to anybody else who is in the meeting. And all of this is going to be powered by MindStudio by Uaii, who is also the sponsor of this video. So, I'm going to show you how to do all of this step by step. Let's go!
Creating a MindStudio Account
If you don't already have a MindStudio account, that is the first thing you're going to need to do. So go ahead and sign up with MindStudio. The other thing we're going to be using is Zapier, and MindStudio has a fantastic Zapier integration. So first sign up for MindStudio, we'll get to Zapier in a minute.
Once you do that, you're going to come to the "My AI" section and then click "New AI." Right here, we're going to click "Start from scratch." MindStudio is extremely sophisticated. It allows you to do a whole bunch of automations using artificial intelligence. It's really cool.
Setting Up the Full Automation
The first thing we're going to do is set up the full automation. We're going to go over and click this little "Automations" button. Then we have the start node, and then we're going to add a node right here. We're going to do user input because the first thing we want to do is allow the user to upload the picture of the notes.
Then we're going to click this little plus button and we're going to say "create new". What we want to do is allow for images, so upload image right there. Where it says "variable", we're going to change that to "image". Instead of "label text" - this is basically the text to tell the user what to do - we're going to say "please upload your image" and everything else should be the same.
Now let's click back to main.flow and now this user input is ready. Next, we need to interpret what's in the image, and we're going to be using GPT-4 with vision to do that. You will need an OpenAI API key to do that. So open up OpenAI, create a new key, then I'm going to call this "notes", create secret key, I'm going to copy it, and I am going to revoke this API before I publish the video.
Then we're going to add another node, and we're going to want to run a function. Okay, so we click on that, then we're going to say "browse community functions". We're going to scroll down a little bit, and we're going to find GPT-4 vision right there. Then we're going to import it, we're going to paste in our OpenAI API key, and then right here, we're going to actually insert a variable by doing "{{image}}" and that'll reference the image that the user just uploaded. And then for the response data variable, we'll call that "output", and that should be good to go.
Now we have the start, we have the user input, then we have the analysis from GPT-4 vision, and then we need to do a few other things. Once we get a response back from GPT-4 Vision, we need to do something with it. And what we're going to be doing is taking the text from the image - the notes - and then using that in the later nodes. So click plus right here, then we're going to select "send message".
Right here, what we're going to do is we're going to reference the output, so "{{output}}", and then at the bottom, we're going to say "only write the text". And then what we're going to do is rather than displaying to the user, we're going to assign it to a variable, and we'll call that variable "the text", and that is going to be the text of the image.
Using Zapier for Automation
Next, we're going to be using Zapier. So navigate over to Zapier.com, log in or sign up, and we're going to create a zap from scratch. Now click on "Trigger" and we're going to select "Webhook". Then choose an event, and we're going to say "catch hook" because we're looking for webhooks. Now it is listening. Go back to our application. So then you come up to the top right and click "Preview Draft".
You're going to land here, click "Open", and if you don't see this, go ahead and click "New" in the top right and it'll show you. We're going to click here and I'm going to upload a sample image of some notes. Then I click "Next". Now it's uploading. Perfect! Now that should be in Zapier.
Now we're going to create another node of Zapier. This is what's going to take all that text and send it out to different email addresses. So we select "Run Function", we're going to look for "Browse Community Functions", we're going to scroll down and look for Zapier. It's all the way at the bottom - Zapier Webhook. Then import.
Right here, where it says "Zapier webhook URL", you're going to paste in what we just copied. Now we're going to reference that final text one variable, and this will make sense in a minute. Now that that's set up, we're going to switch back to Zapier. We're going to say "Test Trigger", and now it's listening.
Testing the Automation
Now we go back to our application. So then you come up to the top right and click "Preview Draft". You're going to land here, click "Open", and if you don't see this, go ahead and click "New" in the top right and it'll show you. We're going to click here and I'm going to upload a sample image of some notes. Then I click "Next". Now it's uploading. Perfect! Now that should be in Zapier.
Now we're going to create another node of Zapier. This is what's going to take all that text and send it out to different email addresses. So we select "Run Function", we're going to look for "Browse Community Functions", we're going to scroll down and look for Zapier. It's all the way at the bottom - Zapier Webhook. Then import.
Right here, where it says "Zapier webhook URL", you're going to paste in what we just copied. Now we're going to reference that final text one variable, and this will make sense in a minute. Now that that's set up, we're going to switch back to Zapier. We're going to say "Test Trigger", and now it's listening.
Conclusion
After all the Zapier stuff happens, we're going to click a new node. We're going to send a message, and we're just going to say "Email sent to your list. Thank you!" And we're going to display it to the user, rather it being sent from the user, we're going to send it from the system. And that should be good, we're done.
Now that we're done, let's test it. I don't want it to be called "Untitled", so let's go ahead and say "Notes Sender". And there are a bunch of settings in here that you can play around with, but we're not going to do that right now. Then we just click "Publish", and once we publish it, here it is, it's ready to go. We can share this with anybody.
If you liked this video, please consider giving a like and subscribe. And I'll see you in the next one!
Frequently Asked Questions
-
What is MindStudio?
MindStudio is an artificial intelligence platform that allows you to create automations using sophisticated AI technologies.
-
Do I need an OpenAI API key to use GPT-4 Vision?
Yes, you will need an OpenAI API key to utilize GPT-4 Vision for image interpretation.
-
Can I customize the email addresses to send the transcribed notes?
Yes, you can configure the email addresses to which the transcribed notes will be sent using Zapier.
-
Is Zapier integration available in MindStudio?
Yes, MindStudio has a fantastic Zapier integration, allowing seamless automation workflows.
-
Can I use MindStudio for other types of automations?
Absolutely! MindStudio is a versatile platform that supports a wide range of automation tasks using AI.
