GPT4o Braze Marketing Platform Tests
Overall Assessment:
Certified Marketer: 10/10
Certified Digital Strategist: 9/10
Certified Digital Practitioner: 5/10
Certified Administrator: 7/10
Out of the box, GPT4o contains more marketing knowledge than anyone in your marketing department and it’s safe to say, more than your entire marketing department combined. When it comes to the Braze platform specifically though, GPT4o has the knowledge base of a mediocre admin. Just like a mediocre admin, the model will flat out make things up about the platform and spout it as pure fact.
This is a perfect instance where a little fine tuning could go a very long way. It would be very feasible and easy to put together a fine tuning dataset that brought GPT4o’s natural abilities above a 9 in every category. Without fine tuning, I would be reluctant to rely on the model to produce sufficient admin level outputs at all times. Ironically, I would be much more willing to trust the coding and SDK suggestions that the model makes.
If you need help creating HTML templates, working with code syntax within your emails, or brainstorming broad buyer personas, GPT4o has you solidly covered on every front. With just the minimal amount of RAG tuning, it can become your go to Liquid Syntax expert. Especially now that GPTs are free to all, there is really no reason to not do that. With a bit of fine tuning specifically on Braze level documentation, GPT4o could perform well above your average admin in terms of pure knowledge and guidance when it comes to the platform.
Full Test Results and Evaluation