User Avatar

AI Product Leader 🦊 | Author http://Model47.com | Co-Founder #PrimaDonaStudios & #TowardsArcadia | Speaker | Writer🚢

RAI 25/100: AIR-BENCH
Jeremiah Marble

This one is really exciting!

For my own RAI work (25/100!), I've been compiling my own "prompt library" - and it's not simple.

So am mad envious at their 5,694 diverse prompts across 314 granular risk categories!!

I wish we could just download their prompts - but of course that would defeat the purpose, since every model-maker would do the same & game the system.

So will try to hook up a pipeline. Will slide into their repo....