Jeremiah Marble
1y ago
This one is really exciting!
For my own RAI work (25/100!), I've been compiling my own "prompt library" - and it's not simple.
So am mad envious at their 5,694 diverse prompts across 314 granular risk categories!!
I wish we could just download their prompts - but of course that would defeat the purpose, since every model-maker would do the same & game the system.
So will try to hook up a pipeline. Will slide into their repo....
It could be this? https://huggingface.co/datasets/stanford-crfm/air-bench-2024
Since - i'm not trying to judge a base model, but rather "my own" AI system that leverages an LLM/model. So presumably "my own" would have a different (ideally, better??) score than what I'm using?
Here is the original paper: https://arxiv.org/abs/2407.17436
Jeremiah Marble
1y ago
Did you know that (as of today) you could CALL CHATGPT?
Today, OpenAI dropped a toll-free number 1-800-CHATGPT (1-800-242-8478).
We can test it out for 15 free mins/ month (and you can WhatsApp ChatGPT as well).
The fun thing about doing these hashtag#RAI posts (24/100 today!) - is I get to play around with it. Today, let's try my first LinkedIn video, as I call ChatGPT (and realize once again how insignificant I am in the universe :).
It's ok though - for those of you out there trying to build AI systems responsibly, now we get YET ANOTHER input type to test out.
Have fun!
