Join This Initiative!

Want to join one of our initiative projects? Visit this AI Alliance webpage and fill in the form. Thank you for your interest.

We welcome your contributions for cataloging existing evaluations and benchmarks, and for creating new ones. Improving our leaderboards and creating new ones is important for our mission of making evaluations accessible and as widely used as possible. Visit the initiative’s GitHub repo to see what tools and leaderboards are already implemented. See the issues and the work tracking project.

Here is the project dashboard filtered by labels for the main work streams:

• evaluations and building a taxonomy
• leaderboards

See also the companion projects, Evaluation Reference Stack and Achieving Confidence in Enterprise AI Applications, for related work.

The repo README explains more details for contributors, such as our “DCO” requirements, which you should understand first.

Making Smaller Contributions

You may not have the time or the expertise to be extensively involved, but you can easily make suggestions for small improvements. Contributing changes as pull requests is the best, welcome way to contribute. Alternatively, consider posting issues. (Browsing the issues is also a good place to find out where help is needed!)

For this documentation website itself, if you are interested in contributing to it, the sources are in the GitHub repo’s docs directory.

Notice that every page on this website has Edit this page on GitHub links, making it easy to view a page, then go straight to the source to make edits and submit a PR. This is the best way to help us fix typos and make other small improvements.

Finally, we welcome suggestions and feedback via email. Be sure to mention this particular initiative, as we have many AI Alliance projects.

---