The OpenAlex docs show that publisher is a possible attribute to group the sources, as detailed in the docs:
https://docs.openalex.org/api-entities/sources/group-sources
However, the link included at the top of the docs, which should group the sources by publisher, does not work.
https://api.openalex.org/sources?group_by=publisher