Implement automation closing PRs and issues where the OP does not follow the expected template

[webknjaz]

Is your feature request related to a problem?

There's a lot of slop and this will hopefully encourage people think before posting.

Describe the solution you'd like

SSIA. It should be possible to implement a PoC based on GHA.

Describe alternatives you've considered

Closing spam manually.

Related component

GH Repo

Additional context

Examples of PRs not following the templates can be easily found among the recently closed ones. The templates are under .github/.

Code of Conduct

• I agree to follow the aio-libs Code of Conduct

[webknjaz]

@rodrigobnogueira in case you're looking for a fun exploratory infra task ^

[Dreamsorcerer]

I suspect that will cause more of a nuisance than it'd solve, but can experiment if someone wants to try.

[webknjaz]

Yeah, I'm envisioning it as an experiment. My ML friend had other ideas like looking at account's rejected vs merged vs still open PR ratios (GH-wise). But I think if we can determine that an issue/PR has the expected Markdown titles missing and auto-close, this will either encourage a human to read the contrib guidelines / instructions and re-submit properly + fill out more new issues/PRs having read of the expectations or they will just never return being a sloperator which is also good for us.

I think we'll return to this once jazzband/pip-tools#2318 is merged and other aspects of handling slop have been observed elsewhere.

[rodrigobnogueira]

@rodrigobnogueira in case you're looking for a fun exploratory infra task ^

Checking for missing key section titles sounds like a solid first step for the automation.
I think Copilot can already be added as an automatic reviewer on every PR (via rulesets or the Copilot settings), and could work well for catching 'low-effort' submissions. I can research a few projects that already do something similar and share examples.

🙏

[webknjaz]

https://github.com/louislam/uptime-kuma/blob/master/.github/workflows/pr-description-check.yml