Close most PRs you receive by thanking them for their work, but that you don't agree with the direction they're taking your project, or when the code quality isn't up to your standards.
The most popular projects are ruled by tirans (Linus) because they feel the scope of a project. Trust your own judgement, you don't owe anyone anything.