Duplicate paragraph extraction when a long sibling paragraph is present #817
Description
Minimal reproducer:
<html>
<body>
<div id="content">
<p>
Authoritative taxonomy of but let's leave it as it is 1 2 3
</p>
</div>
<p>
some text long enough not to skip and printed twice on this line some text long enough not to skip and printed twice on this line
</p>
</body>
</html>
Expected output:
Authoritative taxonomy of but let's leave it as it is 1 2 3
some text long enough not to skip and printed twice on this line ...
Actual output:
Authoritative taxonomy of but let's leave it as it is 1 2 3
Authoritative taxonomy of but let's leave it as it is 1 2 3
some text long enough not to skip and printed twice on this line ...
Key observations:
duplication happens only if:
- paragraph length ≥ ~58 chars
- another long sibling paragraph exists