Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Investigate if continuous slice of frames with the same subtitles can be detected faster using cv solution #7

Open
devmaxxing opened this issue Jan 30, 2022 · 2 comments

Comments

@devmaxxing
Copy link
Owner

If so, then PaddleOCR only needs to be run on one frame per subtitle.

@SWHL
Copy link

SWHL commented May 3, 2022

  • I have the same idea. So I create the RapidVideOCR repo.
  • Welcome to study together.

@devmaxxing
Copy link
Owner Author

devmaxxing commented May 3, 2022

@SWHL Sure. I'm trying to focus on another project at the moment but will definitely come back to this later. In the meantime, I guess some vague initial ideas I had on this was:

  • we could loop through each frame, checking against and adding to a single "accumulator" frame for each iteration. If we detect a subtitle change, then we process the accumulator frame and replace it with the current frame. If no subtitle change is detected, then we incorporate the current frame into the accumulator frame
  • background pixels from previous frames could be useful for removing noise on the current frame
  • it's ok if there are occasional false positives (identifying a frame as a subtitle change when it is not), just need to have some post processing that takes them into consideration like merging duplicate consecutive frame subtitles and subtitles with durations that are too short
  • maybe there's some existing research papers that solves similar problems (isolation of static shapes in a video feed) out there

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants