Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add video segmentation feature #784

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

HendricksJudy
Copy link

Add video segmentation functionality to the project.

  • segment_anything/predictor.py

    • Add segment_video function to read video frames and segment objects using SamPredictor.
    • Import cv2 for video processing.
  • demo/src/App.tsx

    • Add state variable isVideo to handle video input.
    • Add handleVideoUpload function to process video files and call segment_video.
    • Update runONNX function to handle video frames if isVideo is true.
  • demo/src/components/Tool.tsx

    • Add isVideo prop to handle video input.
    • Update render method to display video frames if isVideo is true.
  • README.md

    • Add instructions for using the new video segmentation feature.

Add video segmentation functionality to the project.

* **segment_anything/predictor.py**
  - Add `segment_video` function to read video frames and segment objects using `SamPredictor`.
  - Import `cv2` for video processing.

* **demo/src/App.tsx**
  - Add state variable `isVideo` to handle video input.
  - Add `handleVideoUpload` function to process video files and call `segment_video`.
  - Update `runONNX` function to handle video frames if `isVideo` is true.

* **demo/src/components/Tool.tsx**
  - Add `isVideo` prop to handle video input.
  - Update `render` method to display video frames if `isVideo` is true.

* **README.md**
  - Add instructions for using the new video segmentation feature.
@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Oct 21, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants