Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

3D space gaussian clustering question #54

Open
smileyenot983 opened this issue Sep 9, 2024 · 2 comments
Open

3D space gaussian clustering question #54

smileyenot983 opened this issue Sep 9, 2024 · 2 comments

Comments

@smileyenot983
Copy link

Is this approach extendable into 3D gaussian-level clustering of gaussian. I mean without identity-alpha bleding and convolutional classifier layer.
For example, if I would like to create a map where key - track_id received from DEVA and values are the ids of gaussians

@smileyenot983
Copy link
Author

Upd. I found out that same conv network can be applied to 3d points as the input dimensionality(by default=16) is same.
Issue might be closed

@Caenorst
Copy link

Caenorst commented Dec 28, 2024

I just tried to extract a 3D segment by applying the classifier as a linear layer, but results are not great. Maybe I'm missing something?

classifier = torch.nn.Linear(16, 256, device='cuda')
state_dict = torch.load(classifier_path)
classifier.load_state_dict(OrderedDict(
    weight=state_dict['weight'][:, :, 0, 0],
    bias=state_dict['bias']
))

sel_id = 0

gaussians_logits = classifier(gaussians.get_objects)
gaussians_mask = torch.argmax(gaussians_prob, dim=-1).squeeze() == sel_id

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants