Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Incorrect GUI screenshots #22

Open
jmahmud47 opened this issue Jun 14, 2021 · 3 comments
Open

Incorrect GUI screenshots #22

jmahmud47 opened this issue Jun 14, 2021 · 3 comments
Labels
bug Something isn't working enhancement New feature or request

Comments

@jmahmud47
Copy link
Collaborator

If we take a look at the first augmented image, TraceReplayer can identify the GUI component easily.

Example:
Augmented Image 1:
image1_augmented

GUI Image 1:
image1_gui

However, TraceReplayer cannot identify the correct GUI component in all cases. If we consider the second image, the correct GUI component should be "Departments". However, TraceReplayer incorrectly identifies "Clothing" as the correct GUI component. We cannot even click this component and that component must not be considered. The screenshot is actually considering "Clothing" as the GUI component. But the screenshot is taken from the current screen and therefore, we got an incorrect GUI image. I think one possible solution can be to consider only the current actionable GUI components. What will the best approach to solving this problem?

Augmented Image 2:
image2_augmented

GUI Image 2:
image2_gui

@jmahmud47 jmahmud47 added the bug Something isn't working label Jun 14, 2021
@bee-tool bee-tool bot added the enhancement New feature or request label Jun 14, 2021
@kpmoran
Copy link
Collaborator

kpmoran commented Jun 14, 2021

@jmahmud47 could you please upload the script here so I can debug?

@jmahmud47
Copy link
Collaborator Author

@kpmoran The changes are in these two commits:

1ec152c

0c62cb6

I have made changes in UiAutoConnector.java, ReplayerFeatures.java, TraceReplayer.java files.

You can take a look at the latest commit for debugging.

@jmahmud47
Copy link
Collaborator Author

jmahmud47 commented Jun 18, 2021

@kpmoran This issue is resolved in 3f3cde4

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants