Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

SikuliX Stopped Working - running on secondary monitor #628

Open
D474designs opened this issue Aug 13, 2024 · 2 comments
Open

SikuliX Stopped Working - running on secondary monitor #628

D474designs opened this issue Aug 13, 2024 · 2 comments
Assignees
Labels
aSikulixIDE problems with IDE

Comments

@D474designs
Copy link

I have been using SikuliX for a long time now; Recently I opened SikuliX, and it would not get passed the loading screen.

I have tried every Java SDK build, including 21, 22, 17, 11, and 8; I have redownloaded SikuliX 2.0.5, and 2.0.6.

I have never had a problem before.

The last time I opened it, it ran for a little, and stopped working after the first action. I was also getting the "mouse... blocked" error, which I had not been getting beforehand.

Any help would be appreciated!

@D474designs
Copy link
Author

D474designs commented Aug 13, 2024

I got it back up, and running, on JDK 22; SikuliX seems to have a problem when running ONLY on a secondary monitor, this problem seems to exacerbate when using applications in full screen, and changing the screen setup.

I will update if I find out more on the specific problem, the only thing I could extrapolate from logs, was, the monitor setup was causing a hang up:
C:\Users\HP\OneDrive\Documents\Sikulix>java -jar sikulixidewin-2.0.6-20230417.153928-17.jar -v -c
[SXLOG 4.904] [debug] IDE starting
[SXLOG 5.039] [debug] IDE: IDE window reset to primary monitor - was (3832,-8 1616x886)
[SXLOG 8.321] [debug] JythonRunner: starting initialization
[SXLOG 8.324] [debug] IDE: starting GUI
[SXLOG 8.326] [debug] HotkeyManager: add Capture Hotkey: CTRL+SHIFT 2 (50, 192)
[SXLOG 8.413] [debug] IDE: Capture HotKey installed
[SXLOG 8.414] [debug] HotkeyManager: add Abort Hotkey: ALT+SHIFT C (67, 576)
[SXLOG 8.415] [debug] IDE: Stop HotKey installed
[SXLOG 8.825] [debug] IDE: Restore scripts from last session
[SXLOG 8.838] [debug] EditorPane: created 1723550685321
[SXLOG 8.853] [debug] EditorPane: loadfile: C:\Users\HP\OneDrive\Documents\Sikulix\AMFYTL.sikuli
[SXLOG 8.889] [debug] EditorPane: InitTab: (text/jython)
[SXLOG 8.900] [debug] ImagePath: new BundlePath: C:\Users\HP\OneDrive\Documents\Sikulix\AMFYTL.sikuli
[SXLOG 8.901] [debug] EditorPane: setFiles: for: C:\Users\HP\OneDrive\Documents\Sikulix\AMFYTL.sikuli
[SXLOG 8.922] [error] Region(4385,523,510,344) outside any screen - actions might not work
Exception in thread "main" java.lang.NullPointerException: Cannot invoke "org.sikuli.script.support.IScreen.capture()" because "_screen" is null
at org.sikuli.ide.EditorRegionButton.getRegionImage(EditorRegionButton.java:77)
at org.sikuli.ide.EditorRegionButton.(EditorRegionButton.java:34)
at org.sikuli.ide.EditorRegionButton.createFromString(EditorRegionButton.java:110)
at org.sikuli.ide.EditorPane.replaceWithImage(EditorPane.java:1069)
at org.sikuli.ide.EditorPane.parseLine(EditorPane.java:1042)
at org.sikuli.ide.EditorPane.parseRange(EditorPane.java:1022)
at org.sikuli.ide.EditorPane.parse(EditorPane.java:973)
at org.sikuli.ide.EditorPane.parse(EditorPane.java:975)
at org.sikuli.ide.EditorPane.doParse(EditorPane.java:960)
at org.sikuli.ide.EditorPane.loadFile(EditorPane.java:356)
at org.sikuli.ide.SikulixIDE.restoreScriptFromSession(SikulixIDE.java:573)
at org.sikuli.ide.SikulixIDE.restoreSession(SikulixIDE.java:544)
at org.sikuli.ide.SikulixIDE.startGUI(SikulixIDE.java:353)
at org.sikuli.ide.SikulixIDE.start(SikulixIDE.java:122)
at org.sikuli.ide.Sikulix.main(Sikulix.java:300)
[SXLOG 10.493] [debug] Jython: added as Jython::sys.path[0]:
C:\Users\HP\AppData\Roaming\Sikulix\Lib\site-packages
[SXLOG 10.495] [debug] Jython: found Lib/site-packages/sites.txt
[SXLOG 10.496] [debug] Jython: ***** sys.path
0: C:\Users\HP\OneDrive\Documents\Sikulix\AMFYTL.sikuli
1: C:\Users\HP\AppData\Roaming\Sikulix\Lib\site-packages
2: C:\Users\HP\OneDrive\Documents\Sikulix\Lib
3: C:\Users\HP\OneDrive\Documents\Sikulix\sikulixidewin-2.0.6-20230417.153928-17.jar\Lib
[SXLOG 10.697] [debug] JythonRunner: ready: 2.7.3

After this point, SikuliX will not load any further, the loading screen stays up, and no further information is thrown.

These two lines might be the only clue as to the issue I was able to resolve, by changing my screen configuration via Windows' Project Mode:
[SXLOG 8.922] [error] Region(4385,523,510,344) outside any screen - actions might not work
Exception in thread "main" java.lang.NullPointerException: Cannot invoke "org.sikuli.script.support.IScreen.capture()" because "_screen" is null

@RaiMan RaiMan self-assigned this Dec 11, 2024
@RaiMan RaiMan added the aSikulixIDE problems with IDE label Dec 11, 2024
@RaiMan RaiMan changed the title SikuliX Stopped Working SikuliX Stopped Working - running on secondary monitor Dec 11, 2024
@D474designs
Copy link
Author

Another nuance I noticed with the Region error, the screen positioning affects the grid which SIkuli X uses to dictate cursor location. After switching primary monitors, a resolution change, and moving the screens on their virtual plane, Sikuli X stopped loading completely with the, "...outside any screen..." error as the culprit. I was able to reverse the screen positions to offset the error.

I recommend a variable system which begins at the center median, and expands it's size from said point, until all screens are encompassed. This system would be similar to the existing system, which centers around a primary screen.

The edge cases being the change in resolutions, the change in screen positions on their virtual plane, and changing primary screens; The problem carried over to other versions of Sikuli X, indicating this was in fact a hard coded error.

The new system would correct the cursor being detected "outside," of range; Thank you for you work RaiMan!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
aSikulixIDE problems with IDE
Projects
None yet
Development

No branches or pull requests

2 participants