Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

S3 Permission Denied when attempting to Exztract qt5-install #77

Open
ghost opened this issue Oct 13, 2021 · 16 comments
Open

S3 Permission Denied when attempting to Exztract qt5-install #77

ghost opened this issue Oct 13, 2021 · 16 comments

Comments

@ghost
Copy link

ghost commented Oct 13, 2021

NOte: I'm building on an 18.04/Ubuntu system.

During the "Downloading Qt from AWS" portion of the build, I received a "Connection reset by peer"
Checking the S3/URL, I noted:

This XML file does not appear to have any style information associated with it. The document tree is shown below.

AccessDenied
Access Denied
806Q918P9KQ03XW0
NBnCleigpSEo8fw7yOWRZe2LkaL7BQHBsn08JJrUrq3DcPGy5Fs5FuxXu0B5b7Mj0trBtHG8TNk=
@JulianGro
Copy link
Contributor

I just tried and can access the file just fine. Have you tried multiple times? Maybe Amazon had some trouble.
The URL should be something like https://athena-public.s3.amazonaws.com/dependencies/vcpkg/qt5-install-5.15.2-ubuntu-18.04-amd64.tar.xz

@daleglass
Copy link
Contributor

Mm, I don't think anything changed in that part in a long time. I would suspect network problems on your end or some sort of rare issue, because if S3 breaks a lot of people are going to notice.

Please try again, and if it still doesn't work paste here the full output you're getting.

@ghost
Copy link
Author

ghost commented Oct 13, 2021

Hello JulianGro, Hello daleglass,
Thank you for the replies. It's rather odd... if I hit up Julian's provided URL, it starts downloading w/o issue.
<I'm downloading right now... and may just manually put in the qt dir>
I work day-in-day-out in aws... so I'm familiar with S3... :\

Needless to say.. I've attempted to rerun the script a few times.. here's the output

`############################################################

Building

############################################################

Checking whether Qt is already installed... no.
-- EXTERNAL_BUILD_ASSETS: https://athena-public.s3.amazonaws.com
-- GLES_OPTION:
-- Found PythonInterp: /usr/bin/python3 (found version "3.6.9")
Using the Python interpreter located at: /usr/bin/python3
['/home/mbogucki/Vircadia/source/prebuild.py', '--release-type', 'DEV', '--build-root', '/home/mbogucki/Vircadia/build']
Using a packaged Qt
cmake path: /home/mbogucki/vircadia-files/qt/qt5-install/lib/cmake
Downloading Qt from AWS
Extracting https://athena-public.s3.amazonaws.com/dependencies/vcpkg/qt5-install-5.15.2-ubuntu-18.04-amd64.tar.xz to /home/mbogucki/vircadia-files/qt
Traceback (most recent call last):
File "/home/mbogucki/Vircadia/source/prebuild.py", line 211, in
main()
File "/home/mbogucki/Vircadia/source/prebuild.py", line 145, in main
qt.installQt()
File "/home/mbogucki/Vircadia/source/hifi_qt.py", line 210, in installQt
hifi_utils.downloadAndExtract(self.qtUrl, self.path)
File "/home/mbogucki/Vircadia/source/hifi_utils.py", line 127, in downloadAndExtract
tempFileName = downloadFile(url, hash, hasher)
File "/home/mbogucki/Vircadia/source/hifi_utils.py", line 113, in downloadFile
tempFileName, headers = urllib.request.urlretrieve(url)
File "/usr/lib/python3.6/urllib/request.py", line 277, in urlretrieve
block = fp.read(bs)
File "/usr/lib/python3.6/http/client.py", line 463, in read
n = self.readinto(b)
File "/usr/lib/python3.6/http/client.py", line 507, in readinto
n = self.fp.readinto(b)
File "/usr/lib/python3.6/socket.py", line 586, in readinto
return self._sock.recv_into(b)
File "/usr/lib/python3.6/ssl.py", line 1012, in recv_into
return self.read(nbytes, buffer)
File "/usr/lib/python3.6/ssl.py", line 874, in read
return self._sslobj.read(len, buffer)
File "/usr/lib/python3.6/ssl.py", line 631, in read
v = self._sslobj.read(len, buffer)
ConnectionResetError: [Errno 104] Connection reset by peer
CMake Error at CMakeLists.txt:98 (message):
prebuild.py failed with error 1

-- Configuring incomplete, errors occurred!
To aid with debugging, please re-run with the --collect-info argument.

Fatal error:
Command 'cmake ../source' exited with value 1

`

@daleglass
Copy link
Contributor

Very strange... I tried the URL here, downloads perfectly fine for me.

Could you have some sort of proxy or other system that could be interfering? Some kind of firewall, antivirus, etc?

@ghost
Copy link
Author

ghost commented Oct 13, 2021

Hi Dale,
I have a pfsense-firewall.. but all outbound should be open. I managed to manually download and install the qt-package... which allowed me to move forward. However I'm encountering a new issue w/ jsdoc and NPM.
Should I open a new issue or follow up in this thread??

@daleglass
Copy link
Contributor

By the way, is there a reason you need to specifically build on 18.04? Starting with 21.04 you can build against the system Qt packages.

I recall there being some issues with npm, but I thought that was solved at this point. Yeah, please open a separate issue on that.

@ghost
Copy link
Author

ghost commented Oct 13, 2021 •
edited by ghost
Loading

Well.. my main workstation is 18.04 ... I don't like going bleeding edge since this system is also my "work/dailydriver" system.
I did attempt to download and use the appImage but it was missing a ton of dependencies, esp qt-related libraries.

@daleglass
Copy link
Contributor

Fair enough! Please also report issues with the AppImage, it should work correctly.

@JulianGro
Copy link
Contributor

To be fair, 18.04 is what we build the releases on, so it is the most well tested and supported.

Also yeah, there shouldn't be any missing dependencies. Are you sure your 18.04 install is up to date?

@ghost
Copy link
Author

ghost commented Oct 14, 2021

Hi JulianGro,
Yeah.. my system is up to date...

`$> sudo apt-get upgrade
[sudo] password for mbogucki:
Reading package lists... Done
Building dependency tree
Reading state information... Done
Calculating upgrade... Done
The following packages have been kept back:
debhelper libegl-mesa0 libgbm1 libgl1-mesa-dri libgl1-mesa-dri:i386 libglapi-mesa libglapi-mesa:i386 libglx-mesa0 libglx-mesa0:i386 libosmesa6 libxatracker2 mesa-va-drivers mesa-vdpau-drivers my-weather-indicator netplan.io openscad
ubuntu-advantage-tools
0 upgraded, 0 newly installed, 0 to remove and 17 not upgraded.

I downloaded a fresh appimage.. and this is what I'm seeing when I invoke: <see attached file -- to save on screen clutter>

foo.txt

@JulianGro
Copy link
Contributor

That is very weird. The AppImage contains that file, it also works on my system which it shouldn't if it doesn't use the file because I am also on Ubuntu 18.04 and cannot have Qt 5.15 installed because of that either.

@mwbogucki could you check if the file is damaged via

echo "8fa373969fb58e50fe4ae66ce0c06a1f5ef314a5ad92f5efcd2e326060e3aa5fea0de082af224518ccf1a5b6896f176a59920deb43cb516852cf2a5183850d3a Vircadia-x86_64_v2021.1.3-Eos.AppImage" | sha512sum -c -

@ghost
Copy link
Author

ghost commented Oct 14, 2021 via email

@JulianGro
Copy link
Contributor

I am sorry, I honestly have absolutely no idea what could be going wrong on your end.

@ghost
Copy link
Author

ghost commented Oct 14, 2021 via email

@ghost
Copy link
Author

ghost commented Oct 14, 2021 via email

@JulianGro
Copy link
Contributor

I recall there being some issues with npm, but I thought that was solved at this point. Yeah, please open a separate issue on that.

@mwbogucki vircadia/vircadia-native-core#1228 (comment)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@JulianGro @daleglass