v4.7 - see CHANGELOG.md for details

xnl-h4ck3r · Dec 9, 2024 · ed75caf · ed75caf
1 parent 604ec29
commit ed75caf
Show file tree

Hide file tree

Showing 4 changed files with 18 additions and 3 deletions.
diff --git a/CHANGELOG.md b/CHANGELOG.md
@@ -1,5 +1,11 @@
 ## Changelog
 
+- v4.7
+
+  - New
+
+    - BUG FIX: If an input domain has unicode in, e.g `xñl.uk`, then it will be converted to the punycode version, e.g. `xn--xl-zja.uk` to use that as the input instead. This will ensure the URLs and responses are correctly retrieved from the archive sources.
+
 - v4.6
 
   - New

diff --git a/README.md b/README.md
@@ -1,6 +1,6 @@
 <center><img src="https://github.com/xnl-h4ck3r/waymore/blob/main/waymore/images/title.png"></center>
 
-## About - v4.6
+## About - v4.7
 
 The idea behind **waymore** is to find even more links from the Wayback Machine than other existing tools.
 

diff --git a/waymore/__init__.py b/waymore/__init__.py
@@ -1 +1 @@
-__version__="4.6"
+__version__="4.7"
diff --git a/waymore/waymore.py b/waymore/waymore.py
@@ -3325,7 +3325,16 @@ def main():
             if subDomain != '':
                 inputIsSubDomain = True
                 subDomain = subDomain+'.'
-            argsInputHostname = subDomain+tldExtract.domain+'.'+tldExtract.suffix
+
+            # Convert domain to punycode
+            punyCode = tldExtract.domain.encode("idna").decode("ascii")
+            if tldExtract.domain != punyCode:
+                writerr(colored(getSPACER(f'IMPORTANT:  You passed a domain that contains unicode characters, so this will be converted to Punycode when retrieving from archived sources, i.e. {punyCode}.{tldExtract.suffix}\n'),'yellow'))
+                argsInput = argsInput.replace(tldExtract.domain,punyCode)
+                rootDomain = punyCode
+            else:
+                rootDomain = tldExtract.domain
+            argsInputHostname = subDomain+rootDomain+'.'+tldExtract.suffix
 
             # Warn user if a sub domains may have been passed
             if inputIsSubDomain: