Rewrite everything and make debian package

Author: heinthanth

.gitignore

@@ -0,0 +1,2 @@
+better-mirror.deb
+better-mirror/usr

README.md

@@ -1,81 +1,94 @@
-# Mirrorscript-v2
-Script to change official Kali repository to mirrors. This helps increase packages update and downloading for some user. Please visit my blog [post](https://www.metahackers.pro/speed-kali-linux-update/).
+# Better Mirror
 
-## Requirements
-Kali Linux,
-Python3
+```text
+ ___ _____   _   ____    __  __ _ ___ ___  __  ___
+| _ )__ / |_| |_|__ /_ _|  \/  / | _ \ _ \/  \| _ \
+| _ \|_ \  _|  _||_ \ '_| |\/| | |   /   / () |   /
+|___/___/\__|\__|___/_| |_|  |_|_|_|_\_|_\\__/|_|_\
+```
 
-## Usage
-Run the script in privilege mode, such that `sources.list` could be edited.
+A Linux package that find the fastest mirror and configure apt to use that.
 
-## Help
+Just a fork of [IceM4nn/mirrorscript-v2](https://github.com/IceM4nn/mirrorscript-v2)
+
+## Installation
+
+```shell
+$ git clone https://github.com/heinthanth/better-mirror
+$ cd better-mirror
+$ chmod +x build.sh
+$ ./build.sh
+$ sudo dpkg -i better-mirror.deb
 ```
-# python3 mirrorscript-v2.py -h
-usage: mirrorscript-v2.py [-h] [-v] [-https] [-src]
 
-Kali Mirrorscripts-v2 by IceM4nn automatically select the best kali mirror
-server and apply the configuration
+## Help
+
+```shell
+$ sudo better-mirror -h
+
+ ___ _____   _   ____    __  __ _ ___ ___  __  ___
+| _ )__ / |_| |_|__ /_ _|  \/  / | _ \ _ \/  \| _ \
+| _ \|_ \  _|  _||_ \ '_| |\/| | |   /   / () |   /
+|___/___/\__|\__|___/_| |_|  |_|_|_|_\_|_\\__/|_|_\
+
+better-mirror 1.0.0 - H31iUMx49
+https://github.com/heinthanth/better-mirror
 
-optional arguments:
-  -h, --help     show this help message and exit
-  -v, --verbose  enable verbose output
-  -https         use HTTPS in apt transport (default HTTP)
-  -src           enable sources packages (default disable)
+
+usage: better-mirror [option] [mode]
+
+options:
+        -c, --choose    : perform mirror choosing
+        -h, --help      : display help message
+        -s, --src       : enable source repository
+
+modes:
+        -v, --verbose   : enable verbose mode
 ```
 
-## Sample output:
+## Sample Output
+
+```shell
+$ sudo better-mirror -v -c
+ ___ _____   _   ____    __  __ _ ___ ___  __  ___
+| _ )__ / |_| |_|__ /_ _|  \/  / | _ \ _ \/  \| _ \
+| _ \|_ \  _|  _||_ \ '_| |\/| | |   /   / () |   /
+|___/___/\__|\__|___/_| |_|  |_|_|_|_\_|_\\__/|_|_\
+
+better-mirror 1.0.0 - H31iUMx49
+https://github.com/heinthanth/better-mirror
+
+
+[*] calculating the mirror latency ...
+[*] pinging kali.download ... latency 23.0 ms
+[*] pinging ftp.jaist.ac.jp ... latency 117.5 ms
+[*] pinging ftp.free.fr ... latency 213.5 ms
+[*] pinging ftp.belnet.be ... latency 222.5 ms
+[*] pinging mirror.neostrada.nl ... latency 223.75 ms
+[*] pinging mirror.serverius.net ... latency 218.25 ms
+[*] pinging ftp2.nluug.nl ... latency 232.75 ms
+[*] pinging mirrors.dotsrc.org ... latency 216.75 ms
+[*] pinging ftp1.nluug.nl ... latency 235.5 ms
+[*] pinging ftp.acc.umu.se ... latency 231.0 ms
+[*] pinging archive.linux.duke.edu ... latency 304.25 ms
+[*] pinging mirror.pwnieexpress.com ... latency 341.25 ms
+[*] pinging mirror-1.truenetwork.ru ... latency 322.5 ms
+[*] pinging mirror.karneval.cz ... latency 336.5 ms
+[*] pinging hlzmel.fsmg.org.nz ... latency 324.5 ms
+[*] pinging wlglam.fsmg.org.nz ... latency 330.75 ms
+[*] pinging archive-4.kali.org ... latency 252.0 ms
+[*] pinging mirrors.ocf.berkeley.edu ... latency 251.0 ms
+[*] pinging ftp.halifax.rwth-aachen.de ... latency 257.25 ms
+[*] pinging ftp.hands.com ... latency 197.0 ms
+[*] finding the best mirror ...
+[*] found! the selected mirror: kali.download ... latency 23.0 ms
+[*] backuping original /etc/apt/sources.list to /etc/apt/sources.list.bak
+[*] updating /etc/apt/sources.list
+[*] performing 'apt-get update' for you
+Hit:1 http://kali.download/kali kali-rolling InRelease
+Ign:2 http://dl.google.com/linux/chrome/deb stable InRelease
+Hit:3 http://dl.google.com/linux/chrome/deb stable Release
+Hit:4 http://packages.microsoft.com/repos/vscode stable InRelease
+Reading package lists... Done
+[*] Done!
 ```
-# python3 mirrorscript-v2.py -v -https -src
-
-#
-# Mirrorscripts-v2 - By Hazmirul Afiq
-# Automatically select the best Kali mirror and apply the configuration
-# https://github.com/IceM4nn/mirrorscript-v2
-# https://www.metahackers.pro/speed-kali-linux-update/
-#
-
-[-] Checking if 'apt-transport-https' package is installed.
-	- apt-transport-https is installed
-
-[+] Getting mirror list ...
-[+] Found a lists of mirrors:
-	- https://hlzmel.fsmg.org.nz/kali
-	- https://wlglam.fsmg.org.nz/kali
-	- https://mirror.karneval.cz/pub/linux/kali
-	- https://ftp.acc.umu.se/mirror/kali.org/kali
-	- https://mirrors.dotsrc.org/kali
-	- https://ftp.halifax.rwth-aachen.de/kali
-	- https://ftp2.nluug.nl/os/Linux/distr/kali
-	- https://ftp1.nluug.nl/os/Linux/distr/kali
-	- https://mirror.neostrada.nl/kali
-	- https://kali.download/kali
-	- https://mirrors.ocf.berkeley.edu/kali
-
-[+] Checking mirrors ... This could take some times.
-[+] Finding the best latency
-	- hlzmel.fsmg.org.nz             : 416.890
-	- wlglam.fsmg.org.nz             : 388.998 
-	- mirror.karneval.cz             : 391.414
-	- ftp.acc.umu.se                 : 313.722
-	- mirrors.dotsrc.org             : 314.235
-	- ftp.halifax.rwth-aachen.de     : 291.252
-	- ftp2.nluug.nl                  : 297.838
-	- ftp1.nluug.nl                  : 302.336
-	- mirror.neostrada.nl            : 294.256
-	- kali.download                  : 40.478
-	- mirrors.ocf.berkeley.edu       : 348.848
-
-[+] Fastest mirror: ('kali.download', '040.478')
-[+] Preparing ...
-	- Making a backup file /etc/apt/sources.list.bk ...
-	- Checking sources.list for older entries ...
-	- Commenting older entries ...
-	- Done
-
-[+] Updating sources.list with new entry ...
-	- Your new mirror: https://kali.download/kali
-
-[+] Done!
-	- Run 'apt clean; apt update' for the changes to load.
-
-```

better-mirror.py

@@ -0,0 +1,178 @@
+#!/usr/bin/env python3
+
+import re
+import os
+import urllib
+import xmltodict
+import subprocess
+import sys
+from threading import Thread
+
+# check if we have privileges
+if not os.getuid() == 0:
+    sys.exit("\n\033[31mcan you run as root or sudo, please?\033[0m\n")
+
+# check if supported distros
+supported_distros = ['kali-rolling']
+with open("/etc/os-release") as release:
+    version = re.search("VERSION_CODENAME=\"(.*)\"", release.read())
+    if not version:
+        sys.exit(
+            "\n\033[31mI don't know what distros you are using :(\033[0m\n")
+    else:
+        if not version[1] in supported_distros:
+            sys.exit(
+                "\n\033[31m{} is not supported in these days\033[0m\n".format(version[1]))
+
+verboseMode = False
+enableSource = False
+
+threads = list()
+results = dict()
+hostlist = dict()
+selectedMirror = ""
+
+
+def ascii():
+    print("""\
+ ___ _____   _   ____    __  __ _ ___ ___  __  ___ 
+| _ )__ / |_| |_|__ /_ _|  \/  / | _ \ _ \/  \| _ \\
+| _ \|_ \  _|  _||_ \ '_| |\/| | |   /   / () |   /
+|___/___/\__|\__|___/_| |_|  |_|_|_|_\_|_\\\\__/|_|_\\
+  
+better-mirror 1.0.0 - H31iUMx49
+https://github.com/heinthanth/better-mirror
+
+    """)
+
+
+def help():
+    ascii()
+    print("usage: better-mirror [option] [mode]")
+    print("\noptions:")
+    print("\t-c, --choose\t: perform mirror choosing")
+    print("\t-h, --help\t: display help message")
+    print("\t-s, --src\t: enable source repository")
+    print()
+    print("modes:")
+    print("\t-v, --verbose\t: enable verbose mode")
+    print()
+
+
+def measurelatency(hostname):
+    res = ""
+    p = subprocess.Popen(['ping', '-c 4', hostname],
+                         stdout=subprocess.PIPE, stderr=subprocess.PIPE).communicate()
+    res = [x.decode('utf-8') for x in p]
+    if not res[0]:
+        results[hostname] = 9999
+        res = "\033[31merror\033[0m"
+    else:
+        latencies = re.findall(r'time=([0-9\.]*)\sms', res[0])
+        latencies = list(map(float, latencies))
+        average = sum(latencies) / len(latencies)
+        results[hostname] = average
+        res = "\033[32m" + str(round(average, 2)) + " ms\033[0m"
+
+    if verboseMode:
+        print("\033[33m[*]\033[0m pinging \033[32m{hostname}\033[0m ... latency {latency}".format(
+            hostname=hostname, latency=res))
+
+
+def main():
+    # get list of mirror from meta4 file
+    meta_xml = urllib.request.urlopen("http://http.kali.org/README.meta4")
+    lists = xmltodict.parse(meta_xml)
+
+    print("\033[33m[*]\033[0m calculating the mirror latency ...")
+    for info in lists["metalink"]["file"]["url"]:
+        url = urllib.parse.urlparse(info["#text"])
+        hostlist[url.netloc] = str(url.path).replace("/README", "")
+        thread = Thread(target=measurelatency, args=[url.netloc])
+        thread.start()
+        threads.append(thread)
+
+    for thread in threads:
+        thread.join()
+
+    if verboseMode:
+        print("\033[33m[*]\033[0m finding the best mirror ...")
+    result = sorted(results.items(), key=lambda item: item[1])
+
+    selected = result[0]
+    print("\033[33m[*]\033[0m found! the selected mirror: \033[32m{}\033[0m ... latency \033[32m{} ms\033[0m".format(
+        selected[0], round(selected[1], 3)))
+    selectedMirror = selected[0]
+
+    if verboseMode:
+        print(
+            "\033[33m[*]\033[0m backuping original /etc/apt/sources.list to /etc/apt/sources.list.bak")
+    os.popen('cp /etc/apt/sources.list /etc/apt/sources.list.bak')
+
+    print("\033[33m[*]\033[0m updating /etc/apt/sources.list")
+    newcontent = []
+    try:
+        read_only_sources_list = open("/etc/apt/sources.list", "r")
+        for line in read_only_sources_list:
+            if(re.search(r'# add with better-mirror', line)):
+                # will skip this line
+                pass
+            elif re.search(r'^deb http(?:s|)://(.*)/kali kali-rolling', line):
+                newcontent.append("\n# " + line)
+            elif re.search(r'^deb-src http(?:s|)://(.*)/kali kali-rolling', line):
+                newcontent.append("# " + line + "\n")
+            elif re.search(r'^#\s*deb http(?:s|)://(.*)/kali kali-rolling', line):
+                newcontent.append("\n" + line)
+            elif re.search(r'^#\s*deb-src http(?:s|)://(.*)/kali kali-rolling', line):
+                newcontent.append(line + "\n")
+            elif line.strip() == "":
+                pass
+            else:
+                newcontent.append(line)
+        newcontent.append("\ndeb http://{hostname}{path} kali-rolling main non-free contrib # add with better-mirror\n".format(
+            hostname=selectedMirror, path=hostlist[selectedMirror]))
+        if enableSource:
+            newcontent.append("deb-src http://{hostname}{path} kali-rolling main non-free contrib # add with better-mirror\n".format(
+                hostname=selectedMirror, path=hostlist[selectedMirror]))
+    except PermissionError:
+        sys.exit(
+            "\033[31m[*] unsufficient permission ... cannot open /etc/apt/sources.list\033[0m")
+    finally:
+        read_only_sources_list.close()
+
+    try:
+        source_list = open("/etc/apt/sources.list", "w")
+        for line in newcontent:
+            source_list.writelines(line)
+    except PermissionError:
+        sys.exit(
+            "\033[31m[*] unsufficient permission ... cannot write /etc/apt/sources.list\033[0m")
+    finally:
+        source_list.close()
+
+    print("\033[33m[*]\033[0m performing 'apt-get update' for you")
+    if verboseMode:
+        os.system("apt-get update")
+    else:
+        os.system("apt-get update -qq")
+    print("\033[33m[*]\033[0m Done!")
+
+
+if len(sys.argv) == 1:
+    help()
+    exit(1)
+else:
+    # parse the argument
+    if "-h" in sys.argv or "--help" in sys.argv:
+        help()
+        exit(0)
+    if "-v" in sys.argv or "--verbose" in sys.argv:
+        verboseMode = True
+    if "-s" in sys.argv or "--src" in sys.argv:
+        enableSource = True
+    if "-c" in sys.argv or "--choose" in sys.argv:
+        ascii()
+        main()
+    else:
+        help()
+        exit(1)

better-mirror/DEBIAN/changelog

@@ -0,0 +1,5 @@
+better-mirror (1.0.0) heinthanth; urgency=low
+
+  * initial release - with Kali Linux supported
+
+  -- Hein Thanth <contact@heinthanth.com>  Wed, 12 Feb 2020 13:34:00

better-mirror/DEBIAN/control

@@ -0,0 +1,7 @@
+Package: better-mirror
+Version: 1.0.0
+Maintainer: Hein Thanth <contact@heinthanth.com>
+Description: A package that select the fastest for debian-like distros like Kali Linux, Parrot Security Linux
+Homepage: https://github.com/heinthanth/better-mirror
+Architecture: all
+Depends: python3, python3-pip

better-mirror/DEBIAN/postinst

@@ -0,0 +1,3 @@
+pip3 install xmltodict
+cp /etc/apt/sources.list /etc/apt/sources.list.origin
+chmod +x /usr/bin/better-mirror

build.sh

@@ -0,0 +1,5 @@
+#!/usr/bin/env bash
+mkdir -p ./better-mirror/usr/bin
+cp better-mirror.py ./better-mirror/usr/bin/better-mirror
+
+dpkg -b ./better-mirror ./better-mirror.deb