## All robots
User-agent: *

## Allow everything...
Disallow:

## ...expect for archived pages (kali-docs/kali-tools)
Disallow: /docs/development/leveraging-the-kali-bot/
Disallow: /docs/virtualization/import-premade-virtualbox-legacy/
Disallow: /docs/virtualization/install-vmware-guest-tools-legacy/
Disallow: /docs/virtualization/install-virtualbox-guest-additions-legacy/
Disallow: /docs/installation/mini-iso/
Disallow: /docs/nethunter/dojo-kali-linux-on-android/
Disallow: /tools/openssh-gssapi/
Disallow: /tools/redeye/
Disallow: /docs/arm/efikamx/
Disallow: /docs/arm/imx-6ull-evk/
Disallow: /docs/arm/nanopi2/
Disallow: /docs/arm/raspberry-pi-with-luks-full-disk-encryption/
Disallow: /docs/arm/ss808-mk808/
Disallow: /tools/fuse3/
Disallow: /tools/mfterm/
Disallow: /tools/stunnel4/
Disallow: /tools/libfreefare/
Disallow: /tools/libnfc/
Disallow: /tools/mfcuk/
Disallow: /tools/mfoc/
Disallow: /tools/sickle-tool/
Disallow: /tools/spectools/
Disallow: /tools/curlftpfs/
Disallow: /tools/outguess/
Disallow: /tools/de4dot/
Disallow: /docs/arm/gemini-pda/
Disallow: /docs/wsl/mesa-21/
Disallow: /docs/introduction/kali-linux-default-passwords/
Disallow: /docs/policy/kali-linux-root-user-policy/
Disallow: /docs/general-use/kali-domains/
Disallow: /docs/nethunter/nethunter-mitmf/
Disallow: /docs/nethunter/nethunter-mana-wireless/
Disallow: /docs/development/public-packaging/
Disallow: /docs/arm/galaxy-note-10.1/
Disallow: /tools/abootimg/
Disallow: /tools/android-sdk/
Disallow: /tools/backdoor-factory/
Disallow: /tools/bluez-firmware/
Disallow: /tools/fake-hwclock/
Disallow: /tools/faraday-client/
Disallow: /tools/firmware-sof/
Disallow: /tools/freerdp2/
Disallow: /tools/initramfs-tools/
Disallow: /tools/ipv6-toolkit/
Disallow: /tools/king-phisher/
Disallow: /tools/netkit-ftp/
Disallow: /tools/netkit-telnet/
Disallow: /tools/netkit-tftp/
Disallow: /tools/p7zip/
Disallow: /tools/pev/
Disallow: /tools/plecost/
Disallow: /tools/radare2-cutter/
Disallow: /tools/rtlsdr-scanner/
Disallow: /tools/smali/
Disallow: /tools/u-boot/
Disallow: /tools/usbutils/
Disallow: /tools/winexe/
Disallow: /tools/xprobe/
Disallow: /tools/zd1211-firmware/
Disallow: /tools/zenmap-kbx/


## Point out where sitemap is
Sitemap: https://www.kali.org/sitemap.xml