fastdl.me

(WIP) big fat fastdl for Counter-Strike: Source maps

• "this will not help anyone" - anonymous
• "that's fucking nuts holy shit" - anonymous
• "who's downloading maps from Afria?" - anonymous
• "one of the best project for CSS" - anonymous
• "i like ur fastdl and i thinkg its cool and thank you" - anonymous
• "you live in denial" - anonymous
• "it doesn't work" - anonymous
• "My name is Joe Biden and I endorse this website!" - Evil Joe Biden   anonymous

Directory list of canon/filtered maps | Directory list of all hashed/unfiltered maps

Smaller list of mostly bhop/trikz/kz/surf/xc maps

Contact / submit maps / request fixes

• Email: hello@fastdl.me
• check.fastdl.me
  • Contact form. Upload & submit links to maps.
  • You can check your maps folder for unique maps with the commands from this page.
• Post in the Sourcejump Discord server or bhoptimer Discord server (main)
• Upload it to Gamebanana as every map posted there is then added to this site.
  • (it's good for your map to have a "homepage", which it can, if it's on Gamebanana)

Source-code & repositories:

• Website & list of maps
• More map info (filelist, entities lumps, original filenames, etc)

Known missing maps we're looking for:

• bhop_aabhnerd_stage1
  • bhop_aabhnerd is on the server so this doesn't really matter
• bhop_alanlox
• bhop_alanlox2
• bhop_br4d
• bhop_color_prikol
• bhop_enoe_hard
• bhop_kasvihuone_jcs
• bhop_kterenahatu
• bhop_m_skipper
  • wip map?
• bhop_mp_stairs_remake_b
• bhop_niceopti
• bhop_pro_bhopper_mp_remake_b
• bhop_ragequit_mini_v4
  • gmod map?
• bhop_red_shade_fix
• bhop_s_bonus1
• bhop_strafe_combine
• bhop_stref_amazon_remake_b
• bhop_stref_black
• bhop_terarightnow
• bhop_together_h
  • the long-sought legend
• bhop_unbunt
• bhop_waffle
  • not sure what this is. GMOD maybe?
• bhop_zinkwasbirnin1990v2
  • gmod map?
• kz_slide_isnt_kz_d
  • wip port from the csgo kz_slide_isnt_kz maybe?
• surf_doodoo

Questions:

• Is it okay to scrape?

  • Yes. Preferably use `/maps/mapname.bsp.bz2` or `/mapsredir/mapname.bsp.bz2` instead of `/m2/*` or `/h2/*`.
  • CSV files for each page:
    • Directory list of canon/filtered maps
    • Directory list of all hashed/unfiltered maps
    • Smaller list of mostly bhop/trikz/kz/surf/xc maps
  • Some text files of map/file names:
    • Canon/filtered
    • All hashes
    • mostly bhop/trikz/kz/surf/xc

  • If you want to download with wget/curl:

    • wget http://main.fastdl.me/maps/bhop_badges.bsp.bz2
    • curl -L -O http://main.fastdl.me/maps/bhop_badges.bsp.bz2

• Can I use this as my fastdl?

  • Yes. sv_downloadurl "http://main.fastdl.me/"

• Maybe host .bsp files too?

  • Maybe one day but only .bsp.bz2's for now. It would be cool to mount the "maps" folder with rclone/sshfs/httpdirfs.

• What's the difference between /maps/ & /hashed/?

  • /maps/: slightly curated list that uses the canon/correct maps and removes some maps.
    • Canon maps csv
    • Removed maps csvs
  • /hashed/: list of everything (old/broken versions, duplicate/incorrect names, etc)

• Can fastdl.me host maps for CS:GO or TF2?

  • I'm not personally interested in hosting maps for these right now as it'd cost more money.
    (CS:GO is effectively dead now that CS2 is released... hopefully everybody saved maps they wanted)
    Here's a cool TF2 map archive though: https://maps.mevl2.duckdns.org/ (more games at https://ar.mevl2.duckdns.org/)
    And here's a mirror of a cool, curated GMOD-oriented bhop fastdl (czarchasm): html / csv

• "Why is the map not downloading from the fastdl?"

  • Sometimes I rename maps or remove dupes. See renamed_by_me.csv / removed_because_i_renamed_them.csv
  • "Why is the map [that exists] not downloading from the fastdl?"
    Mainly... I dunno...
    • Sometimes the server doesn't receive the request.
    • Sometimes the server receives the request but then the download dies mid-connection.
    • Perhaps it's sometimes related to ISP filtering / country firewalls / dropped connections.
    • I also had a Linux gaming CS:S friend who couldn't download maps when /maps/ redirected to /hashed/.
      I'm not sure why this was a problem but making /maps/ not use HTTP redirects solved it for them.
    • Cloudflare server-updates kill requests that run longer than 30 seconds. Source

• "Can you upload some custom files/assets?" (e.g. sounds, textures, models)

  • I'd prefer not to.
    If you put them on your own fastdl/http server then you can redirect `/maps/` to fastdl.me.
    Here are some example configs:

  • # caddy (/etc/caddy/Caddyfile)
    http://fastdl.example.org {
    	root * /path/to/your/assets
    	file_server browse
    	handle /maps/* {
    		redir http://main.fastdl.me/maps/{file}
    	}
    }

  • # nginx (/etc/nginx/sites-enabled/fastdl.example.org.conf) (untested)
    server {
    	listen 80;
    	server_name fastdl.example.org;
    	root /path/to/your/assets;
    
    	location / {
    		autoindex on;
    		try_files $uri $uri/ $uri/index.html =404;
    	}
    
    	location ~ /maps/(.*)$ {
    		return 302 http://main.fastdl.me/maps/$1;
    	}
    }
    		

Other things:

• Old versions of 7-Zip are known to have problems extracting these .bz2 files.

  • Just update it :)

• Every .nav file is currently a dummy .nav file.

  • I'll add the real .nav files where available soon:tm: (or will I?). It'd be A LOT of work so I have no plans to do it.

• Somewhat History

  • 2019-XX
    fastdl.me originates with plans to be an easy fastdl host. It was never finished so it went offline quickly.
     
  • 2022-05
    I scrape acer's fastdl (hosted by sojourner) for a personal backup.
     
  • 2022-??
    The shared hosting provider for acer's fastdl, blocks access to map directory list / index pages.
    This isn't too surprising since it was ~140GB of files that probably saw a lot of bandwidth usage each month.
    Map additions decreased in the prior months and download speeds were slow at times.
    TL;DR: death flags.
     
  • 2022-11
    fastdl.me revives as a bhop/surf/xc/kz/trikz map archive/fastdl.
    The latest files from acer's fastdl were acquired to absorb / provide longer-lasting hosting.
    Around two-dozen sources of maps, from fastdls & community-outreach, are collected and combined.
     
  • 2023-01
    It's decided to include every map possible instead of being 99% bhop/surf/xc/kz/trikz.
    Gamebanana's CS:S section is scraped and added.
    (This bumps the total unique map files from maybe around 14k to maybe around 48k)
     
  • 2023-01
    Cloudflare HTTPS certificate issues. "main.x.fastdl.me" is migrated to "main.fastdl.me".
     
  • 2023-03
    Originally fastdl.me had `/maps/*.bsp.bz2` HTTP redirecting to `/hashed/sha1hash.bsp.bz2`.
    This has pros and cons. The biggest con was that fastdl downloads break for some users.
    `/maps/*.bsp.bz2` was changed to use a Cloudflare Worker to resolve that.
    This still has pros and cons...
     
  • 2023-08
    New map-uploads on Gamebanana are now automatically added (port god Fibzy caused this to finally happen).
     
  • 2023-11-23~
    happy birthday
    ~5TB of traffic over the past year
    ~400GB of maps stored (~905GB uncompressed)

• Some (but not all) server explosion/downtime events

  • 2023-12-27 10:17 (5am for me)
    I'm woken up by website-down notifications.
    fastdlpy service was being killed by the OOM. File-system was mostly remounted as read-only.
    A Cookie Clicker addon's log had been tail'd for a month straight in tmux, eating all the RAM and somehow corrupting some inodes.
    
    Backup node is started after around 8 minutes.
    The backup node was using the wrong database path which meant a 3-month old database was used.
    
    Main node did not came back online after a reboot.
    Host provider's panel was down so status and remote-console couldn't be accessed.
    
    The outdated backup VM database was noticed and fixed after around 15 minutes.
    
    Host provider's panel is finally available after another 15 minutes and shows the main node was stuck on the initramfs shell waiting for a manual fsck.
     
  • 2024-01-21
    Same storage "exploded" again. Manual fsck required. 5 hours of downtime?
     
  • 2024-01-29
    Same storage "exploded" again. Manual fsck required. 9 hours of downtime?
     
  • 2024-02-01
    Migration (the third!) & dockerization.
    Server goes down once, shame on the provider.
    Server goes down twice, shame on the provider?
    Server goes down a third time, shame on me, I should've seen that coming...
    I still don't know why that drive kept "exploding" but there's no way it was my fault.
     
  • 2024-07-02 / 2024-07-03
    Server was down for ~6 hours. I don't know why and the logs didn't indicate anything.
     
  • 2024-09-01
    Fixed: one of the servers was not updating the DB & HTML for some unknown amount of time.
    Some recent map downloads would randomly fail due to this.
     

• Available URL samples:

  • main.fastdl.me
    • Open directory with some generic sounds and materials for bhoptimer.
  • main.fastdl.me/hashed/f698fd3d702567d250af541d81e7488d6abf4de3.bsp.bz2
    • Directory with every .bsp.bz2 archived.
    • You can also suffix the mapname like this:
      main.fastdl.me/hashed/f698fd3d702567d250af541d81e7488d6abf4de3/bhop_badges.bsp.bz2
    • This 302 redirects to the Cloudflare R2 bucket URL (mainr2.fastdl.me).
      That subdomain might be changed in the future but it should be faster to hit `mainr2` for /hashed/ than waiting for the redirect from `main`.
      Note: `mainr2` doesn't support suffixing the mapname to the path though like `main` does.
  • main.fastdl.me/maps/bhop_badges.bsp.bz2
    • Path that is used for fastdl.
      This 302 redirects to mainr2.fastdl.me/hashed/f698fd3d702567d250af541d81e7488d6abf4de3.bsp.bz2
      Note: mainr2.fastdl.me could change.
      Note: Also this might occasionally change from using 302 redirects to not (via Cloudflare Workers)
      Currently using Cloudflare Workers...
      Note 2023-05-28: /maps/<hash>.bsp.bz2 works too...
  • main.fastdl.me/mapsredir/bhop_badges.bsp.bz2
    • This 302 redirects to mainr2.fastdl.me/hashed/f698fd3d702567d250af541d81e7488d6abf4de3.bsp.bz2
      Note: mainr2.fastdl.me could change.
      This is always available for redirects as /maps/ sometimes uses Cloudflare Workers.
  • main.fastdl.me/h2/f698fd3d702567d250af541d81e7488d6abf4de3/bhop_badges.bsp.bz2
    • Used by the /maps/ & /hashed/ index pages to download hashed files with a good filename.
  • main.fastdl.me/m2/bhop_badges.bsp.bz2
    • Downloads the map as the filename (like /h2/).
      Useful for hotlinking files to download with a good filename.

• 😀 😃 😄 😁 😆 😅 😂 🤣 🥲 🥹 ☺️ 😊 😇 🙂 🙃 😉 😌 😍 🥰 😘 😗 😙 😚 😋 😛 😝 😜 🤪 🤨 🧐 🤓 😎 🥸 🤩 🥳 😏 😒 😞 😔 😟 😕 🙁 ☹️ 😣 😖 😫 😩 🥺 😢 😭 😮‍💨 😤 😠 😡 🤬 🤯 😳 🥵 🥶 😱 😨 😰 😥 😓 🫣 🤗 🫡 🤔 🫢 🤭 🤫 🤥 😶 😶‍🌫️ 😐 😑 😬 🫨 🫠 🙄 😯 😦 😧 😮 😲 🥱 😴 🤤 😪 😵 😵‍💫 🫥 🤐 🥴 🤢 🤮 🤧 😷 🤒 🤕 🤑 🤠 😈 👿 👹 👺 🤡 💩 👻 💀 ☠️ 👽 👾 🤖 🎃 😺 😸 😹 😻 😼 😽 🙀 😿 😾 ✢ ✣ ✤ ✥ ✦ ✧ ★ ☆ ✯ ✡︎ ✩ ✪ ✫ ✬ ✭ ✮ ✶ ✷ ✵ ✸ ✹ → ⇒ ⟹ ⇨ ⇾ ➾ ⇢ ☛ ☞ ➔ ➜ t h e g a m e ➙ ➛ ➝ ➞ ♠︎ ♣︎ ♥︎ ♦︎ ♤ ♧ ♡ ♢ ♚ ♛ ♜ ♝ ♞ ♟ ♔ ♕ ♖ ♗ ♘ ♙ ⚀ ⚁ ⚂ ⚃ ⚄ ⚅ 🂠 ⚈ ⚉ ⚆ ⚇ 𓀀 𓀁 𓀂 𓀃 𓀄 𓀅 𓀆 𓀇 𓀈 𓀉 𓀊 𓀋 𓀌 𓀍 𓀎 𓀏 𓀐 𓀑 𓀒 𓀓 𓀔 𓀕 𓀖 𓀗 𓀘 𓀙 𓀚 𓀛 𓀜 𓀝

• Privacy policy and Cookie policy things (last updated 2023-12-09) (history)

  • Requests (IP address, geo-located country, HTTP request headers, filename, timestamp, response status) are logged for up to 72 hours (although, the logs are usually wiped within 24 hours).
  • Requests to `/maps/*.bsp` have the filename logged indefinitely on publicly available log-servers.
  • Logs are used to prevent/mitigate attacks and debug the service.
  • fastdl.me uses the services of Cloudflare, which records site metrics (e.g. number of requests/visitors, bandwidth usage).
    More information on their policies: here and here.
  • Cookies:
    fastdl.me does not use or set cookies itself.
    fastdl.me uses the services of Cloudflare, which might set necessary cookies if the website is being attacked, for example.
    More information on on their policy: here.