Staredit Network > Forums > General StarCraft > Topic: SC Nibbits Map Collection
SC Nibbits Map Collection
Sep 17 2019, 2:02 am
By: Cerorec  

Sep 17 2019, 2:02 am Cerorec Post #1



Here is all of the SC1 maps on SC Nibbits I could find, including hidden ones and "removed" ones!
Site claims to have: 15,804 maps. (As of 9/16/19)
Total maps found: 15,823 maps!
Size: 2.27 GB (.7z file)
Size: 3.82 GB

Download Here -> https://mega.nz/#!RoRR3IDT!XVv_fid3D8b9XW-pSGuBi3Ux_aTx0_uILfccB_rGijQ

I tried contacting the site owner via email about a "Download All" button, but the email doesn't work and returns an error. I can't find any other way to contact the site owner and I might as well just release this full map pack.

How I did it: On http://sc.nibbits.com/maps/browse/?sort=date&order=desc#filters=0 , go to "Show all maps" which includes duplicated maps. Each page has 25 links, except for the last one. Go to the last page which is page 633 and download every single map individually until you come back to page 1. Now, I know what you are thinking. This is very tedious and long process. I used tools to help me out like a script I made in Java and URLOpener.com that opens multiple pages at once to quicken this process. With these tools, and how the site SC Nibbits is built, I could download around 1500 maps in about an hour! The hidden maps weren't on the pages, but were hidden within the "gaps". For ex. on page 1, sc.nibbits.com/maps/get/140996/ is Cat n Mouse Highway V2.4.scx (number being 140996) and sc.nibbits.com/maps/get/140995/ is Arbiter Bound 2(P).scx (number being 140995). Now, Cat n Mouse Highway V2.4.scx is 5th from the line and Arbiter Bound 2(P).scx is 6th from the line, and so there is no number gap between these two maps. However, there are tons of number gaps throughout the whole site, and some gaps range to the 1000s which I skipped. Within these gaps, there are hidden maps, like ones whose pages were deleted by the admin because of its sexual content, like Kerrigan Has Sex With Duke.scm and Strip ashley massaro 2.2.scx. With my script, I obtained every number from this map on this page to that map on that page and used URLOpener.com to open them all at once, downloading all from the working links and obtaining many hidden maps.

My story: When I started this project, I started out slow. I wanted to archive.org every single map and download them all too. I didn't have the tools with me yet, but each day I got a little better at my process. Then I calculated it would take me around 1-2 months to finish this (250 - 500 maps per day). I wanted to finish this fast and 1-2 months was too long for me, so like several days later I found shortcuts and tools to help quicken the process. So basically I archived maps from pages 633 to 281. On the day when I was at page 280, archive.org knew of my activity and implemented, "429 Too Many Requests. You have sent too many requests in a given amount of time." so I couldn't mass archive links anymore. Well, that was a bummer. Afterwards, I just said screw it and just downloaded the maps straight from the site itself, SC Nibbits with my tools. You can archive those download links, but you can't use URLOpener.com or similar sites to archive multiple pages at once anymore... because of me. :( Or maybe it only affects me who knows.

The math: The site claims to have 15,804 maps. Ok, let see if that's correct. Each page shows 25 links. The last page (633) shows 4 links. 632 x 25 + 4 = 15,804 maps, which is how the site got its number. However, some of these links direct to maps that are undownloadable, which numbers to 49. On top of that, many links aren't maps at all, but other things like txt and ico files, which numbers to 6. So, 15804 - 49 - 6 = 15749 maps. In other words, this site has 15749 downloadable maps on its pages. Now, the number of hidden maps I've found is 84. If you add it up then 15749 + 84 = 15833 maps. BUT, in my folder I have 15823 maps. Wut... So I must have miscalculated somewhere as the difference is 10. If I did miss a map from the pages, it is probably around 1-4 maps, tops. No more than 4, but I'm confident I have all of the maps from the pages, so "10" has to be from miscalculations from elsewhere, maybe hidden maps, broken maps, or non maps. With the number of 15823, which is higher than 15804, I'm confident to say that I have at least 99% of all of the SC1 maps from SC Nibbits, in my map pack.

Now, there may be more hidden maps on this site. There are gaps numbering in the 1000s which I skipped, so there may have been hidden maps within these gaps. I found around 84 hidden or extra maps, and the number could be higher. I used the link sc.nibbits.com/maps/get/x/ where x is a number, to find maps. This is just a redirect link. For ex. sc.nibbits.com/maps/get/140996/ redirects to sc.nibbits.com/media/maps/140/996/Cat n Mouse Highway V2.4.scx where the map is stored. It may be possible that there are maps that don't have redirect get links, so who knows how many hidden maps this site has.

Well, I think that covers it. In the map pack there are two txt files. I took notes while I was archiving and downloading the maps. I'll post them here too.


Left Off Page & Math.txt

download
http://sc.nibbits.com/maps/browse/?sort=date&order=desc&av=1&p=1

web archive
http://sc.nibbits.com/maps/browse/?sort=date&order=desc&av=1&p=280

https://web.archive.org/save/ (DOESN'T WORK 7STAR BROWSER WITH URL OPENER.COM!!!)
(DOESN'T WORK WITH VIVALDI!, FIREFOX SUCKS! AND DOESN'T WORK! WITH URL OPENER.COM)
(WOW BRAVE BROWSER WORKS!)

633 pages, 1 page has 4 maps
632 x 25 = 15800, 15800 + 4 = 15804
site claims 15,804 maps, which matches, however, dozens of map links are broken
14,830 + 1000 = 15,830, 26+ extra maps?

TOTAL: 15,823

15,823 - 15,804 = 19 more maps

49 broken maps

15804 - 49 = 15755

10+1+1+1+2+1+1+3+4+3+7+7+1+10+24+1+1+5+1 - Extra maps = 84

15755 + 84 = 15839
15839 - 6 = 15833 (6 non maps)
Difference: 15833 - 15823 = 10

WARCRAFT
2463 pages, last page is 25 maps
2463x25=61575

STARCRAFT 2
118 pages, last page is 10 maps
117x25+10=2935


Broken File Links.txt

Undownloadable
http://sc.nibbits.com/maps/download/15041/ Spike's Journey 7
http://sc.nibbits.com/maps/download/15067/ Spike's Journey 8
http://sc.nibbits.com/maps/download/15208/ Spike's Journey
http://sc.nibbits.com/maps/download/15478/ Zerg Installation
http://sc.nibbits.com/maps/download/15497/ Spike's Journey 5
http://sc.nibbits.com/maps/download/14205/ DBZ=YUGIOH
http://sc.nibbits.com/maps/download/14206/ WWI - Kaiser\'s Fury P.scx
http://sc.nibbits.com/maps/download/14261/ DLK's Map Making Guide
http://sc.nibbits.com/maps/download/14300/ WWII - Rommel\'s MastermindP.scx
http://sc.nibbits.com/maps/download/14402/ Something For Nothin/'.scx
http://sc.nibbits.com/maps/download/14452/ (1)Scrouge/'s Generation.scx (Hidden)
http://sc.nibbits.com/maps/download/14486/ Fronter/'s Movie Guide.scx
http://sc.nibbits.com/maps/download/14568/ The Dominion/'s Revenge.scm (Hidden)
http://sc.nibbits.com/maps/download/14618/ Teen Titans Go! #1
http://sc.nibbits.com/maps/download/14623/ RUSH qUiCk!~~OR Die!``By Zach
http://sc.nibbits.com/maps/download/14710/ Spike's Journey 4
http://sc.nibbits.com/maps/download/14714/ Spike's Journey 2 1/2
http://sc.nibbits.com/maps/download/14799/ Spike/'s Journey 9.scx
http://sc.nibbits.com/maps/download/14825/ (1)Stukov/'s Vengance01.scx
http://sc.nibbits.com/maps/download/14877/ (2)Grendel/'s Revenge.scx
http://sc.nibbits.com/maps/download/14939/ Kullia - First Encount.scm
http://sc.nibbits.com/maps/download/14964/ Spike/'s Journey 6.scx
http://sc.nibbits.com/maps/download/24104/ Chips Obstacle #1
http://sc.nibbits.com/maps/download/25024/ The New Heros #2- Death
http://sc.nibbits.com/maps/download/25057/ The world of Roleplaying
http://sc.nibbits.com/maps/download/25933/ http://sc.nibbits.com/maps/project/25070/defendersslayers
http://sc.nibbits.com/maps/download/26040/ http://sc.nibbits.com/maps/project/25165/i2a-arena-60done
http://sc.nibbits.com/maps/download/26123/ Pro Maps #1
http://sc.nibbits.com/maps/download/26218/ http://sc.nibbits.com/maps/project/25318/little-bloody-war
http://sc.nibbits.com/maps/download/26343/ http://sc.nibbits.com/maps/project/25429/battle-of-the-heroes
http://sc.nibbits.com/maps/download/26741/ http://sc.nibbits.com/maps/project/25768/shared-bases-2001-ver-8
http://sc.nibbits.com/maps/download/27123/ http://sc.nibbits.com/maps/project/26090/drug-warz-2
http://sc.nibbits.com/maps/download/27508/ http://sc.nibbits.com/maps/project/26440/what-the-f
http://sc.nibbits.com/maps/download/27919/ http://sc.nibbits.com/maps/project/26793/dz-coi-heii
http://sc.nibbits.com/maps/download/28820/ http://sc.nibbits.com/maps/project/27574/lalakers
http://sc.nibbits.com/maps/download/29189/ http://sc.nibbits.com/maps/project/27889/four-johnny
http://sc.nibbits.com/maps/download/32090/ http://sc.nibbits.com/maps/project/30595/open-quests-rpg
http://sc.nibbits.com/maps/download/32360/ http://sc.nibbits.com/maps/project/30816/what-the-fv2
http://sc.nibbits.com/maps/download/32536/ http://sc.nibbits.com/maps/project/30965/carters-cat-and-mouse
http://sc.nibbits.com/maps/download/32591/ http://sc.nibbits.com/maps/project/31009/the-fastest-shared-bases
http://sc.nibbits.com/maps/download/127536/ http://sc.nibbits.com/maps/project/70120/alien_forcec2b2scm
http://sc.nibbits.com/maps/download/128888/ http://sc.nibbits.com/maps/project/71460/dkdslipknots-bc-2scx
http://sc.nibbits.com/maps/download/129056 http://sc.nibbits.com/media/maps/129/56/Pleasure%20Kerrigan#2.scx (removed map and broken)
http://sc.nibbits.com/maps/download/129317/ http://sc.nibbits.com/maps/project/71876/blood-pressure-mara12c2618scx
http://sc.nibbits.com/maps/download/129662/ http://sc.nibbits.com/maps/project/72211/dbz-the-wizards-curse101scx
http://sc.nibbits.com/maps/download/130381/ http://sc.nibbits.com/maps/project/72810/re-apocalypse-file-2scx
http://sc.nibbits.com/maps/download/132870/ http://sc.nibbits.com/maps/project/74946/julio-salomon-mendoza-trelles
http://sc.nibbits.com/maps/download/134615/ http://sc.nibbits.com/maps/project/73073/miles-laser-tag-v3a-elitescx
http://sc.nibbits.com/media/maps/136/245/Horror%20Survival%20#1.scx

Unarchivable
http://sc.nibbits.com/maps/download/15389/ PvZ+Defence+SE.scx (archived now by Brave Browser)

Others
http://sc.nibbits.com/maps/download/?????/gif file
http://sc.nibbits.com/maps/download/15427/ Cat & Mouse in the jungle (No file type)
http://sc.nibbits.com/maps/download/14592/S.W.A.T [Gear-up] Readme.txt
http://sc.nibbits.com/maps/get/23414 (redirect)
http://sc.nibbits.com/maps/download/24105/ BW.ICO
http://sc.nibbits.com/maps/download/24115/ (redirect, Starfighters 24090)
Problems at page 550 - 549 due to browsers working with URL Opener.com, now fixed by Brave Browser
http://sc.nibbits.com/maps/download/26054/ S.A. doc.txt
http://sc.nibbits.com/maps/project/26284/ultima BW.ICO
Page 444 to 443, 51 downloads?! Or maybe I counted wrong (Update 8/26/19 Another map was added)
http://sc.nibbits.com/maps/download/29590/ BW.ICO
Page 306, March 22, 2009, Hunted v1.scx is the first of that date. Machinist's first upload perhaps, beginning of massive CnM maps uploading. (8/29/19)
Page 290, Between Income Def and Frogger Def there is a whole host of maps. 151 maps downloaded total, 127247 to 127425.
(8/29/2019) Another map was uploaded, 1 map missing somewhere.
From 272 below, very little gaps, as in many exact 50s. Gap closes much more later on.
Page 181, Between Special Forces Ex. and Heroes of Might there is a jump back, to 127250, going back to those host of maps. 3 maps skipped, probably hidden.
Pages 180-177 skipped except up to Thron.scx (177), presumably I have those maps downloaded
Page 100 is broken

Removed Maps
Another one somewhere before... (counted 51 downloads)
http://sc.nibbits.com/maps/download/122965/ Þý (4)Good Game Hunters(n).scx (Hidden map, project page deleted)
http://sc.nibbits.com/maps/download/124056/ (4)Thanatos(o).scx (Hidden map, project page deleted)
http://sc.nibbits.com/maps/download/125077/ Sexy Hydralisk Zones SexyHydraliskZones.scx (Hidden map, project page deleted)
http://sc.nibbits.com/maps/download/125575/ Kerrigan Has Sex With Duke.scm (Hidden map, project page deleted)
http://sc.nibbits.com/maps/download/125856/ Strip ashley massaro 2.2.scx
http://sc.nibbits.com/maps/download/125869/ Strip The Celeberties 1.3.scx
http://sc.nibbits.com/maps/download/125896/ delete-this empty.scm
http://sc.nibbits.com/maps/download/125900/ Strip The Celeberties 2.4.scx
http://sc.nibbits.com/maps/get/127784 (redirect, Trigger Happy Defense [v1.3a], http://sc.nibbits.com/maps/download/32242/, never downloaded before)
Page 274-273 51 downloads, Hidden map
Page 228-225 107 links, 5 page not found and 1 broken link, 1 extra map downloaded, Hidden map
Page 220-217 103 links, 1 redirect and 1 page not found, 1 extra map downloaded, Hidden map
Page 200-197 106 links, 1 extra download, Hidden map, probably "Sexy Pic Part 1"
Page 190-187 107 links, 5 page not found, 2 extra maps, Hidden maps
Page 186-183 103 links, 1 extra download, Hidden map, probably "Sexy Pic Part 9"
Page 174-173 228 links, 1 extra download, 1 broken link map, 50 maps downloaded
Page 172-171, 54 links, 1 page not found, 3 extra maps, HIdden maps
Page 170-166, 179 links, 129 downloads, 4 extra maps, Hidden maps
Page 165-161, 195 links, 128 downloads, 3 extra maps, Hidden maps
Page 160-157, 150 links, 107 downloads, 7 extra maps, Hidden maps
Page 156-153, 127 links, 107 downloads, 7 extra maps, Hidden maps
Page 144-141, 173 links, 101 downloads, 1 extra map, Hidden map
Page 140-137, 210 links, 110 downloads, 10 extra maps, Hidden maps
Page 128-125, 282 links, 124 downloads, 24 extra maps, Hidden maps
Page 104-101, 282 links, 101 downloads, 1 extra map, hidden map
Page 92-89, 455 links, 101 downloads, 1 extra map, hidden map
Page 45-41, 140 links, 130 downloads, 5 extra maps, hidden maps
Page 28-25, 112 links, 101 downloads, 1 extra map, hidden map



Yep, Warcraft 3 files is over 60000! Idk if I want to take the job of downloading them all. I'll consider it, and hopefully Nibbits.com stays online for a long time hosting these maps. They Must Implement Download All!

Attachments:
Left Off Page & Math.txt
Hits: 0 Size: 0.89kb
Broken File Links.txt
Hits: 0 Size: 7.84kb



None.

Sep 17 2019, 5:07 am NudeRaider Post #2

We can't explain the universe, just describe it; and we don't know whether our theories are true, we just know they're not wrong. >Harald Lesch

Nice!

Is there a reason you skipped the larger gaps? Should be no problem with your tools if thousands of pages turn out empty, right?




Sep 19 2019, 6:49 am Cerorec Post #3



Quote from NudeRaider
Nice!

Is there a reason you skipped the larger gaps? Should be no problem with your tools if thousands of pages turn out empty, right?

Yea... I should since I now I have tools. At first I didn't have the tools, and I was using archive.org, so I thought it would take too much time going through each and every number. Archive.org is quite slow to use too... due to a lot of things.

At first, 20 pages = 500 maps = 1 hour of my time each day = about 600 links visited, but now with my tools and techniques it was like 1500 maps per hour, going through like 3000+ links. What I'll probably do next is go through the entire numbers, from 1 to 141003 the latest map. But, the first map uploaded starts at number 14995, which is odd, so like http://sc.nibbits.com/maps/download/14995/ or http://sc.nibbits.com/maps/get/14995/.



None.

Sep 19 2019, 7:27 am Cerorec Post #4



I have a feeling this is going to take a very long time... I just opened up like
http://sc.nibbits.com/maps/get/1001
http://sc.nibbits.com/maps/get/1002
.
.
.
http://sc.nibbits.com/maps/get/1999
http://sc.nibbits.com/maps/get/2000
999 links at once, took around 4-5 minutes to load all pages completely using Brave Browser, and they are all "Page Not Found" links.

There may be other complications along the way. Stay tuned!

To add, probably the biggest reason I skipped the gaps because I assumed they were empty like "Page Not Found" links and to save time. That was before I had the tools, and I was starting out slow and tedious. It was not until like midway I discovered there are extra maps not found on those pages. So yea... sorry it took me awhile to refresh my memory.

Post has been edited 1 time(s), last time on Sep 19 2019, 7:49 am by Cerorec.



None.

Options
  Back to forum
Please log in to reply to this topic or to report it.
Members in this topic: None.
[05:43 pm]
Zoan -- NudeRaider
NudeRaider shouted: Zoan yes you can.
oh, yeah you’re right. Then yeah if you use an ai script it should be easy to farm unfinished buildings in some unused area on the map and just move them around, right?
[2019-10-17. : 6:06 am]
NudeRaider -- KrayZee
KrayZee shouted: Voyager7456 Somehow I misread your shout. "Glad I can entertain you in Nude" as if you sent a racy photo, video or something.
nah, he just made a comment that had us laughing very hard.
[2019-10-17. : 6:02 am]
NudeRaider -- Zoan
Zoan shouted: sraw531 you can’t move buildings afaik
yes you can.
[2019-10-16. : 10:03 pm]
Dem0n -- no
[2019-10-16. : 8:26 pm]
GGmano -- Is here a forum only for temple siege?
[2019-10-16. : 4:20 pm]
KrayZee -- Voyager7456
Voyager7456 shouted: Glad I can entertain you Nude
Somehow I misread your shout. "Glad I can entertain you in Nude" as if you sent a racy photo, video or something.
[2019-10-16. : 2:26 pm]
martosss -- Moose
Moose shouted: martosss IIRC, the plan was to go 64-bit only eventually so they're interested in differences between the versions
well I might have found 1 bug for them to fix - some maps load on 32 bit, but not on 64 bit game version
[2019-10-16. : 2:19 pm]
Zoan -- sraw531
sraw531 shouted: I'm pretty sure you would move the building away at some point. When you do so, you can give it to someone else. I was thinking nexi because its possible you could encourage the computer to expand to a specific spot
you can’t move buildings afaik
[2019-10-16. : 10:10 am]
Moose -- martosss
martosss shouted: jjf28 OK, I have 1 more question - are you using 32 bit SC:R or 64 bit ? In game settings there's an option to switch to 32, is it checked? I just tried hosting the map with 64-bit SC:R and it failed... I ticked the option to use 32 bit SC:R => it worked and map was hosted. So I guess the issue still exists for 64 bit SC:R ? I also tried calling a friend and he couldn't see the map when he entered the lobby. Weird, I might have to report this to Blizzard?
IIRC, the plan was to go 64-bit only eventually so they're interested in differences between the versions
[2019-10-16. : 5:27 am]
O)FaRTy1billion[MM] -- or a magic box :(
Please log in to shout.


Members Online: Roy, Zoan, KrayZee, jjf28