Staredit Network > Forums > Technology & Computers > Topic: Splitting a large file into smaller individual files
Splitting a large file into smaller individual files
Apr 28 2015, 5:17 am
By: rockz  

Apr 28 2015, 5:17 am rockz Post #1

ᴄʜᴇᴇsᴇ ɪᴛ!

There's a million programs out there which will take a large file and split it up in 500 MB increments, but I'd like to split up a large text file (or binary file) and search for header text.

For example, if I have a text file like this:
NEWFILE:The rain in Spain falls mainly on the plain.NEWFILE:Some people just want to watch the world burn.NEWFILE:When is a door not a door?

I want 3 files to be output with the following text in them:

The rain in Spain falls mainly on the plain.
Some people just want to watch the world burn.
When is a door not a door?

There has got to be an easy way to do this that someone has already come up with.

"Parliamentary inquiry, Mr. Chairman - do we have to call the Gentleman a gentleman if he's not one?"

Apr 28 2015, 5:26 am O)FaRTy1billion[MM] Post #2

👻 👾 👽 💪

This would be easy to do with probably any scripting language ... otherwise it'd be easy enough to throw together a simple C program for it.

TinyMap2 - Latest in map compression! ( 7/09/14 - New build! )
EUD Action Enabler - Lightweight EUD/EPD support! (ChaosLauncher/MPQDraft support!)
EUDDB - topic - Help out by adding your EUDs! Or Submit reference files in the References tab!
MapSketch - New image->map generator!
EUDTrig - topic - Quickly and easily convert offsets to EUDs! (extended players supported)
SC2 Map Texture Mask Importer/Exporter - Edit texture placement in an image editor!
\:farty\: This page has been viewed [img][/img] times!

Apr 28 2015, 5:27 am NudeRaider Post #3

We can't explain the universe, just describe it; and we don't know whether our theories are true, we just know they're not wrong. >Harald Lesch

Well it should be pretty easy to program yourself. You just gotta know how the header looks like*. Because individual files have an EOF Marker, which can obviously not be inside the large file to separate the subfiles.

* And that's why there's probably no program that does that yet, because every file(type) has a different header, if it has one at all.
But I'm assuming you know what's inside the large file so it should be doable.

Apr 28 2015, 1:51 pm Roy Post #4

An artist's depiction of an Extended Unit Death

Yeah, it's a trivial implementation. You could go and download LinqPad and then throw a few C# statements into it:
string text = File.ReadAllText(@"C:\path\to\file.txt");
string delimiter = "NEWFILE:";
string[] splits = Regex.Split(text, delimiter);
for (int i = 0; i < splits.Length; i++)
   if (!string.IsNullOrEmpty(splits[i]))
       File.WriteAllText(@"C:\path\to\file_" + i + ".txt", splits[i]);

But I went ahead and made a GUI for you in case you don't want to bother with all that. See attached. (Haven't tested it with non-text files, though.)

Hits: 1 Size: 10.5kb

  Back to forum
Please log in to reply to this topic or to report it.
Members in this topic: None.
[11:41 pm]
Ultraviolet -- moataz
moataz shouted: Why ths forum is so dead :rip::rip::rip:
Because SC:BW is 25 years old. It's lucky this community still exists at all
[11:10 pm]
Corbo -- NudeRaider
NudeRaider shouted: Corbo good thing you shouted that. When I first saw the post the community note wasn't there yet.
I PM'd roy that message and that made him post it as community notes xd
[02:30 pm]
Ultraviolet -- Dungeon-Master
Dungeon-Master shouted: Ultraviolet Yeah I've been a user since 2008 and lurker starting in 05. Been on and off and never really meddled with the others but without SEN I still wouldn't know extended editors exist.
I was stalking your profile a bit and stumbling on some buried treasure :lol: Fun little snapshot of our younger selves. There's a lot of good stuff in there: desperate long distance romances, broships, trolling, even a kind older woman helping to ease one's sorrows. I'm not making fun of you btw, we were all young and foolish. My history is just as embarrassing if not more so :P
[01:45 pm]
Ultraviolet -- Jacobjsdhfg
Jacobjsdhfg shouted: anyone active
certainly not active enough to respond within a minute :lol:
[12:05 pm]
NudeRaider -- or maybe we're all excited to see what you'll do when you feel unobserved.
[09:29 am]
Jacobjsdhfg -- maybe not
[09:29 am]
Jacobjsdhfg -- =))))))))))))))))))))))))
[09:29 am]
Jacobjsdhfg -- ?????
[09:29 am]
Jacobjsdhfg -- anyone active
[09:29 am]
Jacobjsdhfg -- hiiiiiii
Please log in to shout.

Members Online: Roy