Staredit Network > Forums > Technology & Computers > Topic: Splitting a large file into smaller individual files
Splitting a large file into smaller individual files
Apr 28 2015, 5:17 am
By: rockz  

Apr 28 2015, 5:17 am rockz Post #1

ᴄʜᴇᴇsᴇ ɪᴛ!

There's a million programs out there which will take a large file and split it up in 500 MB increments, but I'd like to split up a large text file (or binary file) and search for header text.

For example, if I have a text file like this:
NEWFILE:The rain in Spain falls mainly on the plain.NEWFILE:Some people just want to watch the world burn.NEWFILE:When is a door not a door?

I want 3 files to be output with the following text in them:

The rain in Spain falls mainly on the plain.
Some people just want to watch the world burn.
When is a door not a door?

There has got to be an easy way to do this that someone has already come up with.

"Parliamentary inquiry, Mr. Chairman - do we have to call the Gentleman a gentleman if he's not one?"

Apr 28 2015, 5:26 am O)FaRTy1billion[MM] Post #2

👻 👾 👽 💪

This would be easy to do with probably any scripting language ... otherwise it'd be easy enough to throw together a simple C program for it.

TinyMap2 - Latest in map compression! ( 7/09/14 - New build! )
EUD Action Enabler - Lightweight EUD/EPD support! (ChaosLauncher/MPQDraft support!)
EUDDB - topic - Help out by adding your EUDs! Or Submit reference files in the References tab!
MapSketch - New image->map generator!
EUDTrig - topic - Quickly and easily convert offsets to EUDs! (extended players supported)
SC2 Map Texture Mask Importer/Exporter - Edit texture placement in an image editor!
\:farty\: This page has been viewed [img][/img] times!

Apr 28 2015, 5:27 am NudeRaider Post #3

We can't explain the universe, just describe it; and we don't know whether our theories are true, we just know they're not wrong. >Harald Lesch

Well it should be pretty easy to program yourself. You just gotta know how the header looks like*. Because individual files have an EOF Marker, which can obviously not be inside the large file to separate the subfiles.

* And that's why there's probably no program that does that yet, because every file(type) has a different header, if it has one at all.
But I'm assuming you know what's inside the large file so it should be doable.

Apr 28 2015, 1:51 pm Roy Post #4

An artist's depiction of an Extended Unit Death

Yeah, it's a trivial implementation. You could go and download LinqPad and then throw a few C# statements into it:
string text = File.ReadAllText(@"C:\path\to\file.txt");
string delimiter = "NEWFILE:";
string[] splits = Regex.Split(text, delimiter);
for (int i = 0; i < splits.Length; i++)
   if (!string.IsNullOrEmpty(splits[i]))
       File.WriteAllText(@"C:\path\to\file_" + i + ".txt", splits[i]);

But I went ahead and made a GUI for you in case you don't want to bother with all that. See attached. (Haven't tested it with non-text files, though.)

Hits: 1 Size: 10.5kb

  Back to forum
Please log in to reply to this topic or to report it.
Members in this topic: None.
[06:11 pm]
Ultraviolet -- :wob:
[2023-2-04. : 11:43 am]
Zycorax -- :wob:
[2023-2-03. : 6:54 pm]
Zoan -- :wob:
[2023-2-03. : 3:35 am]
Ultraviolet -- :wob:
[2023-2-02. : 3:26 am]
Ultraviolet -- :wob:
[2023-2-01. : 2:29 am]
Ultraviolet -- how about yourself?
[2023-2-01. : 2:29 am]
Ultraviolet -- pretty good elite ejaculator
[2023-1-31. : 10:07 pm]
ejac1337 -- How's it going guys?
[2023-1-31. : 2:59 pm]
No-Name-Needed-II -- @Ultraviolet Thanks! It wasn't easy defeating the TMOANC lol..
[2023-1-30. : 8:45 pm]
Ultraviolet -- No-Name-Needed-II
No-Name-Needed-II shouted: Nobody showed interest in Authoring a story for my KotK Shores of Hell terrain so I uploaded it to terrain genre, You'll never look at Asheworld Tileset the same way again :)
Checked it out last night, definitely looks interesting. Can tell a lot of effort went into it
Please log in to shout.

Members Online: No-Name-Needed-II, Roy