Staredit Network > Forums > Modding Discussion > Topic: Expanding DAT files
Expanding DAT files
May 22 2016, 6:00 am
By: O)FaRTy1billion[MM]  

Jan 3 2017, 2:29 am O)FaRTy1billion[MM] Post #21

👻 👾 👽 💪

datcc is a command-line program, you have to run it in command prompt with commands similar to the ones in the previous post



TinyMap2 - Latest in map compression! ( 7/09/14 - New build! )
EUD Action Enabler - Lightweight EUD/EPD support! (ChaosLauncher/MPQDraft support!)
EUDDB - topic - Help out by adding your EUDs! Or Submit reference files in the References tab!
MapSketch - New image->map generator!
EUDTrig - topic - Quickly and easily convert offsets to EUDs! (extended players supported)
SC2 Map Texture Mask Importer/Exporter - Edit texture placement in an image editor!
\:farty\: This page has been viewed [img]http://farty1billion.dyndns.org/Clicky.php?img.gif[/img] times!

Jan 3 2017, 6:16 am Wertyu Post #22



Farty, before anything my apologies for the ignorance. Thousands of thanks for the software!!!!



"Colonel Tom Kazansky was the best Wraith pilot in the Terran Dominion"

Emperor Arcturus Mengsk :horde:

Jan 3 2017, 8:39 am O)FaRTy1billion[MM] Post #23

👻 👾 👽 💪

Now I just need to finish it :P



TinyMap2 - Latest in map compression! ( 7/09/14 - New build! )
EUD Action Enabler - Lightweight EUD/EPD support! (ChaosLauncher/MPQDraft support!)
EUDDB - topic - Help out by adding your EUDs! Or Submit reference files in the References tab!
MapSketch - New image->map generator!
EUDTrig - topic - Quickly and easily convert offsets to EUDs! (extended players supported)
SC2 Map Texture Mask Importer/Exporter - Edit texture placement in an image editor!
\:farty\: This page has been viewed [img]http://farty1billion.dyndns.org/Clicky.php?img.gif[/img] times!

Jan 5 2017, 4:33 am Zoko-TkZ Post #24



I decompiled/recompiled sprites.dat extended to 550, added entries in the Datedit Data folder and changed the size in the def file. Looked in the origins file but didn't see anything relating to sprites.

On opening Datedit an error comes up, saying that the default sprites.dat is not a valid dat file, when the tab is selected the same error comes up along with two access violation errors. Every sprite entry loads up blank although I can see the extra spots that were put in.

I'm going to go back to defaults and give it another try, but if anyone might know what is wrong I'd appreciate the help.



None.

Jan 5 2017, 7:06 pm O)FaRTy1billion[MM] Post #25

👻 👾 👽 💪

I just tried it and got it to work.

Here is everything I did:

- DatCC commands:
Code
datcc -d -s -n 550 .
datcc -c -s -n 550 -e sprites.ini


- Copied the resultant sprites.dat into DatEdit\default\

- Edited DatEdit\Formats\Sprites.def: changed InputEntrycount and OutputEntrycount to 550, then deleted 1VarStart=130, 4VarStart=130, and 5VarStart=130 (somewhere along the line it was decided that extended dat files should have all properties for all entries -- my guess is this what was likely missed).
Here is the complete sprites.def I have:
Code
[HEADER]
Varcount=6
InputEntrycount=550
OutputEntrycount=550

[FORMAT]
0Name=Image File
0Size=2

1Name=Health Bar
1Size=1

2Name=Unknown2
2Size=1

3Name=Is Visible
3Size=1

4Name=Sel.Circle Image
4Size=1

5Name=Sel.Circle Offset
5Size=1


- And then added 33 entries to Datdit\Data\Sprites.txt:
Code
Sprite 517
Sprite 518
Sprite 519
Sprite 520
Sprite 521
Sprite 522
Sprite 523
Sprite 524
Sprite 525
Sprite 526
Sprite 527
Sprite 528
Sprite 529
Sprite 530
Sprite 531
Sprite 532
Sprite 533
Sprite 534
Sprite 535
Sprite 536
Sprite 537
Sprite 538
Sprite 539
Sprite 540
Sprite 541
Sprite 542
Sprite 543
Sprite 544
Sprite 545
Sprite 546
Sprite 547
Sprite 548
Sprite 549

(if you open in Notepad and disable Format->Word Wrap and enable View->Status Bar, the last line should be Ln 550)





TinyMap2 - Latest in map compression! ( 7/09/14 - New build! )
EUD Action Enabler - Lightweight EUD/EPD support! (ChaosLauncher/MPQDraft support!)
EUDDB - topic - Help out by adding your EUDs! Or Submit reference files in the References tab!
MapSketch - New image->map generator!
EUDTrig - topic - Quickly and easily convert offsets to EUDs! (extended players supported)
SC2 Map Texture Mask Importer/Exporter - Edit texture placement in an image editor!
\:farty\: This page has been viewed [img]http://farty1billion.dyndns.org/Clicky.php?img.gif[/img] times!

Jan 6 2017, 10:55 pm Wertyu Post #26



Emm happens the same to me but i tried to add some portraits with portdata.dat, for example with n 115



"Colonel Tom Kazansky was the best Wraith pilot in the Terran Dominion"

Emperor Arcturus Mengsk :horde:

Jan 7 2017, 6:45 pm O)FaRTy1billion[MM] Post #27

👻 👾 👽 💪

Unfortunately portdata hasn't been added to Dat Extender yet. But editing an extended portdata might be easier just to edit with the datcc ini files, because datedit incorrectly separates idle and talking portraits.

I did, however, get it to work in DatEdit just to see if it was possible.

Like before, datcc commands:
Code
datcc -d -p .
datcc -c -p -n 115 -e sprites.ini


Edit the def, however here you have to double the -n value because of datedit:
Code
[HEADER]
Varcount=3
InputEntrycount=230
OutputEntrycount=230


Then in Data\Portdata.txt, I added the following between "Flag (Blue) - Idle Portrait (Pl.12)" and "Marine - Talking Portrait" (so "Idle Portrait 110" should be on line 111)
Code
Idle Portrait 110
Idle Portrait 111
Idle Portrait 112
Idle Portrait 113
Idle Portrait 114

And this before the "None" at the bottom of the file:
Code
Talking Portrait 110
Talking Portrait 111
Talking Portrait 112
Talking Portrait 113
Talking Portrait 114




TinyMap2 - Latest in map compression! ( 7/09/14 - New build! )
EUD Action Enabler - Lightweight EUD/EPD support! (ChaosLauncher/MPQDraft support!)
EUDDB - topic - Help out by adding your EUDs! Or Submit reference files in the References tab!
MapSketch - New image->map generator!
EUDTrig - topic - Quickly and easily convert offsets to EUDs! (extended players supported)
SC2 Map Texture Mask Importer/Exporter - Edit texture placement in an image editor!
\:farty\: This page has been viewed [img]http://farty1billion.dyndns.org/Clicky.php?img.gif[/img] times!

Jan 8 2017, 12:04 am Wertyu Post #28



Damn i forget some little things in the process, but you take the job to enlight me again. More than appreciated



"Colonel Tom Kazansky was the best Wraith pilot in the Terran Dominion"

Emperor Arcturus Mengsk :horde:

Feb 5 2017, 12:28 am O)FaRTy1billion[MM] Post #29

👻 👾 👽 💪

I haven't fully tested it yet, but it now has Weapons.dat, Upgrades.dat and SfxData.dat. The biggest problem I can think of is loading from a CHK, I'm not sure if I made it read those wrong because I didn't check. xD

Upgrades require some editing of FireGraft, but fortunately it's really easy. In Data.mpq, just update the line that has UpgradeCount=61 in Firegraft\1161.fgd and then add the appropriate entries to Firegraft\upgradelist.txt. You can then edit dat reqs and such like normal.


Now all that's left is Techdata.dat (which after Upgrades.dat shouldn't be too bad) and Portdata.dat and fixing whatever is still broken in Units.dat.

Attachments:
DatExtend.qdp
Hits: 5 Size: 57kb



TinyMap2 - Latest in map compression! ( 7/09/14 - New build! )
EUD Action Enabler - Lightweight EUD/EPD support! (ChaosLauncher/MPQDraft support!)
EUDDB - topic - Help out by adding your EUDs! Or Submit reference files in the References tab!
MapSketch - New image->map generator!
EUDTrig - topic - Quickly and easily convert offsets to EUDs! (extended players supported)
SC2 Map Texture Mask Importer/Exporter - Edit texture placement in an image editor!
\:farty\: This page has been viewed [img]http://farty1billion.dyndns.org/Clicky.php?img.gif[/img] times!

Feb 5 2017, 5:46 am tehkain Post #30



Quote from O)FaRTy1billion[MM]
That's more just because it is incomplete. :P I dunno where to put the new names since adding them to stat_txt will sort of fuck up every other string ever. Also they should be able to have wireframes (I think in my test EXE I just reused wireframes instead of adding more).
(From the StarCraft: Origins topic)

For units.dat, couldn't you do something similar to your iscript extender (i.e. a stat_txt2 or units_txt)?



Master of something, master of not all.
-George H.W. Washington

"Ah, what beautiful bunker defenses I have here."
A wild 20 hydralisks appeared!

Feb 5 2017, 7:14 am O)FaRTy1billion[MM] Post #31

👻 👾 👽 💪

probably, I think that's what I had in mind. They don't not have names on purpose right now, I just haven't fixed it. :P



TinyMap2 - Latest in map compression! ( 7/09/14 - New build! )
EUD Action Enabler - Lightweight EUD/EPD support! (ChaosLauncher/MPQDraft support!)
EUDDB - topic - Help out by adding your EUDs! Or Submit reference files in the References tab!
MapSketch - New image->map generator!
EUDTrig - topic - Quickly and easily convert offsets to EUDs! (extended players supported)
SC2 Map Texture Mask Importer/Exporter - Edit texture placement in an image editor!
\:farty\: This page has been viewed [img]http://farty1billion.dyndns.org/Clicky.php?img.gif[/img] times!

Feb 9 2017, 2:23 am O)FaRTy1billion[MM] Post #32

👻 👾 👽 💪

I reuploaded datCC to the first post with a fix to iamges.dat to avoid crashes if you don't use the entries you add (Thanks tehkain).

(I think I compiled it correctly. :P)



TinyMap2 - Latest in map compression! ( 7/09/14 - New build! )
EUD Action Enabler - Lightweight EUD/EPD support! (ChaosLauncher/MPQDraft support!)
EUDDB - topic - Help out by adding your EUDs! Or Submit reference files in the References tab!
MapSketch - New image->map generator!
EUDTrig - topic - Quickly and easily convert offsets to EUDs! (extended players supported)
SC2 Map Texture Mask Importer/Exporter - Edit texture placement in an image editor!
\:farty\: This page has been viewed [img]http://farty1billion.dyndns.org/Clicky.php?img.gif[/img] times!

Jul 9 2017, 9:31 pm Pr0nogo Post #33



I'm in the process of converting my walkable doodads into grps for the sake of saving some tiles, but I want to conserve all vanilla functionality, which means adding dat entries to images.dat. Is there any chance of this being updated to support GPTP plugins and integrated into PyDAT?




Jan 7 2022, 9:38 pm O)FaRTy1billion[MM] Post #34

👻 👾 👽 💪

I forgot to post it here, but I have finally merged datext in to GPTP! 🥳

scbwdata.h has been modified so that 99% of the existing GPTP code does not need updating and nothing special needs to be done to access modified dat arrays. Pretty much the only thing is keeping track of "None" IDs, especially because they are often compared with inequalities rather than just == and !=.

Other notable changes:
- Dat tables are now sized dynamically, so no configuration is necessary. Just put the resized .dat files in your MPQ and this will detect the size & patch accordingly.
- Unit names can now be stored in an optional rez\unitnames.tbl so that stat_txt doesn't need to be completely reorganized to add unit names.

Additionally, I'm not sure if poiuy has linked or mentioned this anywhere official, but there is a branch of PyMS that lets you just right click and add new entries in PyDAT: https://github.com/poiuyqwert/PyMS/tree/expanded_dat_files
Edit: this developmental pyms branch and not stable, see poiuy's post below this one.

PyMS: https://github.com/poiuyqwert/PyMS

There are still very likely bugs as it is very difficult to test every case, but it seems to be mostly stable at this point from what testing Voyager and I have done.

Link: https://github.com/saintofidiocy/GPTP/tree/DatExtender

Post has been edited 2 time(s), last time on Oct 26 2022, 6:03 am by FaRTy1billion.



TinyMap2 - Latest in map compression! ( 7/09/14 - New build! )
EUD Action Enabler - Lightweight EUD/EPD support! (ChaosLauncher/MPQDraft support!)
EUDDB - topic - Help out by adding your EUDs! Or Submit reference files in the References tab!
MapSketch - New image->map generator!
EUDTrig - topic - Quickly and easily convert offsets to EUDs! (extended players supported)
SC2 Map Texture Mask Importer/Exporter - Edit texture placement in an image editor!
\:farty\: This page has been viewed [img]http://farty1billion.dyndns.org/Clicky.php?img.gif[/img] times!

Jan 7 2022, 10:02 pm poiuy_qwert Post #35

PyMS and ProTRG developer

Yeah I have not publicly released the expanded dat files branch of PyMS yet. PyDAT is not fully updated so some features will not work (like opening a directory) or will crash, though all files can be expanded and most of the core functionality should work (Voy has done some testing with it and seems to be having success working with it). There are also major refactors going on for the entire suite, which means other programs are either not available or may be buggy. If you do want to play with expanded dat's, my recommendation for now is to keep it as a separate install of PyMS and only use PyDAT, and continue to use the other programs from the official "master" release.

PyMS with Expanded DAT support in PyDAT has been officially released.

Post has been edited 1 time(s), last time on Oct 25 2022, 2:48 pm by poiuy_qwert.




Jan 7 2022, 10:24 pm O)FaRTy1billion[MM] Post #36

👻 👾 👽 💪

I guess I should have asked before linking it, I just figured it was fine since it's already visible on git and also invaluable to extended dat editing
edit: added notices to posts about it being a dev branch

Post has been edited 1 time(s), last time on Jan 7 2022, 10:43 pm by FaRTy1billion.



TinyMap2 - Latest in map compression! ( 7/09/14 - New build! )
EUD Action Enabler - Lightweight EUD/EPD support! (ChaosLauncher/MPQDraft support!)
EUDDB - topic - Help out by adding your EUDs! Or Submit reference files in the References tab!
MapSketch - New image->map generator!
EUDTrig - topic - Quickly and easily convert offsets to EUDs! (extended players supported)
SC2 Map Texture Mask Importer/Exporter - Edit texture placement in an image editor!
\:farty\: This page has been viewed [img]http://farty1billion.dyndns.org/Clicky.php?img.gif[/img] times!

Jan 7 2022, 10:57 pm Voyager7456 Post #37

Responsible for my own happiness? I can't even be responsible for my own breakfast

Thanks to both of you! I've been using both the expanded dat files branch of PyMS and GPTP DatExt for a while now and they're both truly amazing.



all i am is a contrary canary
but i'm crazy for you
i watched you cradling a tissue box
sneezing and sniffling, you were still a fox


Modding Resources: The Necromodicon [WIP] | Mod Night
My Projects: SCFC | ARAI | Excision [WIP] | SCFC2 [BETA] | Robots vs. Humans | Leviathan Wakes [BETA]


Options
  Back to forum
Please log in to reply to this topic or to report it.
Members in this topic: None.
[2024-4-14. : 9:21 pm]
O)FaRTy1billion[MM] -- there are some real members mixed in those latter pages, but the *vast* majority are spam accounts
[2024-4-14. : 9:21 pm]
O)FaRTy1billion[MM] -- there are almost 3k pages
[2024-4-14. : 9:21 pm]
O)FaRTy1billion[MM] -- the real members stop around page 250
[2024-4-14. : 9:20 pm]
O)FaRTy1billion[MM] -- look at the members list
[2024-4-12. : 12:52 pm]
Oh_Man -- da real donwano
da real donwano shouted: This is the first time I've seen spam bots like this on SEN. But then again, for the last 15 years I haven't been very active.
it's pretty common
[2024-4-11. : 9:53 pm]
da real donwano -- This is the first time I've seen spam bots like this on SEN. But then again, for the last 15 years I haven't been very active.
[2024-4-11. : 4:18 pm]
IlyaSnopchenko -- still better than "Pakistani hookers in Sharjah" that I've seen advertised in another forum
[2024-4-11. : 4:07 pm]
Ultraviolet -- These guys are hella persistent
[2024-4-11. : 3:29 pm]
Vrael -- You know, the outdoors is overrated. Got any indoor gym and fitness equipment?
[2024-4-10. : 8:11 am]
Sylph-Of-Space -- Hello!
Please log in to shout.


Members Online: eksxo, Roy