Seeking programer to fix and update POLUtils *Urgent Notice!*

[nikia]

When I replace the resources.xml, and do updateresources, POL crashes for some reason. Any idea on the cause?

Any word on what might be causing this, having same issue when i downloaded Feb 16 resource update and //updateresources.
Thank you

[Chrian]

how would I go about finding the hex code of the key items listed in Polutils?

[Chipya]

Procrastinating more important work to peek at how the code was written. Went after the low hanging fruit as an exercise and added in the missing information listed by Septimus. Having dat folders go higher than 255 made it a bit unhappy, but got that working, no way to distro though. In the version I have, the WotG maps are missing as well, is that just me?

Was wondering two things though. First is if there was some simple equation that converted the dat file name to the int used as the file id, used the alternate fields for the xml file. Second is if I was doing it wrong to manually update the ROMFileMappings.xml file to add in the missing menu items.

Ok, guess I should go be actually productive now.

[Hyshio]

Found the problem!

POLutils does need an update due to the fact once again SE changed their common files just like they did a few years ago. This is the info I have thx to a member on the windower forums.

Spell and ability data is scattered around in a total of 17 files. It used to be saved in 18 files. The 2 files that used to be used for the information that you're missing were replaced with a single file that now holds both spells and abilities. All of these files are listed in the POLUtils menu (if you are using the newest version). I'm not sure if the mass extractor processes all of these files if you use that feature.

All Languages (Common):
ROM/118/114.DAT : Spell & Ability Data (Level, MP Cost, Cast Time, Element, etc.) *This file is new*

Japanese:
ROM/181/68.DAT : Ability Names
ROM/181/69.DAT : Spell Names
ROM/181/70.DAT : Ability Descriptions
ROM/181/71.DAT : Spell Descriptions

English:
ROM/181/72.DAT : Ability Names
ROM/181/73.DAT : Spell Names
ROM/181/74.DAT : Ability Descriptions
ROM/181/75.DAT : Spell Descriptions

German:
ROM/181/76.DAT : Ability Names
ROM/181/77.DAT : Spell Names
ROM/181/78.DAT : Ability Descriptions
ROM/181/79.DAT : Spell Descriptions

French:
ROM/181/80.DAT : Ability Names
ROM/181/81.DAT : Spell Names
ROM/181/82.DAT : Ability Descriptions
ROM/181/83.DAT : Spell Descriptions

But yea I tried to use the current POLUtils common and it still didnt fix it. Soo POLUtils needs to be fixed again in order to find the new common. Luckly we know where it is this time compared to 2 years ago.

[Chipya]

I'm a little confused. Were you saying there might be a new file that is unknown or that 118/114.DAT is the correct one? The version I'm using has the latest Spells and Abilities in Common pointing to 118/114.DAT which was the last one found in the thread that Khamsin linked to earlier. The info in 114.DAT seems to line up properly, such as it looks like it properly aligns with Healing Breath IV, and the casting time for the Esuna entry is now 1s. What do you use as a mass extractor for the resources.xml? Is it possible that that is pointing to the old file still? Sorry if this info is known, still a lil new to this.

[Khamsin]

114.DAT should be correct, for spell/ability data. We found that much when Aikar came here last time looking for help.

I didn't know, however, where the names for them all were stored, which is what prevented me from producing a complete spells.xml that includes newly added spells, even though I had all the correct data for it.

[Kegsay]

if there was some simple equation that converted the dat file name to the int used as the file id

You could, but you'd need to do a scan of FTABLE and VTABLE to find the correct hex values which match up to the file id. Presumably having file IDs would be more robust to updates than hardcoded folders, but hey, this is SE.

I didn't know, however, where the names for them all were stored, which is what prevented me from producing a complete spells.xml that includes newly added spells, even though I had all the correct data for it.

I assume you still haven't found the location of where the names for them are stored?

[Chipya]

You could, but you'd need to do a scan of FTABLE and VTABLE to find the correct hex values which match up to the file id. Presumably having file IDs would be more robust to updates than hardcoded folders, but hey, this is SE.

Got it, thanks, wasn't sure exactly where to look.

[Septimus]

Found the problem!

POLutils does need an update due to the fact once again SE changed their common files just like they did a few years ago. This is the info I have thx to a member on the windower forums.

Spell and ability data is scattered around in a total of 17 files. It used to be saved in 18 files. The 2 files that used to be used for the information that you're missing were replaced with a single file that now holds both spells and abilities. All of these files are listed in the POLUtils menu (if you are using the newest version). I'm not sure if the mass extractor processes all of these files if you use that feature.

All Languages (Common):
ROM/118/114.DAT : Spell & Ability Data (Level, MP Cost, Cast Time, Element, etc.) *This file is new*

Japanese:
ROM/181/68.DAT : Ability Names
ROM/181/69.DAT : Spell Names
ROM/181/70.DAT : Ability Descriptions
ROM/181/71.DAT : Spell Descriptions

English:
ROM/181/72.DAT : Ability Names
ROM/181/73.DAT : Spell Names
ROM/181/74.DAT : Ability Descriptions
ROM/181/75.DAT : Spell Descriptions

German:
ROM/181/76.DAT : Ability Names
ROM/181/77.DAT : Spell Names
ROM/181/78.DAT : Ability Descriptions
ROM/181/79.DAT : Spell Descriptions

French:
ROM/181/80.DAT : Ability Names
ROM/181/81.DAT : Spell Names
ROM/181/82.DAT : Ability Descriptions
ROM/181/83.DAT : Spell Descriptions

But yea I tried to use the current POLUtils common and it still didnt fix it. Soo POLUtils needs to be fixed again in order to find the new common. Luckly we know where it is this time compared to 2 years ago.

These are all on the version of POLUtils found on Google Docs. This is the version that I have been using for several months now.

Also, if someone can tell me a reliable method for encoding Japanese, French, and German characters so they don't get messed up when exporting from a spreadsheet, I could make this part of my normal update day parsing routine.

[Chipya]

Ok, didn't realize there was a MassExtractor console program in there... Looks like it was never updated for the new location for the combined spells-abilities dat file. It's just a single line change though so I'm hesitant to assume that this is all that needs to be done to get things working. Looks like it only extracts the english files so I'm guessing something else is used to get all languages?

[Gwynplaine]

Bumping in light of expac news to ask about how up to date POLutils is. Are any new things like providence working?

[Radec]

Going through a number of fixes on it now. Provenance isn't currently added, but it's on the list. Expect a bump with additional fixes within the week.

[Septimus]

Hurray! I'm useful!

[achira]

Is more help needed?

[Julian]

Do you mind if I ask what kind of updates you made? I was planning on doing some all around updates to polutils, besides just throwing in the most recent dats in the menus, but I suppose it may be too late for that now

(Dunno if I'm coming back to the game yet, but I definitely have the time for random programming projects now)

[Radec]

SpellInfo2, AbilityInfo2, FFXIEncryption: May15th patch altered the spell/abil common table so the 2 12 13 bytes were no longer rotated, and added in several new unknown values. Prevented 2 12 13 from rotating and added several new unknown fields for each of them

MassExtractor: Extracts all the information used for windower's resources/ files to a seperate folder

ROMFileMappings, MainWindow: added MMM Slips and Vouchers to new items dats

Adjusted the filetable scans to allow for ROM/Folder/datnumber with folders higher than 255

Added a function to redirect the data browser to test server installs

Currently adding in the missing menu entries for abyssea maps, dynamis maps, miniexp mission lists, abys-heroes/paradox/legion/prov mob listings, mob-ws names, Abys-heroes/paradox/legion/prov dialog tables.

[Gwynplaine]

SpellInfo2, AbilityInfo2, FFXIEncryption: May15th patch altered the spell/abil common table so the 2 12 13 bytes were no longer rotated, and added in several new unknown values. Prevented 2 12 13 from rotating and added several new unknown fields for each of them

MassExtractor: Extracts all the information used for windower's resources/ files to a seperate folder

ROMFileMappings, MainWindow: added MMM Slips and Vouchers to new items dats

Adjusted the filetable scans to allow for ROM/Folder/datnumber with folders higher than 255

Added a function to redirect the data browser to test server installs

Currently adding in the missing menu entries for abyssea maps, dynamis maps, miniexp mission lists, abys-heroes/paradox/legion/prov mob listings, mob-ws names, Abys-heroes/paradox/legion/prov dialog tables.

Oh I'm impressed. I'm no programmer so idk how much of a pain all this is but thanks. No one seemed to know how the hell to get MMM stuff to display.

While you're at it want to look and see if it's possible to display the 2nd dialogue table for Whitegate somehow. Let me go try to find which file it was.

Edit: http://polutils.7.forumer.com/viewtopic.php?t=139

ROM 186 103.dat (Japanese)
ROM 186 97.dat (English)

[Radec]

Oh I'm impressed. I'm no programmer so idk how much of a pain all this is but thanks. No one seemed to know how the hell to get MMM stuff to display.

While you're at it want to look and see if it's possible to display the 2nd dialogue table for Whitegate somehow. Let me go try to find which file it was.

Edit: http://polutils.7.forumer.com/viewtopic.php?t=139

ROM 186 103.dat (Japanese)
ROM 186 97.dat (English)

Oh, sure, will add to to-do. If you can find the german and french dats for it too, that'll save some time - they're *probably* not nearby the en/jp ones but might be near the wg-1 de/fr ones

[Gwynplaine]

Ugh, I'm trying. But I only just reinstalled the game and have not yet run the check/update. And POLutils quickly crashes trying to load any dialogue files. I'll try an older version.

[Radec]

Ugh, I'm trying. But I only just reinstalled the game and have not yet run the check/update. And POLutils quickly crashes trying to load any dialogue files. I'll try an older version.

NP, I got them, thanks. Turns out quite a few of the files share an offset in the ftable vtable values, so knowing where one is makes it relatively easy to find them all.

"What are ftable vtable values?" More complicated than it's worth to learn, likely. Long as you can get me the english dat number, it's not too hard to find the rest.