How to set up an automatically generated database from DAT files like YG/ZAM/etc.?

[NyK]

All of these sites datamine the same way, because the URL of each item's page contains the same item#. I would like to do something similar, but I don't know the first thing about datamining. How do these sites pull this data and (seemingly) automatically upload it?

Can anyone point me in the right direction? What program(s)/software do I need to get started?

I have a lot of experience with websites/etc., but this is new to me. I can set up databases, I just need help getting these items datamined and automatically inserted into said database(s).

Your help would be much appreciated.

[tymora]

1. First download this FFXIVTool from http://cosmosa.jp/ffxivtool/
-> Just a DAT Parser

2. Dump the data into CSV file format

3. Parse the CSV file and put the data into your database of choice.

The item number is the same because that is the actual id from FFXIV it seems.

[NyK]

Just a bump on this old thread...

I have all of the data dumped into CSV file format, but how do I go about parsing it into my database? I can create databases via cPanel, but I am unsure how to go about converting the CSV file correctly. Is there a gold standard for doing so? I am researching, but if anyone can offer a clear solution/method that would really help. Do I need to do it directly through PHPMyAdmin?

Thanks.

[Drako]

if you know PHP and jquery you can try datatables