Bay 12 Games Forum

Please login or register.

Login with username, password and session length
Advanced search  
Pages: [1] 2 3 ... 11

Author Topic: World Viewer for DF 44! [Updated 12-16-17]  (Read 123438 times)

Mason11987

  • Bay Watcher
    • View Profile
World Viewer for DF 44! [Updated 12-16-17]
« on: July 22, 2013, 04:52:23 pm »

World Viewer has been updated for DF 44!  Version 2.5.0

World Viewer provides an alternative way of viewing Dwarf Fortress world information (Similar to Legends Viewer by Parker147), created by parsing information supplied by the export option in legends mode.  Here are some screenshots of World Viewer in action.

Download (Windows): on DFFD - 64 bit version here (use the first link if you aren't sure which you need)  Source is on BitBucket.

Spoiler: Select screenshots (click to show/hide)

  • Presents information exported from worldgen - World Gen Parameters, Civilizations, Gods, Leaders, Races, Sites, Structures, Regions, Undeground Regions, Artifacts, World Constructions, Entities, Entity Populations, Historical Figures, Historical Events, Historical Event Collections, Historical Eras.  Including information not directly available in Legends mode:
    • Historical Figure family trees!
    • Battle and War summary information
    • Dynasty details
    • Mountain Peaks
    • Rivers
    • Race populations in specific regions
  • Simple navigation - Efficient navigation between different objects and all their relationships to each-other, including the ability to trace backwards and forwards after navigating through connections.
  • Support for huge XML Files - Fully parsed up to 4.7GB XML from legends export in 64 bit version.
  • Full export to sqlite - To allow more simplified analysis by any other tools.  sqlite database is <20% the size of the XML and encapsulates maps and history/site file data as well. Temporarily disabled
  • World Map - Shows world map overlaid with interesting information including sites, and civilizations.  Allows map selection to view with any of the detailed maps exported from legends mode.
  • World Timeline - Civ IV-like timeline of world events, filterable by importance.  Replay the development and build up of the world and the conflicts of it's participants, while the interesting bits are highlighted on a map.
  • Mod support - Designed to be as mod compatible as possible, tested across at least a dozen popular mods.
  • DFHack Integration - A DFHack script is included which allows extra details to be exported beyond the still incomplete XML export provided within legends mode.  Use of DFHack to export these details is the recommended use of World Viewer.  DFHack
  • Open Source! - And usefully commented! To ensure it continues to be useful even if I'm unable to continue to support it.  Source available on bitbucket
  • Dynamic filtering - Allows you to easily configure what you view, so if you want to see all the still living civilization leaders which have killed >15 things but less than 100 and listed as male, you can do that!

Please let me know what you think and if you have any suggestions!
« Last Edit: December 16, 2017, 10:09:09 pm by Mason11987 »
Logged

PeridexisErrant

  • Bay Watcher
  • Dai stihó, Hrasht.
    • View Profile
Re: World Viewer Updated! (for 34.11)
« Reply #1 on: July 22, 2013, 07:48:13 pm »

PTW
Logged
I maintain the DF Starter Pack - over a million downloads and still counting!
 Donations here.

laularukyrumo

  • Bay Watcher
  • Needs More Socks
    • View Profile
Re: World Viewer Updated! (for 34.11)
« Reply #2 on: July 23, 2013, 12:27:14 am »

Figures this would come out right as 34.11 is on the chopping block. :P Hoping you update it for the new version when it comes around though.
Logged
Quote from: Dwarfotaur
Everytime one of my militia has given birth in the Danger Room, it's lead to instant baby smoothies for everyone.

Gotta Catch 'Em All!

Dat Sig Thread

Matoro

  • Bay Watcher
  • if you drive alone you drive with hitler
    • View Profile
Re: World Viewer Updated! (for 34.11)
« Reply #3 on: July 23, 2013, 02:31:22 am »

So it's like a Legends Viewer but better?
Logged

Mason11987

  • Bay Watcher
    • View Profile
Re: World Viewer Updated! (for 34.11)
« Reply #4 on: July 23, 2013, 05:46:18 am »

Figures this would come out right as 34.11 is on the chopping block. :P Hoping you update it for the new version when it comes around though.

Yeah.... I just kept adding features trying to wait Toady out but I didn't have anything else I could think of :).

Edit -

I completely forgot to mention I included complex (and simple) filtering, using the textbox and the "filter" button at the bottom of every list of things.  This is a screen shot of the filter screen accessed from that button:

Spoiler: Filtering (click to show/hide)

The textbox filters like legends mode does, or at least as close as I could get.
« Last Edit: July 23, 2013, 08:21:07 am by Mason11987 »
Logged

ORCACommander

  • Bay Watcher
  • [ETHIC:TORTURE_ELVES: PERSONAL_MATTER]
    • View Profile
Re: World Viewer Updated! (for 34.11)
« Reply #5 on: June 19, 2014, 08:24:40 pm »

i am gona bump this since my 10k year world gen forced him to do some overhauls :P
Logged

BigD145

  • Bay Watcher
    • View Profile
Re: World Viewer Updated! (for 34.11)
« Reply #6 on: June 19, 2014, 10:06:02 pm »

Figures this would come out right as 34.11 is on the chopping block. :P Hoping you update it for the new version when it comes around though.

It shouldn't be that hard to update since it's just taking legends exports.
Logged

Mason11987

  • Bay Watcher
    • View Profile
Re: World Viewer Updated! (for 34.11)
« Reply #7 on: June 20, 2014, 02:16:16 pm »

It depends on how much has changed. The last update gave a ton of new data but little of the old stuff was changed and that will probably be the case with this one too (hopefully).  Like orca said though his 4.7 GB XML file made me improve some things and optimize the whole process. It also fails a lot more gracefully when you try to kill it with a file that big on a 32 bit os.  Finally that file showed me a few rare world gen situations I hadn't seen before. So all that and a few more details will be incorporated into the new version as well as any new world details.

I'm most excited to be able to retire multiple forts and have things happen in the world around them.
« Last Edit: June 20, 2014, 02:31:16 pm by Mason11987 »
Logged

Timeless Bob

  • Bay Watcher
    • View Profile
Re: World Viewer Updated! (for 34.11)
« Reply #8 on: June 21, 2014, 03:26:28 am »

I'd suggest you run this bad boy on the latest save file for "The Museum".  I think there's 80+ years of Player-made history in there, not to mention some pretty interesting embarks.
Logged
L33tsp34k does to English what Picasso did to faces.

Dwarfopoly
The Luckiest Tourist EVER
Bloodlines of the Forii

Mason11987

  • Bay Watcher
    • View Profile
Re: World Viewer Updated! (for 34.11)
« Reply #9 on: June 23, 2014, 12:55:48 pm »

I'd suggest you run this bad boy on the latest save file for "The Museum".  I think there's 80+ years of Player-made history in there, not to mention some pretty interesting embarks.

Good call, was able to run this and it actually identified a bug (something called "autochop" stores stuff in a historical figure ID -100?) which I addressed, and three historical events I had not ever actually seen, and only knew existed because today had posted the full list of events, two of which provide a lot of good data "site died" and "hf reached summit".  Thanks for the suggestion!  I'm going to address these and maybe use this as a test bed for some story generation ideas I've had.

PeridexisErrant

  • Bay Watcher
  • Dai stihó, Hrasht.
    • View Profile
Re: World Viewer Updated! (for 34.11)
« Reply #10 on: June 23, 2014, 05:13:53 pm »

This is a know bug - dfhack stores lot of data in fake historical figures in binary format, which then corrupts xml exports.  I think it's meant to be fixed in r5, but I haven't tested that yet and it's good to hear it can be addressed on your end too (since exporting from a game without dfhack would keep the corruption). 
Logged
I maintain the DF Starter Pack - over a million downloads and still counting!
 Donations here.

ORCACommander

  • Bay Watcher
  • [ETHIC:TORTURE_ELVES: PERSONAL_MATTER]
    • View Profile
Re: World Viewer Updated! (for 34.11)
« Reply #11 on: June 23, 2014, 11:31:16 pm »

want to run some 10k's on smaller worlds as well?
Logged

Mason11987

  • Bay Watcher
    • View Profile
Re: World Viewer Updated! (for 34.11)
« Reply #12 on: June 25, 2014, 07:22:54 am »

This is a know bug - dfhack stores lot of data in fake historical figures in binary format, which then corrupts xml exports.  I think it's meant to be fixed in r5, but I haven't tested that yet and it's good to hear it can be addressed on your end too (since exporting from a game without dfhack would keep the corruption).

Yeah, I just assume that all negative IDs in the XML are ignored now (you get a note about it when it happens).  I don't see any reason for Toady to start using them.  If something changes (like a dfhack add-on creates data in those that might be useful to me) I can check it out then.

As far as I know it doesn't really corrupt the export outside of adding a weird additional item with a negative id.  Unless there are some examples of dfhack that does break it I've never seen.  Feel free to forward me any good examples you have of that.

want to run some 10k's on smaller worlds as well?

Yeah, I did this a lot while testing, since they were great ways of testing huge family trees.

Mason11987

  • Bay Watcher
    • View Profile
Re: World Viewer Updated! (for 34.11)
« Reply #13 on: July 08, 2014, 07:37:42 am »

    Working on an update although it appears it can handle new worlds, with a few warnings for new events that were unknown of course.  Until then here's some details I'm gathering:

    df 40.01 XML changes discovered (will edit)

    • Structures can be created by a single historical figure now - created structure event now has builder_hfid sometimes
    • Structures can be created by a single historical figure now - created site event now has builder_hfid sometimes
      • These sites are at least sometimes of a new type, vault and are populated by "Dead Fighters" and "Protected Assistants" and a "Monster of Ast" (not the builder)
    • Looks like demons can make artifacts (and do this before time)?  I don't think I've seen that before
    • New agreement formed event, with agreement_id.  Agreement ID seems to just be a count, and isn't referenced anywhere else in the XML
    • New site dispute event, with details, for example: <dispute>grazing rights</dispute><entity_id_1>18</entity_id_1><entity_id_2>24</entity_id_2><site_id_1>6</site_id_1><site_id_2>11</site_id_2>, here are the disputes I've seen so far:
      • grazing rights
      • rights-of-way
      • water rights
      • territory
      • livestock ownership
      • fishing rights
    • New hf attacked site event, with details (attacker, defenderciv, defendersiteciv, site) - these appear to all be part of a Beast Attack event collection as expected
    • New hf destroyed site event, with details (attacker, defenderciv, defendersiteciv, site) - these appear to all be part of a Beast Attack event collection as expected
    • New replaced structure event, with details (civ, siteciv, site, "old ab id" and "new ab id") - looks like old ab id is always 0 and new ab id is always 2 and is always followed with a created structure event with structure id of 3.
    • New site tribute forced event, with details (attacker civ, defender civ, site civ, site)
    • Thefts and Abductions can now include sub-event collections, they didn't previously
    • Historical Figures can now be associated with Sites with a "hangout" site link (in addition to the previous lair/home structure/seat of power/home site building/home site underground)
    • Entity (Former) Position Links for historical figures don't always include start_year now.



It looks like there are two sets of events that occur right at the beginning of each world, which are related to the new Created Site, and Created Structure events.

Here are some details (for me) and for anyone who cares:

All together
  • Created Structure - (time), DEMON thrust a spire of slade up from the underworld naming it STRUCTURE, and established a gateway between worlds in SITE.
  • Add hf Entity Link - (time), DEMON became the master of CIV
    -CIV is owner of SITE
  • Change HF State - (time), DEMON settled in SITE.
  • Add HF Site Link - (time), DEMON ruled from STRUCTURE of CIV in SITE.

All together
  • Created Site - (time), DEMON created NEWSITE.
  • Artifact Created - (time), ARTIFACT was created by DEMON.
  • Agreement Formed - (time), GOD aided the DEMONRACE DEMON in becoming a permanent part of the living world that great fortresses might be raised and tested in siege.  The ritual took place in NEWSITE using ARTIFACT.
  • Artifact Stored - (time), ARTIFACT was stored in NEWSITE by DEMON

It looks like if the first set exists, the other does as well for the same Demon, but there may be multiple ones of these, and all of the multiples of the first set come before the second set.



Now just need to get my hands on some saves which have a decent amount of play time on a fortress to verify nothings changed there, and I should be able to update this today.
« Last Edit: July 08, 2014, 01:13:28 pm by Mason11987 »
Logged

Mason11987

  • Bay Watcher
    • View Profile
Re: World Viewer Updated! (for DF 40.01)
« Reply #14 on: July 09, 2014, 08:23:54 am »

World Viewer has been updated!

There is likely still some work to do, my testing for player-ran forts has been limited.  So if you run into any issues with mature forts please let me know and upload your save and I'll take a look.

There are a significant amount of changes since the last release, including of course support for the changes in world generation in the new version.  I'll post a summary of the other changes soon.


So let me know what you think!

DFFD Link

Edit - Fixed a bug with filtering on Race/Caste
Edit - Made a few changes to handle player-forts better (including new event Site Retired)
« Last Edit: July 09, 2014, 08:22:10 pm by Mason11987 »
Logged
Pages: [1] 2 3 ... 11