how_datvault_works []

This page is read only. You can view the source, but not change it. Ask your administrator if you think this is wrong.
====== How DATVault Works ======
DATVault acts as an indexing, updating, and delivery service for DATs. DATVault is designed to be flexible and it does not force you to organize your DATs in any specific way. 

{{ :diagrams:datvault-flow.png?nolink |}}

===== When are the DATs updated? =====

DATVault checks various sources for updates multiple times per day on a fixed schedule. Any updated DATs are processed and enriched with [[mia_rom_tracking|MIA tracking]] information. The table below outlines when regular DAT updates are processed and made available to download in the DATVault interface shortly thereafter:

|               ^  Update Time                                                                                                                                 |||||
^ DAT Category  ^ 3:00 AM CT  ^ 7:00 AM CT  ^ 11:00 AM CT  ^ 4:00 PM CT  ^ 9:00 PM CT  ^
| Archive       |  X                         |  X                          |  X                          |  X                         |  X                         |
| DeDupe        |  X                         |  X                          |  X                          |  X                         |  X                         |
| EmuArc        |  X                         |  X                          |  X                          |  X                         |  X                         |
| Emulators     |  X                         |  X                          |  X                          |  X                         |  X                         |
| FruitMachine  |  X                         |  X                          |  X                          |  X                         |  X                         |
| NoIntro       |  X*                        |  X*                         |  X*                         |  X*                        |  X*                        | 
| Others        |  X                         |  X                          |  X                          |  X                         |  X                         |
| Pinball       |  X                         |  X                          |  X                          |  X                         |  X                         |
| Pleasuredome  |  X                         |  X                          |  X                          |  X                         |  X                         |
| ReDump        |  X                         |  X                          |  X                          |  X                         |  X                         |
| Scene         |  X                         |  X                          |  X                          |  X                         |  X                         |
| Snaps         |  X                         |  X                          |  X                          |  X                         |  X                         |
| Tosec         |  X                         |  X                          |  X                          |  X                         |  X                         |

===== Why do some No-Intro DATs say Discontinued when they are not? =====

No-Intro DATs are sourced from Dat-o-Matic. There are occasions where a DAT is locked for editing or database cleanup. When a DAT is locked it is not available for download so it is marked as Discontinued until the download is available again.

<WRAP tip>  * If you see a No-Intro DAT marked as "Discontinued" you should disregard and monitor over the next several days. If you see a DAT discontinued for multiple days in a row, then the DAT may actually be discontinued.</WRAP>

===== What are the DATVault JSON files? =====

DATVault works by detecting special JSON files in your DatRoot. Each DAT you would like to manage has its own corresponding JSON file. Each file provides info about the DAT version you currently have. 

<WRAP important>The DATVault JSON files are not meant to be manually edited. Modifying the JSON files may cause DAT updates to not work properly. The information provided is for reference only.</WRAP>

The DATVault JSON files contain the following keys:
  * **''group''**: The group the DAT belongs to. Used for filters.
  * **''system''**: The name of the system.
  * **''date''**: The date the DAT was was last updated on the DATVault server.
  * **''dateCreated''**: The date the DAT was first added to DATVault. Used for the configurable "New" filter.
  * **''version''**: The version of the DAT.
  * **''datURL''**: The download filename for the current DAT.
  * **''cueURL''**: The download filename for cue pack of the DAT (if applicable).
  * **''datName''**: The file name of the current DAT.
  * **''directory''**: The default subdirectory the DAT will be downloaded to if the "Use default subdirectories" option is used when adding new DATs with the DATVault UI.
  * **''datROMsSize''**: The total uncompressed size of all ROMs in the DAT.

**Example DATVault JSON for MAME:**
<code>
{
   "group":"MAME",
   "system":"MAME ROMS (listxml)",
   "date":"2/23/2022 9:55:34 AM",
   "dateCreated":"9/7/2021 1:19:26 PM",
   "version":"V0.241",
   "datURL":"MAME V0.241 ROMS (listxml).zip",
   "cueURL":"",
   "datName":"MAME V0.241 ROMS (listxml).dat",
   "directory":"MAME ROMS (listxml)",
   "datROMsSize":307346898538
}
</code>

The information in the JSON file is compared against the DATVault repository to determine if there are updates available to download. If the JSON file you have does not match the latest version available by DATVault, then the corresponding DAT has an update. When you update a DAT, the JSON file is also updated.

<WRAP important>DATVault only manages DAT updates for DATs it has downloaded. It will NOT update DATs you have placed into your DATRoot manually. Its advised to remove any manually managed DATs before having DATVault manage those DATs.</WRAP>

<WRAP info>DATVault will download any updates into the same directory that contains the respective JSON file. Before a DAT is updated, the current DAT you have (which is referenced in your JSON file) will be renamed with a ''.old'' extension. DATVault does not automatically remove these ''.old'' DATs, so you may want to periodically delete them if you do not wish to archive old DATs.</WRAP>

<WRAP info>Some DATs for disc based systems have accompanying cue sheets. DATVault will download cue packs to a folder called ''cues'' in your Primary ToSort directory.</WRAP>

Now that you understand how DATVault works at a high level, refer to the next section to [[datvault_setup|get started using DATVault]].