Updating Media Database Stuck on Famicon Disk System - Mister

[captain-cutlery]

Hi,

First time setting up Zaparoo, attempting to update the media database and it hangs perpetually on Famicon disc System, I am running zaparoo-core 2.7 on the mister, specifically the multisystem 2.

I hope you can help.

Carl.

termbin logfile:

{"level":"debug","time":"1970-01-01T00:00:15Z","caller":"/build/pkg/config/config.go:131","message":"env config path: "} {"level":"info","time":"1970-01-01T00:00:17Z","caller":"/build/pkg/helpers/service.go:291","message":"service process started with PID 917"} ig.toml"} {"level":"info","time":"1970-01-01T00:00:17Z","caller":"/build/pkg/helpers/service.go:169","message":"starting service"} {"level":"info","time":"1970-01-01T00:00:17Z","caller":"/build/pkg/service/service.go:173","message":"version: 2.7.0"} {"level":"info","time":"1970-01-01T00:00:17Z","caller":"/build/pkg/service/service.go:177","message":"boot session UUID: b81ec1f4-2f45-4b75-bffb-290478251aa9"} {"level":"info","time":"1970-01-01T00:00:17Z","caller":"/build/pkg/service/service.go:62","message":"creating platform directories"} {"level":"info","time":"1970-01-01T00:00:17Z","caller":"/build/pkg/service/service.go:197","message":"running platform pre start"} {"level":"info","uid_count":0,"text_count":0,"time":"1970-01-01T00:00:17Z","caller":"/build/pkg/platforms/mister/platform.go:174","message":"CSV mappings loaded"} {"level":"info","time":"1970-01-01T00:00:17Z","caller":"/build/pkg/service/service.go:204","message":"opening databases"} {"level":"info","time":"1970-01-01T00:00:17Z","caller":"/build/pkg/database/migrations.go:39","message":"goose: no migrations to run. current version: 20251001185734"} {"level":"info","time":"1970-01-01T00:00:17Z","caller":"/build/pkg/database/migrations.go:39","message":"goose: no migrations to run. current version: 20251122041921"} {"level":"info","time":"1970-01-01T00:00:17Z","caller":"/build/pkg/service/service.go:131","message":"cleaning up scan history older than 30 days"} {"level":"info","time":"1970-01-01T00:00:17Z","caller":"/build/pkg/service/service.go:146","message":"closing hanging media history entries"} {"level":"info","time":"1970-01-01T00:00:17Z","caller":"/build/pkg/service/service.go:154","message":"cleaning up media history older than 365 days"} {"level":"info","time":"1970-01-01T00:00:17Z","caller":"/build/pkg/service/service.go:215","message":"initializing playtime limits"} {"level":"info","time":"1970-01-01T00:00:17Z","caller":"/build/pkg/service/service.go:244","message":"loading mapping files"} {"level":"info","time":"1970-01-01T00:00:17Z","caller":"/build/pkg/config/configmappings.go:76","message":"found 0 mapping files"} {"level":"info","time":"1970-01-01T00:00:17Z","caller":"/build/pkg/config/configmappings.go:104","message":"loaded 0 mapping files, 0 mappings"} {"level":"info","time":"1970-01-01T00:00:17Z","caller":"/build/pkg/service/service.go:250","message":"loading custom launchers"} {"level":"info","time":"1970-01-01T00:00:17Z","caller":"/build/pkg/config/configlaunchers.go:120","message":"found 0 custom launcher files"} {"level":"info","time":"1970-01-01T00:00:17Z","caller":"/build/pkg/config/configlaunchers.go:148","message":"loaded 0 files, 0 custom launchers"} {"level":"info","time":"1970-01-01T00:00:17Z","caller":"/build/pkg/service/service.go:256","message":"initializing launcher cache"} {"level":"info","time":"1970-01-01T00:00:17Z","caller":"/build/pkg/service/service.go:259","message":"checking for interrupted media indexing"} {"level":"info","time":"1970-01-01T00:00:17Z","caller":"/build/pkg/service/service.go:262","message":"checking for interrupted media optimization"} {"level":"info","time":"1970-01-01T00:00:17Z","caller":"/build/pkg/service/service.go:265","message":"starting API service"} {"level":"info","time":"1970-01-01T00:00:17Z","caller":"/build/pkg/service/service.go:269","message":"starting publishers"} {"level":"info","time":"1970-01-01T00:00:17Z","caller":"/build/pkg/service/service.go:274","message":"starting media history listener"} {"level":"info","time":"1970-01-01T00:00:17Z","caller":"/build/pkg/service/service.go:282","message":"starting media history PlayTime updater"} {"level":"info","time":"1970-01-01T00:00:17Z","caller":"/build/pkg/service/service.go:286","message":"starting clock reliability monitor"} {"level":"info","time":"1970-01-01T00:00:17Z","caller":"/build/pkg/service/service.go:294","message":"starting reader manager"} {"level":"info","time":"1970-01-01T00:00:17Z","caller":"/build/pkg/service/service.go:297","message":"starting input token queue manager"} {"level":"info","time":"1970-01-01T00:00:17Z","caller":"/build/pkg/service/service.go:300","message":"running platform post start"} {"level":"info","time":"1970-01-01T00:00:17Z","caller":"/build/pkg/platforms/mister/tracker/tracker.go:110","message":"starting tracker"} {"level":"info","time":"1970-01-01T00:00:17Z","caller":"/build/pkg/api/server.go:802","message":"starting HTTP server on :7497"} {"level":"info","time":"1970-01-01T00:00:17Z","caller":"/build/pkg/service/readers.go:296","message":"reader manager started, auto-detect=true"} {"level":"info","time":"1970-01-01T00:00:18Z","caller":"/build/pkg/platforms/mister/tracker/tracker.go:114","message":"loaded 2753 name mappings"} {"level":"info","old_core":"","new_core":"MENU","time":"1970-01-01T00:00:18Z","caller":"/build/pkg/platforms/mister/tracker/tracker.go:216","message":"core changed"} {"level":"info","time":"1970-01-01T00:00:18Z","caller":"/build/pkg/platforms/mister/tracker/tracker.go:597","message":"initializing file watcher for tracker"} {"level":"info","time":"1970-01-01T00:00:18Z","caller":"/build/pkg/platforms/mister/tracker/tracker.go:460","message":"starting file watcher"} {"level":"info","time":"1970-01-01T00:00:18Z","caller":"/build/pkg/platforms/mister/tracker/tracker.go:551","message":"created current path file: /tmp/CURRENTPATH"} {"level":"info","time":"1970-01-01T00:00:18Z","caller":"/build/pkg/platforms/mister/tracker/tracker.go:571","message":"file watcher setup completed in 856.03µs"} {"level":"info","time":"1970-01-01T00:00:18Z","caller":"/build/pkg/platforms/mister/tracker/tracker.go:603","message":"tracker initialization completed successfully"} {"level":"info","time":"1970-01-01T00:00:18Z","caller":"/build/pkg/service/service.go:306","message":"platform post start completed, service fully initialized"} {"level":"info","time":"1970-01-01T00:00:18Z","caller":"/build/pkg/service/readers.go:317","message":"no readers connected after 1 attempts, auto-detect=true"} {"level":"info","time":"1970-01-01T00:00:19Z","caller":"/build/pkg/readers/pn532/pn532.go:351","message":"PN532 reader opened: pn532uart:/dev/ttyUSB0"} {"level":"info","time":"1970-01-01T00:00:19Z","caller":"/build/pkg/service/autodetect.go:179","message":"successfully connected auto-detected reader: pn532_uart:/dev/ttyUSB0"} {"level":"info","time":"1970-01-01T00:00:26Z","caller":"/build/pkg/api/methods/systems.go:31","message":"received systems request"} {"level":"info","time":"1970-01-01T00:00:26Z","caller":"/build/pkg/api/methods/utils.go:30","message":"received version request"} {"level":"info","time":"1970-01-01T00:00:26Z","caller":"/build/pkg/api/methods/media.go:611","message":"received media request"} {"level":"info","time":"1970-01-01T00:00:26Z","caller":"/build/pkg/api/methods/history.go:31","message":"received tokens request"} {"level":"info","time":"1970-01-01T00:00:26Z","caller":"/build/pkg/api/methods/media.go:611","message":"received media request"} {"level":"info","time":"1970-01-01T00:00:26Z","caller":"/build/pkg/service/readers.go:312","message":"reader count changed: 1 connected"} {"level":"info","time":"1970-01-01T00:00:29Z","caller":"/build/pkg/api/methods/media.go:318","message":"received generate media request"} {"level":"info","time":"1970-01-01T00:00:29Z","caller":"/build/pkg/api/methods/media.go:220","message":"generating media db"} {"level":"info","time":"1970-01-01T00:00:29Z","caller":"/build/pkg/database/mediascanner/mediascanner.go:522","message":"checking database readiness for indexing"} {"level":"info","time":"1970-01-01T00:00:29Z","caller":"/build/pkg/api/methods/media.go:611","message":"received media request"} {"level":"info","time":"1970-01-01T00:00:29Z","caller":"/build/pkg/database/mediascanner/mediascanner.go:530","message":"determining indexing resume state"} {"level":"info","time":"2025-12-04T19:05:00Z","caller":"/build/pkg/platforms/mister/platform.go:240","message":"arcade database is up to date"} {"level":"info","time":"2025-12-04T19:05:00Z","caller":"/build/pkg/platforms/mister/platform.go:247","message":"arcade database has 2644 entries"} {"level":"info","time":"2025-12-04T19:05:01Z","caller":"/build/pkg/database/mediascanner/mediascanner.go:629","message":"preparing database for fresh indexing"} {"level":"info","time":"2025-12-04T19:05:01Z","caller":"/build/pkg/database/mediascanner/mediascanner.go:636","message":"starting indexing for systems: [3DO 3DS AcornAtom AcornElectron AdventureVision AliceMC10 Amiga Amiga1200 Amiga500 AmigaCD32 Amstrad AmstradPCW Android Apogee AppleI AppleII Aquarius Arcade Arcadia Archimedes Arduboy Astrocade Atari2600 Atari5200 Atari7800 Atari800 AtariLynx AtariST AtariXEGS Atomiswave Audio BBCMicro BK0011M C16 C64 CDI CPS1 CPS2 CPS3 CasioPV1000 CasioPV2000 ChannelF Chihiro Chip8 CoCo2 ColecoAdam ColecoVision CommanderX16 CreatiVision DAPHNE DICE DOS Dreamcast EDSAC FDS FM7 FMTowns GBA GBA2P GP32 Gaelco Galaksija Gamate GameCom GameCube GameGear GameMaster GameNWatch GamePocket Gameboy Gameboy2P GameboyColor Genesis GenesisMSU Groovy Hikaru Image Intellivision Interact J2ME Jaguar JaguarCD Jupiter Laser Lindbergh Lynx48 MSX MSX1 MSX2 MSX2Plus MacOS MacPlus MasterSystem MegaCD MegaDuck Model1 Model2 Model3 Movie MultiComp Multivision MusicAlbum MusicArtist MusicTrack NAOMI NAOMI2 NDS NES NESMusic NGage Namco22 Namco2X6 NeoGeo NeoGeoAES NeoGeoCD NeoGeoMVS NeoGeoPocket NeoGeoPocketColor Nintendo64 Odyssey2 Orao Oric Ouya PC PC88 PC98 PCFX PCXT PDP1 PET2001 PMD85 PS2 PS3 PS4 PS5 PSP PSX Pico8 PlugNPlay PocketChallengeV2 PokemonMini QL RX78 SAMCoupe SG1000 SGBMSU1 SNES SNESMSU1 SNESMusic SVI328 Saturn ScummVM Sega32X SeriesXS Singe Socrates SordM5 Specialist Spectravideo Sufami SuperACan SuperGameboy SuperGrafx SuperVision Switch TI994A TIC80 TRS80 TSConf TVEpisode TVShow TatungEinstein Thomson TomyTutor Triforce TurboGrafx16 TurboGrafx16CD UK101 VC4000 VIC20 VSmile Vector06C Vectrex Video VideopacPlus VirtualBoy Vita Wii WiiU Windows WonderSwan WonderSwanColor X1 X68000 Xbox Xbox360 XboxOne ZX81 ZXNext ZXSpectrum iOS]"} {"level":"info","time":"2025-12-04T19:05:01Z","caller":"/build/pkg/database/mediascanner/mediascanner.go:651","message":"checkpointing WAL before full database truncation"} {"level":"info","time":"2025-12-04T19:05:01Z","caller":"/build/pkg/database/mediascanner/mediascanner.go:660","message":"performing full database truncation (indexing 201 systems)"} {"level":"info","time":"2025-12-04T19:05:02Z","caller":"/build/pkg/database/mediascanner/mediascanner.go:665","message":"database truncation completed"} {"level":"info","time":"2025-12-04T19:05:02Z","caller":"/build/pkg/database/mediascanner/mediascanner.go:709","message":"seeding known tags for fresh indexing"} {"level":"info","time":"2025-12-04T19:05:03Z","caller":"/build/pkg/database/mediascanner/mediascanner.go:715","message":"successfully seeded known tags"} {"level":"info","time":"2025-12-04T19:05:03Z","caller":"/build/pkg/platforms/mister/platform.go:702","message":"starting amigavision scan"} {"level":"debug","time":"2025-12-04T19:05:08Z","caller":"/build/pkg/config/config.go:131","message":"env config path: "} {"level":"info","time":"2025-12-04T19:05:08Z","caller":"/build/pkg/api/methods/settings.go:82","message":"received settings update request"} {"level":"info","runZapScript":false,"time":"2025-12-04T19:05:08Z","caller":"/build/pkg/api/methods/settings.go:95","message":"update"} {"level":"info","time":"2025-12-04T19:05:08Z","caller":"/build/pkg/api/methods/history.go:31","message":"received tokens request"} {"level":"info","time":"2025-12-04T19:05:08Z","caller":"/build/pkg/api/methods/history.go:31","message":"received tokens request"} {"level":"info","time":"2025-12-04T19:05:12Z","caller":"/build/pkg/api/methods/settings.go:82","message":"received settings update request"} {"level":"info","runZapScript":true,"time":"2025-12-04T19:05:12Z","caller":"/build/pkg/api/methods/settings.go:95","message":"update"} {"level":"info","time":"2025-12-04T19:05:45Z","caller":"/build/pkg/service/service.go:344","message":"clock became reliable (NTP sync detected), healing timestamps"} {"level":"info","true_boot_time":"2025-12-04T19:04:27Z","uptime":78000,"time":"2025-12-04T19:05:45Z","caller":"/build/pkg/service/service.go:358","message":"calculated true boot time"} {"level":"debug","time":"2025-12-04T19:06:24Z","caller":"/build/pkg/config/config.go:131","message":"env config path: "} {"level":"info","time":"2025-12-04T19:06:24Z","caller":"/build/pkg/api/methods/settings.go:82","message":"received settings update request"} {"level":"info","runZapScript":false,"time":"2025-12-04T19:06:24Z","caller":"/build/pkg/api/methods/settings.go:95","message":"update"} {"level":"info","time":"2025-12-04T19:06:24Z","caller":"/build/pkg/api/methods/history.go:31","message":"received tokens request"} {"level":"info","time":"2025-12-04T19:06:24Z","caller":"/build/pkg/api/methods/history.go:31","message":"received tokens request"}

[wizzomafizzo]

Hi! Can you please try this beta release and let me know if it fixes the issue

https://github.com/ZaparooProject/zaparoo-core/releases/tag/v2.7.1-beta1

I have made some adjustments so media database updates run a bit safer

[captain-cutlery]

Hey pal,

Thanks for pointing me to the beta release, however it is still crazy slow, it has now gotten past the Famicom disk ayatem, but hangs on NES now indefinitely and times out.

I am using a CIFS mount via retronas, I am assuming this probably may have something to do with it, although I saw in the zaparoo changelog somewhere that it supports this feature, any other ideas? as it is essentially unusable which sucks after purchasing all the bits 😅.

[wizzomafizzo]

Hey pal,

Thanks for pointing me to the beta release, however it is still crazy slow, it has now gotten past the Famicom disk ayatem, but hangs on NES now indefinitely and times out.

I am using a CIFS mount via retronas, I am assuming this probably may have something to do with it, although I saw in the zaparoo changelog somewhere that it supports this feature, any other ideas? as it is essentially unusable which sucks after purchasing all the bits 😅.

How long are we talking exactly and how many games would you estimate in FDS and NES? And when say it's timing out is that an error message you see somewhere? If you can please get me a new log file to look at

I'm just curious now if this is a bug or the software is not setting expectations correctly. Indexing a tonne of games over CIFS yes it can take quite a while for example I routinely index 450k test games on the SD card and that already takes around 20 minutes. I would expect much slower on a NAS and several systems where it would appear stuck. It's kind of just the nature of the mister, it's a very slow CPU and IO being asked to do a lot of work

Anyway I'd appreciate if you can keep troubleshooting this with me. I have put a lot of time into optimising the index process for large collections and there shouldn't really be an upper limit. I'd like to get it fixed

[captain-cutlery]

Hi,

Sorry for the late response, I have been on holiday, I actually do not have any in the FDS which makes it even weirder, and I have all the USA, Europe, and japan releases so a fair few in the NES folder.

When I say timing out, it will be on the updating media files screen for around 20/30 mins then just times out I have to select update media files again.

I tested without the CIFS mount and it works fine. so it is 100% an over the network issue, which kind of sucks because all my roms are on my retronas. I don't think it is a bottleneck in speed ie my network as I have 1 gig internally everywhere, and I am able to mount PS1 games over the network via retronas on the mister fine. I am still perplexed 😅. will upload the log as soon as I am at home.