Files scanned with local scan disappear after a few days

Q&A
1

Short version: Our files scanned by local scan are completely gone after a few days

Setup:

Newly installed Raspberry Pi 4 with raspbian.
We use iris, the API and the extension local and we start mopidy with sudo systemctl start mopidy.

Our local libray is located on a NAS with over 1000 albums.

This setup worked for years, then our SD card got corrupted and we made a clean install again.
In the old setup we executed the local scan (sudo mopidyctl local scan) every night, which we deemed unnecessary if no new music was added and stopped the regular scans. Unfortunately, now after a few days, all our files are neither visible in iris nor accessible via webhooks. (They are still on the NAS—it’s just the database which seems empty.)

The only fix we know is starting the full scan again every night—but that seems like a dirty workaround.
Can we somehow check why our files are gone? It happened after a power loss, for example.

Config (sudo mopidyctl config):

[core]
cache_dir = /var/cache/mopidy
config_dir = /etc/mopidy
data_dir = /var/lib/mopidy
max_tracklist_length = 10000
restore_state = false

[logging]
verbosity = 0
format = %(levelname)-8s [%(threadName)s] %(name)s %(message)s
color = false
config_file =

[audio]
mixer = software
mixer_volume =
output = alsasink
buffer_time =

[proxy]
scheme =
hostname =
port =
username =
password =

[local]
enabled = true
max_search_results = 100
media_dir = /mnt/music/moritz
scan_timeout = 5000
scan_flush_threshold = 100
scan_follow_symlinks = false
included_file_extensions =
excluded_file_extensions =
  .directory
  .html
  .jpeg
  .jpg
  .7z
  .JPG
  .db
  .docx
  .flp
  .fpl
  .fxp
  .gif
  .gp4
  .gp5
  .ini
  .jpg
  .mdd
  .pdf
  .pdn
  .pk
  .png
  .psd
  .rar
  .rtf
  .s3m
  .ses
  .tar
  .tif
  .ttf
  .txt
  .webp
  .wmv
  .zip
directories =
  Albums                  local:directory?type=album
  Artists                 local:directory?type=artist
  Composers               local:directory?type=artist&role=composer
  Genres                  local:directory?type=genre
  Performers              local:directory?type=artist&role=performer
  Release Years           local:directory?type=date&format=%25Y
  Tracks                  local:directory?type=track
  Last Week's Updates     local:directory?max-age=604800
  Last Month's Updates    local:directory?max-age=2592000
timeout = 10
use_artist_sortname = false
album_art_files =
  *.jpg
  *.jpeg
  *.png

[iris]
enabled = true
country = NZ
locale = en_NZ
verify_certificates = true
snapcast_enabled = true
snapcast_host = localhost
snapcast_port = 1780
snapcast_ssl = false
snapcast_stream = Default
spotify_authorization_url = https://jamesbarnsley.co.nz/iris/auth_spotify.php
lastfm_authorization_url = https://jamesbarnsley.co.nz/iris/auth_lastfm.php
genius_authorization_url = https://jamesbarnsley.co.nz/iris/auth_genius.php
data_dir = $XDG_DATA_DIR/iris

[file]
enabled = true
media_dirs =
  $XDG_MUSIC_DIR|Music
  ~/|Home
excluded_file_extensions =
  .directory
  .html
  .jpeg
  .jpg
  .log
  .nfo
  .pdf
  .png
  .txt
  .zip
show_dotfiles = false
follow_symlinks = false
metadata_timeout = 1000

[http]
enabled = true
hostname = ::
port = 6680
zeroconf = Mopidy HTTP server on $hostname
allowed_origins =
csrf_protection = true
default_app = mopidy

[m3u]
enabled = true
base_dir =
default_encoding = latin-1
default_extension = .m3u8
playlists_dir =

[softwaremixer]
enabled = true

[stream]
enabled = true
protocols =
  http
  https
  mms
  rtmp
  rtmps
  rtsp
metadata_blacklist =
timeout = 5000

Mopidy deps:

Executable: /usr/bin/mopidy
Platform: Linux-6.1.21-v8+-aarch64-with-glibc2.31
Python: CPython 3.9.2 from /usr/lib/python3.9
Mopidy: 3.4.1 from /usr/lib/python3/dist-packages
Mopidy-Local: 3.2.1 from /usr/local/lib/python3.9/dist-packages
  uritools: 4.0.2 from /usr/local/lib/python3.9/dist-packages
  Mopidy: 3.4.1 from /usr/lib/python3/dist-packages
  Pykka: 2.0.3 from /usr/lib/python3/dist-packages
  setuptools: 52.0.0 from /usr/lib/python3/dist-packages
Mopidy-Iris: 3.68.0 from /usr/local/lib/python3.9/dist-packages
  Mopidy: 3.4.1 from /usr/lib/python3/dist-packages
  Pykka: 2.0.3 from /usr/lib/python3/dist-packages
  setuptools: 52.0.0 from /usr/lib/python3/dist-packages
GStreamer: 1.18.4.0 from /usr/lib/python3/dist-packages/gi
  Detailed information:
    Python wrapper: python-gi 3.38.0
    Relevant elements:
      Found:
        uridecodebin
        souphttpsrc
        appsrc
        alsasink
        osssink
        oss4sink
        pulsesink
        id3demux
        id3v2mux
        lamemp3enc
        mpegaudioparse
        mpg123audiodec
        vorbisdec
        vorbisenc
        vorbisparse
        oggdemux
        oggmux
        oggparse
        flacdec
        flacparse
        shout2send
      Not found:
        flump3dec
        mad
2

Struggling to come up with a reason for this. The results of a local scan be saved to an sqlite database file, I think it’s in /var/lib/mopidy/local/.

3

Sorry for the delayed answer. Didn’t have much time in the last weeks to look after the problem. Today I found the error though. It’s kinda embarrassing, but I used a wrong path in the config (because I copied an old config file where the directory structure was different).

Thanks for the reply though! :slight_smile:

PS: I checked the db file prior to noticing the wrong path, and it was the same, before and after reboot.

4

This topic was automatically closed 182 days after the last reply. New replies are no longer allowed.