Page 1 of 1

SyncThing

Posted: Fri Nov 05, 2021 3:59 pm
by stevil2k
Hello, does anyone have syncthing working properly on their mister setups? I can get the ARM binary to run from command line but struggling to get it to run at boot. Steps taken so far are to create an init.d script called /etc/init.d/S52syncthing which I can start and stop from the command line but it wont start at boot. Second idea was to use the S99user - user-startup.sh which also will start stop and restart from CMD but wont start at boot.

I understand that some distros require you to run update-rc.d however, I cannot find it in the usual /usr/sbin folder.

Any help would be appreciated.

Steve

Re: SyncThing

Posted: Fri Nov 05, 2021 6:36 pm
by AngelicLiver
That doesn't sound like the best of ideas. MiSTer isn't really meant to be used this way; the linux configuration is purposefully lean and the filesystem is intended to be largely read-only. Adding another service running in the background is asking for trouble imho.

I know there are scripts to allow you to sync saves with Google Drive or RClone anywhere you like, have you considered using those instead?

Re: SyncThing

Posted: Fri Nov 05, 2021 6:40 pm
by jca
I don't know about your script but I have one in /etc/init.d with the form S99xxx and it starts on bootup.

Re: SyncThing

Posted: Fri Nov 05, 2021 8:02 pm
by stevil2k
jca wrote: Fri Nov 05, 2021 6:40 pm I don't know about your script but I have one in /etc/init.d with the form S99xxx and it starts on bootup.
Good to know its possible! Where are you putting the syncthing binary? Maybe naming the script S99syncthing would help.

Re: SyncThing

Posted: Fri Nov 05, 2021 8:11 pm
by stevil2k
AngelicLiver wrote: Fri Nov 05, 2021 6:36 pm That doesn't sound like the best of ideas. MiSTer isn't really meant to be used this way; the linux configuration is purposefully lean and the filesystem is intended to be largely read-only. Adding another service running in the background is asking for trouble imho.

I know there are scripts to allow you to sync saves with Google Drive or RClone anywhere you like, have you considered using those instead?
I agree that adding services may add to stability issues but I also think there is merit in using this particular sync software over Gdrive and Rclone. Being able to seamlessly sync all my ROMS, HDF files and and save states across multiple platforms to use on either other Misters or emulators on phones, tablets, laptops, PCs seems worth trying. Of course, it could also end up as one big mess, long as I have a robust enough backup of my SD card then there is no real danger.

Re: SyncThing

Posted: Sat Nov 06, 2021 1:48 am
by jca
stevil2k wrote: Fri Nov 05, 2021 8:02 pm
jca wrote: Fri Nov 05, 2021 6:40 pm I don't know about your script but I have one in /etc/init.d with the form S99xxx and it starts on bootup.
Good to know its possible! Where are you putting the syncthing binary? Maybe naming the script S99syncthing would help.
I should have been more explicit, my script is not about syncthing but keeping my HDD spinning. It was just to tell you that it starts properly at boot so yours should also start. Did you try it manually and does it work?

Re: SyncThing

Posted: Sat Nov 06, 2021 9:17 am
by AngelicLiver
stevil2k wrote: Fri Nov 05, 2021 8:11 pm
AngelicLiver wrote: Fri Nov 05, 2021 6:36 pm That doesn't sound like the best of ideas. MiSTer isn't really meant to be used this way; the linux configuration is purposefully lean and the filesystem is intended to be largely read-only. Adding another service running in the background is asking for trouble imho.

I know there are scripts to allow you to sync saves with Google Drive or RClone anywhere you like, have you considered using those instead?
I agree that adding services may add to stability issues but I also think there is merit in using this particular sync software over Gdrive and Rclone. Being able to seamlessly sync all my ROMS, HDF files and and save states across multiple platforms to use on either other Misters or emulators on phones, tablets, laptops, PCs seems worth trying. Of course, it could also end up as one big mess, long as I have a robust enough backup of my SD card then there is no real danger.
Hey power to you for trying these things out, it just seems like a very roundabout way of doing it. SD wear aside SyncThing is relatively resource intensive for a little dual core 800MHz Cortex-A9.

SMB/CIFS support is great, if you have a NAS maybe consider running SyncThing on that?

Re: SyncThing

Posted: Mon Nov 08, 2021 6:07 pm
by stevil2k
jca wrote: Sat Nov 06, 2021 1:48 am
stevil2k wrote: Fri Nov 05, 2021 8:02 pm
jca wrote: Fri Nov 05, 2021 6:40 pm I don't know about your script but I have one in /etc/init.d with the form S99xxx and it starts on bootup.
Good to know its possible! Where are you putting the syncthing binary? Maybe naming the script S99syncthing would help.
I should have been more explicit, my script is not about syncthing but keeping my HDD spinning. It was just to tell you that it starts properly at boot so yours should also start. Did you try it manually and does it work?
Yeah running S99syncthing start works as expected. I think I will take AngelicLiver's advice on this one and look at an alternative way.

Re: SyncThing

Posted: Mon Nov 08, 2021 6:10 pm
by stevil2k
AngelicLiver wrote: Sat Nov 06, 2021 9:17 am
stevil2k wrote: Fri Nov 05, 2021 8:11 pm
AngelicLiver wrote: Fri Nov 05, 2021 6:36 pm That doesn't sound like the best of ideas. MiSTer isn't really meant to be used this way; the linux configuration is purposefully lean and the filesystem is intended to be largely read-only. Adding another service running in the background is asking for trouble imho.

I know there are scripts to allow you to sync saves with Google Drive or RClone anywhere you like, have you considered using those instead?
I agree that adding services may add to stability issues but I also think there is merit in using this particular sync software over Gdrive and Rclone. Being able to seamlessly sync all my ROMS, HDF files and and save states across multiple platforms to use on either other Misters or emulators on phones, tablets, laptops, PCs seems worth trying. Of course, it could also end up as one big mess, long as I have a robust enough backup of my SD card then there is no real danger.
Hey power to you for trying these things out, it just seems like a very roundabout way of doing it. SD wear aside SyncThing is relatively resource intensive for a little dual core 800MHz Cortex-A9.

SMB/CIFS support is great, if you have a NAS maybe consider running SyncThing on that?
Thanks for the suggestion, I think, as you pointed out, the strain on the SD card might be too much. I do have a NAS which is already running SyncThing so will investigate SMB/CIFS suggestion instead.

Re: SyncThing

Posted: Fri Jan 07, 2022 8:17 pm
by Wave
stevil2k wrote: Mon Nov 08, 2021 6:10 pm Thanks for the suggestion, I think, as you pointed out, the strain on the SD card might be too much. I do have a NAS which is already running SyncThing so will investigate SMB/CIFS suggestion instead.
I'm curious what you ended up doing. As you note, SyncThing would be a great boon for keeping MiSTers synced/backed up, but it does seem less than ideal to have it always running as a service.

(I wonder if it'd be feasible to run it on demand from a script, and then close it when it finishes current jobs. Or just reboot to close it.)

Re: SyncThing

Posted: Sat Jan 08, 2022 7:04 am
by dot-bob
I typically start syncthing under a script custom as needed. I find it can affect performance of the linux side of things and strange things can happen.

I also don't use it to sync roms as it can take hours just to scan everything to look for changes let alone transfer them. Roms don't change very often and I typically use FreeFileSync to sync the roms. I only use syncthing to sync settings, saves, and savestates between my NAS, two mister handhelds, and console setup.

It's also very important for the time be accurate on every system else the files can be overwritten by older versions.

Re: SyncThing

Posted: Sat Jan 08, 2022 7:18 am
by ericgus09
dot-bob wrote: Sat Jan 08, 2022 7:04 am I typically start syncthing under a script custom as needed. I find it can affect performance of the linux side of things and strange things can happen.

I also don't use it to sync roms as it can take hours just to scan everything to look for changes let alone transfer them. Roms don't change very often and I typically use FreeFileSync to sync the roms. I only use syncthing to sync settings, saves, and savestates between my NAS, two mister handhelds, and console setup.

It's also very important for the time be accurate on every system else the files can be overwritten by older versions.
You run syncthing on the mister itself? if so which arm binary did you use and how did you configure it since it seems to want to use a web addr on localhost .. kinda curious how you configured it ..I am also interested in doing an rsync sorta thing just for config files and such (no roms or hard disk/floppy images) .. would be very interested if you could elaborate and share how you got it all set up .. I want to do the same sorta thing, run it on demand from the mister scripts menu and say sync it over to my NAS .. I had been looking at rysnc but this tool seems nicer.

Re: SyncThing

Posted: Sat Jan 08, 2022 5:04 pm
by dot-bob
ericgus09 wrote: Sat Jan 08, 2022 7:18 am You run syncthing on the mister itself? if so which arm binary did you use and how did you configure it since it seems to want to use a web addr on localhost .. kinda curious how you configured it ..I am also interested in doing an rsync sorta thing just for config files and such (no roms or hard disk/floppy images) .. would be very interested if you could elaborate and share how you got it all set up .. I want to do the same sorta thing, run it on demand from the mister scripts menu and say sync it over to my NAS .. I had been looking at rysnc but this tool seems nicer.
You can run the standard 32 bit ARM version the packaged named something like syncthing-linux-arm-v1.XX.X.tar.gz. I created extracted it to a directory /media/fat/syncthing,

I placed a "start_syncthing.sh" script under /media/fat/Scripts with the content:

Code: Select all

#!/bin/bash

BASE_PATH="/media/fat/syncthing/config"


"/media/fat/syncthing/syncthing-linux-arm-v1.18.0/syncthing" -home="$BASE_PATH" 2>/dev/null &

echo
echo "syncthing started on port: 8384"
echo
exit 0
I don't recall if I needed to explicitly allow connections from the network vs localhost. If I did I just manually edited the config to allow it then configured the rest via the web ui. Just remember to use the default port or the port you specified in the URL you use to access it. I just left mine to the default port 8384 as I am never on a public or insecure network.

Re: SyncThing

Posted: Sun Jan 09, 2022 7:22 am
by ericgus09
Excellent thank you!