I’m not sure if this is a feature bug, a documentation bug or simple user error but I have yet to successfully sync files from my MBP M1 Max to my Debian server. I’ve tried many different iterations starting as far back as preview 41 and as recent as RC9. I can get the machines to connect and accept the library invitation but the only thing that happens on the server is that the library folder and .aspectnode file are created. On the MBP it immediately goes to “Up to date”. My library is ~2TB so should definitely take more than a sec to verify everything is copied over.
What have I tried (Always starting from the library on the MBP):
Scenario 1: Preload the files on the server in the library path, exactly matching the MBP structure then add a photo on a. the MBP (didn’t sync to server) or b. the server (didn’t sync to the MBP)
Scenario 2: Start from a completely empty directory on the server (no files sync’d)
I’ve tried both scenarios running natively as root, natively as myself and natively as an aspect-specific user always with the same results
I’ve also tried both scenarios running in a custom docker container that I’ve built, again using different users, but again nothing.
I seem to have the server up and working correctly as the systems do connect and I see the library folder/file appear on the server. I just can’t get it to actually do anything.
Please let me know what I might be doing wrong or what other information I can provide to help understand what I’m experiencing
The current web UI doesn’t display the clone progress, yet*, and it takes a while until the actual files will be copied (the first two phases are copying library revisions and cached metadata/thumbnails). So my guess would be that it was still in one of the two earlier stages, especially if the library is rather large.
* The output (stdout/stderr) of the server process should show the current progress, though.
My most recent attempt has been running since yesterday. It failed with a segmentation fault so I restarted aspect-web on my server and aspect on my MBP but all I’ve seen in stdout/err is a warning and an error. Here’s my console output since initially connecting and accepting the invitation:
Listening for requests on https://0.0.0.0:37629/
Listening for requests on http://0.0.0.0:8083/
Recived request showInvitation library='Family Aspect Library'.
Request accepted.
Clone library to '/home/chris/.local/lib/aspect-web/libraries/Family Aspect Library'
Cloning library revisions count: 0/0 bytes 0/0
[main(Kmud) ERR] Failed to test library instance membership: Unknown library instance ID: 01JNVJ3BDRJR8CBQEEAKPYCH94
Storing library structure...
done.
Acquiring library lock...
Loading cache...
Loading revisions...
Loading library...
Loading existing library in file:///home/chris/.local/lib/aspect-web/libraries/Family%20Aspect%20Library
Preloading cached metadata...
Loading missing metadata...
Loading weak checksums...
Setting up duplicate detector...
Computing reduced initial file relations...
Triggering full initial file relations...
Cloning library revisions count: 0/0 bytes 0/0
Cloning library revisions count: 0/26 bytes 0/0
Segmentation fault
chris@nas-02:~/aspect/aspect-web$ ./aspect-web -p ./public -b 0.0.0.0:8083 --user=aspect --group=media
Listening for requests on https://0.0.0.0:44201/
Acquiring library lock...
Loading cache...
Loading revisions...
[main(iC2f) WRN] No HEAD revision found in /home/chris/.local/lib/aspect-web/libraries/Family Aspect Library/.revs! Assuming that no change history exists.
Loading library...
Loading existing library in file:///home/chris/.local/lib/aspect-web/libraries/Family%20Aspect%20Library
Preloading cached metadata...
Loading missing metadata...
Loading weak checksums...
Setting up duplicate detector...
Computing reduced initial file relations...
Triggering full initial file relations...
Listening for requests on http://0.0.0.0:8083/
[main(M6t+) WRN] Failed to get remote address for TCP connection
[main(M6t+) ERR] HTTP connection handler has thrown at the peer <UNSPEC>: Accepting SSL tunnel returned an error: non-recoverable socket I/O error: 0 (Success)
[main(IJg9) WRN] Failed to get remote address for TCP connection
[main(IJg9) ERR] HTTP connection handler has thrown at the peer <UNSPEC>: Accepting SSL tunnel returned an error: non-recoverable socket I/O error: 0 (Success)
edit: I just quit aspect-web to restart again and this was written to output
^CReceived signal 2. Shutting down.
Stopped to listen for HTTP requests on 0.0.0.0:8083
Shutting down sync server...
Stopped to listen for HTTPS requests on 0.0.0.0:44201
Suspending organization activities...
Unloading all libraries...
Storing library structure...
done.
closing request queue...
joining load workers...
load workers done
shutting down request queue...
destroying metadata cache...
destroying thumbnail cache...
image cache shut down.
Waiting for running library stats tasks...
Shutting down organization activities...
Local libraries dispose complete.
closing request queue...
joining load workers...
load workers done
shutting down request queue...
destroying metadata cache...
destroying thumbnail cache...
image cache shut down.
Warning (thread: main): leaking eventcore driver because there are still active handles
FD 165 (streamSocket)
Use '-debug=EventCoreLeakTrace' to show where the instantiation happened
Warning (thread: main): leaking eventcore driver because there are still active handles
FD 165 (streamSocket)
Use '-debug=EventCoreLeakTrace' to show where the instantiation happened
Did you possible encounter a crash on the server side? I tested with a larger library and encountered a crash right after accepting the library invitation (fixed for the next release). This caused the cloned library to be left in a rudimentary state where the synchronization settings hadn’t been set up, yet. Restarting the server would then successfully load the library, but would never start to synchronize anything.
I can’t say for sure, but based on the timing at least it seems very likely.
In addition to the crash, there also turned out to be another issue that resulted in newly added files not getting synchronized to the server. After fixing that, I’ve taken the opportunity to also add activities to the web UI, so that the clone progress, as well as later synchronization activity is now also visible there.
Following up here, sync is starting so that’s a big step forward! Thanks for addressing things so promptly. Unfortunately I still have not managed to sync to my server. I’ve made it to varying stages of the sync process, but every time the cloning gets interrupted. Mostly it’s been Killed during the process of Cloning library revisions count but this last time it completed revisions and moved on to metadata. Unfortunately it just stopped without any indication of error while Cloning library metadata count specifically 11055/174053.
The issue I am experiencing is that when the aspect-web service stops, the cloning process doesn’t appear to resume or recover where it left off. See below for complete stderr once service restarted. Note that nothing is written to the server’s file system after service is started again.
Listening for requests on https://0.0.0.0:41823/
Acquiring library lock...
Loading cache...
Loading revisions...
Loading library...
Loading existing library in file:///home/chris/.local/lib/aspect-web/libraries/Family%20Aspect%20Library
Preloading cached metadata...
Loading missing metadata...
Loading weak checksums...
Setting up duplicate detector...
Computing reduced initial file relations...
Triggering full initial file relations...
ENABLE FOR file:///home/chris/.local/lib/aspect-web/libraries/Family%20Aspect%20Library
Listening for requests on http://0.0.0.0:8083/
Updating export collections...
Edit: Just to mention my main concern here is that I can’t get the process to resume. I’ve tried restarting the service, selecting Synchronize Now in Aspect and even adding a new image to the library. Nothing seems to trigger any new activity on the server