S3Drive - Is "sync" removing any files?

I just installed this on Fedora an hour ago, and uploaded a few files to my bucket. Then the software displayed a message about rebuilding, so I clicked ok. I can no longer see any files under "sync", but there are many files listed under "recent". There are also some new .thumb/ folders are in my bucket. The documentation is unhelpful at explaining what this software is trying to do right now. I searched for my files locally, and it does not appear to be copying anything to this computer.

Is it copying all of my bucket files locally? If so, where?
Is it just reading the full list of files to build its own index?
Most importantly, is it deleting anything from my bucket?

10:40 AM

Ok, I believe this occurred because I accidentally clicked "cached mode". My trackpad is tap-to-click and I didn't intend to click anywhere.

10:41 AM

I don't see any results when searching "cache" in your docs. Can you help me understand what this feature was trying to do?

10:42 AM

Looks like attempting to sort file results switches to cached mode automatically, but cached mode does not display any files. I want to be absolutely certain that this program will not delete anything from my buckets.

no_decaf

I don't see any results when searching "cache" in your docs. Can you help me understand what this feature was trying to do?

S3 protocol doesn't have concept of ordering, so in order to allow "basic" ordering we've had to introduce client-side search. The way it works, it needs to fetch all filepaths/names from the S3 locally, index it and then allow ordering (or searching - it uses same index). Depending on number of files indexing takes some time, there is a loading indicator on the main page when indexing runs and if by any chance it fails it shows the red exclamation mark with the error contents. Before indexing finalize it's going to be empty, so you'll need to switch off the cached mode and switch back once it's done (there also should be prompt to let you know that indexing is done). Perhaps UI can be improved in that area to make it more all clear.

no_decaf

Looks like attempting to sort file results switches to cached mode automatically, but cached mode does not display any files. I want to be absolutely certain that this program will not delete anything from my buckets.

I want to be absolutely certain that this program will not delete anything from my buckets.

Sync option with mode: sync may delete files on the destination. The idea is that destination shall be 1:1 clone of source... so if file gets deleted at source, this delete gets propagated to the destination (so it eventually matches the source). There is a relevant description of this mode in the S3Drive itself. If you do not want S3Drive to delete files on the destination, no matter what, please use copy mode instead of sync. (edited)

Sync option with mode: sync may delete files on the destination.

@Tom can you please tell me where this is configured? When I click Sync in the side menu, I just see a list of files. I checked both Profile Settings and App Settings, and don't see an option for this.

If you do not want S3Drive to delete files on the destination, no matter what, please use copy mode instead of sync.

Can you please let me know where this is configured? Thanks!

no_decaf

Sync option with mode: sync may delete files on the destination.

@Tom can you please tell me where this is configured? When I click Sync in the side menu, I just see a list of files. I checked both Profile Settings and App Settings, and don't see an option for this.

If you do not want S3Drive to delete files on the destination, no matter what, please use copy mode instead of sync.

Can you please let me know where this is configured? Thanks!

2:07 PM

2:09 PM

I can no longer see any files under "sync",

@no_decaf When you click "Sync" you probably see empty screen, instead of Sync configuration, because no sync has been configured. In such case please use the top right corner + button.

@Tom understood. So as long as I don't have any Sync configured, I won't be at risk of overwriting my remote files. I can just upload/download through the Files interface.

1:07 AM

Thank you for the help.

no_decaf

@Tom understood. So as long as I don't have any Sync configured, I won't be at risk of overwriting my remote files. I can just upload/download through the Files interface.

That's right. Obviously when you upload through the Files interface, you always risk overwriting something. Honestly speaking we need to implement a check/prompt which would ask user if they want to ovewrite or skip. If you use versioning , which can be enabled from the bucket settings (for S3 back-ends only), then you can manage (delete/restore) past revisions if they were overwritten or soft-deleted. I hope that helps!

@Tom

when you upload through the Files interface, you always risk overwriting something

Right. My original question was related to unintentional deletes from an empty local path to my bucket. I should have rephrased my last message in this thread to be more clear.

If you use versioning

I've got versioning, replication, and a GCloud Data Flow job that syncs my S3 bucket to GCS for redundancy. I just need a file browser that won't accidentally delete things, and S3 Drive seems to check that box. Have a nice Friday! (edited)

1