S3Drive - general

pitbj joined the server. 1/13/2025 8:27 PM

bar1 joined the server. 1/14/2025 11:07 AM

dermann joined the server. 1/14/2025 12:32 PM

LC' joined the server. 1/14/2025 12:33 PM

timecaster

I noticed this is actually an issue with the Windows installer here: https://github.com/s3drive/windows-app/releases/tag/1.11.1 On a fresh install after opening, it says it is version 1.11.0 (build: 10110003). Is it possible you forgot to update the version number in the latest release?

Sorry for the trouble. This will be fixed in a 1.11.2 release we're hoping to release on ~~16th.~~ 17th. (edited)

martin654 joined the server. 1/15/2025 8:33 PM

LC' joined the server. 1/15/2025 9:58 PM

chaosbolt joined the server. 1/16/2025 5:46 AM

@tom https://kb.cert.org/vuls/id/952657 is this relevant to s3drive?

CERT/CC Vulnerability Note VU#952657

Rsync contains six vulnerabilities

ButWhereIsEverybody🌌

@tom https://kb.cert.org/vuls/id/952657 is this relevant to s3drive?

This report covers vulerabilities found in rsync, whereas we are using rclone. These are two different projects. Rclone advertises itself as: rsync for cloud storage, but other than that there isn't much in common. (edited)

Tom

This report covers vulerabilities found in rsync, whereas we are using rclone. These are two different projects. Rclone advertises itself as: rsync for cloud storage, but other than that there isn't much in common. (edited)

OK, thanks for the clarification. I was not aware that these were two completely separate projects, but assumed (because of the similarity of the names) that they would have some backend code in common.

iPromKnight joined the server. 1/17/2025 7:11 PM

Vano joined the server. 1/17/2025 10:55 PM

just got this working pretty well with Garage as noticed RClone doesn't have preview support on iOS atm Was a bit of an issue with reverse proxy setup, it seems you are parsing the url for the endpoint to extract region or something along those lines The header error in garage though pretty much allowed me to change the garage config region to the segment of the url you were extacting They don't have versioning support, but thats fine for my use needs (low ram s3 store for certain file operations) Is rclone preview still on the cards for iOS?

1

Played around a bit more with a few more tests so, right now we can't rclone preview - which is understood. What we can do though is mount an rclone backend on the local filesystem, and use https://github.com/gaul/s3proxy with the deprecated filesystem provider. This did not work with the new nio provider, as it failed when getting extended file attributes within S3Drive. However - when running the old filesystem one, reads work instantly, and you can play media directly within S3Drive (as long as a premium user)! I ran with

docker run --rm \
-p 20055:80 \
--name s3proxy-test \
-e S3PROXY_AUTHORIZATION=aws-v4 \
-e S3PROXY_ENDPOINT="http://0.0.0.0:80" \
-e S3PROXY_IDENTITY="<my_user>" \
-e S3PROXY_CREDENTIAL="<my_password>" \
-e JCLOUDS_PROVIDER="filesystem" \
-e JCLOUDS_FILESYSTEM_BASEDIR="/data" \
-e S3PROXY_CORS_ALLOW_ALL="true" \
-v /mnt/media/remote:/data:rshared \
andrewgaul/s3proxy

But its cool that that works. Its worth noting, before I tried this - I tried RClones new experimental support for serve s3 https://rclone.org/commands/rclone_serve_s3/ - and while simply directory navigation works, and browsing of top level files, anything in a subdir does not work.

Raju Biswas joined the server. 1/18/2025 1:23 AM

Omar Abid joined the server. 1/18/2025 6:42 AM

iPromKnight

just got this working pretty well with Garage as noticed RClone doesn't have preview support on iOS atm Was a bit of an issue with reverse proxy setup, it seems you are parsing the url for the endpoint to extract region or something along those lines The header error in garage though pretty much allowed me to change the garage config region to the segment of the url you were extacting They don't have versioning support, but thats fine for my use needs (low ram s3 store for certain file operations) Is rclone preview still on the cards for iOS?

Is rclone preview still on the cards for iOS?

It's actually being released today

https://s3drive.app/changelog Already released on desktop, currently await's Apple's approval before it lands to iOS. Worst case, couple days and shall be there. With minor caveat, video preview is not part of this just yet: https://s3drive.canny.io/feature-requests/p/implement-video-preview-for-rclone-back-ends

iPromKnight

just got this working pretty well with Garage as noticed RClone doesn't have preview support on iOS atm Was a bit of an issue with reverse proxy setup, it seems you are parsing the url for the endpoint to extract region or something along those lines The header error in garage though pretty much allowed me to change the garage config region to the segment of the url you were extacting They don't have versioning support, but thats fine for my use needs (low ram s3 store for certain file operations) Is rclone preview still on the cards for iOS?

it seems you are parsing the url for the endpoint to extract region or something along those lines

Yep, there is some logic I don't exactly recall, but it worked nicely with most provider's endpoint scheme. We allow to use custom region, but probably we haven't implemented, "force empty", to override that detection logic which in your cause was causing troubles. We'll add an internal item to check on that.

iPromKnight

Played around a bit more with a few more tests so, right now we can't rclone preview - which is understood. What we can do though is mount an rclone backend on the local filesystem, and use https://github.com/gaul/s3proxy with the deprecated filesystem provider. This did not work with the new nio provider, as it failed when getting extended file attributes within S3Drive. However - when running the old filesystem one, reads work instantly, and you can play media directly within S3Drive (as long as a premium user)! I ran with

docker run --rm \
-p 20055:80 \
--name s3proxy-test \
-e S3PROXY_AUTHORIZATION=aws-v4 \
-e S3PROXY_ENDPOINT="http://0.0.0.0:80" \
-e S3PROXY_IDENTITY="<my_user>" \
-e S3PROXY_CREDENTIAL="<my_password>" \
-e JCLOUDS_PROVIDER="filesystem" \
-e JCLOUDS_FILESYSTEM_BASEDIR="/data" \
-e S3PROXY_CORS_ALLOW_ALL="true" \
-v /mnt/media/remote:/data:rshared \
andrewgaul/s3proxy

But its cool that that works. Its worth noting, before I tried this - I tried RClones new experimental support for serve s3 https://rclone.org/commands/rclone_serve_s3/ - and while simply directory navigation works, and browsing of top level files, anything in a subdir does not work.

and use https://github.com/gaul/s3proxy

Thumbs up for s3proxy and its author Andrew, we've learned a lot from this project.

This did not work with the new nio provider

I am not familiar with it, can you briefly tell me about the use case, we would be happy to try and see if there is anything we could address on the S3Drive layer. (edited)

Tom

Is rclone preview still on the cards for iOS?

It's actually being released today

https://s3drive.app/changelog Already released on desktop, currently await's Apple's approval before it lands to iOS. Worst case, couple days and shall be there. With minor caveat, video preview is not part of this just yet: https://s3drive.canny.io/feature-requests/p/implement-video-preview-for-rclone-back-ends

Oh that’s awesome

thanks Tom!

Tom

Sorry for the trouble. This will be fixed in a 1.11.2 release we're hoping to release on ~~16th.~~ 17th. (edited)

@Tom Thanks for the 1.11.2 update. I noticed that the issue of being unable to utilize the right-click menu from the tray icon has returned, so I can't close S3Drive without having to force close.

USER#7477 joined the server. 1/18/2025 11:10 PM

Sedate-State joined the server. 1/19/2025 1:40 AM

Hi I am new to the service Will there be a self hosted version of the app? As far as I understand, right now, it is not a 100% offline solution. My case: home server, configured via Rclone. I need to self host the service. Thanks @Tom (edited)

Tom

Is rclone preview still on the cards for iOS?

It's actually being released today

https://s3drive.app/changelog Already released on desktop, currently await's Apple's approval before it lands to iOS. Worst case, couple days and shall be there. With minor caveat, video preview is not part of this just yet: https://s3drive.canny.io/feature-requests/p/implement-video-preview-for-rclone-back-ends

Looking forward to rclone video thumbnail preview. Then s3drive will feel more complete. Currently using the old software app called rcx until s3drive has that feature. Recommend checking out that old rcx rclone repo for ideas, maybe even ini import might have some clues in their repo on how s3drive could accomplish it

dm joined the server. 1/19/2025 11:58 AM

dam joined the server. 1/19/2025 1:52 PM

Jonas Ö joined the server. 1/19/2025 6:48 PM

USER#7477

Hi I am new to the service Will there be a self hosted version of the app? As far as I understand, right now, it is not a 100% offline solution. My case: home server, configured via Rclone. I need to self host the service. Thanks @Tom (edited)

help appreciated

USER#7477

Hi I am new to the service Will there be a self hosted version of the app? As far as I understand, right now, it is not a 100% offline solution. My case: home server, configured via Rclone. I need to self host the service. Thanks @Tom (edited)

Hi, Once you install the app, turn off the internet and connect to your "local" endpoint, things shall work just fine. S3Drive connects directly to the endpoint without middleman. If you use paid license, then from time to time you will need to connect to the internet, so S3Drive can fetch the license attached to your account, but you could then keep connection turned off most of the time... and if you don't use any license then you don't need to use/register an account at all.

Aristorn

Looking forward to rclone video thumbnail preview. Then s3drive will feel more complete. Currently using the old software app called rcx until s3drive has that feature. Recommend checking out that old rcx rclone repo for ideas, maybe even ini import might have some clues in their repo on how s3drive could accomplish it

Thanks for your feedback. It's hard for us to give any hard estimates. Before we implement Rclone video thumbnails we'll need implement Rclone video preview/streaming, which we hope to get to to in 2025. It's not that we don't know how to implement it, it's just relatively big piece of work which competes for time with other items on our roadmap: https://s3drive.app/roadmap Rclone (or rather librclone) alone a doesn't have streaming interface: https://github.com/rclone/rclone/issues/7481#issuecomment-1838484915 which could be easily used, so this needs to be implemented and I assume that's what rcx project had to do as well. The challenge is that we need to make that solution work on all platforms (not just Android) and that makes this task bigger than it seems. INI import is also coming: https://s3drive.canny.io/feature-requests/p/add-support-for-rcloneconf-import-and-ini-format (edited)

1

Tom

Hi, Once you install the app, turn off the internet and connect to your "local" endpoint, things shall work just fine. S3Drive connects directly to the endpoint without middleman. If you use paid license, then from time to time you will need to connect to the internet, so S3Drive can fetch the license attached to your account, but you could then keep connection turned off most of the time... and if you don't use any license then you don't need to use/register an account at all.

Thank you for clarifying. I saw on the wiki that there will be a Hosted version. How is that going to work? Will be different to ultimate?

USER#7477

Thank you for clarifying. I saw on the wiki that there will be a Hosted version. How is that going to work? Will be different to ultimate?

Can you send the link please? I am not exactly sure what info you refer to.

https://docs.s3drive.app/contributing/#feature-requests At the bottom

Contributing - S3Drive

Personal storage compatible with S3, WebDav and 70+ other Rclone back-ends

USER#7477

https://docs.s3drive.app/contributing/#feature-requests At the bottom

What platform(s) do you have in mind when thinking about 100% offline?

USER#7477

https://docs.s3drive.app/contributing/#feature-requests At the bottom

Thanks for finding out outdated info, we've updated it now. The hosted referred to managed Storage which we've released recently. In principle app is self-hosted already (it runs purely from your device) and connects directly the server that you point it to. Please find an example list of sofware which can be used to self-host storage: https://docs.s3drive.app/setup/providers/#self-hosted-s3

Supported providers - S3Drive

Personal storage compatible with S3, WebDav and 70+ other Rclone back-ends

Tom

What platform(s) do you have in mind when thinking about 100% offline?

I was thinking more about a solution that does not require authentication every time on windows or android. For example, in case of an internet outage, I want to access my data easily, on my local network, directly in the app, without resorting to other tools. Kind of a local sign in. Other than that, the app works good and I really like it :)

USER#7477

I was thinking more about a solution that does not require authentication every time on windows or android. For example, in case of an internet outage, I want to access my data easily, on my local network, directly in the app, without resorting to other tools. Kind of a local sign in. Other than that, the app works good and I really like it :)

In that case I assume you use (or would like to) paid version of the app? (edited)

Yes. Do not get me wrong. I understand the need for license verification. I just need a solution to easily access the data easily in case of internet outage.

USER#7477

Yes. Do not get me wrong. I understand the need for license verification. I just need a solution to easily access the data easily in case of internet outage.

Sorry for direct question, I was just trying to understand the use case and confirm, since obviously free version of the app can be used without licensing. How about I create a feature item? https://s3drive.canny.io/feature-requests/p/offline-licensing I mean we've had some ideas internally about offline licensing, which we may implement if there is enough interest. On top of the solution we would need to think through about abuse prevention mechanisms and find fine balance between hard to tamper and easy to use. (edited)

I am referring about the paid one. What you have suggested rn is perfect

Tom

Thanks for your feedback. It's hard for us to give any hard estimates. Before we implement Rclone video thumbnails we'll need implement Rclone video preview/streaming, which we hope to get to to in 2025. It's not that we don't know how to implement it, it's just relatively big piece of work which competes for time with other items on our roadmap: https://s3drive.app/roadmap Rclone (or rather librclone) alone a doesn't have streaming interface: https://github.com/rclone/rclone/issues/7481#issuecomment-1838484915 which could be easily used, so this needs to be implemented and I assume that's what rcx project had to do as well. The challenge is that we need to make that solution work on all platforms (not just Android) and that makes this task bigger than it seems. INI import is also coming: https://s3drive.canny.io/feature-requests/p/add-support-for-rcloneconf-import-and-ini-format (edited)

Could use vfs to emulate streaming? @Tom https://rclone.org/commands/rclone_mount/

When rclone reads files from a remote it reads them in chunks. This means that rather than requesting the whole file rclone reads the chunk specified.

and

With --vfs-read-chunk-size 100M and --vfs-read-chunk-size-limit 0 the following parts will be downloaded: 0-100M, 100M-200M, 200M-300M, 300M-400M and so on

Aristorn

Could use vfs to emulate streaming? @Tom https://rclone.org/commands/rclone_mount/

When rclone reads files from a remote it reads them in chunks. This means that rather than requesting the whole file rclone reads the chunk specified.

and

With --vfs-read-chunk-size 100M and --vfs-read-chunk-size-limit 0 the following parts will be downloaded: 0-100M, 100M-200M, 200M-300M, 300M-400M and so on

I'm just sharing my experience as a user, but that only partially helps here. In order to actually play a video with seek, etc. with rclone currently you have to mount using fuse or serve over a compatible protocol, like http(s). those are heavily restricted on mobile apis due to security, so an app has to either try to find a way to make existing solutions work (often in a poorly designed manner to maintain compatibility) or build entirely new apis or shims to interact with existing apis but in a way that works cross-platform with flutter. there are additional challenges like where do you store the previews, how to know if it should be regenerated, etc. i imagine it is quite a lot of work.

Ah, so FS is the limiting factor to that idea. Kinda assumed maybe it was possible, since I see s3drive had the mount option available on android. So figured maybe it could piggy back off a similar already coded feature. I'm no mobile dev, so was just tossing ideas out there.

I have instead put a feature request via rclone. Maybe this is something hopefully that developers think of adding:

12:33 AM

Any support or thumbs up regarding that topic is appreciated. As I could see s3drive potentially making use of this.

Toranoso joined the server. 1/21/2025 10:09 AM

Aristorn

I have instead put a feature request via rclone. Maybe this is something hopefully that developers think of adding:

If you use S3Drive with most recent: 1.11.2 release then you can see that thumbnails are generated for Rclone endpoints as well. They're stored locally (cache on FS), but also uploaded back to .thumb folder. Whether to generate or/and upload thumbnails back (so they can be used on other devices), there is a setting in the Profile Settings. There are couple improvements that we'll implement in the near future. For instance thumbnail generation before uploading a file, as S3Drive at the moment would upload a file and then download it back to generate a thumbnail... but these are minor additions to the existing functionality. Generating thumbnails from video, we already do that on mobile for S3 (as long as files aren't encrypted). Generating video thumbnails for Rclone endpoints require us to build streaming interface (likely using VFS related code), as it's not practical to download the whole file in order to generate a thumbnail. If this proves to be difficult we'll think of hacky workaround, that is rclone serve or perhaps some tricks with RANGE requests to get the portion of the file. (edited)

Deleted User joined the server. 1/21/2025 7:36 PM

Hello @Tom , I just bought a Lifetime Ultimate license. Have been using your software for months now and it has been so good. I have two questions: is the background sync mode in the roadmap for the current year (Android)? Also, can I install and use the APP on multiple Android devices? Considering I use them to sync to another service through your awesome rclone integration?

Deleted User

Hello @Tom , I just bought a Lifetime Ultimate license. Have been using your software for months now and it has been so good. I have two questions: is the background sync mode in the roadmap for the current year (Android)? Also, can I install and use the APP on multiple Android devices? Considering I use them to sync to another service through your awesome rclone integration?

Hi, Thanks for your feedback and support! Background sync isn't on the official roadmap, because there is a big unknown regarding process scheduling. It may be pretty hard (in which case we wouldn't be able to do it this year) or easy (in which case we'll implement it even if there isn't roadmap item), so we haven't risked listing it officially. I know that some users workaround this using Tasker or other app, but results may vary. For both in-app purchase and our website purchase Ultimate will work on all devices as long as you're logged in with the account that made the purchase. Roadmap: https://s3drive.app/roadmap2025 Feature item that I've added just now, so we can track it: https://s3drive.canny.io/feature-requests/p/implement-background-sync (edited)

1

Thanks for the advice and explainations! Just to be sure: what Tasker does is trigger an App Open on specific conditions, right?

ZombieWolf joined the server. 1/22/2025 2:29 PM

James joined the server. 1/23/2025 1:28 PM

Hi, does S3Drive support backing up specific folders (i.g., one-way copy/sync) asdie from media albums?

timecaster

@Tom Thanks for the 1.11.2 update. I noticed that the issue of being unable to utilize the right-click menu from the tray icon has returned, so I can't close S3Drive without having to force close.

@Tom Will you be able to build a new release that fixes this soon?

timecaster

@Tom Will you be able to build a new release that fixes this soon?

Hi, are you saying that upon right-click on Windows nothing pops up? For the time being can you use the in-app left hand drawer menu? We'll look into this issue later next week. Thanks!

Deleted User joined the server. 1/24/2025 9:35 PM

C4k3 w4lk3r joined the server. 1/25/2025 1:19 PM

Chi joined the server. 1/25/2025 8:52 PM

chicagomedpilot joined the server. 1/25/2025 8:54 PM

Tom

Hi, are you saying that upon right-click on Windows nothing pops up? For the time being can you use the in-app left hand drawer menu? We'll look into this issue later next week. Thanks!

Thanks, I didn't realize the left-hand drawer menu Quit would allow it to close. Thanks for the suggestion.

booflethebest joined the server. 1/26/2025 6:35 PM

Jost joined the server. 1/26/2025 7:26 PM

Is anybody successfully using the protondrive via rclone? I'm having trouble, but not shure if its worth to dig deeper.....

nuvolablues joined the server. 1/27/2025 10:04 AM

Jost

Is anybody successfully using the protondrive via rclone? I'm having trouble, but not shure if its worth to dig deeper.....

I am!

12:45 PM

What issue are you encountering?

timecaster

Thanks, I didn't realize the left-hand drawer menu Quit would allow it to close. Thanks for the suggestion.

Just had the issue again where the entire S3Drive turns black when trying to upload more than a few hundred files & stayed that way, so I was unable to close S3Drive using the left-hand drawer Quit since the taskbar menu isn't working either. This is starting to feel alpha quality (edited)

Rae joined the server. 1/27/2025 8:17 PM

Tom

Sorry for direct question, I was just trying to understand the use case and confirm, since obviously free version of the app can be used without licensing. How about I create a feature item? https://s3drive.canny.io/feature-requests/p/offline-licensing I mean we've had some ideas internally about offline licensing, which we may implement if there is enough interest. On top of the solution we would need to think through about abuse prevention mechanisms and find fine balance between hard to tamper and easy to use. (edited)

Tbh as an app dev also I find that time is much better spent making things easier to use and adding value rather than investing in drm. Playing a cat and mouse game always just ends up hurting your users. Gaining new users and keeping existing users is much more valuable. Drm and license enforcement only really makes sense when your at a scale such that your ability to grow is inhibited by being within an order of magnitude of total market demand for your product. This is why many startups give their product away for free so they can get users and grow as fast as possible then focus on piracy. Additionally alot of your early adopters are gonna be in a kinda nerdy self hosty category and they feel strongly about not being reliant on factors outside of their control even if it's not a likely scenario to ever happen

4:40 AM

Sorry for the essay lol

4:46 AM

Also ppl pay for convenience that's why Netflix grew so fast in the face of bittorrent, it's only when they got really big and faced competition where the user had to subscribe to 4 different services to watch what they wanted that they started cracking down on piracy and cracking down on account sharing because their ability to grow was inhibited making it a second best investment in place of growing organically

1

4:48 AM

As long as ur providing useful updates people will pay, it's annoying and malware prone to pirate every new version most normal users won't bother

Blewis9991 joined the server. 1/28/2025 6:37 PM

jack74 joined the server. 1/28/2025 9:14 PM

Zyn joined the server. 1/28/2025 10:54 PM

dom joined the server. 1/29/2025 11:51 AM

Dexter joined the server. 1/29/2025 5:52 PM

fireworks joined the server. 1/29/2025 11:18 PM

bo joined the server. 1/30/2025 2:59 AM

James

Hi, does S3Drive support backing up specific folders (i.g., one-way copy/sync) asdie from media albums?

It does support all file types and specific folders on all platforms except iOS. In the left hand drawer menu you can configure all that using: "Sync" option.

JCO joined the server. 1/31/2025 3:13 PM

Sommercamp.wien joined the server. 1/31/2025 6:09 PM

DFIR joined the server. 2/1/2025 5:36 AM

timecaster

Thanks, I didn't realize the left-hand drawer menu Quit would allow it to close. Thanks for the suggestion.

Hi, tray context menu shall be fixed on Windows with 1.11.3 release.

Tom do you have any ETA when will S3Drive managed account buckets feature be finished? Dance

I2rys (安全)

Tom do you have any ETA when will S3Drive managed account buckets feature be finished? Dance

Yes, we plan to release it end of February / beginning of March.

(edited)

1

kdw2060 joined the server. 2/2/2025 10:42 AM

kdw2060 joined the server. 2/2/2025 10:46 AM

nougmanoff joined the server. 2/2/2025 12:10 PM

nougmanoff joined the server. 2/2/2025 12:14 PM

requisite5 joined the server. 2/2/2025 2:09 PM

Opinion on possibly creating an interim solution to rclone video thumbnails? Even if it requires enabling a advanced checkbox that says a warning that it will download the whole video to create the thumbnail? Atleast since s3drive creates a .thumbnails folder, it would be a one time thing until you manage to code something together for partial streaming based thumbnail generation.

Aristorn

Opinion on possibly creating an interim solution to rclone video thumbnails? Even if it requires enabling a advanced checkbox that says a warning that it will download the whole video to create the thumbnail? Atleast since s3drive creates a .thumbnails folder, it would be a one time thing until you manage to code something together for partial streaming based thumbnail generation.

Our focus is to implement streaming interface, which is ideal, but also requires most work. If this proves to be consuming too much time we'll try to provide fallback solution which will be something along the lines as you say (with some performance tweaks). If things go well, over the next couple months we should have either solution ready. (edited)

Oπ<3 joined the server. 2/4/2025 7:32 AM

Garzahd joined the server. 2/7/2025 11:13 PM

Domi joined the server. 2/8/2025 5:54 AM