Guild icon
S3Drive
Visit Live Discord
Avatar
Hello guys and welcome to our Discord channel. In case you have any questions, problems, ideas or would like to simply talk about the app, S3, syncing and all that stuff... we would love to hear from you. 🚀
sirlegar joined the server. 01/30/2023 4:41 PM
Avatar
Avatar
sirlegar
Click to see original message
Avatar
Hi there, how do you feel being the first to join? 🙂
Avatar
It was a good idea to create a discord channel. Interactivity was very limited. This will improve the feedback loop
16:42
Hahah feels good 🙂
Avatar
I need to get my community management skills up to speed, in the meantime let's give a Discord channel a try and see how it goes. I hope actually to get more feedback here. Well, thanks for joining !
🚀 1
Avatar
Today we've released support for video thumbnails and enlarged thumbnail, so it uses up the full square space. It's already available on Android, on iOS is pending release and will be available later today / tomorrow. How do you like it? (edited)
barrrrtek joined the server. 01/30/2023 7:35 PM
H10ISBFYAKE91 joined the server. 02/05/2023 7:52 PM
Avatar
Welcome to our channel @barrrrtek and @H10ISBFYAKE91 !
myfrogger joined the server. 02/13/2023 7:57 AM
Avatar
Hi, looks like a cool project. I can't seem to run it on windows because I get the error that files are missing. Any thoughts? The code execution cannot proceed because MSVCP140.dll was not found. repeated error for VCRUNTIME140.dll & VCRUNTIME140_1.dll
08:00
Also, what is the recommended installation directory? It seems to be installing into %APPDATA% but I tried it in Program Files also. Both gave me the above errors.
Avatar
Hi, @myfrogger thanks for letting us know about the issue. It seems that Visual C++ Redistributable package may be missing in your system: https://www.microsoft.com/en-gb/download/details.aspx?id=48145 What Windows version are you running exactly? https://support.microsoft.com/en-us/windows/which-version-of-windows-operating-system-am-i-running-628bec99-476a-2c13-5296-9dd081cdd808 There is no preference as where you install the package. We're using default settings of: "Inno Setup", but in principle you can install it wherever you want. Finally, sorry for this issue, we're Linux users ourselves and we're working on improving tests and setup instructions on different desktop platforms, Windows included. (edited)
The Visual C++ Redistributable Packages install run-time components that are required to run C++ applications built using Visual Studio 2015.
Learn how to find which version of Windows operating system your PC is running and device specifications.
09:26
@myfrogger Wait, did you actually use our "exe" installer or installed via Microsoft Store?
Avatar
Avatar
s3drive
Hi, @myfrogger thanks for letting us know about the issue. It seems that Visual C++ Redistributable package may be missing in your system: https://www.microsoft.com/en-gb/download/details.aspx?id=48145 What Windows version are you running exactly? https://support.microsoft.com/en-us/windows/which-version-of-windows-operating-system-am-i-running-628bec99-476a-2c13-5296-9dd081cdd808 There is no preference as where you install the package. We're using default settings of: "Inno Setup", but in principle you can install it wherever you want. Finally, sorry for this issue, we're Linux users ourselves and we're working on improving tests and setup instructions on different desktop platforms, Windows included. (edited)
I used the exe installer as I hate the microsoft store. I'll try downloading Visual C++ now. I'm using Windows 10 Pro 22H2 (edited)
Avatar
No error messages now but when it loads I only get a black window
10:19
I've uninstalled, reinstalled, and restarted
Avatar
Avatar
myfrogger
No error messages now but when it loads I only get a black window
Right, I've tried it on a fresh Win install and I also get a black screen. We're working on the fix and will let you know hopefully later today. Actually we've only reproduced it in a virtual environment and can't reproduce this on a physical environment. Black screen so far appears to be an issue with the GPU / hardware acceleration / DirectX version (at least 11 is required). (edited)
Avatar
Avatar
myfrogger
No error messages now but when it loads I only get a black window
May I ask what's your graphic card model? Is it dedicated or perhaps integrated within your CPU / motherboard?
kartz joined the server. 02/13/2023 12:16 PM
Avatar
It's integrated graphics
Avatar
Avatar
myfrogger
It's integrated graphics
Thanks that helps, do you perhaps have DirectX (at least 11) installed?
12:22
It can be checked typing: dxdiag in the search bar.
Avatar
Actually I'm also testing your software in a virtual environment using Oracle VirtualBox so maybe that's the issue
Avatar
Right, so in fact that's an issue with VirtualBox, we're using latest 7.0.4 and it doesn't work. It works fine on VMWare Workstation though. (edited)
12:25
App does require 3D acceleration due to technology that we're using (Flutter), perhaps it's possible to start it in a software acceleration mode only, but we haven't explored that yet. (edited)
Avatar
Gotcha. I'll try to test this soon on a physical computer. It doesn't seem to have any bloatware installed so I should be safe. It's incredibly difficult to find good backup and sync software if you want end-to-end encryption and using a S3 based cloud
12:26
This idea is very, very cool though it wasn't what I was initially searching for. Those are the best finds though 🙂 🙂
12:27
People upload FAR to much data to hosted clouds. I uploaded business "trade secret" data for work to dropbox for years...what a disaster that could have been! I was so ignorant
Avatar
Thanks for the good words. It keeps us motivated 🙂 We're pending major release with multiple new features being added. It will also include photo backup from Android/iOS to S3. Different sync modes including two-way sync will be available ~April 2023 - https://s3drive.canny.io/feature-requests/p/syncbackup-options-two-way-one-way
Avatar
That's an amazing idea. Actually I uploaded all my photos to the cloud up until recently out of ignorance also! Then I switched to Mega.io but recently scrapped the whole thing and decided to sync only to my laptop, which is then backed up in a more secure way. Photo backup is a major upgrade and very useful!!
12:31
I don't know why but I've seen on other apps it's hard to make automatic backup triggers on iOS. It seems the main way people do it is based on GPS movement. I didn't want to give apps my location. The other way I've seen recently is auto sync is triggered upon the device connected to a charger. That's better but I've seen only used on one app.
12:32
Maybe you know other ways but to my non-technical research brain, auto syncing on iOS seemed like a real obstacle for developers.
Avatar
It's quite tricky to do it reliably on iOS and so far the backup mode will work for S3Drive when you start the app (comparing to fully supported background sync on Android)... but then we will be using all available means to improve that. Thanks for the hints with triggers.
Avatar
So if you run into that problem, maybe try the sync when connected to a charger
Avatar
In fact it's quite tricky to do it reliably on Android as well due to: https://dontkillmyapp.com/
Hey Android vendors, don’t kill my app!
👍 1
Avatar
Avatar
myfrogger
So if you run into that problem, maybe try the sync when connected to a charger
It's possible that it needs to create an iOS shortcut in the "automation" section. Another iOS approved trigger might be to connect to a certain wifi
Avatar
Given that iOS ecosystem is a pretty new thing to me and our team these hints are extremely useful !
Avatar
I thought it might be. It's surprisingly hard to find solutions as a user if I don't want to trust the company also with my data. It seems most people want an all-in-one solution so who knows
12:38
I mean, who knows what most people want. I don't think I'm the usual customer and there's not enough people like me to make lots of money
Avatar
I was personally struggling to find such solution. That's actually how this project started.
🔥 1
12:40
I actually don't like all-in-one. I prefer to choose best tools for specific case.
12:40
Most people do prefer all-in-one though as you say.
12:40
Great, I'd love to hear if you managed to install the app and whether it works all fine for you.
Avatar
I'll keep you updated in a day or two when I have more time 🙂 Thanks for your help!
Avatar
Thanks for your feedback !
_shaike joined the server. 02/13/2023 7:08 PM
Avatar
Hello
19:09
Does a3 photosync supports syncing video files or just photos?
Avatar
Hi @_shaike, it supports both video and photos, however by default only photo albums upload is enabled, video albums needs to be explicitly marked for auto upload.
Avatar
Where can i gind itcon photosync s3? It shows me DCIM and WA business folders
19:37
Sorry for typos
Avatar
That's how it looks on my end. There is Movies folder.
19:40
Then I need to unhide it.
Avatar
I am talking about photosync not s3 drive
Avatar
This is PhotoSync screenshot.
19:41
Depending on the Android version these folders are named differently, but in principle rule is the same.
Avatar
Right, is that everything that you see? No more albums?
Avatar
This is what i see
Avatar
Got it
Avatar
So no videos
Avatar
I am not sure why videos are not displayed. Within a week or maximum two, there will be Early March we shall deliver photo & video module (with a backup and background mode) to S3Drive with more flexible album management. This is where our focus is currently. BTW. What's your phone model / Android version? (edited)
Avatar
Fold 3 with android 13 oneui 5 December 2022
19:48
That's will be grear
19:48
Great
Avatar
Thanks for letting me know. I need to say that we haven't tested PhotoSync with Android 13 enough, instead we worked hard on S3Drive. If you don't mind waiting little bit I would recommend trying it once the backup module is released. Sorry for the inconvenience.
Avatar
That's fine i really appreciate your work
19:52
So i should use s3 drive meanwhile?
Avatar
It can't automatically backup your media, so it's not a replacement for PhotoSync just yet... but in general if you want to interact with S3 then S3Drive is the way to go.
Avatar
Ok will do acctually i just want to clear some space. But since i had too many files on found that s3drive couldnt handle it
19:55
By the way does s3 drive will supported multiple buckets available?
Avatar
Given that we released first version in December, there is plenty of work ahead of us and lots of improvements deployed weekly.
19:56
Multiple buckets support will come in a next earliest release, which is scheduled mid this week. (edited)
Avatar
Great thanks for the great work
Avatar
Nice
Avatar
Thanks for the good words. It's been crazy past few months, but comments like this make my day and give me motivation to push hard on this 🙂 (edited)
Avatar
Avatar
_shaike
Ok will do acctually i just want to clear some space. But since i had too many files on found that s3drive couldnt handle it
@_shaike You did say that S3Drive couldn't handle lots of files. There is a known issue if too many files are being downloaded / uploaded simultaneously (there is no hard limit which might make app crash), but as such the front-end should handle buckets with lots of files. What problems you were facing in more detail if I can ask? (edited)
Avatar
I have tried to upload about 6000 files and it just crashed
Avatar
Avatar
_shaike
I have tried to upload about 6000 files and it just crashed
I see, right, it won't work just yet, but we're working on this as one of the high priority items with ETA end of February / early March. Once it's there we will then be able to support folder upload which will come next.
Avatar
Good to hear
20:05
Good luck
👍 1
Avatar
Any idea why Backblaze is refusing my connection?
00:55
As an aside, it would be very helpful if there was a button to click to "list buckets" for me to select. Is my bucket formatted properly? This doesn't seem to be the issue though because even if I enter the wrong credentials, I still can't seem to connect to the server.
Avatar
OOPS. It appears I need to enter https:// But what's interesting is that the computer was actually sending network traffic. Maybe it's defaulting to HTTP? So backblaze was rejecting all HTTP traffic but accepted HTTPS? (edited)
02:02
A significant downside is that the file and folder names are not encrypted 😦
02:03
This is especially important to me because I like to use very descriptive file names.
02:06
Next, when I try to create a share link, I cannot uncheck this box nor edit the date/time for link expiry. Do I need to make my S3 bucket public by chance? (edited)
Avatar
Even with the bucket set to public the link doesn't work for me (edited)
Avatar
Hi @myfrogger, you're right if no scheme (https/http) was provided it defaulted to HTTP. We're going to make more explicit. Likely the endpoint without scheme will default to https, where as IP addr will default to http. Filename encryption is on our Roadmap and we have a working prototype already. https://s3drive.canny.io/feature-requests/p/filenamefilepath-encryption (ETA ~April 2023). We're making further research to understand standards or well established implementation in that area, so we can stay compatible. The sharing functionality is based on S3 presign URLs, their limitation is that the signature can't be valid longer than 7 days, so every 7 days new link would have to be generated. We're researching how to overcome this limitation. For instance we could combine this with a link shortener, so there is single link that doesn't change, but under the hood we would regenerate the destination link as needed. The encrypted share link has the master key at the end after the # character and looks like this: https://s3.us-west-004.backblazeb2.com/my-s3drive/.aashare/hsnwye5bno3p/index.html?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=004060aad6064900000000044%2F20230214%2Fus-west-004%2Fs3%2Faws4_request&X-Amz-Date=20230214T095014Z&X-Amz-Expires=604800&X-Amz-SignedHeaders=host&X-Amz-Signature=abdcd875e2106ee54c6a1d1851617c7e694e121464c5ca9023526ce2836be595#GKSGYX4HGNAd4nTcXb/GIA== What it does it tries to load the encrypted asset as usual, but it's not aware per se if an asset is encrypted. In the background JavaScript tries to fetch the asset and replaces the one on the screen with decrypted version. It looks like it has failed on your side. Can you go to the console (right-click -> inspect element) to see if there is anything abnormal (that is error in the Console or different than 200 status code in any of the network requests).
Avatar
The current sharing functionality is pretty basic version initially introduced in PhotoSync. We actually plan to integrate it with our web client, so when you share a link, it would open normally inside the app: https://web.s3drive.app It's not on our roadmap yet, we need to build some spec first. Realistically we won't be able to build it earlier than June/July. Speaking of your file / image sharing issue. Does it work unencrypted? What size is it? Bucket doesn't need to be public (it shouldn't be). The idea of presigned sharing is that you choose which resource to share from a private bucket. I would be glad to assist you on any other issues. As you see, it's all pretty early stage, but we're catching up fast. Thanks for your feedback and an idea with listing buckets button. Noted and added to our improvement items. (edited)
Avatar
You guys are awesome!! Thanks for all your hard work. I do see that you catch up very quickly 🙂 1. I'm happy to hear that folder name and file name is on the near roadmap for completion. Usability problem solved 🙂 2. The S3 presign URL concept is interesting. Can a link be done for a time period shorter than a week? I assume the user would need to have their program opened and some kind of timer to check if any links need to be signed again. Then the shortened link would need to be updated. It's a good idea actually but would want to make sure it's done in a trustless or trust minimized way. Also be careful deploying resources that you have to pay for as then you'd have ongoing costs. It depends what your monetization plan is long term I guess. 3. If the link is presigned, am I right to assume that there is no ability to revoke the sharing? 4. I'm actually not familiar. What is PhotoSync? 5. The link appears to work fine in Chrome but in Firefox it stops loading the page faster. If I click refresh, the image appears as it should. Strange but seems like all is fine. The things I would typically be sharing are not photos so it's not really a priority issue for me. 6. I'd love it if S3 drive had a different favicon so I can more easily distinguish it. I'd love it more if it was mounted as a drive letter in my file explorer. 😉 Actually, I think what I'd personally use most is if I could right click, go to "send to" and have S3 drive as a destination. I'd have to think about if I'd want it in the main folder or prompt me where to put it. I'd probably choose to have a popup to prompt me where I want it saved within S3 drive. (edited)
Avatar
Can I ask a general S3 question? Are there any implications of backing up say, 10000 files at 250kb each or a few larger zipped files? Before I came across S3Drive, I was actually looking for more permanent backup solutions. There are two different approaches that I see and I don't know if one is better than the other. One is storing each file individually and the other is first putting them into "chunks" of X MB/GB first.
Avatar
Avatar
myfrogger
You guys are awesome!! Thanks for all your hard work. I do see that you catch up very quickly 🙂 1. I'm happy to hear that folder name and file name is on the near roadmap for completion. Usability problem solved 🙂 2. The S3 presign URL concept is interesting. Can a link be done for a time period shorter than a week? I assume the user would need to have their program opened and some kind of timer to check if any links need to be signed again. Then the shortened link would need to be updated. It's a good idea actually but would want to make sure it's done in a trustless or trust minimized way. Also be careful deploying resources that you have to pay for as then you'd have ongoing costs. It depends what your monetization plan is long term I guess. 3. If the link is presigned, am I right to assume that there is no ability to revoke the sharing? 4. I'm actually not familiar. What is PhotoSync? 5. The link appears to work fine in Chrome but in Firefox it stops loading the page faster. If I click refresh, the image appears as it should. Strange but seems like all is fine. The things I would typically be sharing are not photos so it's not really a priority issue for me. 6. I'd love it if S3 drive had a different favicon so I can more easily distinguish it. I'd love it more if it was mounted as a drive letter in my file explorer. 😉 Actually, I think what I'd personally use most is if I could right click, go to "send to" and have S3 drive as a destination. I'd have to think about if I'd want it in the main folder or prompt me where to put it. I'd probably choose to have a popup to prompt me where I want it saved within S3 drive. (edited)
2. Period can be shorter than 7 days. We just didn't implement it yet. 3. That's right, as usual there are ways around, but not all of them feasible for S3Drive. It's possible to revoke credentials and generate a new ones, that would invalidate the link, but that's not practical if user have to do it themselves. The other option is to change the resource / filename, that's also quite impractical. The most feasible option that we've researched so far is connected to E2E encryption. Basically revoking share would mean regenerating sharing key for that resource. That means that presigned link would still be valid for some time, but the adversary would only be able to get the encrypted blob. We're still researching this. 4. This project started in Summer 2022 just as an Android app to backup Photos to S3 - https://play.google.com/store/apps/details?id=com.photosync.s3 (actually month earlier it was just Backblaze - https://play.google.com/store/apps/details?id=com.syncsolutions.backblazesync). Lots of research was already done in order to implement them. S3Drive extends that on all file types and all platforms. 5. Yeah it's rough around the edges, but in principle works for the most persistent users. We'll improve that. 6. We didn't even go as far, but the right click context menu (and tray icon with options like auto-startup etc.) is definitely something we would be adding. Thanks for mentioning that. I will make sure it's added to our list. Speaking of favicon, logo and UI in general. That's something that received least amount attention, since we were focused on building all the blocks to validate the concept. Now we keep adding new features and deploying bugfixes / improvements. There will be a moment within a few months at least where we step back and focus on UI simplification and beautifying. Do you have any ideas what favicon would work better? Thanks ! (edited)
Avatar
Avatar
myfrogger
Can I ask a general S3 question? Are there any implications of backing up say, 10000 files at 250kb each or a few larger zipped files? Before I came across S3Drive, I was actually looking for more permanent backup solutions. There are two different approaches that I see and I don't know if one is better than the other. One is storing each file individually and the other is first putting them into "chunks" of X MB/GB first.
It's finding a sweet spot between usability, costs and performance. For instance minimum billable object size for AWS S3 is 128KB, that means that if you store smaller objects you're still paying for the full 128KB. Smaller files means also more requests which will likely degrade performance and increase API costs (e.g. https://www.backblaze.com/b2/b2-transactions-price.html). S3 protocol doesn't support bulk upload (it does support bulk delete though), so 10000 files means at least 10000 PUT requests. On the other hand if you compress files and store them as chunks of X MB/GB, then even if small 250kb file is being changed, you need to replace the whole chunk which also comes at some price. If it's a cold backup that you synchronize from time to time, then having some sort of block storage (https://github.com/archiecobbs/s3backer) / chunks might be preferable way. If you want to conveniently access your data and even have a working copy that you work with, then a standard file approach is preferable even if it comes at some cost. S3 has its limitation, but it's powerful protocol, soon we will be supporting Versioning (https://s3drive.canny.io/feature-requests/p/version-preview-restore-integration-with-trash). Perhaps over the time S3 protocol will further expand allowing new operations (including bulk ones). If not, we have some ideas how to overcome some of the S3 protocol limitations with a "convenience proxy" that we're also researching, but not everything at once 🙂 (edited)
🙏 1
Avatar
Avatar
myfrogger
You guys are awesome!! Thanks for all your hard work. I do see that you catch up very quickly 🙂 1. I'm happy to hear that folder name and file name is on the near roadmap for completion. Usability problem solved 🙂 2. The S3 presign URL concept is interesting. Can a link be done for a time period shorter than a week? I assume the user would need to have their program opened and some kind of timer to check if any links need to be signed again. Then the shortened link would need to be updated. It's a good idea actually but would want to make sure it's done in a trustless or trust minimized way. Also be careful deploying resources that you have to pay for as then you'd have ongoing costs. It depends what your monetization plan is long term I guess. 3. If the link is presigned, am I right to assume that there is no ability to revoke the sharing? 4. I'm actually not familiar. What is PhotoSync? 5. The link appears to work fine in Chrome but in Firefox it stops loading the page faster. If I click refresh, the image appears as it should. Strange but seems like all is fine. The things I would typically be sharing are not photos so it's not really a priority issue for me. 6. I'd love it if S3 drive had a different favicon so I can more easily distinguish it. I'd love it more if it was mounted as a drive letter in my file explorer. 😉 Actually, I think what I'd personally use most is if I could right click, go to "send to" and have S3 drive as a destination. I'd have to think about if I'd want it in the main folder or prompt me where to put it. I'd probably choose to have a popup to prompt me where I want it saved within S3 drive. (edited)
The drive letter / mount is something we've already tried and had a working read-only prototype on Linux. https://s3drive.canny.io/feature-requests/p/file-mount-on-desktop-clients-with-write-support Mac and Linux will likely be supported end of Summer using FUSE driver that we're already tried. With Windows we haven't explored it yet, but there are some ways to do it (https://github.com/winfsp/winfsp). We'll definitely implement it, it's just at this stage it's hard to give us ETA. We might adjust priorities later on depending on the users percentage per platform, but we don't have a clear view / analytics to make that decision just yet. What platform are you using by the way?
Avatar
Thank you for the detailed responses. I'm using I use Windows and iPhone. My initial thought with the favicon is the current folder with the letters S3 on it. I'd have to do a bit of thinking and asking around at identifying the target market for this product. I'm not even sure S3Drive is the best name for marketing purposes. I don't dislike it though; just rambling. As far as those coming from Dropbox, Onedrive, etc, etc.... I think that the E2EE/control or own your data is a significant selling point and also the "pay for what you need". I don't know why all these companies have different "packages" when it seems easier to onboard people to a pay-as-you-go model. Apple seems to be the only one that figured it out that millions of people don't care about a $0.99 fee but they do care about $5-10. I think that you could monetize by having your own built in cloud (simply putting everyone's data into your own BackBlaze or Wasabi account). At least then when someone downloads the app, there is a usable setting without any further configuration. Maybe offer X 50gb free storage like everyone else. I remember reading years ago that getting someone to use the app the moment they download it is critical to keeping them as a user. I think you should embrace accepting bitcoin, lightning, and maybe some other crypto payments. Also embrace the community that wants their data private. Don't ask for names, don't log their details, etc. For cards use stripe. Maybe this not a project that you'll monetize but I feel like this could be a full time job, and an opportunity to make a great product that people would pay for. Anyway---I agree with you that you can't do everything at once, and the priorities appear to be ordered in a logical way. Keep up the good work 🙂 I'm happy to be an early user and maybe able to contribute somehow along the way. (edited)
Avatar
Just realized there are concerns with sharing data because idiots will share illegal material. Maybe stay out of the business of hosting the data for now. I'm just thinking out loud but I'll leave the above writing there in case anyone finds it helpful.
Avatar
Avatar
myfrogger
Thank you for the detailed responses. I'm using I use Windows and iPhone. My initial thought with the favicon is the current folder with the letters S3 on it. I'd have to do a bit of thinking and asking around at identifying the target market for this product. I'm not even sure S3Drive is the best name for marketing purposes. I don't dislike it though; just rambling. As far as those coming from Dropbox, Onedrive, etc, etc.... I think that the E2EE/control or own your data is a significant selling point and also the "pay for what you need". I don't know why all these companies have different "packages" when it seems easier to onboard people to a pay-as-you-go model. Apple seems to be the only one that figured it out that millions of people don't care about a $0.99 fee but they do care about $5-10. I think that you could monetize by having your own built in cloud (simply putting everyone's data into your own BackBlaze or Wasabi account). At least then when someone downloads the app, there is a usable setting without any further configuration. Maybe offer X 50gb free storage like everyone else. I remember reading years ago that getting someone to use the app the moment they download it is critical to keeping them as a user. I think you should embrace accepting bitcoin, lightning, and maybe some other crypto payments. Also embrace the community that wants their data private. Don't ask for names, don't log their details, etc. For cards use stripe. Maybe this not a project that you'll monetize but I feel like this could be a full time job, and an opportunity to make a great product that people would pay for. Anyway---I agree with you that you can't do everything at once, and the priorities appear to be ordered in a logical way. Keep up the good work 🙂 I'm happy to be an early user and maybe able to contribute somehow along the way. (edited)
@myfrogger You're absolutely spot on. We're researching what cloud we could use or whether we need to build our own one (likely MinIO based). Ideally we would pay predictable amount for the resources and resell it at some margin as a complete solution back to the users. The issue with Wasabi, Backblaze and many other clouds is that we can't control the costs as a business (there are many components) and can't easily specify quota per user account, so we don't bankrupt if one user decides to abuse the S3 credentials. Building own cloud on the other hand is additional chunk of work that we would like to avoid, more importantly it comes with huge responsibility, some legal burden and maintenance costs (infrastructure updates, security fixes, SLA, outages, on-call...). We'd also like to leave a room for power users which would like to use their own S3 back-end, so we're not locking anyone with our ecosystem. ~90-95% users would likely use our default offering, because it's convenient, but if someone would like to set up their own MinIO instance using their NAS or whatever, then go ahead. We'll come back to that, but first priority is to build a stable S3 protocol clients. I would love this to be a full-time gig, at the moment it is a full time volunteering and won't be source of income for long, but that's fine. I am extremely excited building technology which helps people to keep their data private without giving it up to seemingly "free" alternatives. It's quite challenging explaining people that "free" software that they use it's actually not free (they pay by their data being sold and mismanaged), these very same people will say: "I've nothing to hide", they're majority and not a target of our offering. There is still significant community of people who actually do mind protecting their privacy. I would rather stay in that circle. ... and I am glad to have a users like you who open up and give proper feedback. Thank you ! (edited)
🚀 1
Avatar
Avatar
myfrogger
Just realized there are concerns with sharing data because idiots will share illegal material. Maybe stay out of the business of hosting the data for now. I'm just thinking out loud but I'll leave the above writing there in case anyone finds it helpful.
As long as a business provides an easy way for DMCA to take down the copyrighted material I think it should be fine. (edited)
👍 1
alisa.algo joined the server. 02/16/2023 4:28 PM
Avatar
Hi @alisa.algo Welcome here 🙂
Avatar
Avatar
myfrogger
Hi @alisa.algo Welcome here 🙂
Hey:)
Avatar
Since 1.1.1 there is an improved upload performance (using multi-threaded workers), as well as additional functions in the Transfers section. Previously uploading ~100+ files could crash the app depending on the machine. Currently ~1000 files is a piece of cake. We've tested ~11k and except that scrolling the items isn't exactly a smooth experience, it's uploading just fine. It is possible to retry the failed requests with the retry arrow. There are also bulk operation buttons to stop all and delete all items within the tab you're in. (edited)
09:29
09:29
Waiting list
09:30
Failed ones (auto-retry will get there in one of the next releases) (edited)
Avatar
Awesome!!! Great work 🙂
👍 1
tillerson joined the server. 02/26/2023 10:40 AM
Avatar
Hi @tillerson !
10:41
Welcome to our modest community 🙂
Avatar
hello
stefanc12 joined the server. 03/01/2023 11:59 PM
stca joined the server. 03/02/2023 12:03 AM
Avatar
Avatar
stefanc12
Click to see original message
Avatar
Hello, I am trying the photosync for s3 and I'm getting invalid url on the generated access key
Avatar
made it work - I had to add https:// in front of it
00:53
Trying S3Drive with the same but cannot connect
Avatar
Hi @stca and welcome to our channel. We've recently added the photo & video backup module in our S3Drive app which is now recommended way of interacting with S3 endpoints. If you would like to keep using PhotoSync you're free to do so, however going forwards we're actively expanding S3Drive. Thanks
12:51
Hi @stefanc12 and welcome to our channel ! 👋 (edited)
Avatar
Hi @s3drive thanks. I've already switched to s3Drive but that one cannot connect to my idrive s3 ... not sure what to do, I think I've tried everything ...
22:21
I'm interested in the premium version with encryption. Quick question: can I also decrypt the files with some standard command or software?
Avatar
Avatar
stca
I'm interested in the premium version with encryption. Quick question: can I also decrypt the files with some standard command or software?
Encryption is compatible with V2 client-side cipher that AWS introduced. I am not aware of CLI that supports it, but it is supported by AWS SDK's, please search table for "Content Encryption: AES/GCM" and "Key Wrap: AESWrap"(https://docs.aws.amazon.com/general/latest/gr/aws_sdk_cryptography.html#crypto_features) which is supported by Java, .NET, Ruby V2, and C++. We haven't published any script or CLI tool yet, but we will provide one as an open-source, so user can always download and decrypt data at their discretion. We haven't prioritized that yet, as due to some limitations of both AES-GCM and AWS approach, we're having problem with implementing encrypted video streams and considering switching to different cipher and/or encryption scheme: https://s3drive.canny.io/feature-requests/p/support-streaming-of-encrypted-videos (edited)
Avatar
Avatar
stca
Hi @s3drive thanks. I've already switched to s3Drive but that one cannot connect to my idrive s3 ... not sure what to do, I think I've tried everything ...
I've tried connecting to iDrive myself and it worked just fine. Do you get any specific error? What endpoint are you using (I got e.g.: https://f4n6.par.idrivee2-46.com) ? Can you please long tap on version number at the bottom of the login screen, so you go to the Logs and perhaps see some error or warning that might render something useful? (edited)
Avatar
Multiple issues: (a) can't verify the secret key (the other app has a view button) (b) can't place cursor to add or delete a letter (c) not clear if I need to add the https:// part to the endpoint string
12:25
I get "Failed to authorize"
12:25
same credentials worked on the other app
12:26
endpoint looks similar to yours
Avatar
Avatar
stca
same credentials worked on the other app
Regarding a) We will add such option, thanks for mentioning that. b) That's something we can't easily reproduce. What's your Android version and phone model? c) Both: "https://f4n6.par.idrivee2-46.com" and "f4n6.par.idrivee2-46.com" would behave the same and use secure HTTPS context. Quick question, does the API key that you generate have both: "Read and write" permissions? S3Drive verifies the credentials, by saving a small test file to the bucket.
Avatar
For b) I have an Samsung S22 Ultra.
14:33
Android 13
14:33
It is read/write ... Photo sync did save files with same account
14:34
And it also works on syncaware ...
Avatar
Avatar
stca
endpoint looks similar to yours
I've managed to reproduce the "Failed to authorize" issue once: "Default encryption" is enabled for an iDrive bucket. It seems that they've implemented encryption in a way which modifies the ETag / MD5 hashes on the S3 protocol side. S3Drive performs strict ETag validation which is required for not yet released syncing features. After we write an object to iDrive E2, we expect ETag to match content of file that we've sent to the server (file integrity), instead they seem to return ETag of their encrypted blob. We will think of workaround, e.g. by disabling syncing features (and notifying user) if we detect ETag issue instead of preventing user from logging in by displaying: "Failed to authorize", however before it's there the only way is to disable iDrive encryption. https://s3drive.canny.io/feature-requests/p/workaround-idrive-e2-auth-issue-if-default-encryption-is-used PhotoSync doesn't perform ETag validation, since it's only one-way upload. Technically speaking the iDrive approach isn't correct from an S3 protocol perspective and is unique amongst S3 providers, e.g. Backblaze's encryption works just fine. Thanks for reporting this issue ! (edited)
👍 1
Avatar
there's gonna be a better way to connect to the account with QR code or something like on the web instead of typing all that ... Maybe with a small tool to generate the QR code or something ...
Avatar
Avatar
stca
there's gonna be a better way to connect to the account with QR code or something like on the web instead of typing all that ... Maybe with a small tool to generate the QR code or something ...
Thanks, I know it's indeed painful with 4 details to be provided. There will be improvement coming within a few weeks. We've already implemented QR code auth in our previous app (PhotoSync). The old web client does indeed support that: https://web.syncaware.com (edited)
Avatar
Avatar
stca
there's gonna be a better way to connect to the account with QR code or something like on the web instead of typing all that ... Maybe with a small tool to generate the QR code or something ...
Basically the idea is that desktop or web will display QR codes, which then mobile app will scan and securely (encrypted !) provide the credentials over.
Avatar
I've signed in after disabling the idrive default encryption as you've indicated
👍 1
13:21
not sure how to transfer a folder?
13:22
is album thumbnail view enabled?
13:22
or is it only for media backup?
Avatar
Avatar
stca
not sure how to transfer a folder?
It's not yet possible, but eventually will be.
👍 1
Avatar
Avatar
stca
or is it only for media backup?
Initially it's media backup only preview functionality.
Avatar
Avatar
stca
or is it only for media backup?
By saying thumbnail view, you mean grid view?
Avatar
can i select which media?
13:23
i.e. camera album ...
Avatar
Avatar
s3drive
By saying thumbnail view, you mean grid view?
yes
Avatar
Avatar
stca
can i select which media?
You can upload: "All" media from select album/albums or "Only new", there is a dialog prompt the moment when album is selected. In next turn we will implement manual mode where you can manually select media to backup (or conversely mark them "fresh" for reupload).
Avatar
Avatar
stca
yes
Yes, we might actually kill the current view, since filenames + list isn't condensed enough for bigger albums. The issue is that on iOS there is no way to reliably get the filename for display anyway, so we'll likely default to thumbnail / grid view. (edited)
13:28
There is an active development on all this, it's all coming. Bear with us please and stay tuned 🙂
Avatar
Avatar
s3drive
Yes, we might actually kill the current view, since filenames + list isn't condensed enough for bigger albums. The issue is that on iOS there is no way to reliably get the filename for display anyway, so we'll likely default to thumbnail / grid view. (edited)
👍
13:29
after upload preview is not working for me (I have added an encryption key) (edited)
Avatar
Avatar
stca
after upload preview is not working for me (I have added an encryption key) (edited)
Is it a photo or video?
13:31
actually I only have the thumbs folder
13:31
I'll check on idrive
13:32
yup ... only the thumbs folder exists (edited)
Avatar
What are your numbers here after backup has finished? Is media that was supposed to be backed up media appearing in: "Backed up" counter?
Avatar
it says 2 and 2
13:38
2-2-0
13:38
But I have another issue, in that folder/album I believe I should only have 2 photos
Avatar
Great, so when you navigate to Root folder, can you see: Automatic uploads folder?
Avatar
when I go in it I see pics I have just received in whatsapp
13:39
Root folder of?
Avatar
Basically Top of the Files section.
Avatar
there is no no, I don't see that
13:39
but auto upload is not enabled
13:39
I used "Start backup"
13:40
now in the album I see 2 files only
Avatar
That's fine, since your numbers claim that media was backed up, it should be there. I am wondering if it has something to do with iDrive read consistency.
13:41
Album tab shall display all pictures. There are two annotations, green (backed up) and white cloud (not backed up yet), no annotation mean media is not selected for backup.
Avatar
some strange things are happening ... files appear in the root
13:42
then disappear ...
13:43
the 2 photos show as backed up
Avatar
... but have you seen Automatic upload folder at least once?
13:43
I can enable the auto backup to see
Avatar
It won't change anything really. It's just poor name of mine, the automatic upload folder is where the backed up media are supposed to appear regardless if it's user clicking "Start backup" or if auto mode is enabled (edited)
Avatar
says: app needs to be running, background service will be available soon
Avatar
What do you mean that files appear in the root? You mean like just at the first top level in the Files tab? (edited)
Avatar
Avatar
stca
says: app needs to be running, background service will be available soon
That's right, background service is being worked on. PhotoSync had that, we can do the same here.
Avatar
in the listing ... a screen refresh or cache issue??
13:47
now they are not there anymore
13:47
I should take a screenshot if it happens again
Avatar
That looks to me like hitting different iDrive server every refresh which have different version of cache. We haven't used iDrive actively really.
13:47
Never experienced that with Backblaze for instance.
Avatar
could be ...
Avatar
I am still worried that Automatic uploads folder isn't displayed, as this is where files are supposed to be uploaded. We will allow overriding that location by user in the Settings, but it's not there yet.
Avatar
Avatar
stca
could be ...
I've found this topic on Reddit, which in general highlights multiple issues that iDrive E2 is having. https://www.reddit.com/r/selfhosted/comments/vyu2c7/comment/iw0pgdx/?utm_source=share&utm_medium=web2x&context=3 One of them 4 months ago: "It’s impossible to access newly created folders" I am not claiming that this is what's happening, as there well may be an issue on our side (we're still beta). Is it possible by any chance for you to switch to e.g. Backblaze or other provider at least temporarily? (edited)
Avatar
I suppose it is ... but I am in no hurry
Avatar
maybe I can try the MinIO instead ...
Avatar
Avatar
stca
maybe I can try the MinIO instead ...
MinIO is great, however ironically with the default settings using their Docker image we've faced similar listing cache issues (LS command was returning stale objects which were not fetchable via GET method), we have it in our backlog and didn't have chance to investigate since priorities are elsewhere. I guess it must be related to default cache settings which are maybe performance focused. Let's be honest, S3 protocol implementations for a long time weren't suitable for thing like S3Drive, due to consistency issues which were addressed not that long time ago. For AWS it was December 2020: https://aws.amazon.com/blogs/aws/amazon-s3-update-strong-read-after-write-consistency/
exploit01415 joined the server. 03/07/2023 6:35 PM
Avatar
Avatar
exploit01415
Click to see original message
exploit01415 03/07/2023 6:35 PM
Avatar
exploit01415 03/07/2023 6:49 PM
Hello 🙂
Avatar
exploit01415 03/07/2023 7:10 PM
19:10
Any idea how to fix this? Encryption is enabled
Avatar
Hi @exploit01415, thanks for your post. I assume that's an Android? Can I ask you what's your OS version and phone brand/model? Does it happen for every file during upload? (edited)
Avatar
Avatar
s3drive
Hi @exploit01415, thanks for your post. I assume that's an Android? Can I ask you what's your OS version and phone brand/model? Does it happen for every file during upload? (edited)
exploit01415 03/08/2023 10:30 AM
Galaxy S21 Ultra, Android 13 (edited)
10:30
Yeah since I enabled encryption
Avatar
@exploit01415 Thanks, we're fully on this. We've managed to reproduce it on some low-end Samsung with Android 13. I will let you know later today about progress on this. Sorry for the inconvenience !
Avatar
Avatar
s3drive
@exploit01415 Thanks, we're fully on this. We've managed to reproduce it on some low-end Samsung with Android 13. I will let you know later today about progress on this. Sorry for the inconvenience !
exploit01415 03/08/2023 10:37 AM
No worries, I was just trying the app for the first time 🙂 (edited)
👍 1
Avatar
Avatar
exploit01415
No worries, I was just trying the app for the first time 🙂 (edited)
If you come across something else that's not working for you or it's not clear enough, I'd be more than happy to help.
💯 1
Avatar
Avatar
exploit01415
Yeah since I enabled encryption
We've addressed this issue in the 1.1.3 release which is currently pending review on the Play Store. I will let you know once it's Live (this usually takes between ~5-12 hours). Thank you very much for reporting this.
Avatar
Avatar
exploit01415
Any idea how to fix this? Encryption is enabled
This issue is now fixed, please update your app version. Thanks ! (edited)
🔥 2
fortymarlin joined the server. 03/13/2023 11:48 PM
Avatar
Hi @fortymarlin, welcome to our little world !
👍 1
Avatar
Keep up the great work Tom! This is turning into a better app every week!
👍 1
Avatar
How do i support this app? Is it for free?
Avatar
Avatar
_shaike
How do i support this app? Is it for free?
App is entirely free. You're supporting us by simply using it, as you would likely report an issue, or perhaps might have some improvement idea. We're working on a sustainable business model, but at the moment we're focused on delivering remaining functionalities and moving it from (beta) to (stable). We'll be offering managed S3 accounts in Q2, but will always leave an option for a user to use their own S3 account. (edited)
Avatar
Thanks much
Avatar
Avatar
_shaike
Thanks much
If you like the app, we would appreciate rating our app and/or leaving the review on App/Play Store. I think the idea behind the app is great and fits many uses cases, but we're pretty early and far from being a recognizable solution 🙂
imlogarithm joined the server. 03/16/2023 12:41 AM
Avatar
I use StorJ but found that upload/download speeds can sometimes be abyssimal and requests to delete folders with many thousand items fail for no good reasons. I'm considering to move my data to Wasabi, thoughts?
Avatar
Avatar
imlogarithm
I use StorJ but found that upload/download speeds can sometimes be abyssimal and requests to delete folders with many thousand items fail for no good reasons. I'm considering to move my data to Wasabi, thoughts?
@imlogarithm Hi, thanks for joining. There are couple items here. Do you have an encryption enabled and use files bigger than 100MB? If so, then S3Drive uses much slower software encryption for such files which has visible performance effects, we plan to fix this, however since it's a topic of highly security sensitive nature, we're not rushing the decision. These are the roadmap items: https://s3drive.canny.io/feature-requests/p/explore-support-for-xchacha20-poly1305 and https://s3drive.canny.io/feature-requests/p/support-streaming-of-encrypted-videos which we plan to deliver around Summer 2023. If you upload/download multiple items without encryption enabled or smaller than 100MB and find poor upload/download speeds then switching to different S3 (Wasabi) might help, but only if you're not already maxing out your current internet connection. Deleting item is a different beast. Currently we're not deleting items, but rather "copy" them to trash one by one, and then delete files in the original location. It's not that delete is slow, but the "copy" operation takes time and it's safe to assume that "thousand" files operation will be roughly 1000x slower then a single file. What can help here is to switch to S3 provider/region that has closest proximity to your internet connection, but no matter what results won't be satisfying enough. No worries though, we plan to address this in ~April 2023 by adding support for native S3 versioning: https://s3drive.canny.io/feature-requests/p/version-preview-restore-integration-with-trash so we can actually skip Copy operation... and Delete itself is fast enough. (edited)
👍 1
Avatar
Avatar
imlogarithm
I use StorJ but found that upload/download speeds can sometimes be abyssimal and requests to delete folders with many thousand items fail for no good reasons. I'm considering to move my data to Wasabi, thoughts?
I've just checked it and it seems that Storj doesn't support object versioning and I didn't find if it's on their radar to have it implemented. On the other hand Wasabi does support it: https://wasabi-support.zendesk.com/hc/en-us/articles/115001684631-Does-Wasabi-support-versioning-
Yes. The versioning feature with a cloud storage service offers an additional level of protection by providing a means of recovery when customers accidentally overwrite or delete objects. This allo...
👍 1
Avatar
Thanks mate!
Avatar
imlogarithm 03/16/2023 3:36 PM
I left a 5 stars review for both apps hope it helps it rank high in search results
👍 1
15:36
What is the UI coded in? React native or flutter?
Avatar
fortymarlin 03/16/2023 4:30 PM
Hi, which S3 storage would you recommend to connect to?
Avatar
Avatar
fortymarlin
Hi, which S3 storage would you recommend to connect to?
Hi, They all have slightly different pricing models, each of them being suited towards certain workflows. You probably can't go wrong with either Backblaze (PayG but transfer fees) or Wasabi (fixed plan, but no transfer fees). I didn't have technical problems with Scaleway (except some billing issues and requirement of using credit card instead of debit card). If you want fully "own" the data, then you can self-host MinIO, but this would only be cost-effective for bigger datasets or if you can afford setting it up on at your Home/NAS. I probably wouldn't recommend iDrive E2 (lots of technical issues and inconsistent behavior)... and with Storj I need to say I don't exactly know what guarantees they give, but you probably can't go wrong with free ~150GB (UPDATE: They've changed that to 25GB - https://forum.storj.io/t/storj-free-tier-update-for-new-accounts-25-gb-storage/22155) data plan just to try them out. No matter what, I wouldn't recommend using just one destination as the only backup of your data, but similar applies to Dropbox and alike. (edited)
👍 1
Avatar
Avatar
imlogarithm
I left a 5 stars review for both apps hope it helps it rank high in search results
Thank you, it always helps !
Avatar
Avatar
imlogarithm
What is the UI coded in? React native or flutter?
We're using Flutter and it works really well. All of the logic, networking, encryption is also built using Flutter / Dart... and if something can't be achieved with Flutter, then we call native platform functions. (edited)
👍 1
Avatar
Great choice
Avatar
Avatar
imlogarithm
Great choice
Are you interested in a cross-platform development? There is also other promising project: https://kotlinlang.org/docs/multiplatform.html it wasn't mature enough when we started. EDIT: Apparently it's still in Beta. (edited)
Avatar
I have plans to work on kids mobile games but will probably orchestrate instead of code. I have some coding background but never loved coding much.
Avatar
Avatar
imlogarithm
I have plans to work on kids mobile games but will probably orchestrate instead of code. I have some coding background but never loved coding much.
Well, I never loved coding as an isolated activity, but I find it extremely exciting when used as a tool to solve some real life problems. Good luck on your project ! (edited)
👍 1
Avatar
@s3drive you think that Kotlin Multiplatform is mature enough to match Flutter? I couldn't find performance comparisons. It seems like Kotlin would be a good choice as it's a first class citizen for android too so you don't have to learn as many programming languages, but do they have rendering engines as good as flutter? I know flutter just released a new rendering engine for IOS that use metal, and their android engine is pretty good too.
Avatar
Avatar
imlogarithm
@s3drive you think that Kotlin Multiplatform is mature enough to match Flutter? I couldn't find performance comparisons. It seems like Kotlin would be a good choice as it's a first class citizen for android too so you don't have to learn as many programming languages, but do they have rendering engines as good as flutter? I know flutter just released a new rendering engine for IOS that use metal, and their android engine is pretty good too.
I don't think I am educated enough on Kotlin Multiplatform to answer that. I don't think that currently KMM maturity is near enough of Flutter, but specifics probably depends on the project. I think Kotlin has a better future than Dart though. I also liked working with Kotlin more... and the ecosystem is Java compatible, which means you have access to decades of knowledge and different projects. EDIT: It's not exactly that, Kotlin is apparently going into "language on it's own" direction and not necessarily aiming to use JVM (source: https://stackoverflow.com/a/74957737). This slightly alters my argument, still I've seen plenty of tools to migrate Java to Kotlin if you ever needed to port some Java logic. Yes, Flutter recently allows enabling Impeller engine on iOS and Android, previously Skia was used (I am actually not sure if it's not the same engine that KMM uses). To be honest it's not even about Kotlin vs Dart. If you know one language you can pretty easily use another. It's about what libraries, packages you get out of the box in one ecosystem or the other - https://pub.dev/ I think that Flutter ecosystem it's still early, but mature enough for many projects. . Bear in mind that you very often rely on some library which gives you native access to certain platform. These are not quick to build yourself and save you lots of time if you find one. I don't think KMM has many of these libraries, so often you will have to build one yourself in Kotlin and connect it to Swift and Android SDK (in which case you need to know the native language as well) (edited)
👍 1
Avatar
imlogarithm 03/20/2023 1:51 AM
I wonder if Microsoft won't just catch up with their MAUI and they have lots of addons and packages etc... dotnet is pretty solid. I think I prefer the way you can declare your ui in XML and then mode the interactions or something. Not sure yet. Performance probably sucks big time however.
01:51
I jist hate the JVM so much, that and gradle or maven or we... everything Java I dislike.
01:53
Not sure it matters much which stack you pick today as they will all evolve differently so I'd go with the one that feels right to begin with and has the documentation and tools do that I want to do.
daniel_recker_95 joined the server. 03/20/2023 2:13 AM
Avatar
Avatar
imlogarithm
I wonder if Microsoft won't just catch up with their MAUI and they have lots of addons and packages etc... dotnet is pretty solid. I think I prefer the way you can declare your ui in XML and then mode the interactions or something. Not sure yet. Performance probably sucks big time however.
Never had chance to work with C#, but it seems is pretty robust, mature language and for quite a while no longer locked in to Microsoft. My understanding is that Xamarin or MAUI they work in a similar way as React Native, which is you still call native UI components. (On the contrary Flutter uses the rendering engine)... so I don't think that performance will be that badly affected. Speaking of XML UI, I worked with Android and really didn't enjoy it (perhaps the MAUI one is nicer?), but before I tried Jetpack Compose I've introduced Flutter. The nested / React way of defining components is much clearer to me than XML. I never liked Java, it's verboseness, clunkiness and being memory hungry. With Android development I was forced to try it... and Kotlin made the introduction much nicer. After a while Gradle is no longer an issue, as you know the quirks. There are exciting projects like GraalVM which make resource startup costs of Java negligible. You can then reuse your project language on the back-end with huge choice of Reactive back-end frameworks (so far tried Vert.x and liked it). I was amazed by understanding how portable the Java ecosystem is... also I've fixed my previous comment and be aware that Kotlin (at least in KMM) is taking: "language on it's own" path and stepping away from JVM. One thing I've understood a while ago, perfect is the enemy of good. I better start using some technology and learn from it, the constantly try to find the best language / ecosystem, which may actually not exist. Same applies to Flutter, my biggest concern is that Google will simply kill it (https://killedbygoogle.com/), but before that happen I am sure that either there will be nice alternative and/or I will have time&resources to migrate my project elsewhere. After all it's Flutter that initially saved me a lot of time, so if I need to "pay it back" a little later, that's still fine with me. (edited)
Avatar
Hi @daniel_recker_95 , welcome to the channel !
polyen joined the server. 03/20/2023 2:03 PM
Avatar
Hi @polyen, welcome to our channel !
pairg joined the server. 03/22/2023 8:55 PM
Avatar
Hi @pairg, welcome here ! (edited)
zer0r00t joined the server. 03/24/2023 5:23 AM
Avatar
Hi @zer0r00t , welcome to our small community !
Avatar
Avatar
zer0r00t
Click to see original message
08:03
Interesting software
👍 1
Avatar
... and it will only get even more interesting with our ambitious 2023 Roadmap - https://s3drive.canny.io
Avatar
Nice
08:10
I'm a homelabber so I'd love to host this on my server someday
08:12
If you don't mind me asking, is Sync Solutions a company?
Avatar
Avatar
zer0r00t
I'm a homelabber so I'd love to host this on my server someday
The architecture of the client does require valid S3 endpoint. You can run e.g. MinIO on your end: https://hub.docker.com/r/minio/minio/#! which gives fully S3 compatible API. In such setup it's only S3Drive client on your device hitting your MinIO endpoint which is also in your control.
Avatar
Avatar
s3drive
The architecture of the client does require valid S3 endpoint. You can run e.g. MinIO on your end: https://hub.docker.com/r/minio/minio/#! which gives fully S3 compatible API. In such setup it's only S3Drive client on your device hitting your MinIO endpoint which is also in your control.
Is this also true for the webapp when used with local s3 servers? Or is data proxied through another server?
Avatar
Avatar
zer0r00t
If you don't mind me asking, is Sync Solutions a company?
It's a trade name, we're currently registered as a sole proprietorship, we're pending registration and paperwork to switch to limited company. This will likely be finished around Q2/Q3 2023. It is possible the trade name will change at that point. (edited)
Avatar
Cool. Nothing wrong with companies doing FOSS. Just trying to understand the motivations and goals
Avatar
Avatar
zer0r00t
Is this also true for the webapp when used with local s3 servers? Or is data proxied through another server?
Webapp is exactly the same codebase as desktop and mobile clients (thanks to Flutter), so it's hitting the API directly, you can verify that in your browser (right-click + inspect element and see the network tab - XHR requests). There are few exceptions where we might hit some other server (but never for S3 related operations), but we've mentioned that explicitly in our privacy section: https://s3drive.app/privacy
Avatar
Hmm
08:22
I see pro features mentioned. Do you see a bitwarden-like business model?
Avatar
Avatar
zer0r00t
Cool. Nothing wrong with companies doing FOSS. Just trying to understand the motivations and goals
Just for you to be aware we're not exactly FOSS. In our setup the clients code is closed, but the back-end protocol (S3) is open, meaning that you can always switch to other S3 client if you're not happy. There are other models on the market. For instance there are multiple companies having their clients open-sourced, but back-end is closed, which has some other advantages, but also disadvantages (vendor lock-in being one of them).
Avatar
Oooh
08:25
Yea
08:25
Ok I skimmed the webpage and thought it was FOSS
08:27
So files can be decrypted with or without s3drive am I understanding this correctly?
08:28
Both the encryption and backend are safe from vendor lock-in?
Avatar
Avatar
zer0r00t
I see pro features mentioned. Do you see a bitwarden-like business model?
We've been thinking about sustainable business model for a while. Our plans include hosted S3 accounts, which would include all of the Pro features when you get the data plan. BItwarden business model, we're not there yet, maybe eventually.
Avatar
Avatar
zer0r00t
So files can be decrypted with or without s3drive am I understanding this correctly?
That's right, this is because we're compatible with the AWS FOSS implementation: https://docs.aws.amazon.com/general/latest/gr/aws_sdk_cryptography.html#crypto_features
Avatar
That's great. That makes me feel more confident
Avatar
Avatar
zer0r00t
That's great. That makes me feel more confident
In our roadmap we plan to release open source decryption / export tool: https://s3drive.canny.io/feature-requests/p/open-source-data-decryption-export-tool
Avatar
Very nice. Reminds me of standard notes
Avatar
Avatar
zer0r00t
Both the encryption and backend are safe from vendor lock-in?
Back-end yes, no vendor lock-in, because we plan to stay compatible with S3. There maybe additional extra features on top of S3 protocol which are not possible to achieve with current S3 (related to e.g. file sharing and atomic rename/copy) in which case we might come up with some optional middle-man.
Avatar
So far I see this as a valid replacement to rclone WebDAV serve with rclone's crypt -- for less technical people who are afraid of CLIs
Avatar
Avatar
zer0r00t
Both the encryption and backend are safe from vendor lock-in?
Regarding encryption, there are couple challenges that we face with current AES-256 GCM implementation (mostly related to bigger files and video streams). We have plans to improve that: https://s3drive.canny.io/feature-requests/p/explore-support-for-xchacha20-poly1305 https://s3drive.canny.io/feature-requests/p/support-streaming-of-encrypted-videos but that still needs more research and there are couple dependencies. No matter what, our encryption standard will remain open and if possible compatible with other tooling.
Avatar
Avatar
zer0r00t
So far I see this as a valid replacement to rclone WebDAV serve with rclone's crypt -- for less technical people who are afraid of CLIs
Yes, but hopefully not only this. I find S3Drive way more convenient tool than rclone for accessing my files or backing up my photos on a day to day basis.... and I am not afraid of CLIs. (edited)
Avatar
yes that too of course
08:39
S3 compatible app on android at least, that looks nice is rare
08:39
Even if I don't use encryption, it's still handy to manage a bucket with a GUI
Avatar
Avatar
zer0r00t
S3 compatible app on android at least, that looks nice is rare
Heh, thanks for that. Our design is far from modern expectations, but well, there are other S3 clients which kind of lowered entry bar for us 🙂
Avatar
design is not bad at all
08:40
i kinda like it
08:41
on desktop tho, it feels very weird to use a smartphone/tablet-ish UI
Avatar
Avatar
zer0r00t
on desktop tho, it feels very weird to use a smartphone/tablet-ish UI
You're right, on the plus side, this allowed us to release desktop clients early. GUI will be improved, once we get through other items... and we're fully booked for 2023 so far.
Avatar
also the taskbar icon imho looks too close to windows explorer icon
Avatar
Avatar
zer0r00t
also the taskbar icon imho looks too close to windows explorer icon
That's a valid point, thanks. Being an Ubuntu user myself didn't have that graphic encoded in my mind.
Avatar
@zer0r00t If you have any other questions, concerns I would be glad to help out... and speaking of FOSS you might actually think of reasons behind our decision and it's mostly related to the fact that we try to build a sustainable business. With our open back-end model, OSS clients would simply kill any ways for us to monetize our work. OSS in general has funding issues and there are many examples of that. Companies in order to sell OSS, try to build closed source back-end, vendor lock-in you into their solution and make self-hosting pretty hard (despite code being open source). It's fine to find ways to monetize their work, it's just it's little bit deceptive practice (to claim Free, Open, but being far from it) in my opinion. As with every business, things may or may not work out. We plan to introduce certain safeguard triggers (e.g. if we ever planned to wind down our operations we would then release our work on some open-source license), more on that in our next updates. (edited)
Avatar
of course
09:00
all the best
09:01
oh something you might want to look into:
09:01
i use this https://garagehq.deuxfleurs.fr/ at home as my s3 server
An open-source distributed storage service you can self-host to fullfill many needs.
👍 1
09:01
s3drive doesn't seem to work with it
09:02
works fine with rclone, arq, cloudberry just fine
09:03
Avatar
Avatar
zer0r00t
Click to see attachment 🖼️
Thanks, we'll look into that.
Avatar
Avatar
zer0r00t
Click to see attachment 🖼️
I know I probably ask for too much, but do you have an example endpoint I could use to try it out? If not, no worries we'll have it running and then play around.
Avatar
sure
09:06
allow me an hour
👍 1
Avatar
Avatar
zer0r00t
allow me an hour
Great, thanks that would speed things up on our end. Don't feel rushed though. We're here most of the day anyway. (edited)
Avatar
anytime
Avatar
Avatar
zer0r00t
Click to see attachment 🖼️
I did a quick setup on my local: https://garagehq.deuxfleurs.fr/documentation/quick-start/ and discovered that the issue is that by default in enforces region: garage... and there is no way to provide region in S3Drive. It seems that we may add additional form field to specify the region.
Avatar
Avatar
zer0r00t
Click to see attachment 🖼️
The quick fix if you want to use S3Drive is to set the region in toml file like this: s3_region = "us-east-1". We auto-detect region from the endpoint URL and have a way to detect custom region from MinIO.... and if it doesn't work we use the most common default which is us-east-1.
10:16
it is set up as us-east-1 in toml
10:16
sending you my test creds
Avatar
Avatar
zer0r00t
it is set up as us-east-1 in toml
Thanks, got this. In fact there is an issue on our side. The detection logic (pretty stupid regex) incorrectly detects the region from your endpoint. When I've tested Garage locally using just IP addresses it wasn't an issue. I've sent you possible temporary resolution via PM. (edited)
Avatar
Avatar
zer0r00t
I see pro features mentioned. Do you see a bitwarden-like business model?
I think I haven't responded to that properly. We haven't decided exactly, our closest business plans include managed accounts with storage plans instead of selling "Pro" features. We've still left a room for ourselves if we ever decided to sell "Pro" features... and since we wouldn't like to disrupt current early adopters there is the Enrol API mentioned in our Privacy section that I believe you refer to. Realistically speaking, we'll keep certain Pro features always free (E2E encryption, photo backup etc.) to lower the barrier of entry and likely provide some additional Pro extensions and possibly per seat licensing model for companies in the future. We'll certainly stay cautious with changes and we extremely value existing users who contribute by providing valuable feedback. (edited)
✅ 1
👍 1
_.slipstream joined the server. 03/24/2023 10:30 PM
Avatar
@s3drive working nicely with garage now
22:34
👍
Avatar
Avatar
zer0r00t
@s3drive working nicely with garage now
Thanks for letting me know. Do you mind if I ask how are you finding Garage and did you try any S3 compatible alternatives that is MinIO / Seaweed FS / Ceph or anything like that?
Avatar
I did use minio before using garage
16:53
I think I'll be moving back to minio
16:55
Garage store a lot of chunk files which are hard to deal with on ext4
16:55
It takes ages to run ncdu on the data folder
Avatar
Avatar
zer0r00t
Garage store a lot of chunk files which are hard to deal with on ext4
Ah yes, I've seen in their documentation that they actually recommend XFS instead due to possible inode limit issues with EXT4.
Avatar
Yea
16:56
I like the CLI tho
Avatar
... and it's a single Go binary with less baggage that MinIO already have.
16:57
I would be curious to try SeaweedFS though. (edited)
Avatar
I was looking into SeaweedFS today
16:58
Looks very interesting
16:58
I need to read the docs a bit more
.kirausagi joined the server. 03/26/2023 3:24 AM
Avatar
Hi @.kirausagi, welcome to our channel !
Exp0rt joined the server. 03/28/2023 5:39 AM
Avatar
Hi @Exp0rt, welcome to our small world !
dsdsdsdsdsdsdsds joined the server. 03/30/2023 1:26 AM
Avatar
imlogarithm 04/07/2023 2:44 AM
I'd go with whatever option had the easiest backups tbh. I find that setting up an environment is not that hard, having redundancy too, but having good backups isin't that simple.
awkwardlysocial joined the server. 04/07/2023 6:43 PM
Avatar
awkwardlysocial 04/07/2023 6:43 PM
Sup people
Avatar
Hi @awkwardlysocial, welcome to the channel, how are things?
Avatar
Avatar
s3drive
Hi @awkwardlysocial, welcome to the channel, how are things?
awkwardlysocial 04/07/2023 6:44 PM
Good good. Just recently finished college. Now looking to get into a university in Canada
Avatar
Avatar
awkwardlysocial
Good good. Just recently finished college. Now looking to get into a university in Canada
Exciting times. What degree you aiming for? Let me guess... CS? 🙂 (edited)
Avatar
Avatar
s3drive
Exciting times. What degree you aiming for? Let me guess... CS? 🙂 (edited)
awkwardlysocial 04/07/2023 6:45 PM
Aahh not really
18:46
I was considering it
18:46
But given my ADHD. I decided to go towards English literature/writing/media etc.
18:46
As I like to be creative
18:47
I am also however, a tech nerd 🤓
Avatar
Right, so my guess wasn't exactly right. It's just so many people I've talked to are either CS students or converting to IT.
Avatar
awkwardlysocial 04/07/2023 6:48 PM
I really did want to
18:48
But I also didn't want to make myself suffer mentally (edited)
18:48
As I've suffered enough 🤷
Avatar
Yeah sure. We forget in our society that in the long run mental health wins over any aspect. I also know some people who tried hard to convert to IT for the luxurious pay being the reason one, but ultimately decided it's not for them. (edited)
Avatar
awkwardlysocial 04/07/2023 6:50 PM
eg. Due to family pressure, I went with the science department starting from 9th grade to college
18:51
And oh boy, worst mistake of my life
18:51
I was in a mentally dark place. Almost decided to "game over" myself
18:52
I've recovered in the past few months. Life's much better now 💪
Avatar
Yep I know that, it's like if someone else decides what you like doing... and noone asks you. Happened a lot around my circles. Sorry to hear that, but I am glad that you've took some steps and recovered. Good luck with your submission in Canada, stay strong ! (edited)
Avatar
awkwardlysocial 04/07/2023 6:53 PM
Thanks 👍🏻
18:53
Feel like this server isn't promoted enough
18:53
Really good app btw
Avatar
Thanks, it's all pretty new and still expanding. We're not doing much of a marketing, little bit overwhelmed by outstanding tech items right now. (edited)
Avatar
awkwardlysocial 04/07/2023 6:55 PM
That's alright
Avatar
Is there anything in particular I can assist you with?
Avatar
awkwardlysocial 04/07/2023 6:55 PM
I've personally done some android development myself
18:56
It can be quite interesting
Avatar
Indeed, we've started with Android and decided to expand on all platforms.
Avatar
Avatar
s3drive
Is there anything in particular I can assist you with?
awkwardlysocial 04/07/2023 6:57 PM
Oh yeah forgot, I can't seem to be able to delete folders
18:58
It loads for a few moments but the folder persists
Avatar
Avatar
awkwardlysocial
Oh yeah forgot, I can't seem to be able to delete folders
I see, what cloud are you using? We've seen such behaviour with MinIO and iDrive.
Avatar
Avatar
s3drive
I see, what cloud are you using? We've seen such behaviour with MinIO and iDrive.
awkwardlysocial 04/07/2023 6:59 PM
Storj
Avatar
Avatar
awkwardlysocial
Oh yeah forgot, I can't seem to be able to delete folders
Also, there are lots of improvements that we will be releasing regarding folder operations: https://discord.com/channels/1069654792902815845/1069654792902815848/1085780599962349648 "Deleting item is a different beast. Currently we're not deleting items, but rather "copy" them to trash one by one, and then delete files in the original location. It's not that delete is slow, but the "copy" operation takes time and it's safe to assume that "thousand" files operation will be roughly 1000x slower then a single file. What can help here is to switch to S3 provider/region that has closest proximity to your internet connection, but no matter what results won't be satisfying enough. No worries though, we plan to address this in ~April 2023 by adding support for native S3 versioning: https://s3drive.canny.io/feature-requests/p/version-preview-restore-integration-with-trash so we can actually skip Copy operation... and Delete itself is fast enough. " (edited)
Avatar
Avatar
awkwardlysocial
Storj
Thanks for your report. At this stage all I can say is sorry that it doesn't work as expected, we will have a closer look regarding Folder delete and Storj. It's usually some tricky caching behaviour that we've hasn't managed consistently reproduce... but I am sure that we'll eventually get to this. Ultimately we can come up with some compromise, e.g. hide folder for some time after delete. (edited)
Avatar
Avatar
awkwardlysocial
Storj
One question that I have, does it stay like this forever or eventually the folder entry disappears?
Avatar
Avatar
s3drive
Thanks for your report. At this stage all I can say is sorry that it doesn't work as expected, we will have a closer look regarding Folder delete and Storj. It's usually some tricky caching behaviour that we've hasn't managed consistently reproduce... but I am sure that we'll eventually get to this. Ultimately we can come up with some compromise, e.g. hide folder for some time after delete. (edited)
awkwardlysocial 04/07/2023 7:10 PM
Ah no need to be sorry
👍 1
Avatar
Avatar
s3drive
One question that I have, does it stay like this forever or eventually the folder entry disappears?
awkwardlysocial 04/07/2023 7:10 PM
Seems to stay like that
Avatar
Avatar
awkwardlysocial
Ah no need to be sorry
@awkwardlysocial I will let you know once I find out something with Storj, in the meantime was wondering how are you finding other aspects of S3Drive? Is there anything that you don't like / like in particular? It's an early stage and every single feedback is extremely valuable for us. (edited)
Avatar
Avatar
s3drive
@awkwardlysocial I will let you know once I find out something with Storj, in the meantime was wondering how are you finding other aspects of S3Drive? Is there anything that you don't like / like in particular? It's an early stage and every single feedback is extremely valuable for us. (edited)
awkwardlysocial 04/07/2023 7:51 PM
Ability to turn off Trash/Recycle bin would be pretty nice
👍 1
19:52
As for the Ui, I would like to see Monet theming.
prematrix joined the server. 04/08/2023 12:37 AM
Avatar
Hello
00:37
00:38
Why can't I connect to my iDrive E2?
Avatar
Hi @prematrix, this happens when iDrive E2 encryption is enabled. In general they use non-standard approach to reporting object hashes that we rely on. There are some ways around, but we haven't got to that yet. More on that here: https://discord.com/channels/1069654792902815845/1069654792902815848/1081247124580204574 and: https://s3drive.canny.io/feature-requests/p/workaround-idrive-e2-auth-issue-if-default-encryption-is-used The recommended path for iDrive E2 is to disable their encryption and enable in-app E2E encryption. (edited)
Avatar
Thank you for the response. I will use cryptomator, until the issue is fixed.
Avatar
Avatar
prematrix
Thank you for the response. I will use cryptomator, until the issue is fixed.
Thanks for letting us know. We will definitely have it sorted pretty soon. Stay tuned !
xenthys joined the server. 04/10/2023 10:14 PM
Avatar
Hello there! ablobwave The Discord server is hard to join from the app since it opens a webview, I'd recommend opening the invite externally so the Discord application can pick it up, or at least the standard web browser. Trying out the application with MinIO, so far so good, pleased by the rename function that likely performs a copy + delete under the hood. It does what one would expect from an S3 client, no ads either, really liking it. (edited)
Avatar
Not sure what the .aa* file and folder are about, but some "don't touch my bucket" parameter would be nice if the app doesn't strictly need them, otherwise that sounds like an additional bucket policy :D EDIT: looks like the file is for some kind of init feature within the app, and one of the two folders is the trash. I've seen the versioning feature request, but the trash folder could be opt-in if possible. (edited)
Avatar
Hi @xenthys, welcome to our channel. Thanks for your post. Being relatively new Discord user myself such feedback is extremely useful, thanks ! You're right, "rename" performs a "copy" and then "delete" (but only if "copy" was successful operation.). The .aainit file is our write test, as well as ETag response validation (which is required for not yet released syncing features), as some providers (talking mostly about iDrive E2 with SSE enabled) don't generate valid ETags. BTW. Would you like S3Drive to support read-only mode? Regardless, we will try to improve clarity of this operation, so user feels more confident that we're not doing some shady write/reads. Speaking of Trash itself, likely this week starting on Android first there will be a Settings option to disable Trash feature altogether (which is a soft-delete emulation, but slow and pointless if bucket already supports versioning). Versioning UI with restore options will come little bit later. (edited)
Avatar
Avatar
s3drive
Hi @xenthys, welcome to our channel. Thanks for your post. Being relatively new Discord user myself such feedback is extremely useful, thanks ! You're right, "rename" performs a "copy" and then "delete" (but only if "copy" was successful operation.). The .aainit file is our write test, as well as ETag response validation (which is required for not yet released syncing features), as some providers (talking mostly about iDrive E2 with SSE enabled) don't generate valid ETags. BTW. Would you like S3Drive to support read-only mode? Regardless, we will try to improve clarity of this operation, so user feels more confident that we're not doing some shady write/reads. Speaking of Trash itself, likely this week starting on Android first there will be a Settings option to disable Trash feature altogether (which is a soft-delete emulation, but slow and pointless if bucket already supports versioning). Versioning UI with restore options will come little bit later. (edited)
Thank you for your reply! Let me know if you have any question about Discord, I love to help around. For the .aainit file it's fine, but I'd prefer if the app saved the test results locally then deleted the file. I want to be able to write files so I wouldn't use a read-only mode, and we can always create read-only access keys if we want to be sure that's how the app will behave! I'm very interested by the share link expiry slider or date picker though, I never share for 7 days, it's either a smaller duration or permanent. Cool, I don't mind not having the versioning UI yet, but had to delete my file versions + the trash versions to cleanup my bucket so… yeah, trash is cool but I assume most people who want that have versioning enabled. I assume you already have quite a few buckets on various providers to test your features, but I can provide a MinIO one if it could be of interest. There was a 2nd folder with an HTML page in it, not sure what it was about but same thing I'd say, that's probably the least expected action from an S3 browser… While I audited the actions and indeed didn't find anything malicious, that could get me assassinated by my colleagues if I ever connected a more important bucket to the app. doggokek
Avatar
Avatar
xenthys
Thank you for your reply! Let me know if you have any question about Discord, I love to help around. For the .aainit file it's fine, but I'd prefer if the app saved the test results locally then deleted the file. I want to be able to write files so I wouldn't use a read-only mode, and we can always create read-only access keys if we want to be sure that's how the app will behave! I'm very interested by the share link expiry slider or date picker though, I never share for 7 days, it's either a smaller duration or permanent. Cool, I don't mind not having the versioning UI yet, but had to delete my file versions + the trash versions to cleanup my bucket so… yeah, trash is cool but I assume most people who want that have versioning enabled. I assume you already have quite a few buckets on various providers to test your features, but I can provide a MinIO one if it could be of interest. There was a 2nd folder with an HTML page in it, not sure what it was about but same thing I'd say, that's probably the least expected action from an S3 browser… While I audited the actions and indeed didn't find anything malicious, that could get me assassinated by my colleagues if I ever connected a more important bucket to the app. doggokek
Thanks for your help. Currently sharing uses S3 presigned URL, they're part of the protocol, however the signature validity is limited to 7 days max. The HTML is in fact created when sharing files externally to create the "album" feel. The workflow is that we create "presigned" URL for every resource that you share, then we embed them in the HTML which is itself "presigned". There will be in-app sharing later this year, which will basically open shared resources within the Web app: https://s3drive.canny.io/feature-requests/p/in-app-sharing It will still have to follow the S3 protocol limitations though. We're exploring different ways, so we can generate permanent links and allow users revoking them. There are multiple ways, one way is to create a middle-man (link shortener/alias and presigned links generator) to constantly extend the validity and keep the same URL scheme. The other way is to aim more into closer integration, e.g. with permission management and STS using MinIO we could revoke shared resources, something which isn't possible with pure S3 protocol. We haven't exactly agreed on the best way forwards. Thanks for all your feedback and I am more than happy to hear how are you finding different parts of the app and whether it suits your workflow. Speaking of MinIO, last time when we've tried to test the S3Drive with MinIO we've came across same listing caching issues when folder was deleted with all of its contents. The contents was removed properly, but the folder entry stayed in the s3 ls even though headObject couldn't retrieve it as a valid S3 entry. I am curious if you came across of something similar. (edited)
Avatar
Yes, 7 days is the maximum but not the minimum, when I share a file however I'd like to keep using raw presigned URLs without having app-specific features included without me being aware. I'm looking for an S3 browser to use S3 features, if I wanted a fully-featured platform I'd install Nextcloud instead and use S3 as the backend storage, be careful about feature creep! I expect the majority of users who are technical enough to have an S3 bucket to use the app just for a quick file access or upload as well. I haven't encountered any issue with MinIO yet, but I deleted content through the console with their versions when I figured out the trash feature. I know MinIO doesn't immediately update the file list after a create or delete operation, even the console shows an invalid object count if you check too soon after, so maybe that's related?
Avatar
While my messages are very opinionated, in the end it remains your application of course, I would never order an independent developer to do what I want, unless we have a paid contract haha
Avatar
Avatar
xenthys
Yes, 7 days is the maximum but not the minimum, when I share a file however I'd like to keep using raw presigned URLs without having app-specific features included without me being aware. I'm looking for an S3 browser to use S3 features, if I wanted a fully-featured platform I'd install Nextcloud instead and use S3 as the backend storage, be careful about feature creep! I expect the majority of users who are technical enough to have an S3 bucket to use the app just for a quick file access or upload as well. I haven't encountered any issue with MinIO yet, but I deleted content through the console with their versions when I figured out the trash feature. I know MinIO doesn't immediately update the file list after a create or delete operation, even the console shows an invalid object count if you check too soon after, so maybe that's related?
We will implement slider to allow providing the minimums. Our aim is to actually hide the S3 complexities and provide the "drive" experience for the general public. Our userbase is mixed. I take your point and will make a note to incorporate raw sharing. Speaking of Nextcloud, yes it's an option, but not anyone wants to set up their server, manage it, take care of updates and security... also if you want Nextcloud to not cost a lost (when e.g. hosted on some VPS)... then actually you need to connect it with some S3 provider to get reasonably priced storage. Our aim is to skip layers like Nextcloud and simply using some client-side magic provide similar experience (and less convoluted than Nextcloud - but that's my opinion) using raw S3. Speaking of caching issues. It's likely what we've experienced with MinIO and was little bit confused, because all other providers (except iDrive) update their listings immediately.
Avatar
Avatar
xenthys
While my messages are very opinionated, in the end it remains your application of course, I would never order an independent developer to do what I want, unless we have a paid contract haha
If we only got more such "opinionated" messages, it would've been much easier to build stuff... and working full-time on this for about a year now without a single paycheck, I wouldn't mind a paid contract 🙂 ... but seriously, it's actually one of the coolest things I've been working on in my 10+ years career and seeing already such positive reception we've no intentions to stop. (edited)
Avatar
I see, however you're going to have a hard time implementing a nice drive experience on top of bare S3 buckets, especially if you reduce yourself to the common denominator between the various providers. I guess some kind of "expert mode" would help settle the debate, where you expose raw S3 functions and let the user do whatever without interfering. Yes, Nextcloud was an example, I don't know many people with an S3 bucket who don't already have a way to share files, and most will probably just use OneDrive or similar if they want simplicity. With the single-file installer and compatibility with any shared hosting service, it's not the hardest to use 😄
10:51
I'd love to be rich enough to offer paid contracts by myself, the company I work at would unfortunately not be interested, our buckets are going to be heavily locked down so even accessing them directly from a company laptop on the internal network would be frowned upon. Welcome to healthcare!
Avatar
Avatar
xenthys
I'd love to be rich enough to offer paid contracts by myself, the company I work at would unfortunately not be interested, our buckets are going to be heavily locked down so even accessing them directly from a company laptop on the internal network would be frowned upon. Welcome to healthcare!
We're also planning some enterprise offerings. Basically S3Drive, locked down within the internal infrastructure with SSO, permission management, audit log and some management tools on top of MinIO (or other solution). Obviously the model would've to be slightly different. We would likely provide management tools as an open-source on some license. I am just thinking loud and this is something we will start work on 2023 Q4 / 2024 Q1 at earliest. Out of curiosity what your company uses for the S3? Is it MinIO, Ceph or some cloud S3? (edited)
Avatar
We're moving from Azure Blob storage to AWS S3 directly, so pretty much going from the least to the most compliant S3 implementation :p (edited)
11:00
As for our SSO, it's based on Microsoft so probably not what you would expect for a company fully using AWS as its sole cloud provider.
11:01
I have to say, my main use of S3Drive is to have an S3 app on my phone, the others weren't as appealing, but your vision fully makes sense once we take all platforms into account.
11:08
Regarding licensing, maybe you'd like the Sustainable Use created by n8n: https://github.com/n8n-io/n8n/blob/master/LICENSE.md It's based on the Fair-code software model (https://faircode.io/) which only restricts commercial applications of your software, it's interesting.
👍 1
Avatar
Avatar
xenthys
I see, however you're going to have a hard time implementing a nice drive experience on top of bare S3 buckets, especially if you reduce yourself to the common denominator between the various providers. I guess some kind of "expert mode" would help settle the debate, where you expose raw S3 functions and let the user do whatever without interfering. Yes, Nextcloud was an example, I don't know many people with an S3 bucket who don't already have a way to share files, and most will probably just use OneDrive or similar if they want simplicity. With the single-file installer and compatibility with any shared hosting service, it's not the hardest to use 😄
It's indeed a challenge to provide a nice drive experience on top of bare S3. There are multiple missing features, block read/writes, bulk operations, atomic operations. We're not discouraged though, as there are ways around. The beauty of such approach is that we're staying compliant with S3 at all times, so there is no vendor lock-in or proprietary back-end. With some optional tooling/layers we can improve the experience. The other advantages of S3Drive comparing to well-established players is price competitiveness (S3 is just cheap)... and ZK client-side encryption, so you can drop your files anywhere and secure them, so they are private. To be honest... every week/month as we build it we find new ideas that slightly affect our direction and it's just how things are developed.
Avatar
Hey, I play Star Citizen, unless your app stays in alpha for a decade you're good doggokek
Avatar
Avatar
xenthys
Regarding licensing, maybe you'd like the Sustainable Use created by n8n: https://github.com/n8n-io/n8n/blob/master/LICENSE.md It's based on the Fair-code software model (https://faircode.io/) which only restricts commercial applications of your software, it's interesting.
Cool, thanks. It's really helpful. We've been studying different open-source licensing and having chance to read lots of horror stories (ElasticSearch, core-js recently ... and couple more) we were not exactly convinced what's the best path to take given that the S3 protocol itself is open and the fact that we don't have the proprietary back-end as a means to protect the IP by making the open-source client useless without back-end (not that we would want to take that route). (edited)
Avatar
Well, the horror story for most users is seeing a project moving to another license, no matter from which to which. The model used by n8n has been criticized by pro-FOSS folks, but GitHub stars don't pay rent.
11:15
I find it very interesting because self-hosted people won't have any barrier, even within companies, but they can't offer a SaaS version of your product. That seems to match your vision.
11:17
Your "back-end" would be the layer you plan to use in order to transform an S3 bucket into a drive I assume, but licensing should only be validated with a lawyer anyway.
Avatar
Avatar
xenthys
Your "back-end" would be the layer you plan to use in order to transform an S3 bucket into a drive I assume, but licensing should only be validated with a lawyer anyway.
It's all interesting, thank you. I can imagine FOSS communities not approving such licences, but pragmatic open-source is just unsustainable and we're probably yet to see even more similar licences and more projects using these. (edited)
Avatar
Avatar
xenthys
I find it very interesting because self-hosted people won't have any barrier, even within companies, but they can't offer a SaaS version of your product. That seems to match your vision.
We'll get back to the licensing later this year. Next couple months are about delivering the major roadmap items. By that time we might have a clearer picture and more established userbase.
Avatar
The more I think about it… I can't hire you, but would an "expert mode" bounty work? Basically a "gimme bare-bones S3 and don't touch my bucket!!" mode as described above. Another interesting feature would be to be able to set the filename on upload, because rename leaves deleted versions. Or maybe a checkbox to delete the renamed version on versioned buckets? I assume you're going to have a versioning check for the trash feature later, so the idea would be to piggyback on it if it's not too much work. Let me know if there's anything I can do to help of course.
Avatar
Avatar
xenthys
The more I think about it… I can't hire you, but would an "expert mode" bounty work? Basically a "gimme bare-bones S3 and don't touch my bucket!!" mode as described above. Another interesting feature would be to be able to set the filename on upload, because rename leaves deleted versions. Or maybe a checkbox to delete the renamed version on versioned buckets? I assume you're going to have a versioning check for the trash feature later, so the idea would be to piggyback on it if it's not too much work. Let me know if there's anything I can do to help of course.
If bare-bones S3 means, simply disable some convenience features then why not. Rename with old name object version delete is possible. Normally I would be hesitant to implement it, since it's easy to for feature creep to kick in... and it's not sort of feature where one would like to make a mistake in. On the other hand we already have to the delete (after copy) to emulate move. I like the idea to not clutter the bucket. We will have it implemented. (edited)
Avatar
Managing versions is going to be annoying when you take compliance mode into account, S3 is a feature creep in itself already haha
Avatar
Avatar
xenthys
Managing versions is going to be annoying when you take compliance mode into account, S3 is a feature creep in itself already haha
Yes, but what's the alternative? 🙂 I love that one: https://xkcd.com/927/
Avatar
Indeed, I'm just joking about the fact S3 itself is no longer true to its name when you take every feature into account.
12:12
But even with compliance, worst case scenario is handling a 403 technically speaking, just ensure the error message is clear enough :p
12:13
If I hated the S3 standard, I wouldn't be here 🙃
Avatar
Basically growing pile of IFs, growing pile of tests... and possible becoming little bit less exciting to work on... but if it's what it takes to stay compatible... well we can still handle it. Well, S3 is far from perfect... what I love about it... it is actually a standard that's broadly accepted. (edited)
12:15
Finally, Compliance mode is a feature with real use-cases, so it's not like this work gets more pleasant with a different standard. One needs to handle 403 regardless of the API. (edited)
Avatar
Avatar
s3drive
Yes, but what's the alternative? 🙂 I love that one: https://xkcd.com/927/
I liked IRC as a chat platform standard, even though authentication and privacy is a mess. This normally makes you think about another XKCD…
12:17
Indeed, and versioning / object locking / compliance are all part of the same mechanism so you can hardly implement one without the others.
Avatar
Avatar
prematrix
Thank you for the response. I will use cryptomator, until the issue is fixed.
Hi @prematrix , it's been addressed in a 1.1.4 Android release which is now live. It will be available on different platforms later this week.
Avatar
Avatar
xenthys
Thank you for your reply! Let me know if you have any question about Discord, I love to help around. For the .aainit file it's fine, but I'd prefer if the app saved the test results locally then deleted the file. I want to be able to write files so I wouldn't use a read-only mode, and we can always create read-only access keys if we want to be sure that's how the app will behave! I'm very interested by the share link expiry slider or date picker though, I never share for 7 days, it's either a smaller duration or permanent. Cool, I don't mind not having the versioning UI yet, but had to delete my file versions + the trash versions to cleanup my bucket so… yeah, trash is cool but I assume most people who want that have versioning enabled. I assume you already have quite a few buckets on various providers to test your features, but I can provide a MinIO one if it could be of interest. There was a 2nd folder with an HTML page in it, not sure what it was about but same thing I'd say, that's probably the least expected action from an S3 browser… While I audited the actions and indeed didn't find anything malicious, that could get me assassinated by my colleagues if I ever connected a more important bucket to the app. doggokek
Disabling Trash in Settings menu is now a thing on Android, since 1.1.4 release.
Avatar
Avatar
stca
For b) I have an Samsung S22 Ultra.
Hi @stca, Since 1.1.4 release on Android, the encrypted iDrive E2 buckets are now supported.
Avatar
Avatar
xenthys
I liked IRC as a chat platform standard, even though authentication and privacy is a mess. This normally makes you think about another XKCD…
Yes, I remember IRC, but I am relatively young and got the internet connection pretty late, by the time I was connected and when lived in Poland, Gadu-Gadu took over the whole country. IRC always reminds me the old Linux days, where you had to compile everything. I believe that many IRC users might be in their mid-50s now 🙂 (edited)
Avatar
Well done, downloaded the update and found the option, thanks!
👍 1
14:36
There's an unexpectedly high number of younger people on IRC, by curiosity or because some FOSS projects refuse non-FOSS chat platforms, and IRC remains easy to join with web clients.
14:39
Now waiting on the .aainit file being nuked (delete file itself + all its versions) once the init is done and raw presigned URL sharing doggokek
Avatar
Avatar
xenthys
There's an unexpectedly high number of younger people on IRC, by curiosity or because some FOSS projects refuse non-FOSS chat platforms, and IRC remains easy to join with web clients.
Sure, but at the same time there are newer and more exciting protocols. https://matrix.org/ being one of them.
Avatar
It's heavier to run and there isn't as much compatibility yet, moderation remains an issue as well. But I agree, we'll eventually get there, in the meantime Discord is fine!
Avatar
Avatar
xenthys
Hello there! ablobwave The Discord server is hard to join from the app since it opens a webview, I'd recommend opening the invite externally so the Discord application can pick it up, or at least the standard web browser. Trying out the application with MinIO, so far so good, pleased by the rename function that likely performs a copy + delete under the hood. It does what one would expect from an S3 client, no ads either, really liking it. (edited)
... forgot to mention that we've also fixed the Discord link with 1.1.4 release. Thank you for reporting this issue.
Avatar
Oh nice, I checked and it indeed gets caught by the Discord app, well done and thanks to you for the quick fix!
Avatar
Avatar
xenthys
The more I think about it… I can't hire you, but would an "expert mode" bounty work? Basically a "gimme bare-bones S3 and don't touch my bucket!!" mode as described above. Another interesting feature would be to be able to set the filename on upload, because rename leaves deleted versions. Or maybe a checkbox to delete the renamed version on versioned buckets? I assume you're going to have a versioning check for the trash feature later, so the idea would be to piggyback on it if it's not too much work. Let me know if there's anything I can do to help of course.
I've had a thought about the bare bones presigned URLs. The current "album sharing" allows sharing more than one file/media, as well as allows sharing client-side encrypted content, since HTML includes JS decryption code and there is key injected in the URI (after #). This isn't possible with raw presigned URL. Having said that, we could either default to raw presigned URL if it's a single and unencrypted file share (or provide some configuration option to determine the single unencrypted sharing file mode). The only issue that I have with this approach is, that now we're ending up maintaining two solutions, but if it's what it takes to make the community happy, we'll handle it. (edited)
Avatar
I don't represent the community as a whole, but I find sharing a single file from a classic S3 bucket is quite common and what I personally expect to be able to handle from any S3 client. 😅
20:53
It could be a toggle up to the user, as a "use at your own risk" kind of deal. You already handle presigned URLs, so I assume you'd just return it to the user instead of continuing the whole "setup an album" procedure.
Avatar
Given the size of S3Drive community you're significant part of this at this stage 🙂 Fair enough, we'll plan this in our items along with the slider which needs to be done anyway.
blobooh 1
Avatar
Avatar
xenthys
It could be a toggle up to the user, as a "use at your own risk" kind of deal. You already handle presigned URLs, so I assume you'd just return it to the user instead of continuing the whole "setup an album" procedure.
Indeed. Just realised that we actually can't base this purely on fact whether file is encrypted or not, because from a client point of view we don't know that before we headObject and get the envelope AES keys.... so it must be a toggle with some warning. It would then simply return the Blob that's stored on S3, regardless of what's inside. (edited)
Avatar
I was thinking about an "advanced features" toggle that wouldn't change the "Share" button's behavior, but add a "Create pre-signed URL" button under it maybe?
Avatar
Avatar
xenthys
I was thinking about an "advanced features" toggle that wouldn't change the "Share" button's behavior, but add a "Create pre-signed URL" button under it maybe?
That's good idea as well. In that case we don't interfere with existing workflow and UI, we simply suplement new advanced feature. I think I like it more.
21:02
Cool, sounds like we've a plan.
iarcanex joined the server. 04/12/2023 4:49 AM
Avatar
Hey there! Joined since I had a question or two. Does S3Drive support backing and "syncing" up an external drive? Looking for more a set and forget option, but wasn't too sure.
Avatar
@iarcanex Hi ! Not out of the box. The sync modes are closer than ever: https://s3drive.canny.io/feature-requests/p/syncbackup-options-two-way-one-way and there will be nothing stopping you to sync the whole drive letter to the remote location. Having said that it won't be really the best tool to reliably back up your external drive for quite a while and there are some unique challenges (e.g. what if drive letter changes when you reconnect drive, how shall we handle it?) that we haven't even tried solving just yet. You might be better off using tools e.g. Rclone and some custom scripting. (edited)
👍 1
screamingintothevoid1 joined the server. 04/12/2023 8:27 PM
Avatar
screamingintothevoid1 04/12/2023 8:28 PM
hi! trying to setup the app, but i gett the CORS error. is there a guide for this?
Avatar
Avatar
myfrogger
As an aside, it would be very helpful if there was a button to click to "list buckets" for me to select. Is my bucket formatted properly? This doesn't seem to be the issue though because even if I enter the wrong credentials, I still can't seem to connect to the server.
Hi @myfrogger I hope you're doing well. This is to let you know that long awaited option to list all available buckets that you've suggested will be available today/tomorrow (awaiting release) on Android and will be deployed to other platforms later this week:
20:29
@screamingintothevoid1 Hi and welcome to the channel, what platform are you using? Is it Web? (edited)
Avatar
screamingintothevoid1 04/12/2023 8:29 PM
i was using web to try to set it up before i tried to hard on the android app.
20:32
i dont need to use the web app. just android. i guess try that setup with android?
Avatar
@screamingintothevoid1 Basically CORS needs to be enabled for bucket which can be done by any non-web client using: "Set up CORS" option which shall return clear message that it succeeded. In principle web client shall be able to some extent detect CORS issue and "Set up CORS" via proxy, but that's pretty experimental and may not work for all browsers consistently. Does your bucket support CORS setting? What S3 provider are you using? Yes if Web didn't work, please try an Android (or other client) first and use: "Set up CORS" to see what happens. (edited)
Avatar
Avatar
screamingintothevoid1
i was using web to try to set it up before i tried to hard on the android app.
Regardless if you manage to get it running. We would extremely appreciate if you could give us some details about your browser, S3 provider and the exact error or screenshot, so we can reproduce it on our side and address this issue. Thanks ! (edited)
Avatar
screamingintothevoid1 04/12/2023 8:41 PM
i didnt get it working yet. i will try later. it was supposed to be a short distraction from my AWS training to work on IAM, S3, etc. i'll check it out tomorrow some more.
20:42
i am using AWS, Chrome (latest), S22Ultra, with A13.
20:43
but i will get you more info later. im an SRE. i'll help out as i can
Avatar
@screamingintothevoid1 Good luck on your AWS training ! One thing that came to my mind. Your user / IAM needs to have permission to modify bucket settings in order to set up CORS correctly, but the error message (if there is any) on Android shall reflect that. Thanks for the details. If you have any other issue I am glad to help. (edited)
Avatar
screamingintothevoid1 04/12/2023 8:44 PM
guess imma learn about CORS. thanks for the tips and ill get back to you
Avatar
Avatar
xenthys
Thank you for your reply! Let me know if you have any question about Discord, I love to help around. For the .aainit file it's fine, but I'd prefer if the app saved the test results locally then deleted the file. I want to be able to write files so I wouldn't use a read-only mode, and we can always create read-only access keys if we want to be sure that's how the app will behave! I'm very interested by the share link expiry slider or date picker though, I never share for 7 days, it's either a smaller duration or permanent. Cool, I don't mind not having the versioning UI yet, but had to delete my file versions + the trash versions to cleanup my bucket so… yeah, trash is cool but I assume most people who want that have versioning enabled. I assume you already have quite a few buckets on various providers to test your features, but I can provide a MinIO one if it could be of interest. There was a 2nd folder with an HTML page in it, not sure what it was about but same thing I'd say, that's probably the least expected action from an S3 browser… While I audited the actions and indeed didn't find anything malicious, that could get me assassinated by my colleagues if I ever connected a more important bucket to the app. doggokek
Hi @xenthys, I can proudly say that we've released version 1.1.5 on Android which includes some of these changes. When verifying bucket we just try to read the usually non-existent key (.s3drive_bucket_read_test) and verify the response instead of trying to write a file. Slider now works, so it's possible to set expiry time shorter than maximum of 7 days. There is an option to use raw preshared URLs. We've also introduced basic Version UI. It is now possible to preview the revisions. In a next update we will allow opening, preview, deleting and restoring to particular version. Thank you for these suggestions, they were great and helped us to validate it all ! 👍 ... and as always we're open for a feedback.
Avatar
Avatar
awkwardlysocial
Ability to turn off Trash/Recycle bin would be pretty nice
Hi @awkwardlysocial, Thanks for this idea. It is now added as a Settings option. It modifies the way the items are deleted to either delete them directly in-place (new hard-deleted behaviour) or move to Trash (previous behaviour).
Avatar
Avatar
myfrogger
As an aside, it would be very helpful if there was a button to click to "list buckets" for me to select. Is my bucket formatted properly? This doesn't seem to be the issue though because even if I enter the wrong credentials, I still can't seem to connect to the server.
This option is now live on Android. Thanks !
Avatar
Avatar
s3drive
Hi @awkwardlysocial, Thanks for this idea. It is now added as a Settings option. It modifies the way the items are deleted to either delete them directly in-place (new hard-deleted behaviour) or move to Trash (previous behaviour).
awkwardlysocial 04/13/2023 5:05 AM
Thank you for adding that feature!
Avatar
Avatar
awkwardlysocial
Thank you for adding that feature!
There will be couple more things coming in as suggested by our other user here. For instance when moving an item we do "copy+delete" to emulate "move". The thing is that with versioned buckets even though the old file was "deleted" it still uses up space as a revision (delete marker). There will be a setting to let user decide whether they want to cleanup or persist version. (edited)
jdave joined the server. 04/19/2023 9:13 PM
Avatar
Hi, I am starting to use s3drive with Wasabi an S3 solution. Wasabi bucket is configured as immutable with versioning. Testing the delete option in S3Drive, the file disappears in S3drive when 'deleted' but of'course is not deleted in Wasabi.. but it does not come back in S3Drive.. is there a way to fix that?
Avatar
Avatar
jdave
Click to see original message
Avatar
I believe object locking isn't (properly?) supported yet, so it's probably adding a delete marker thus hidden by S3Drive but not "physically" deleted
👍 1
22:33
that would require proper version support, which is in progress as far as I know
Avatar
Hi @jdave, Thanks for your feedback. If the Delete settings are set as on the attached screenshot, we delete file directly from S3, however we still don't delete the object's versions that were created when file was initially created. In theory we could implement an option to also delete a version during a file delete, but if we were to do it immediately it would slow down the delete operation significantly since there is no way to delete multiple versions in one request. Our immediate plan to address this was to provide list of deleted (yet still versioned) files in the current Trash (which is somewhat legacy option where files landed for users which didn't want to delete file in-place, but didn't have a bucket which supported versioning). What would be your preferred way how S3Drive works? Would allowing deleting versions from the Trash be sufficient for you (at least initially?) In theory we could add a setting where after file is deleted we could mark specific versions to be deleted as well and we could do it asynchronously over the next seconds, but that's little bit more complicated option. In the meantime if this is a showstopper for you, you could perhaps introduce lifecycle policies (which Wasabi supports as well). You could set up to delete "all file versions" after x days since file was deleted initially: https://docs.wasabi.com/docs/lifecycle https://wasabi-support.zendesk.com/hc/en-us/articles/360061322811-How-do-I-configure-Object-Lifecycle-Policies-with-Wasabi-#:~:text=Lifecycle%20Policies%20are%20used%20on%20Wasabi%20to%20manage,Lifecycle%20Policy%2C%20please%20see%20our%20documentation%20available%20here. Please let me know how does that sound and if you need my help on setting this up. Thanks ! BTW. Thanks @xenthys for your help as well ! (edited)
Avatar
Thank you Tom.. i appreciate the full response.. in my case i want to keep Wasabi immutable and not delete anything even if the user tries, i would love to see that S3Drive recognize that the 'delete' was not successful and continue to show that the file exists, as right now the file is missing from S3drive but does exist in Wasabi. I have flushed the cache and rebuilt the search data, but the files still does not show up in S3drive.
Avatar
Avatar
jdave
Thank you Tom.. i appreciate the full response.. in my case i want to keep Wasabi immutable and not delete anything even if the user tries, i would love to see that S3Drive recognize that the 'delete' was not successful and continue to show that the file exists, as right now the file is missing from S3drive but does exist in Wasabi. I have flushed the cache and rebuilt the search data, but the files still does not show up in S3drive.
We've shifted our focus temporarily for the next day or two to finalize Stage II of versioning capabilities, we're going to play with the Object Lock policies and understand them better and see what we can reliably achieve with S3Drive and potentially release them in a next release in a few days. We'll then extract the remaining improvements for the Stage III which we shall address later this quarter. I might get back to you later today (GMT+2 timezone here) as I'll likely have some questions regarding these policies. I would've thought that they'll already prevent running the DELETE command on the object. (edited)
Avatar
Thank you
Avatar
Avatar
jdave
Thank you Tom.. i appreciate the full response.. in my case i want to keep Wasabi immutable and not delete anything even if the user tries, i would love to see that S3Drive recognize that the 'delete' was not successful and continue to show that the file exists, as right now the file is missing from S3drive but does exist in Wasabi. I have flushed the cache and rebuilt the search data, but the files still does not show up in S3drive.
Right, so we checked how it works. Wasabi S3 bucket behaves differently depending if versioning is enabled. If versioning is enabled, then regardless of Compliance / Object Lock settings, it is possible to delete an object. Deleting an object created so called: "Delete marker". It is possible to preview all historical versions and restore to any of them, however it is not possible to delete any version from the system until Retention Time has passed. If versioning is disabled, then deleting an object is not possible, because without versioning enabled it would have to delete the object permanently. In a next release which we shall be able to deploy early next week there will be options to Delete/Restore versions and to preview deleted file versions in Trash. There will be also improvements in terms of error handling, e.g. deleting a version restricted by Compliance Settings is not possible, so it shall render clear 403 / Access Denied error. If things go well, we shall be able to also build a generic: "Versions" view which would show technically all recently changed files in the bucket and would allow to delete specific revision(s). There is also an issue with error reporting in S3Drive when versioning is disabled and Compliance Settings enabled. During delete, file seemingly gets deleted, and disappears from the screen, but when screen gets refreshed the entry persist, this is because currently we're using quiet delete, which ignores delete error from Wasabi. We'll have it fixed. Please find couple screenshots which shows the error reporting (it doesn't exactly work like that in a current S3Drive version, but'll be fixed next week) when trying to delete a version restricted by Compliance Settings. I've created a file, then overwritten it with version 2, then deleted it and then uploaded version 3 (so I can have it displayed again and click on the "Show versions" feature). I've then tried to delete one of the revisions which failed as expected.
Avatar
So I was right about delete markers, woooh doggokek
Avatar
Avatar
xenthys
So I was right about delete markers, woooh doggokek
Indeed, thank you guys for supporting this project with valuable feedback !
Avatar
Avatar
xenthys
So I was right about delete markers, woooh doggokek
I knew that we will have to get to this eventually 🙂 ... and we're already finding some versioning implementation differences between providers. E.g. MinIO version restore works differently than Backblaze/Wasabi. There are couple bugs (or features?) when deleting entries that we've found on Backblaze... we'll have to deal somehow with all that... but that's fine 🔥 (edited)
Avatar
Ah, as expected indeed, I'm glad S3Drive exists but I'm also glad it's being developed by someone else haha
devOps joined the server. 04/22/2023 4:36 AM
Avatar
Avatar
jdave
Thank you Tom.. i appreciate the full response.. in my case i want to keep Wasabi immutable and not delete anything even if the user tries, i would love to see that S3Drive recognize that the 'delete' was not successful and continue to show that the file exists, as right now the file is missing from S3drive but does exist in Wasabi. I have flushed the cache and rebuilt the search data, but the files still does not show up in S3drive.
Hi @everyone , we've just released a major release (v1.2.0) 🚀 which extends versioning features, modifies behaviour of copy/rename/move/trash function to seamlessly support versioning and don't duplicate version, also there is an option to restore specific versions or delete object versions to save some space. There is also improved error handling, so in case of an Object Lock there will be an error message and relevant Log which can be viewed by long-tapping the app version number. Versioning capabilities are configurable in the Settings. There is a space usage indicator in the left panel / drawer. There is a new Recent section, which displays all recently modified files. Search function is improved, so the index is built faster and also includes implicit folder search (e.g. if there is a file: folder/file.txt, but folder/ entry doesn't explicitly exists, it is still searchable) There is an option to hide files starting with: . As usual there are couple other performance improvements and bugfixes. We would love to hear how are you finding new changes and if version management during file operations is what you would expect. (edited)
19:28
Avatar
Wow
19:29
Good stuff
👍 1
Avatar
Awesome, will try a bit later but that's really nice on paper!
Avatar
The pricing seems really fair
Avatar
Avatar
zer0r00t
The pricing seems really fair
Thanks for the feedback. We try to make it affordable for personal use and if for any reason user is not able to afford Pro, then there is a Basic package which shall be enough for many cases. It's not entirely straightforward for us to come up with fair pricing, as there are some discrepancies between our real expenditures and our motives behind the project. For instance work related to E2E and complexity of Zero Knowledge is about half of the total project R&D, yet we offer E2E for free as we believe that anyone shall be able to receive little bit of privacy regardless if they can afford it or not.
Avatar
I believe encryption itself being free but filename being under Pro is a good balance
11:04
Also the fallback perpetual licensing thing is very interesting
Avatar
If I was in your position, I would only bill for features that have a recurrent cost while factoring global R&D costs into the final price.
Avatar
Is there a timeline as to when the pricing will jump to €14.99? I'd love to purchase but don't exactly need it right now
Avatar
Regarding filename encryption, I don't know which cost it would have on your end so I'm quite neutral about it being a pro feature. On one hand, if it has no impact it's a bit disappointing not to have it as part of E2E in general. On the other hand, it doesn't change much as long as contents are encrypted and you need to monetize, so you have to find features that push people to the pro version.
Avatar
Reminds me of boxcryptor
Avatar
Avatar
zer0r00t
Is there a timeline as to when the pricing will jump to €14.99? I'd love to purchase but don't exactly need it right now
There is no timeline as such, likely won't be changed for the next few months whilst we build all of the remaining features. We're still deciding about our final price, but it won't be far off from what it is now.
👍 1
Avatar
Filename encryption is the one feature that makes me want to pay for it. So from a business POV it's working
Avatar
I want to keep versioning, I believe I'll keep it based on the plans page since i'm using it right now, but morally speaking why not support Tom? 😄
11:12
If it's supposed to be a pro feature I don't mind paying for it, as simple as that. Giving a discount to early adopter is fine, but I wouldn't straight out retain used pro features.
Avatar
Avatar
xenthys
Regarding filename encryption, I don't know which cost it would have on your end so I'm quite neutral about it being a pro feature. On one hand, if it has no impact it's a bit disappointing not to have it as part of E2E in general. On the other hand, it doesn't change much as long as contents are encrypted and you need to monetize, so you have to find features that push people to the pro version.
It really depends on the perspective. There are no recurring costs once it's built, but it needs to be built first. Same applies to all of the features, yet collectively this app is more than a year of a senior engineering. In other words, since we're not hosting anything (almost, there are some convenience features, CORS proxy etc.) with the self-hosted, there are almost no other costs involved other than development.
Avatar
Indeed, I wrote that before seeing that was for self-hosted plans, and didn't correct afterward 😅
11:16
Having an interesting enough free app for adoption, then interesting enough features to push to pro… tough balance indeed.
Avatar
The pro features pre-release is tied to the s3 key ID is that correct?
11:17
So we cannot lose the ID-key pair
Avatar
Minor feedback, I would change the following text from: Hide "." files Show all files, including starting with the dot. Hide files starting with the dot character To: Hide dotfiles Show all files, including ones starting with a dot. Hide files starting with the dot character.
👍 1
Avatar
Avatar
zer0r00t
The pro features pre-release is tied to the s3 key ID is that correct?
We've had to find some way to store the Pro features without an account, so yes we calculate hash based on the S3 key ID (we don't touch the key though). There are other components, e.g. installation ID. We're focusing on building stuff right now instead of complex licensing paywall APIs, eventually we will come up with a reasonable switch plan. We might even ditch the key IDs and simply base it on timestamp, not exactly sure. Costs of giving some licences even for free are way less than our time wasted on some licensing shenanigans... and developing paywalls is way less exciting than building out new features ! (edited)
Avatar
Avatar
xenthys
If it's supposed to be a pro feature I don't mind paying for it, as simple as that. Giving a discount to early adopter is fine, but I wouldn't straight out retain used pro features.
That worked fine with previous subscription model that we were running, but combined with Perpetual licensing it didn't make much sense (to be honest we would have to build specific code to handle that), so current Early Adopters remain all of the features as if they bought it. We might change it, but this will affect future users. We can't break certain promises.
Avatar
If you reinstall the app or change your phone, you will lose your pro features. If you have a rooted phone, you can cheat the install date so it's not enough. While these are noble intentions, it will probably bite you in the ass from both sides in the end. Shelling out 10€/year is frankly nothing, unless you're a Turkey resident per example, but still if you need pro features then you supposedly have some infrastructure costs already. I'm putting my money where my mouth is, I just got a pro perpetual license, now I just need to check how to use it! doggokek
👍 1
Avatar
... and thank you guys for this feedback, it's really helpful for me. We're yet to find reasonable model. S3Drive is becoming tool that's used by different people with different use cases, we'll be making lots of adjustments to make most of the people happy.
Avatar
Putting a paywall on previously-free features is never recommended, so I get you, but you will always have someone complain about it.
Avatar
Avatar
xenthys
If you reinstall the app or change your phone, you will lose your pro features. If you have a rooted phone, you can cheat the install date so it's not enough. While these are noble intentions, it will probably bite you in the ass from both sides in the end. Shelling out 10€/year is frankly nothing, unless you're a Turkey resident per example, but still if you need pro features then you supposedly have some infrastructure costs already. I'm putting my money where my mouth is, I just got a pro perpetual license, now I just need to check how to use it! doggokek
Thank you for the purchase, it really means a lot to us !
Avatar
I'd pay more for a lifetime license with all feature updates guaranteed lol (edited)
11:35
That being said if it stays at 10€/year for life I'm fine with it
Avatar
Avatar
xenthys
I'd pay more for a lifetime license with all feature updates guaranteed lol (edited)
The issue with lifetime that I have personally is defining the "lifetime". There are lots of cloud, VPNs or other products that you buy for approximately 3x the avg yearly subscription. Lifetime usually means lifetime of a company, product not necessarily your lifetime. Users don't like subscriptions and I get it, I don't like them myself. It's just this model allows us to finance development on the fly and make reasonable development decisions. It's easy to overspend: "lifetime" money which in theory shall be equally distributed for the lifetime of the project.
11:40
I would hate to promise: "lifetime", only to shut down the project few years later. EDIT: Don't be worried, because we don't plan doing it and even if it happened, we would make it opensource: https://s3drive.app/faq?open=opensource (edited)
Avatar
Yeah I understand no worries, it's not even about the subscription because it's once a year so that's alright, I just hate having to update my card everywhere when it expires. It would be annoying to support SEPA direct debit on your end though, but that would solve my issue :D
Avatar
There will be more billing options available (including crypto). I am not a huge fan of Stripe, but it's extremely convenient to start with. SEPA is possible, but someone on our end would have to deal with it manually or we would have to find some partner which gives us nice API.
Avatar
I was also thinking about the file sharing expiration slider, and realised it will not fit all use cases if I want to create a URL that expires in 5 minutes or in an hour per example. Having a manual number input with a [(seconds /) minutes / hours / days] selection next to it would be the most granular approach even if it wouldn't look that good. Or 3 sliders, from 0 to 59 for minutes, 0 to 23 for hours, and 0 to 7 days. That would allow sharing for an hour and a half instead of having to put 90 minutes with the number input. Reset the previous sliders to 0 if you set the expiry to 7 days, which would also be the default expiry time like it is now. Having a more granular display could be behind the "Show advanced features" option we talked about, so that wouldn't clutter the interface for all users by default, but remain there if people want it.
11:49
Now that I talked about it, I want raw pre-signed URLs and granular expiry sliders, ugh. How much would it cost to sponsor these features in priority?
Avatar
Avatar
xenthys
Yeah I understand no worries, it's not even about the subscription because it's once a year so that's alright, I just hate having to update my card everywhere when it expires. It would be annoying to support SEPA direct debit on your end though, but that would solve my issue :D
I know that every country have some specifics about payment methods. There are certain providers that you can use which are integrated with many banks, so in principle no SEPA transfer is required, but more like user logging in to their bank account confirming some online payment. I am from Poland and there are Przelewy24, PayU and Blik. I know SOFORT being popular in Germany. Do you use any of these in your country?
Avatar
SEPA is convenient, but having dealt with them at my previous job, they're unfortunately a fraud territory I can't recommend. In France we just give an IBAN and swear it's ours, some providers request bank details, but fraudsters easily edit them anyway…
Avatar
Avatar
xenthys
I was also thinking about the file sharing expiration slider, and realised it will not fit all use cases if I want to create a URL that expires in 5 minutes or in an hour per example. Having a manual number input with a [(seconds /) minutes / hours / days] selection next to it would be the most granular approach even if it wouldn't look that good. Or 3 sliders, from 0 to 59 for minutes, 0 to 23 for hours, and 0 to 7 days. That would allow sharing for an hour and a half instead of having to put 90 minutes with the number input. Reset the previous sliders to 0 if you set the expiry to 7 days, which would also be the default expiry time like it is now. Having a more granular display could be behind the "Show advanced features" option we talked about, so that wouldn't clutter the interface for all users by default, but remain there if people want it.
... so basically you would like an easier way to provide relative time for a shorter ranges e.g. few minutes, 30 minutes, 1h 20 etc.? (edited)
Avatar
I may or may not have edited one because I potentially wanted to pay for a non-profit's internet box subscription with my personal account, an the provider wanted the bank account to be in the name of the non-profit.
Avatar
Avatar
s3drive
... so basically you would like an easier way to provide relative time for a shorter ranges e.g. few minutes, 30 minutes, 1h 20 etc.? (edited)
Absolutely, and more sliders is the easiest way I can think about to compound time that would please our human brains
11:57
It might be the time to have a #technical channel, a #billing channel, and of course an #off-topic channel for everything else :D
11:58
You could also throw some #support channel into the mix but it might overlap with the others and doesn't feel necessary yet (edited)
Avatar
Avatar
xenthys
It might be the time to have a #technical channel, a #billing channel, and of course an #off-topic channel for everything else :D
That's a good idea, I was hesitant to create these categories, since I periodically do the snapshot of the whole discussion that I embed on website as sort of free SEO / uncategorized FAQ.
Avatar
Or just a forum channel with tags, then you can snapshot whichever post is of interest
Avatar
I think more channels sounds great.
Avatar
therefore only one forum is necessary since you can then filter by tag, which could be Development, Billing, Support… the sky's the limit
12:02
As you prefer, it's your server :p
Avatar
I am a Discord noob, I will simply follow your advice 🙂
Avatar
Forums allow for multiple discussions in parallel, each of them being its own channel. It'd be nice for feature requests or specific topics I believe
12:05
I'm a former moderator under NDA with Discord to setup servers like Square Enix before the E3 a few years ago, let me know if you have any question 😄
s3drive started a thread. 04/27/2023 12:07 PM
Avatar
Avatar
xenthys
I'm a former moderator under NDA with Discord to setup servers like Square Enix before the E3 a few years ago, let me know if you have any question 😄
That's quite an achievement !
Avatar
I'm proud to be a volunteer for projects and people I appreciate, but moderators are frequently seen as a necessary evil
👍 1
Avatar
Avatar
xenthys
I'm proud to be a volunteer for projects and people I appreciate, but moderators are frequently seen as a necessary evil
I guess at certain scale no moderation leads to human nature taking over the channel, herd behavior and all sorts of stuff which is researched by many PhDs.
Avatar
Yeah, thanks to 4chan and unmoderated subreddits acting as research grounds haha
Avatar
Some people are also unable to act properly within communities, and either get banned all the time or wait until "moderators are asleep" to be active
12:34
The most annoying members are the ones who test the limits of the rules, being annoying without directly breaking them, complaining about being unfairly banned if you ever remove them… they have too much time on their hands, welcome to the Internet I guess ;-;
Avatar
Avatar
xenthys
The most annoying members are the ones who test the limits of the rules, being annoying without directly breaking them, complaining about being unfairly banned if you ever remove them… they have too much time on their hands, welcome to the Internet I guess ;-;
Reminds me of public service auditors, it's just they're pretty useful, as even though annoying to some, they're testing certain freedoms and the knowledge of law by those who enforce it.
Avatar
Well, auditors are not doing it to be annoying, some members on the other hand…
13:27
Also, law is written by people who work in that field, it's a real mess and they have to cover every case. Discord server rules written by some dude who had some free time don't really have that requirement, especially if you want members to actually read them ablobsweats
Avatar
As long as the released features are stacked as per the FAQ, it's all good
14:50
Question though, what happens if there is a gap between subscriptions? Can I pay for a year, stop paying, then resub when I feel like I need the new feature(s)?
14:52
Or is it more like; keep all features accrued while continuous recurring payments, then those stacked features become permanent?
Avatar
If you stop paying I believe your license is still valid for the features that were released until it "expired" to give you only security updates
15:28
Otherwise it wouldn't be called perpetual, and renewing it for a year would certainly update the list of features you're allowed to access
15:31
@s3drive how about just tying the "free pro features" to user accounts created before the end of the beta period? people who care about them can create a free account and be sure to retain them, you will only have to monitor for account sharing on your end, no more fiddling with access keys and all that
👍 1
15:32
I assume the account I created and bought the license on is what will enable pro features on the app in the future, as long as I have a profile logged into my managed account
15:35
cool checkmark, way better value than Twitter Blue lol
Avatar
+1, users may have to revoke old access keypairs and generate new ones for whatever reason
16:32
A digitally signed text file that the app checks could work
Avatar
Avatar
zer0r00t
Question though, what happens if there is a gap between subscriptions? Can I pay for a year, stop paying, then resub when I feel like I need the new feature(s)?
Yes, you can do that. The moment you resubscribe you will get current Pro features as part of your perpetual license. It's likely that there will be various incentives (e.g. continuity discount) to actually stay. Decision will always be yours though and whatever works for you better.
Avatar
Avatar
xenthys
@s3drive how about just tying the "free pro features" to user accounts created before the end of the beta period? people who care about them can create a free account and be sure to retain them, you will only have to monitor for account sharing on your end, no more fiddling with access keys and all that
Good idea. That seem to be fair compromise (user gets their freebie), but need to formalise this through registration, so we can handle that without too much technical drama. I like that so far.
Avatar
Avatar
xenthys
cool checkmark, way better value than Twitter Blue lol
Thanks goes to Material iconset and to Twitter of course 🙂
Avatar
Avatar
zer0r00t
A digitally signed text file that the app checks could work
Everytime I hear crypto, my heart beats faster 🙂 In theory this could work. Basically some private key hidden behind the API could generate a verifiable token which would be stored on the user's bucket (and likely device for little bit of redundancy) and could be then verified. The issue that I see so far is that not every user would want their bucket to be written to with some "licensing" file. (edited)
Avatar
If I have 5 profiles and 3/5 are read-only buckets, where do you store the license? :D
Avatar
Clearly solution isn't Web Scale https://www.youtube.com/watch?v=b2F-DItXtZs (edited)
Avatar
Having an S3Drive user account is the easiest, if one profile is connected to a paid or beta account then you're good, if you touch my buckets be warned I'm gonna bite doggokek
Avatar
Avatar
xenthys
Having an S3Drive user account is the easiest, if one profile is connected to a paid or beta account then you're good, if you touch my buckets be warned I'm gonna bite doggokek
You can be proud of forcing us to modify improve our bucket validation method, so it's read only.
17:39
I actually like it, less invasive, but still effective... and allows some weird use cases of bucket read-only access. Win for everyone.
Avatar
For granularity you can "just" store a feature_flags int that computes to an array of pro features with bitwise operations, easy on your API and authentication gateway or whatever you do behind the scenes.
17:41
Update the integer for all the active pro accounts every time you add a feature, done stickbug
Avatar
Avatar
xenthys
For granularity you can "just" store a feature_flags int that computes to an array of pro features with bitwise operations, easy on your API and authentication gateway or whatever you do behind the scenes.
Yep, would work, unless we have more features than bitwise on INT allows. Regardless, this is an implementation detail.
Avatar
Avatar
s3drive
I actually like it, less invasive, but still effective... and allows some weird use cases of bucket read-only access. Win for everyone.
Update field type to bigint, done doggokek
17:46
Erm, wrong message reply
Avatar
Avatar
s3drive
I actually like it, less invasive, but still effective... and allows some weird use cases of bucket read-only access. Win for everyone.
Thank you for that, note that writing without explicit user consent could have legal repercussions depending on the buckets and their contents, it's a big no-no for S3 clients even though I understand your position 😅
shaileshchaudhary joined the server. 04/28/2023 3:41 AM
Avatar
Hi @shaileshchaudhary, welcome to the channel ! (edited)
klemer1001 joined the server. 04/29/2023 6:54 AM
Avatar
Hi @klemer1001, thank you for joining and welcome to S3Drive 📁 community !
Avatar
Avatar
xenthys
Now that I talked about it, I want raw pre-signed URLs and granular expiry sliders, ugh. How much would it cost to sponsor these features in priority?
I think I've missed that comment, we've built the presigned URL option for you as requested and released that 13th of April, please find this announcement: https://discord.com/channels/1069654792902815845/1069654792902815848/1095920742182424646 We'll be able to get to Sliders eventually, I've set up the roadmap item just now: https://s3drive.canny.io/feature-requests/p/easier-way-to-set-up-relative-expiry-time-for-shared-links but we're slammed with other priority work. There are lots of stuff to finish before the holiday time where we'll relax for a short while. We're very much open for sponsorships (thanks !), on the other hand given the typical development time costs I don't believe I am able to provide reasonable offer for a single personal contributor. We're getting various feedback and improvements requests, some of them we're addressing on the fly, some of them will have to wait according to our priority list, some of them are not part of our general vision and unless there is shared interest, we'll be handling these via Enterprise package (e.g. https://github.com/s3drive/app/issues/23#issuecomment-1528861909). (edited)
mix9311 joined the server. 04/30/2023 1:15 PM
Avatar
Avatar
s3drive
I think I've missed that comment, we've built the presigned URL option for you as requested and released that 13th of April, please find this announcement: https://discord.com/channels/1069654792902815845/1069654792902815848/1095920742182424646 We'll be able to get to Sliders eventually, I've set up the roadmap item just now: https://s3drive.canny.io/feature-requests/p/easier-way-to-set-up-relative-expiry-time-for-shared-links but we're slammed with other priority work. There are lots of stuff to finish before the holiday time where we'll relax for a short while. We're very much open for sponsorships (thanks !), on the other hand given the typical development time costs I don't believe I am able to provide reasonable offer for a single personal contributor. We're getting various feedback and improvements requests, some of them we're addressing on the fly, some of them will have to wait according to our priority list, some of them are not part of our general vision and unless there is shared interest, we'll be handling these via Enterprise package (e.g. https://github.com/s3drive/app/issues/23#issuecomment-1528861909). (edited)
Oh my, you're right, I didn't check since it wasn't mentioned but I can indeed see it! The date picker is just perfect on phone as well so no need for sliders there, last time I checked it was impossible to edit the expiry at all.
Avatar
Avatar
xenthys
Oh my, you're right, I didn't check since it wasn't mentioned but I can indeed see it! The date picker is just perfect on phone as well so no need for sliders there, last time I checked it was impossible to edit the expiry at all.
Oh yeah, that's probably my Discord skills. Great to hear that you like this change.
Avatar
Avatar
s3drive
Oh yeah, that's probably my Discord skills. Great to hear that you like this change.
I probably just missed it, no worries, thanks for letting me know! Unrelated, is it planned to get an official S3Drive logo? I don't know if the folder icon is yours or not, and it could fit any file storage service so it probably lacks a bit of personnality?
14:26
I created the #support where people can post about topical matters, you can see the tags with little emojis which will allow everyone to filter posts once they start to flow in. I also added a "Developer Response" tag you can add to posts if you answer, allowing people to know where you've intervened, that's a common thing on Reddit and I loved the concept but let me know if you'd rather not have that.
14:28
I can also add a "Confirmed" tag for bug reports per example, so you can say whether it's a confirmed bug or not, filtering with those two tags could allow people to immediately see a list of known bugs. EDIT: just added it, costs nothing and can be adapted on the fly if we ever need to change it (edited)
Avatar
Avatar
xenthys
I probably just missed it, no worries, thanks for letting me know! Unrelated, is it planned to get an official S3Drive logo? I don't know if the folder icon is yours or not, and it could fit any file storage service so it probably lacks a bit of personnality?
Definitely, honestly the whole app is missing some nicer UI, branding and logo as you say. We're aware of this and current icon is pretty poor. We weren't making change to UI, being focused on the technology and functionality. I think it all comes down if split for S3Drive is required. We don't really know shall we keep the self-hosted and managed together as one product, one app. We might keep S3Drive as it is, focusing on S3 and have separate managed "Drive" product, this would affect branding, we don't know exactly at this stage what path this all will take. Regardless, S3Drive as it is will receive better logo and better icon 🙂 (edited)
Avatar
Cool, I like the profile system and believe it can remain a single app, and people who subscribe to even the lowest drive tier can have pro features imo
Avatar
Avatar
xenthys
Cool, I like the profile system and believe it can remain a single app, and people who subscribe to even the lowest drive tier can have pro features imo
One app is slightly more complex technically, but definite less headache when managing updates, release, pipelines etc. Our goal is to rely on S3 protocol, so having one app actually helps us to stick to this goal and not diverge with some proprietary protocol. The only thing we need to think through is the clear marketing as what S3Drive is, as we're targeting different userbases, each of them having slightly different needs.
14:37
I will get back on the Discord updates later, as I need to leave. Thanks for that ! (edited)
Avatar
Avatar
xenthys
I created the #support where people can post about topical matters, you can see the tags with little emojis which will allow everyone to filter posts once they start to flow in. I also added a "Developer Response" tag you can add to posts if you answer, allowing people to know where you've intervened, that's a common thing on Reddit and I loved the concept but let me know if you'd rather not have that.
Thanks for that. I like it all and it's pretty neat. I think it's a great start for more organized workflow. (edited)
kuwaha7913 joined the server. 05/01/2023 11:22 PM
Avatar
Hi @kuwaha7913 and welcome to our little S3 world 👋
secrethash joined the server. 05/10/2023 8:16 AM
Avatar
Avatar
secrethash
Click to see original message
09:10
Hey, I used the mobile application for Android. After successful login it shows this error and does not list the objects. MinioError: ListObjectsV2 search parameter maxKeys not implemented (edited)
09:10
I am using Cloudflare's R2 S3 Compatible Object Storage.
Avatar
It looks like the app identifies Cloudflare R2 as a MinIO API, can you create a Bug Report post in #support please?
11:05
If I'm right, that would mean S3Drive gets confused about which options are available and which aren't
Avatar
Avatar
xenthys
It looks like the app identifies Cloudflare R2 as a MinIO API, can you create a Bug Report post in #support please?
Sure thing.
Avatar
Thanks!
Avatar
@everyone We've released new 📁 S3Drive version (1.2.5) on Web which uses improved rendering engine. Once it loads once all subsequent loads shall be much quicker and the UI shall be way more responsive. I would be glad to hear if you find it an improvement 🔥 (edited)
👍 1
kadircanersahin joined the server. 05/14/2023 11:07 AM
Avatar
Hi @kadircanersahin, welcome to our channel 👋
roaarr_44 joined the server. 05/18/2023 6:51 PM
Avatar
Avatar
roaarr_44
Click to see original message
Avatar
Hello, welcome!
Avatar
I am trying out S3drive on my iphone. I want to connect to an AWS bucket that I have created in my existing AWS account. (there are multiple buckets there). I can't figure out what I am suppose to enter under 's3-endpoint', and I tried everything. Can someone explain what I need to set up on AWS S3 and what I have to enter in the s3drive app under 's3-endpoint'?
Avatar
it should be given to you by AWS, but pretty much the region URL where the bucket is located
04:21
it's formatted as s3.<region>.amazonaws.com
👍 1
grahamc1984 joined the server. 05/22/2023 2:56 PM
Avatar
Avatar
grahamc1984
Click to see original message
grahamc1984 05/22/2023 3:06 PM
Avatar
Hi @grahamc1984, welcome 👋
Avatar
grahamc1984 05/23/2023 6:22 AM
Has anyone managed to use the 'Upload folder's menu option ? I select the folder, select USE THIS FOLDER and ALLOW access, nothing then appears to happen. I don't think it is an Android file permission issue as uploads of the individual files in the folder work OK.
Avatar
grahamc1984 05/23/2023 7:17 AM
If I select the Documents folder to upload instead of a sub folder it does upload just one file - but it is a file from the images folder not from the Documents folder.
Avatar
grahamc1984 05/23/2023 7:33 AM
Selecting the camera images folder gives an exception.
Avatar
grahamc1984 05/23/2023 9:27 AM
The Socket exception only happens on Cloud flare R2. But for other providers when I select upload the Documents folder it actually uploads the contents of Images/Documents. So it does look like a file permissions issue.
Avatar
grahamc1984 05/23/2023 9:37 AM
Yes the app settings are 'allow access to media only'. I think this can only be extended to all files if the app configuration requests it.
Avatar
Avatar
grahamc1984
Yes the app settings are 'allow access to media only'. I think this can only be extended to all files if the app configuration requests it.
Thanks for reporting this issue. We're trying to find a way to resolve permissions issues for folder upload. In principle access to files inside of the selected directory shouldn't require: "All files permission", however we're facing some limitations of the file related library that we use and we're working to overcome these problems. Yes, we could use, "All files permission", to get seamless access to files, but it's pretty powerful permission to grant and it's also hard to justify use of this permission when releasing app on Google Play.
Avatar
Avatar
grahamc1984
Yes the app settings are 'allow access to media only'. I think this can only be extended to all files if the app configuration requests it.
We will be deploying some improvements to folder upload permissions later today / tomorrow (Release 1.2.10). It will be an improvement over what we have currently, but there are still couple underlying problems we are not able to easily address. Most importantly permissions shall work just fine for all types of files and instead of requesting ALL FILES permission we will be using SAF (https://developer.android.com/guide/topics/providers/document-provider) which is pretty much the only supported/approved of managing files for Android 11+ (edited)
josh_bifrostcloud joined the server. 05/24/2023 5:24 PM
Avatar
Avatar
grahamc1984
Yes the app settings are 'allow access to media only'. I think this can only be extended to all files if the app configuration requests it.
This was successfully deployed. Unfortunately we're not supporting sub-folders (they will be skipped in the process), but we're working on improving that. I was wondering if this resolves your issue at least partially?
Avatar
Yes it fixed the problem.
👍 1
buzz69. joined the server. 05/28/2023 7:40 PM
Avatar
Hi, ive just downloaded the app, its working ok on my android phone - i'm self hosting with xns relayer and its working without ssl (which obviously i don't want to continue with), but with self signed cert on its coming up with handshake error.. any ideas?
Avatar
very easy to use btw, great features coming down the road too..
Avatar
Avatar
buzz69.
Hi, ive just downloaded the app, its working ok on my android phone - i'm self hosting with xns relayer and its working without ssl (which obviously i don't want to continue with), but with self signed cert on its coming up with handshake error.. any ideas?
Hi @buzz69., Just a question, did you add the self-signed certificate to your Android device? On Android 13, there is Settings -> Security and privacy -> Other security settings (Credential storage section) -> Install from device storage. There is also a guide, how to export certificate from a URL and import in on Android: https://coderwall.com/p/wv6fpq/add-self-signed-ssl-certificate-to-android-for-browsing#:~:text=Copy%20the.crt%20file%20to%20the%20root%20of%20the,should%20ask%20you%20to%20confirm%20the%20security%20exception.
Avatar
Brilliant thanks so much, I'll do this later and see if it works!
Avatar
getting this error, this is trying to connect to a bucket on the Windows desktop app (edited)
real_zer0main joined the server. 05/31/2023 12:25 PM
Avatar
real_zer0main 05/31/2023 12:31 PM
Hi. I'm trying to connect to my Minio instance from Android S3Drive client but it doesn't work, fails with OS Error: CERTIFICATE_VERIFY_FAILED: self signed certificate. And I indeed have self-signed certificate but I followed your instructions from https://github.com/s3drive/app/issues/19 (https://proxyman.io/posts/2020-09-29-Install-And-Trust-Self-Signed-Certificate-On-Android-11) and my browser on Andriod recognizes this certificate (if I go to minio browser, my Chrome is fine with the cert). But S3Drive continues to fail with the same error. I'm using the latest version. (edited)
Avatar
Avatar
ethan48
getting this error, this is trying to connect to a bucket on the Windows desktop app (edited)
Hi @ethan48, In order to rule out any platform specific issues can you try to connect using S3Drive using different than Windows platform, e.g. your mobile phone or web? On Windows 11 when I try to connect to this endpoint using some made up credentials I get null response, which is somewhat expected. I would expect to get the SSL related error instead.
Avatar
I just tried it on my laptop and on an Android phone and it works perfectly as it should, that's so weird not sure why I was getting an SSL error on that computer I tried it on
Avatar
It's so nice to finally have a decent S3 client for mobile
15:49
there were previously no good iOS clients and BucketAnywhere was an option on Android but it wasn't the most up to date, modern or intuitive thing to use and at times was a real pain
👍 1
Avatar
Avatar
real_zer0main
Hi. I'm trying to connect to my Minio instance from Android S3Drive client but it doesn't work, fails with OS Error: CERTIFICATE_VERIFY_FAILED: self signed certificate. And I indeed have self-signed certificate but I followed your instructions from https://github.com/s3drive/app/issues/19 (https://proxyman.io/posts/2020-09-29-Install-And-Trust-Self-Signed-Certificate-On-Android-11) and my browser on Andriod recognizes this certificate (if I go to minio browser, my Chrome is fine with the cert). But S3Drive continues to fail with the same error. I'm using the latest version. (edited)
Hi @real_zer0main, we've deployed some changes as per https://developer.android.com/training/articles/security-config guideline and released patch on Play Store. Can you please update and see whether it works for you? If for some reason there is still an issue in that area we will then test it thoroughly and come up with a fully fledged solution. Thanks !
Avatar
Avatar
s3drive
Hi @real_zer0main, we've deployed some changes as per https://developer.android.com/training/articles/security-config guideline and released patch on Play Store. Can you please update and see whether it works for you? If for some reason there is still an issue in that area we will then test it thoroughly and come up with a fully fledged solution. Thanks !
real_zer0main 06/01/2023 9:13 AM
I updated, same error. Or do I also need to add this xml config file somewhere?
Avatar
Avatar
real_zer0main
I updated, same error. Or do I also need to add this xml config file somewhere?
The file was on our side. Thanks for letting me know. In which case we'll be looking on this and hopefully by the end of this week will have it fixed. What's your Android version by the way? (edited)
Avatar
Avatar
s3drive
The file was on our side. Thanks for letting me know. In which case we'll be looking on this and hopefully by the end of this week will have it fixed. What's your Android version by the way? (edited)
real_zer0main 06/01/2023 9:20 AM
Android 13. I've tried many s3 client apps and none of them worked with self-signed cert.
Avatar
Avatar
real_zer0main
Android 13. I've tried many s3 client apps and none of them worked with self-signed cert.
Cool, so if we have it fixed we'll hopefully stand out 👍
Avatar
Avatar
real_zer0main
Android 13. I've tried many s3 client apps and none of them worked with self-signed cert.
In fact this one isn't easy. I've added the forum item to keep track of this, but this will have to wait until either Flutter team improves the framework or whether actually we have time to implement a workaround: https://discord.com/channels/1069654792902815845/1114132460989599774
rkafp joined the server. 06/03/2023 6:02 AM
Avatar
Avatar
s3drive
Hi @buzz69., Just a question, did you add the self-signed certificate to your Android device? On Android 13, there is Settings -> Security and privacy -> Other security settings (Credential storage section) -> Install from device storage. There is also a guide, how to export certificate from a URL and import in on Android: https://coderwall.com/p/wv6fpq/add-self-signed-ssl-certificate-to-android-for-browsing#:~:text=Copy%20the.crt%20file%20to%20the%20root%20of%20the,should%20ask%20you%20to%20confirm%20the%20security%20exception.
Hi Tom, i've followed the guide but when i go to upload file in andriod phone its saying private key required to install certificate
11:31
on android 13
Avatar
Hmm, that's odd, you shouldn't need the private key at all to trust a certificate, which is the actual point of using certificates… is your Android drunk? blobthonkang
Avatar
looks like it.. i'll give it a go on another phone..
Avatar
Avatar
s3drive
In fact this one isn't easy. I've added the forum item to keep track of this, but this will have to wait until either Flutter team improves the framework or whether actually we have time to implement a workaround: https://discord.com/channels/1069654792902815845/1114132460989599774
real_zer0main 06/03/2023 1:53 PM
Thanks. Yep, this is what I thought based on not having this feature in so many applications. Still, Chrome does it somehow.
Avatar
@s3drive hi - using xns backup successfully on iOS and andriod, all working via https website which is great.. I appreciate the media backup is a new feature, just to note the 'backed up assets' no' isn't updating regularly in both iOS and android (but it is working in background i believe..).
its_keiko joined the server. 06/11/2023 6:21 PM
Avatar
Avatar
buzz69.
@s3drive hi - using xns backup successfully on iOS and andriod, all working via https website which is great.. I appreciate the media backup is a new feature, just to note the 'backed up assets' no' isn't updating regularly in both iOS and android (but it is working in background i believe..).
That's great ! Thanks for letting me know. We'll have a look on the counter issue. Speaking of background upload it's not yet implemented. We've already got a working prototype on Android, but we're still finding best ways for background sync on iOS. There will certainly be improvements in that area.
07:37
Hi @its_keiko, welcome to the channel !
Avatar
Background will be excellent 👍
Avatar
Avatar
s3drive
Hi @its_keiko, welcome to the channel !
Hello. I'm just looking around thank you 😊
arwen.elrond joined the server. 06/13/2023 5:07 AM
fuwa2tofu joined the server. 06/13/2023 11:27 AM
Deleted User joined the server. 06/18/2023 8:49 PM
Avatar
Deleted User 06/18/2023 8:49 PM
hi! just wondering if S3Drive is fully open source? i don't see source code on github
Anon ID Mars joined the server. 06/19/2023 4:23 AM
Avatar
Avatar
Deleted User
hi! just wondering if S3Drive is fully open source? i don't see source code on github
Hi @Deleted User , please find more about that in our FAQ: https://s3drive.app/faq?open=opensource
Avatar
Hi @s3drive, you may want to use #changelog for releases :p
13:26
you can also name yourself "Tom" since you'e already singled out as the S3Drive developer hehe
Avatar
Avatar
xenthys
you can also name yourself "Tom" since you'e already singled out as the S3Drive developer hehe
Thanks for that. Can I move this post or rather delete and add again?
Avatar
you will have to repost there, Discord doesn't support moving messages
Avatar
Cool, it's been a while, I've already forgot the rules and improvements that we've got here ! 🙂
Avatar
I don't think anyone follows that channel elsewhere but I published the messages in order, nice thing to do!
13:29
we haven't taken time to talk together yet haha, we should probably do it someday
_verzen_ joined the server. 06/22/2023 5:00 PM
Avatar
Hi @_verzen_ 👋
quilquip joined the server. 06/24/2023 8:39 AM
Avatar
hi @s3drive i've completed a guide for XNS/S3Drive attached. Let me know if you have any comments. thanks
gcasale joined the server. 06/24/2023 6:49 PM
Avatar
Avatar
buzz69.
hi @s3drive i've completed a guide for XNS/S3Drive attached. Let me know if you have any comments. thanks
Hi @buzz69. , cool. I am happy to see S3Drive being positioned closely to one of the S3 providers. That's the whole idea and beauty of S3 protocol. 🔥 Multiple clients (S3Drive being one of them) and multiple back-ends, all speaking 🗣️ the same language. If you need my input on anything, just let me know !
Avatar
Cool, I was just asking in case you wanted me to add anything etc.. if all good then great 👍
Avatar
@s3drive also happy to discuss further collaboration in terms of supporting your offer in terms of storage. I can get you storage costs very low or zero in certain configs if you become a provider. Can talk you through how if you are available for a call. Cheers
markus.berthold joined the server. 06/29/2023 6:57 AM
saitama_sensei joined the server. 06/30/2023 3:16 AM
Avatar
saitama_sensei 06/30/2023 3:22 AM
S3Drive such an awesome app. Just joined discord server to thank the development team.
Avatar
Hi, agreed, I initially did the same :D
Avatar
Avatar
saitama_sensei
S3Drive such an awesome app. Just joined discord server to thank the development team.
Thanks for these kind words. Given an opportunity to ask, is there anything that annoys you with S3Drive or perhaps some aspect you would like us to improve or implement?
Avatar
markus.berthold 06/30/2023 10:57 AM
@s3drive where should I report bugs? The followings fails: If a bucket has object lock and versioning enabled and a file already exists, an upload of an updated file (via menu or drag and drop) file fails. In the log the following error is logged:
11:01
The upload was done as the bucket root user.
Avatar
markus.berthold 06/30/2023 11:30 AM
Since then no new upload works.
s3drive started a thread. 06/30/2023 11:49 AM
14:55
I don't know what to name it, because support-bugs-requests is too long but there's no reason to have multiple channels for that either
14:55
looks like #general works well due to low activity, but osoner or later we'll have to set topics
Avatar
Avatar
xenthys
😭
It's my fault again. I shouldn't have continued conversation, but start a new one at @support. It would be way easier if I could simply create the thread in a desired location. It's hard to expect that any newcomer will automatically start discussion in a right place. (edited)
Avatar
It's fine, I mean, if we want people to follow some kind of rule we should write something in #rules to begin with :D
tamaraa12 joined the server. 07/03/2023 11:13 AM
Avatar
Avatar
s3drive
That's great ! Thanks for letting me know. We'll have a look on the counter issue. Speaking of background upload it's not yet implemented. We've already got a working prototype on Android, but we're still finding best ways for background sync on iOS. There will certainly be improvements in that area.
hi Tom, any news on background backup?
Avatar
Avatar
buzz69.
hi Tom, any news on background backup?
Hi, not much progress on that, as there are couple of outstanding items / E2EE base layers that we've had to finally tackle as it was blocking our other items. End of this month we'll have retrospective internally and will plan remaining year. It also seem that ordering and ZIP downloads are higher on the list: https://s3drive.canny.io/feature-requests/p/implement-order-by-name-size-modified https://s3drive.canny.io/feature-requests/p/add-support-for-folder-zip-download (edited)
Avatar
Avatar
buzz69.
hi Tom, any news on background backup?
We're also improving upload resilience, error handling and retry methods. 👷 It make sense to apply these improvements before focusing on background upload, so there is a stable base.
JH joined the server. 07/07/2023 11:08 AM
Avatar
Avatar
s3drive
Hi, not much progress on that, as there are couple of outstanding items / E2EE base layers that we've had to finally tackle as it was blocking our other items. End of this month we'll have retrospective internally and will plan remaining year. It also seem that ordering and ZIP downloads are higher on the list: https://s3drive.canny.io/feature-requests/p/implement-order-by-name-size-modified https://s3drive.canny.io/feature-requests/p/add-support-for-folder-zip-download (edited)
Ok, makes sense, but i will be brutally honest with you, the phone app is not really something people will use without background, the reality is even leaving the app on the upload tends to stop shortly after the phone goes into energy save mode. I appreciate you have other priorities though!
Avatar
Avatar
buzz69.
Ok, makes sense, but i will be brutally honest with you, the phone app is not really something people will use without background, the reality is even leaving the app on the upload tends to stop shortly after the phone goes into energy save mode. I appreciate you have other priorities though!
I somewhat agree with you, but there is so much we can do. Stuff that's being worked applies to all platforms. Platform specific improvements come later. Even if this comes at some cost to Android's userbase, we're still improving platform as a whole. Our statistics prove that each day we're having more and more users (including Android) and getting mostly positive reviews which makes us feel that our technical decisions aren't that bad. We're applying method of quick wins and focusing on things which have the best balance of benefit to the community vs development cost. Background upload is really useful, at the same time it's not entirely cheap from a development point of view, especially that you need to do build it separately on Android and iOS. Sorry if this doesn't satisfy your current needs, we will get to that I can promise.
Avatar
I appreciate this is a work in progress and you will have far more insight on what needs doing.. this is just from user perspective. Looking forward to this coming down the line though
👍 1
Avatar
I wanted to manage my buckets on Android, while my use case is niche it does the job for me :p
Avatar
Avatar
xenthys
I wanted to manage my buckets on Android, while my use case is niche it does the job for me :p
There a multiple user bases that use S3Drive with different use cases and needs and we're happy to accommodate most of them. Some people are interested in the encryption, some just want the mobile clients, some are looking to backup their photos, some are looking for general S3 file browser ... or better web interface to S3. Did I miss anything? 🙂 (edited)
Avatar
Avatar
xenthys
I wanted to manage my buckets on Android, while my use case is niche it does the job for me :p
Interestingly, we're getting more requests from companies / hosting providers that are interested in our solution our would like to use S3Drive in their clouds. We're welcoming new business partners and integrations. Just recently we've made a move to stay compatible with Rclone which will further improve and open-up the ecosystem: https://rclone.org/crypt (edited)
havilah. joined the server. 07/11/2023 5:56 AM
sanrinconr joined the server. 07/11/2023 6:31 PM
Avatar
Rclone crypt sounds interesting
👍 1
Avatar
Avatar
zer0r00t
Rclone crypt sounds interesting
It's going to be a major release which we plan to push as early as next week. Stay tuned for Rclone compatibility, filepath encryption, drive mount, multipart upload, web support for bigger files and many smaller yet important improvements. (edited)
👍 2
Deleted User joined the server. 07/14/2023 2:25 AM
Avatar
@s3drive I cannot update the new release on Android or IOS, says i'm currently v1.3.1 which is no longer supported, go back to delete and download, then comes back with exact same error.
Avatar
Avatar
buzz69.
@s3drive I cannot update the new release on Android or IOS, says i'm currently v1.3.1 which is no longer supported, go back to delete and download, then comes back with exact same error.
We've planned the forced upgrade on all platforms (due to encryption scheme upgrade), however faced some technical issues which combined with the App Store and Google Play processing delays lead us ultimately to this mess. We hope that within few hours Google Play issue will be resolved and subsequently the App Store. I am really sorry for this issue to happen, but with mobile clients we're now at mercy of prompt review time from both Google and Apple side. In the meantime please fallback to desktop or web client, where update was delivered immediately. (edited)
Avatar
ok thanks for the info, just checking you were aware really. thanks
sutraman joined the server. 07/22/2023 1:02 PM
Avatar
Our iOS release was just approved and shall appear on the App Store within minutes. We're still waiting for the Google Play team to approve our release.
👏 1
Avatar
Must be stressful dealing with the faceless giants…
xbdm joined the server. 07/22/2023 7:33 PM
bituhh joined the server. 07/22/2023 10:35 PM
Avatar
that's why we need decentralisation!
Avatar
feels like a hopeless dream nowadays
Avatar
Avatar
xenthys
Must be stressful dealing with the faceless giants…
It is indeed. Just to give you an idea, one of the reasons that we've decided to ship macOS app via .DMG from our website is long review times and multiple issues related to the fact that our iOS / macOS app are linked forever (due to https://developer.apple.com/support/universal-purchase/ thing). When we've introduced payments on iOS, our macOS releases were blocked and subject to same scrutiny, rules and reviews even though we didn't want to introduce these for macOS in a same way as for iOS. ... fast forward few months, our .DMG release is currently broken for a few days already, because Apple Notary process stopped working for no apparent reason (screenshot attached). Their official channel says that it's not a technical issue, but instead their Developer Programs Support needs to be contacted: https://developer.apple.com/forums/thread/118465 We've contacted them and they replied with generic info how to troubleshoot notarization issues, ignoring the fact that error specifically mention that they need to do something on their side. Without notarized .DMG user needs to explicitly allow the app to run... but that's least of a trouble. Even if app starts it has no access to Keychain, meaning no S3 login data can be stored securely... rendering S3Drive pretty much useless. We've kindly replied and waiting for their action. Not really much we can do. Fun fun fun 🙂
bongosmash 1
storj-derek joined the server. 07/27/2023 8:18 PM
Avatar
ooooh storj, hello
Avatar
Hi Derek !
Avatar
Avatar
s3drive
It is indeed. Just to give you an idea, one of the reasons that we've decided to ship macOS app via .DMG from our website is long review times and multiple issues related to the fact that our iOS / macOS app are linked forever (due to https://developer.apple.com/support/universal-purchase/ thing). When we've introduced payments on iOS, our macOS releases were blocked and subject to same scrutiny, rules and reviews even though we didn't want to introduce these for macOS in a same way as for iOS. ... fast forward few months, our .DMG release is currently broken for a few days already, because Apple Notary process stopped working for no apparent reason (screenshot attached). Their official channel says that it's not a technical issue, but instead their Developer Programs Support needs to be contacted: https://developer.apple.com/forums/thread/118465 We've contacted them and they replied with generic info how to troubleshoot notarization issues, ignoring the fact that error specifically mention that they need to do something on their side. Without notarized .DMG user needs to explicitly allow the app to run... but that's least of a trouble. Even if app starts it has no access to Keychain, meaning no S3 login data can be stored securely... rendering S3Drive pretty much useless. We've kindly replied and waiting for their action. Not really much we can do. Fun fun fun 🙂
In the meantime this have been passed to Senior Support (hello Mari) team which asked yet again to provide full description of the issue in a format they've requested. After a day of silence they've wanted "screenshot" of an error, as if pixels contained more ASCII data than the text I've provided. I am replying as fast I can, but it seems that error: "Team is not yet configured for notarization. Please contact Developer Programs Support" is not that easy to fix on their side. Well... 🍏
Avatar
Hi @s3drive
23:59
Nice to see new features
23:59
Possible to get a temporary pro sub to test things out?
Avatar
Hi @zer0r00t, thanks ! What platform(s) are you using? I could send you the promo code for Android. Web has no paywall at the moment. Other platforms require registering an account. Since we're closely integrated with Stripe we don't yet have a workflow for "enabling Pro" outside of it, however if you get it, I could offer you a refund once you're done testing.
kakarot1925 joined the server. 07/29/2023 8:39 AM
Avatar
Hi @kakarot1925, welcome to S3Drive !
Avatar
Avatar
s3drive
Hi @zer0r00t, thanks ! What platform(s) are you using? I could send you the promo code for Android. Web has no paywall at the moment. Other platforms require registering an account. Since we're closely integrated with Stripe we don't yet have a workflow for "enabling Pro" outside of it, however if you get it, I could offer you a refund once you're done testing.
I do use Android
Avatar
Avatar
zer0r00t
I do use Android
Cool, I've sent you the code, if you need anything just let me know.
chernsha joined the server. 07/29/2023 10:33 AM
Avatar
The new rclone stuff is nice
👍 1
12:52
Will test large file downloads from browser
Avatar
Hmm I cannot seem to access the files using rclone
01:24
What's the correct way to configure?
tamara312_89588 joined the server. 07/30/2023 2:28 AM
Avatar
Avatar
zer0r00t
Hmm I cannot seem to access the files using rclone
If you use mount feature on Desktop you can find the exact commands in the application logs. If file content encryption together with filename encryption is used, then please find below sample config. # Obscure password echo "YourPlaintextPassword" | rclone obscure - # Add it to Rclone config, config file location: `rclone config file` [s3drive_remote] type = s3 provider = Other access_key_id = <access_key_id> secret_access_key = <secret_access_key> endpoint = <endpoint> region = <region> [s3drive_crypt] type = crypt filename_encoding = base64 remote = s3drive_remote:<bucket_name> password = <obscuredPassword> filename_encryption = standard directory_name_encryption = true suffix = none Then you can use: s3drive_crypt as your remote encrypted location. Please note that whilst we support both encrypted and unencrypted files in the same location, Rclone doesn't seem to like the mix and won't display existing unencrypted files for the encrypted remote. In such case it's better to either keep everything encrypted globally or have dedicate paths with encrypted-only or unencrypted-only files. (edited)
👍 1
morethanevil joined the server. 07/31/2023 6:40 AM
rbhr joined the server. 07/31/2023 9:10 AM
Avatar
Avatar
rbhr
Click to see original message
Sticker
Avatar
Avatar
rbhr
Click to see original message
morethanevil 07/31/2023 9:53 AM
09:53
Hi 🙂
Avatar
just on the encryption theme, i don't know what the process is so this might seem a newbie question, but i'm assuming if you encrypt and access your bucket on a mobile device, then goto the desktop and use the same pw etc and try and view the mobile encrypted data you can do that? ie the key to decrypt is with the id and pw so is interchangeable between devices?
Avatar
morethanevil 07/31/2023 9:54 AM
I have a question about the pro version.. I bought it via Playstore and now I wanted to know, how I can connect the desktop app to it?
Avatar
Avatar
buzz69.
just on the encryption theme, i don't know what the process is so this might seem a newbie question, but i'm assuming if you encrypt and access your bucket on a mobile device, then goto the desktop and use the same pw etc and try and view the mobile encrypted data you can do that? ie the key to decrypt is with the id and pw so is interchangeable between devices?
Yes
👍 1
Avatar
Avatar
morethanevil
I have a question about the pro version.. I bought it via Playstore and now I wanted to know, how I can connect the desktop app to it?
Play store only unlocks android app
Avatar
morethanevil 07/31/2023 10:49 AM
Okay so I can not create an account in the app with pro enabled and link it to desktop app?
Avatar
Avatar
morethanevil
I have a question about the pro version.. I bought it via Playstore and now I wanted to know, how I can connect the desktop app to it?
Hi and thank you for supporting us. It seems you've bought the Pro just on Android. If you need Pro working on all devices you would need to register an account and buy it through our website. When you use that account on any device it will obtain the license from our server and enable you the Pro. For iOS/Android, we as a developer were forced to use respective in-app payments, by default that's assigned to your Apple/Google account and it's not visible on other S3Drive clients. We haven't implemented any propagation mechanism and weren't sure about the exact approach. Speaking of how you manage credentials between devices, at the moment they need to be manually copied over, but we're looking to improve that: https://s3drive.canny.io/feature-requests/p/qr-code-credentials-exchange If you're not happy with your purchase, I could make an exception and we could switch the "plans" over.
Avatar
Avatar
morethanevil
Okay so I can not create an account in the app with pro enabled and link it to desktop app?
It may work like that in the future, but that's not the case yet... and even if it was, the price would have to be different as technically you would buy lifetime version on all devices. The difference is that on our website we sell perpetual fallback license, whereas on iOS/Google we're forced (EDIT: well there are also subscriptions, but there isn't concept of perpetual fallback license - https://s3drive.app/faq?q=perpetual as such) to sell the lifetime with their 15% cut. (edited)
Avatar
morethanevil 07/31/2023 10:57 AM
Thanks for the explanation, I will wait for QR Code feature, it is the easiest way atm. I got a warning after executing the installer from windows defender.
10:58
For the Linux version Flatpak would be nicer than appimage, because it is updateable
Avatar
Avatar
morethanevil
Thanks for the explanation, I will wait for QR Code feature, it is the easiest way atm. I got a warning after executing the installer from windows defender.
Microsoft implements some heuristic mechanism to flag the executable if not enough people used the package. We've recently switched location of where we host our packages to Github release: https://github.com/s3drive/app/releases It might go away eventually, we're also thinking of buying "trusted certificate" from some provider, which should mitigate these warnings sooner. Alternatively you can use MSIX package, but we update it rarely due to pretty crappy experience with Microsoft Store: https://apps.microsoft.com/store/detail/s3drive-cloud-storage/9NX2DN9Q37NS (edited)
Avatar
morethanevil 07/31/2023 11:02 AM
Ahh cool, please link the store app on github too 🙂
Avatar
Avatar
morethanevil
For the Linux version Flatpak would be nicer than appimage, because it is updateable
Flatpak is pending: https://github.com/flathub/flathub/pull/4364 however there is some licensing stuff we're not sure about and didn't have time to do the legal research. It will come probably in a few weeks. (edited)
Avatar
morethanevil 07/31/2023 11:03 AM
Flatpak is as great as the store app. They can selfupdate, so it is easier to manage versions. You can be listed on flathub too
11:03
= more users 😄
Avatar
Avatar
morethanevil
Flatpak is as great as the store app. They can selfupdate, so it is easier to manage versions. You can be listed on flathub too
Yes, we think the same. It's just there are two ways the "proprietary" packages can be distributed and the technical approach is quite different. One way or another, it will appear on Flathub. As you say more users and pretty convenient to distribute.
👍 1
Avatar
morethanevil 07/31/2023 11:07 AM
I installed the store app, works perfect without warnings. Should be the prefered method for installing, and exe for people who don't like the store
Avatar
Avatar
morethanevil
I installed the store app, works perfect without warnings. Should be the prefered method for installing, and exe for people who don't like the store
Point taken. We'll have it updated, as the version is quite old.
☺️ 1
Avatar
Avatar
morethanevil
I installed the store app, works perfect without warnings. Should be the prefered method for installing, and exe for people who don't like the store
Just to give you an idea, how we love this process. This is the first hand experience trying to login to dev account:
Avatar
morethanevil 07/31/2023 11:16 AM
😅
Avatar
After clearing cookies different one. Sorry, I've just had to vent 🙂
Avatar
morethanevil 07/31/2023 11:18 AM
If it don't works as expected, than add a hint about the warning from the installer. A notice is better than a surprise i think 🤔
👍 1
Avatar
morethanevil 08/01/2023 8:49 PM
Just hot the new update on Android, thanks 😁 I will try out ☺
Avatar
morethanevil 08/02/2023 6:36 AM
Update works well so far, but I don't get the E2EE running. I set a new crypt in rclone, with only one password, since s3drive does not support 2 passwords. I set filenames and directory names to encrypt too. Then I added the bucket to the app and activated the encryption with the same password. I get access, but folders and filesnames stay encrypted. Did I miss something? Then I saw that my other buckets are missing in the app, after I added the encrypted one. The profiles got overwritten. Securitysettings should be moved to bucket settings, since they only apply to the current bucket. It is a little confusing at first. Dark mode and dotfiles are appwide settings.
06:40
Steps to reproduce on the missing profiles: I already had unecnrypted buckets. I added another one and set encrypted with password from rclone. Since it did not work, I tried to toggle off and on again to set the password again (Maybe I mistyped) and then the other buckets were gone
06:41
Import / Export settings would be great in this case 😄
Avatar
Avatar
morethanevil
Update works well so far, but I don't get the E2EE running. I set a new crypt in rclone, with only one password, since s3drive does not support 2 passwords. I set filenames and directory names to encrypt too. Then I added the bucket to the app and activated the encryption with the same password. I get access, but folders and filesnames stay encrypted. Did I miss something? Then I saw that my other buckets are missing in the app, after I added the encrypted one. The profiles got overwritten. Securitysettings should be moved to bucket settings, since they only apply to the current bucket. It is a little confusing at first. Dark mode and dotfiles are appwide settings.
Thanks for your input. Please find the other post with sample Rclone config: https://discord.com/channels/1069654792902815845/1069654792902815848/1135157727216279585 For filename encryption to work, please make sure that these two landed in your settings: filename_encoding = base64 suffix = none By default the Rclone's encoding is base32: https://github.com/rclone/rclone/blob/88c72d1f4de94a5db75e6b685efdbe525adf70b8/backend/crypt/crypt.go#L140 unless overriden by the config creator.
Avatar
Avatar
morethanevil
Steps to reproduce on the missing profiles: I already had unecnrypted buckets. I added another one and set encrypted with password from rclone. Since it did not work, I tried to toggle off and on again to set the password again (Maybe I mistyped) and then the other buckets were gone
In principle this shouldn't happen, the E2EE settings regardless of UI are applied per S3 credentials separately. If your other credentials are lost, well it sounds like we may've screwed up. I am going to reproduce it. Is this Android?
Avatar
Avatar
morethanevil
Import / Export settings would be great in this case 😄
It will definitely come soon.
Avatar
Avatar
morethanevil
Update works well so far, but I don't get the E2EE running. I set a new crypt in rclone, with only one password, since s3drive does not support 2 passwords. I set filenames and directory names to encrypt too. Then I added the bucket to the app and activated the encryption with the same password. I get access, but folders and filesnames stay encrypted. Did I miss something? Then I saw that my other buckets are missing in the app, after I added the encrypted one. The profiles got overwritten. Securitysettings should be moved to bucket settings, since they only apply to the current bucket. It is a little confusing at first. Dark mode and dotfiles are appwide settings.
For the 2nd password, I've just added this item: https://s3drive.canny.io/feature-requests/p/support-2nd-rclone-crypt-password Rclone support is still "hot" and our aim was to deliver MVP with contents, filepath encryption and drive mount. We also hope that we'll be able to influence Rclone crypt improvements first, as it would affect the end derived key for the file encryption: https://github.com/rclone/rclone/issues/7192 (edited)
Avatar
Avatar
morethanevil
Steps to reproduce on the missing profiles: I already had unecnrypted buckets. I added another one and set encrypted with password from rclone. Since it did not work, I tried to toggle off and on again to set the password again (Maybe I mistyped) and then the other buckets were gone
When you say: "Since it did not work", at the moment when you enable/disable filename encryption and go back to the listing, you need to explicitly refresh it on the S3Drive side in order for changes to be applied to your existing already loaded listing. This will get improved as well, so it's less confusing. (edited)
Avatar
Avatar
s3drive
Thanks for your input. Please find the other post with sample Rclone config: https://discord.com/channels/1069654792902815845/1069654792902815848/1135157727216279585 For filename encryption to work, please make sure that these two landed in your settings: filename_encoding = base64 suffix = none By default the Rclone's encoding is base32: https://github.com/rclone/rclone/blob/88c72d1f4de94a5db75e6b685efdbe525adf70b8/backend/crypt/crypt.go#L140 unless overriden by the config creator.
morethanevil 08/02/2023 9:34 AM
It works now, second notice was the hint from the app to encode the password in base64 using https://www.base64encode.org and then enter the password as base64, not plaintext. Is there a possibilty to enter a plain password, which is then calculated in base64?
Encode to Base64 format or decode from it with various advanced options. Our site has an easy to use online tool to convert your data.
Avatar
Avatar
s3drive
In principle this shouldn't happen, the E2EE settings regardless of UI are applied per S3 credentials separately. If your other credentials are lost, well it sounds like we may've screwed up. I am going to reproduce it. Is this Android?
morethanevil 08/02/2023 9:34 AM
Yes Android Playstore release from yesterday
Avatar
Avatar
s3drive
For the 2nd password, I've just added this item: https://s3drive.canny.io/feature-requests/p/support-2nd-rclone-crypt-password Rclone support is still "hot" and our aim was to deliver MVP with contents, filepath encryption and drive mount. We also hope that we'll be able to influence Rclone crypt improvements first, as it would affect the end derived key for the file encryption: https://github.com/rclone/rclone/issues/7192 (edited)
morethanevil 08/02/2023 9:35 AM
One password is okay for the beginning, it works now. Maybe a quickstart guide with screenshots would be nice, so people can reproduce
Avatar
Avatar
morethanevil
It works now, second notice was the hint from the app to encode the password in base64 using https://www.base64encode.org and then enter the password as base64, not plaintext. Is there a possibilty to enter a plain password, which is then calculated in base64?
Yes, please click: "Start" instead of "Existing key (base64)". The existing key is legacy option from previous AES-GCM encryption. It will work for Rclone if you properly encode your password, but it's mostly to satisfy previous user password if they want to decrypt files encrypted using legacy encryption.
Avatar
Avatar
morethanevil
One password is okay for the beginning, it works now. Maybe a quickstart guide with screenshots would be nice, so people can reproduce
We're working on some documentation pages and tutorials using: https://squidfunk.github.io/mkdocs-material/ It wasn't our priority when features API wasn't exactly stable, but now things are getting final shape.
👍 1
Avatar
Avatar
s3drive
Yes, please click: "Start" instead of "Existing key (base64)". The existing key is legacy option from previous AES-GCM encryption. It will work for Rclone if you properly encode your password, but it's mostly to satisfy previous user password if they want to decrypt files encrypted using legacy encryption.
morethanevil 08/02/2023 9:37 AM
I thought start would setup a new password and encryption. This is why i used existing 😄
Avatar
Avatar
s3drive
Thanks for your input. Please find the other post with sample Rclone config: https://discord.com/channels/1069654792902815845/1069654792902815848/1135157727216279585 For filename encryption to work, please make sure that these two landed in your settings: filename_encoding = base64 suffix = none By default the Rclone's encoding is base32: https://github.com/rclone/rclone/blob/88c72d1f4de94a5db75e6b685efdbe525adf70b8/backend/crypt/crypt.go#L140 unless overriden by the config creator.
BTW. I am wondering in the end if you had to set Base64 encoding (in the Rclone config) explicitly or was it already set by the Rclone's config creator? (edited)
zev_averbach joined the server. 08/02/2023 10:06 AM
Avatar
Welcome @zev_averbach 👋 (edited)
Avatar
Avatar
s3drive
BTW. I am wondering in the end if you had to set Base64 encoding (in the Rclone config) explicitly or was it already set by the Rclone's config creator? (edited)
morethanevil 08/02/2023 10:29 AM
The config creator uses base32 as default, as you said before. It only shows options if you say yes to the advanced configuration when creating the config file
Avatar
morethanevil 08/02/2023 10:41 AM
Just ran the configuration assistant
Avatar
Avatar
morethanevil
Just ran the configuration assistant
Great, so indeed possible.
Avatar
Avatar
morethanevil
Steps to reproduce on the missing profiles: I already had unecnrypted buckets. I added another one and set encrypted with password from rclone. Since it did not work, I tried to toggle off and on again to set the password again (Maybe I mistyped) and then the other buckets were gone
There is a concurrency issue combined with a bug in library that we use: https://pub.dev/packages/flutter_secure_storage. When setting E2E password, we run the key derivation: https://rclone.org/crypt/#key-derivation which takes some xxx ms. When user taps/clicks on password confirmation, more than once, this all starts over and chances are it will clean up the other credentials. We need to apply quick workaround first, so we have time to properly fix this in the underlying library. (edited)
Avatar
Avatar
s3drive
There is a concurrency issue combined with a bug in library that we use: https://pub.dev/packages/flutter_secure_storage. When setting E2E password, we run the key derivation: https://rclone.org/crypt/#key-derivation which takes some xxx ms. When user taps/clicks on password confirmation, more than once, this all starts over and chances are it will clean up the other credentials. We need to apply quick workaround first, so we have time to properly fix this in the underlying library. (edited)
morethanevil 08/02/2023 10:48 AM
I will setup the buckets again and start with the encrypted one 😄
10:49
But it is great that you found the bug, so a workaround or fix can be made
10:53
I wanted to use my backups a better way than just rclone via sftp. So I learned about MinIO with Versioning and so on... It is a little tricky to bind a user to a bucket but I found a solution for this. Then I wanted to use S3 on android too, but there were no good apps. Mostly they only work with AWS, your app was the first one which worked and has not a UI from the 1990. Now with the encryption and the app, I am able to restore files and Folders without copy rclone.conf over, than run a long mounting and hoping to get my file
Avatar
Avatar
morethanevil
I wanted to use my backups a better way than just rclone via sftp. So I learned about MinIO with Versioning and so on... It is a little tricky to bind a user to a bucket but I found a solution for this. Then I wanted to use S3 on android too, but there were no good apps. Mostly they only work with AWS, your app was the first one which worked and has not a UI from the 1990. Now with the encryption and the app, I am able to restore files and Folders without copy rclone.conf over, than run a long mounting and hoping to get my file
Great to hear, I am amazed to see that there are so many different user stories with S3Drive. Speaking of "bind a user to a bucket", is it something you would like to share more about? Is it MinIO specific or something we could help with S3Drive as well?
Avatar
morethanevil 08/02/2023 11:00 AM
It is for MinIO only, the user managment is aweful there 😄
11:00
Every user with read write can create and delete every bucket.
11:00
Useful ACLs are missing
11:00
But it is possible via JSON Format to bind a user to one bucket, I was looking around last night and finally found a solution in a blogpost
11:01
Minio is a really cool opensource project which democratizes cloud storage. The feature that I love most about it is S3 compatibility which means that you ca...
11:01
{ "Version": "2012-10-17", "Statement": [ { "Action": [ "s3:ListBucket", "s3:PutObject", "s3:GetObject", "s3:DeleteObject" ], "Effect": "Allow", "Resource": [ "arn:aws:s3:::BUCKET-NAME/*", "arn:aws:s3:::BUCKET-NAME" ], "Sid": "Description" } ] }
11:01
Please copy from the blog, not discord 😄
11:01
Discord always screws up
11:02
As for S3 Drive it could check the permissions from the user and do an autodiscovery for the buckets. Then the user could select the ones to have in the app
11:03
The only thing to do would be setup the passwords for encrypted buckets
11:03
Serverside encryption is aweful too in minio, you need a kms 🙃
Avatar
Avatar
morethanevil
It is for MinIO only, the user managment is aweful there 😄
I see, I believe Minio's goal was to build a replacement for AWS S3, with all of the IAM / KMS clunky, but enterprise-ready stuff
Avatar
Avatar
morethanevil
As for S3 Drive it could check the permissions from the user and do an autodiscovery for the buckets. Then the user could select the ones to have in the app
On the S3 login screen you can select single bucket manually, but autodiscovery sounds also interesting. Technically we could ask user (dialog) and import all buckets as separate profiles (or perhaps there is a neater way to manage it). (edited)
Avatar
morethanevil 08/02/2023 11:05 AM
A policy generator for the json files would be cool from the devs... selecvt user, select bucket, select ACL...
Avatar
Avatar
s3drive
On the S3 login screen you can select single bucket manually, but autodiscovery sounds also interesting. Technically we could ask user (dialog) and import all buckets as separate profiles (or perhaps there is a neater way to manage it). (edited)
morethanevil 08/02/2023 11:06 AM
If you use more than 5 buckets it is a little work to add them all, and retype the credentials everytime 😄
Avatar
Avatar
morethanevil
If you use more than 5 buckets it is a little work to add them all, and retype the credentials everytime 😄
Avatar
morethanevil 08/02/2023 11:12 AM
Thanks ☺️ I upvoted
Avatar
if you want a self-service MinIO policy: { "Version": "2012-10-17", "Statement": [ { "Effect": "Allow", "Action": [ "s3:*" ], "Resource": [ "arn:aws:s3:::${aws:username}" ] }, { "Effect": "Allow", "Action": [ "s3:*" ], "Resource": [ "arn:aws:s3:::${aws:username}/*" ] } ] }
11:13
that's what I always add to any MinIO instance I configure, full control over your own bucket that's your username
Avatar
morethanevil 08/02/2023 11:20 AM
And it only allows the user to use his own buckets?
Avatar
only a single bucket that is their own username
11:42
they can even delete it or create it if it doesn't exist
11:44
you can always replace ${aws:username} by anything you want, be it a variable or a fixed bucket name, there unfortunately isn't any group name variable
Avatar
morethanevil 08/02/2023 11:45 AM
So the first aws:username means the username of the user and the second one is for the bucket? I am not much into the policy thing, the docs are not very userfriendly 😅
Avatar
no, both time it's the bucket name
11:45
the policy can be assigned to either a user or a group
11:46
in my case I have a users group to which I assign the selfservice policy, then I add whoever I want to the users group and they'll be able to manage their very own bucket
Avatar
morethanevil 08/02/2023 11:46 AM
Okay so the only difference to the other would be, that your json provides full access to the bucket, including deletion and creation
Avatar
it can be simplified a lot actually, I kept the resources separate but you can merge them
Avatar
Avatar
xenthys
you can always replace ${aws:username} by anything you want, be it a variable or a fixed bucket name, there unfortunately isn't any group name variable
morethanevil 08/02/2023 11:47 AM
That's cool ☝🏻 One policy for a group and then just add users
Avatar
{ "Version": "2012-10-17", "Statement": [ { "Effect": "Allow", "Action": [ "s3:*" ], "Resource": [ "arn:aws:s3:::${aws:username}", "arn:aws:s3:::${aws:username}/*" ] } ] }
11:48
by default I don't merge them because the first resource is the bucket itself, while the other is for its content
11:51
I also had a "public-ro" and a "public-rw" policy, useful if you want all users to be able to access a common bucket but only allow a subgroup to write there
Avatar
Avatar
morethanevil
Okay so the only difference to the other would be, that your json provides full access to the bucket, including deletion and creation
yeah, I'm afraid the one you sent doesn't allow multiparts or versions usage, it also allows users to set policies on their buckets if they want to allow other users to access it, or make a directory public
Avatar
morethanevil 08/02/2023 12:04 PM
I will try this after work, thank you 😺
Avatar
Avatar
xenthys
if you want a self-service MinIO policy: { "Version": "2012-10-17", "Statement": [ { "Effect": "Allow", "Action": [ "s3:*" ], "Resource": [ "arn:aws:s3:::${aws:username}" ] }, { "Effect": "Allow", "Action": [ "s3:*" ], "Resource": [ "arn:aws:s3:::${aws:username}/*" ] } ] }
morethanevil 08/02/2023 12:04 PM
Username needs to be replaced with an existing bucket? How do I use this with groups?
Avatar
no, that one can be used as-is
12:05
MinIO will interpolate the variable itself with the username of whichever user performs the API call
12:06
the policy has the exact same effect whether it's assigned to a group to which your user belongs, or to the user directly (edited)
Avatar
morethanevil 08/02/2023 12:15 PM
Okay create a policy "selfmanagment" and add users to it, then they can manage only themselfs Can they create more than one bucket for themself or only just one with their username as mentioned in policy?
Avatar
just the one in the policy, what isn't explicitly allowed is denied
12:22
it's however better for most users to have only one bucket then create directories in it
12:23
and if you need two buckets to separate pro vs perso for example, then maybe two accounts is better
Avatar
morethanevil 08/02/2023 12:23 PM
Okay but this is okay One bucket fir one user You helped me more in an hour, than the docs the whole week 😁 I will write this to my wiki and make a Post on Lemmy and Reddit. I am surely not the only one steuggeling with this
12:23
Thanks 🌞
Avatar
I found the docs rather helpful, but they're aimed at very technical and specific needs instead of being adapted for standard use cases, they aren't a tutorial
12:25
you're welcome!
Avatar
morethanevil 08/02/2023 12:44 PM
The standard cases would be most users, so a policy generator would be cool 😁
Avatar
Avatar
xenthys
you're welcome!
morethanevil 08/02/2023 12:45 PM
I will mention you in the postings if you like. Or you could post it yourself in the minio subreddit. Most people will then find it via search engines
Avatar
it's fine, I no longer contribute on Reddit because I can't really stand the platform nor its users anymore
12:46
I'm no longer giving free content to Reddit, and I have better things to do than argue with redditors about my own use cases
Avatar
morethanevil 08/02/2023 12:54 PM
Understandable I prefer Lemmy, I really love it by now 🥰
Avatar
morethanevil 08/02/2023 10:32 PM
Just did a few things, I tried the policy and it works great, thanks again
22:32
Next step was to write a "quick" tutorial for rclone with minio and s3drive
22:33
@s3drive Please review my guide and add it to your FAQ / Wiki / whatever. So users can see how it works. The guide is in my cryptpad here:
22:34
You can use my screenshots too, they are not case sensetive, it was a vm
22:35
Nextcloud link will be available 3 days (automatic deletion)
Avatar
Avatar
morethanevil
@s3drive Please review my guide and add it to your FAQ / Wiki / whatever. So users can see how it works. The guide is in my cryptpad here:
That's great, thanks for your work. Before we're done with MkDocs, we could add that our Github and reference back from the website. In any case the required format would be MD. I don't really want to put any burden on you, but would it be possible for you to prepare it in the MD format? Please find the e.g. instruction that we have for Backblaze: https://github.com/s3drive/app/blob/master/INITIAL_SETUP.md and corresponding raw MD: https://raw.githubusercontent.com/s3drive/app/master/INITIAL_SETUP.md The images could be placed in the: https://github.com/s3drive/app/tree/master/resources/images perhaps it would make sense to create a specific folder for the instruction. If you're happy with that approach. please fork: https://github.com/s3drive/app and create the pull request to the repo.
Avatar
Avatar
s3drive
That's great, thanks for your work. Before we're done with MkDocs, we could add that our Github and reference back from the website. In any case the required format would be MD. I don't really want to put any burden on you, but would it be possible for you to prepare it in the MD format? Please find the e.g. instruction that we have for Backblaze: https://github.com/s3drive/app/blob/master/INITIAL_SETUP.md and corresponding raw MD: https://raw.githubusercontent.com/s3drive/app/master/INITIAL_SETUP.md The images could be placed in the: https://github.com/s3drive/app/tree/master/resources/images perhaps it would make sense to create a specific folder for the instruction. If you're happy with that approach. please fork: https://github.com/s3drive/app and create the pull request to the repo.
morethanevil 08/03/2023 7:01 AM
Okay I fork and add everything in there in MD. GitHub has a great preview and editor 😊
Avatar
morethanevil 08/03/2023 7:49 AM
Pull request is done 🙂
alex_50852 joined the server. 08/03/2023 9:33 AM
Avatar
Avatar
morethanevil
Okay I fork and add everything in there in MD. GitHub has a great preview and editor 😊
Thanks for the article. I've moderated it a bit, fixed typos, casing, added some headings / warnings and then moved location within the repo: https://github.com/s3drive/app/commit/93c8b5dd5da32eb44e5b3143e5833962e376384b It landed here: https://github.com/s3drive/app/blob/master/RCLONE_SETUP.md
👍 1
Avatar
morethanevil 08/03/2023 4:54 PM
Glad I could help a little bit. Typos etc were to be expected. I am not a native speaker 😅
Avatar
Avatar
morethanevil
Glad I could help a little bit. Typos etc were to be expected. I am not a native speaker 😅
No worries, I am sure that native speakers make typos as well 😉
Avatar
morethanevil 08/03/2023 4:57 PM
😁
Avatar
@s3drive I was thinking about creating a green Contributor role, it isn't much but still a nice way to recognize individuals who go out of their way to help the project out, what do you think about it?
Avatar
Avatar
xenthys
@s3drive I was thinking about creating a green Contributor role, it isn't much but still a nice way to recognize individuals who go out of their way to help the project out, what do you think about it?
I like that. It seems that Github displays that if there is a pull request merged into repo, certainly we should have something like that on Discord. (edited)
Avatar
Good, I'll do that then
Avatar
Avatar
xenthys
Good, I'll do that then
Feel free to add yourself then, you've helped already a lot ! 🙂
Avatar
Maybe later 😊
Avatar
morethanevil 08/03/2023 6:37 PM
Issues don't count anymore 🫤 I read you need to have your profil public in your settings 🤔
helios6509 joined the server. 08/04/2023 11:49 AM
redsolver joined the server. 08/04/2023 12:19 PM
Avatar
Hi 👋
Avatar
Avatar
helios6509
Click to see original message
17:23
lol this thing
Avatar
Welcome, Helios, we hope you've brought sunshine (edited)
Avatar
morethanevil 08/05/2023 5:15 AM
Sunshine would nice 🌞
05:15
I found a little bug and opened an issue on GitHub ☺
Avatar
@morethanevil Thanks, we will get to that next week. Backup module wasn't looked after for quite a while awaiting crucial changes in order to make background upload possible.
👍 1
Avatar
I cannot subscribe to this, it tells me my card was declined... Would be nice to have other payment options like iDEAL or Paysafecard :/
Avatar
Avatar
helios6509
I cannot subscribe to this, it tells me my card was declined... Would be nice to have other payment options like iDEAL or Paysafecard :/
Hi @helios6509, sorry that you face these issues, we use Stripe to handle the payments and don't have exactly full control over the card decline criteria. Since iDEAL is supported by Stripe I am going to have a look if that's something I can enable. In the meantime, all I can do is to ask you to try again or using different card. I've also PM'd you with a payment link which may help your transaction to pass through. Thanks !
Avatar
Avatar
helios6509
I cannot subscribe to this, it tells me my card was declined... Would be nice to have other payment options like iDEAL or Paysafecard :/
Thank you for your suggestion, iDEAL is now enabled. If you have any troubles with the payment or S3Drive feel free to reach out to me directly. (edited)
Avatar
Avatar
s3drive
Thank you for your suggestion, iDEAL is now enabled. If you have any troubles with the payment or S3Drive feel free to reach out to me directly. (edited)
Thanks!
Avatar
Hey @s3drive any chance we will get S3Drive in Linux as a Flatpak?
Avatar
Avatar
helios6509
Hey @s3drive any chance we will get S3Drive in Linux as a Flatpak?
Yes, this is a work in progress (https://github.com/flathub/flathub/pull/4364), there were couple challenges that we've mostly solved and likely within couple next weeks it shall be live on Flathub.
👍 1
Avatar
Avatar
helios6509
Hey @s3drive any chance we will get S3Drive in Linux as a Flatpak?
In the meantime on top of: AppImage you can find deb package in the releases: https://github.com/s3drive/app/releases if that's any use for you.
👍 1
Avatar
morethanevil 08/06/2023 6:54 PM
Tried the new update. Passwort-Manager works fine, thanks 🐱
18:54
But this keeps popping up everytime I go back to the bucket 😁
18:55
Hint: you already got 5 stars ☺
👍 1
19:01
Tested autofill as you wished on GitHub, works as aspectedfor E2EE and adding profiles 👍
Avatar
Avatar
morethanevil
Tested autofill as you wished on GitHub, works as aspectedfor E2EE and adding profiles 👍
That's great thank you for this suggestion. It's super helpful yet was super easy to build.
Avatar
Avatar
morethanevil
But this keeps popping up everytime I go back to the bucket 😁
Does it go away if you click Maybe later or No thanks? We're not keen on integrating with Google APIs (privacy issues) in order fetch if comment was already added and improve this prompt experience, so basically this will bug user from time to time until: "No thanks" is clicked. I am going to check it again, perhaps there are some issues with the library that's supposed to decide when to show the dialog.
Avatar
morethanevil 08/06/2023 7:16 PM
It does not matter which I choose As soon as I come back from the menu it shows up
Yibo joined the server. 08/07/2023 5:28 AM
05:29
05:30
怎么解决,不能安装
05:30
打开文本文件的时候 要弹出的
Avatar
Avatar
Yibo
怎么解决,不能安装
morethanevil 08/07/2023 6:05 AM
How do I fix it? It won't install.
Avatar
Avatar
Yibo
打开文本文件的时候 要弹出的
morethanevil 08/07/2023 6:05 AM
When you open a text file, it's a pop-up.
06:06
Translated with deepl
06:16
i want open it using another app,but i can not
06:17
it is oneplus 11
06:18
when i using iphone, can open it with another app
Avatar
Avatar
morethanevil
It does not matter which I choose As soon as I come back from the menu it shows up
This shall be now addressed with the most recent update.
Avatar
morethanevil 08/07/2023 8:21 AM
Yes it is fixed now ☺
greatscott1170 joined the server. 08/07/2023 9:16 PM
frenchtoucan joined the server. 08/08/2023 2:59 PM
Avatar
@s3drive problem with latest upgrade hanging.. happening pretty much constantly.. android version
Avatar
Avatar
buzz69.
@s3drive problem with latest upgrade hanging.. happening pretty much constantly.. android version
Thanks for your feedback. Can you create #support item please? Can you describe how does it look like? On what screen this hanging happens? Does it get worse or get better after certain action? Do you have E2E enabled? Do you find anything interesting in Logs? We've deployed many smaller releases over the past two weeks https://s3drive.app/changelog Do you remember what was the last version that worked for you? What's your Android version and phone model?
test_36022 joined the server. 08/09/2023 8:56 AM
Avatar
Hello @test_36022, what are we testing today?
Avatar
Your patience blobowoevil
Avatar
Will do!
dgr8shogun joined the server. 08/09/2023 11:47 AM
bingofps joined the server. 08/12/2023 3:04 PM
confident_rabbit_87075_49035 joined the server. 08/13/2023 12:35 AM
pjort.kat joined the server. 08/13/2023 11:54 AM
AD26 joined the server. 08/14/2023 10:04 PM
Avatar
Hey fellas, I'm trying out the app using Storj as the back end. I have encryption enabled on my Android, but when I try to download my data on my desktop, the data downloaded in both photos and videos are empty. Edit: I plugged in the my encryption key on my desktop using the web app, and this is the error I'm getting: Error: FormatException: Invalid Key IV: [longnumber] Edit2: It looks like I'm still using the deprecated encryption. I plugged it in the other option, and now the files are showing up. Moreover, when using the web app, downloads always fail and awfully slow for a 2mb photo. With the app, it works as normal, but similar download speeds. Since I'm using a deprecated password, how would I go about updating it? Create a new password, and re-upload my files? (edited)
Avatar
Hi @AD26, If you get: "Invalid Key IV" that indicates that you've objects encrypted using deprecated AES-GCM encryption scheme. S3Drive can open them, but you'll need to set up key using: AES-GCM key (deprecated) button whenever you want to access your files. This is because it needs to process your key using base64 encoding instead of plaintext (default for Rclone). In any case all existing AES-GCM encrypted data will remain readable, but whenever you update it or write new file it will use Rclone encryption scheme using your current key (whether a new plaintext or legacy base64). You don't need to re-upload your files, both schemes are supported and before we remove AES-GCM support we will give more than enough time. It is possible to use the AES-GCM password in Rclone CLI if you ever need. Given your AES-GCM password is: czNkcml2ZQ== using this command: echo "czNkcml2ZQ==" | base64 -d | rclone obscure - you can generate a password, e.g.: AQbZ5H8mrzlnkNj9MXnjpxS5QmxbRpw which can be used in Rclone config: rclone config file as indicated in this post: https://discord.com/channels/1069654792902815845/1069654792902815848/1135157727216279585 Speaking of decryption speeds in browser, let's continue in the support item that I've created: https://discord.com/channels/1069654792902815845/1140911911479808081 (edited)
jeannesbond joined the server. 08/15/2023 7:44 PM
wolfefx joined the server. 08/17/2023 7:14 AM
Avatar
Avatar
wolfefx
Click to see original message
Avatar
Welcome
dantheman61 joined the server. 08/17/2023 6:01 PM
mgrmgrcentral.com joined the server. 08/19/2023 10:12 PM
muntasim joined the server. 08/21/2023 7:54 PM
szirok_03617 joined the server. 08/23/2023 6:54 AM
Avatar
szirok_03617 08/23/2023 6:57 AM
i have rclone encrypted files, file names and content, there is in config dump password1 and password2, i tried to set p1 and also p2 in s3 web drive, but it does not decrypt, why?
06:57
so is it compatible with rclone e2e yes or no?
Avatar
Avatar
szirok_03617
i have rclone encrypted files, file names and content, there is in config dump password1 and password2, i tried to set p1 and also p2 in s3 web drive, but it does not decrypt, why?
Please set up your Rclone as mentioned in this post: https://discord.com/channels/1069654792902815845/1069654792902815848/1135157727216279585 rclone password dump gives obscured password. You need to use your original text password. Alternatively you'll need to use "password reveal" on your obscured password. https://forum.rclone.org/t/how-to-retrieve-a-crypt-password-from-a-config-file/20051 We're not supporting Rclone 2nd password, but it's part of our roadmap: https://s3drive.canny.io/feature-requests/p/support-2nd-rclone-crypt-password We're supporting default Rclone salt: https://forum.rclone.org/t/how-to-correctly-setup-the-salt-for-the-crypt-remote/4273/2 I've created additional two roadmap items to support your use case: https://s3drive.canny.io/feature-requests/p/add-support-for-custom-rclone-salt https://s3drive.canny.io/feature-requests/p/add-option-to-restore-rclone-password Please vote on them, so the priority is pushed higher. If you have any more issues with S3Drive, please create a support item: https://discord.com/channels/1069654792902815845/1102236355645419550 Thanks (edited)
Avatar
Avatar
szirok_03617
so is it compatible with rclone e2e yes or no?
It is entirely compatible, but we're not yet supporting 2nd password. You need to set up S3Drive and Rclone using just one password.
Avatar
Avatar
szirok_03617
Click to see original message
20:27
I was trying to create a support post but, I am unable to
20:28
To report a bug
20:28
In app
Avatar
confident_rabbit_87075_49035 08/24/2023 4:09 PM
Hi all, is there a place for low priority feature requests 😄 I have got one
Avatar
Avatar
confident_rabbit_87075_49035
Hi all, is there a place for low priority feature requests 😄 I have got one
Hi, you can request them in #support, there's a tag for that, don't worry about priorities yet since this community isn't very active at the moment
👍 1
yossie_54569 joined the server. 08/26/2023 6:07 AM
coldfusion0015 joined the server. 08/26/2023 11:49 PM
currawong. joined the server. 08/27/2023 11:29 AM
Avatar
szirok_03617 09/01/2023 7:48 AM
please add support to download using save file as, not into browser storage. Lets say on c: drive i have 1gb free space, so i want to save 5gb file on e: drive where i have 200gb free space. i cant because web app downloads to cache on c
07:48
please add possibility to download using save file as at start, not first to cache
aquib42 joined the server. 09/01/2023 6:34 PM
Avatar
Avatar
aquib42
Click to see original message
Avatar
Hi, welcome!
drcody joined the server. 09/04/2023 9:22 AM
definitelynotblackbeard joined the server. 09/04/2023 11:43 AM
Avatar
Avatar
definitelynotblackbeard
Click to see original message
definitelynotblackbeard 09/04/2023 11:43 AM
Avatar
definitelynotblackbeard 09/04/2023 12:01 PM
Hey @s3drive , I would like to buy the pro version since I want the mounted drive option. But I've had less than sub par experiences with other mount drive applications, which is how I landed up with yours. Is there a way to get like a 7 day trial to test the mounted drive option to see if it is worth it?
Avatar
Avatar
definitelynotblackbeard
Hey @s3drive , I would like to buy the pro version since I want the mounted drive option. But I've had less than sub par experiences with other mount drive applications, which is how I landed up with yours. Is there a way to get like a 7 day trial to test the mounted drive option to see if it is worth it?
Hi @definitelynotblackbeard , Our billing integration with Stripe doesn't yet support trial, but you can test all app's capabilities by creating a free account (https://s3drive.app/account) and use the free 10GB allocated storage plan, as long as you login to S3Drive app with the same credentials. Behind the scenes there is an S3 cluster that we manage. Pro version allows you to use all these features but with your custom S3 endpoint. (edited)
Avatar
definitelynotblackbeard 09/04/2023 1:52 PM
Gotcha thank you i will try trhat out
13:53
Also, follow up. I know the app is not open source, but do you all have a contribers system where other devs can help fix issues / add features?
Avatar
Avatar
definitelynotblackbeard
Hey @s3drive , I would like to buy the pro version since I want the mounted drive option. But I've had less than sub par experiences with other mount drive applications, which is how I landed up with yours. Is there a way to get like a 7 day trial to test the mounted drive option to see if it is worth it?
Behind the scenes we're using: https://rclone.org/commands/rclone_mount/, so if that option works for you, S3Drive works pretty much the same, except it's "clickable" from the app. You can also use Rclone mount yourself outside S3Drive, but the data (including encrypted data) will stay compatible between S3Drive and Rclone. (edited)
🤟 1
Avatar
Avatar
definitelynotblackbeard
Also, follow up. I know the app is not open source, but do you all have a contribers system where other devs can help fix issues / add features?
For this to work the app doesn't need to be FOSS, but at least source open. Whilst we've had that in mind it doesn't fit with our current revenue stream. We don't have enough capacity to properly manage open-source community and at this stage we think that having full control on the project direction allows us to focus on deliverables, build lean and deploy fast. With open-source we would likely receive dozens of pull requests for features which are not part of the streamline, yet we would have to dedicate resources to maintain, test, fix, refactor etc. As long as we get enough revenue from selling data plans (due to be released Q4 - https://s3drive.app/pricing - monthly/yearly), and not the software itself, we could then think of making clients open source: https://s3drive.app/faq?q=opensource as both sides may benefit from this move. (edited)
Avatar
definitelynotblackbeard 09/04/2023 2:06 PM
gotcha that makes a lot of sense. So for now it's feature requests and github issues that will push the development forward from our side? Is there a tiered system such as if you have x license we prioritize your issues etc?
Avatar
Avatar
definitelynotblackbeard
gotcha that makes a lot of sense. So for now it's feature requests and github issues that will push the development forward from our side? Is there a tiered system such as if you have x license we prioritize your issues etc?
Mostly yes. We don't have any formal decision process on this. If something gets added by the community we then prioritize internally based on multiple factors, general interest, development time etc. For bigger number of licenses and very custom features (not part of the general roadmap) we have an Enterprise plan - https://s3drive.app/pricing where we can provide quotes on custom features/integrations and discounts. Do you have anything in mind in terms of features / bugs? We can discuss this here or via different channels. (edited)
Avatar
definitelynotblackbeard 09/04/2023 2:21 PM
Gotcha. Yeah this is not on an enterprise level altough I work with large companies who might benefit from this app. I am gonna test it and if it works well I might recommend it to our project teams. We currently use Gladinet which works fine but your client(s) seem so much smoother etc. As for features and bugs, I like identifying possible new features and bugs especially if I like the app so if I can communicate them here that would be cool. Just started using this today but the things I have for now are: - When you close the desktop client, in windows, it should auto minimize to tray to ensure sync jobs keep on running. Right now, I go in, change stuff or look for a file and then when I hit the X it closes the whole app.
14:22
- File offloading / Cloudnas. If we could add a feature where files in a targeted folder will be checked for last modified etc and if it hasn't been modified in x days (whatever user specifies) it is removed from the local machine but still stays in the s3 bucket. Kinda how onedrive / wasabi cloud nas does it
Avatar
Avatar
definitelynotblackbeard
Gotcha. Yeah this is not on an enterprise level altough I work with large companies who might benefit from this app. I am gonna test it and if it works well I might recommend it to our project teams. We currently use Gladinet which works fine but your client(s) seem so much smoother etc. As for features and bugs, I like identifying possible new features and bugs especially if I like the app so if I can communicate them here that would be cool. Just started using this today but the things I have for now are: - When you close the desktop client, in windows, it should auto minimize to tray to ensure sync jobs keep on running. Right now, I go in, change stuff or look for a file and then when I hit the X it closes the whole app.
We've got that one internally, but created public roadmap item: https://s3drive.canny.io/feature-requests/p/desktop-app-minimize-to-tray-dont-close At the moment you can use tray icon and "Hide" option or simply minimize the app. It's a small item, but then the actual solution given our tech / cross-platform wasn't entirely easy we haven't implemented it straight away.
🤟 1
Avatar
Avatar
definitelynotblackbeard
- File offloading / Cloudnas. If we could add a feature where files in a targeted folder will be checked for last modified etc and if it hasn't been modified in x days (whatever user specifies) it is removed from the local machine but still stays in the s3 bucket. Kinda how onedrive / wasabi cloud nas does it
That's interesting. I've added an item: https://s3drive.canny.io/feature-requests/p/file-offloading-cloudnas-delete-idle-files-locally Do you have some additional docs about the behavior / use-cases?
jguzmansulb joined the server. 09/04/2023 2:31 PM
Avatar
Avatar
s3drive
That's interesting. I've added an item: https://s3drive.canny.io/feature-requests/p/file-offloading-cloudnas-delete-idle-files-locally Do you have some additional docs about the behavior / use-cases?
definitelynotblackbeard 09/04/2023 2:58 PM
Yeah this is a game changer. If wasabi wasn't so damn expensive with this tech it would be paid for already. This explains it well :https://www.siscloudservices.com/storage/content/our-services/data-center-on-cloud/wasabi/20230117-sis-wasabi-cloud-nas-data-sheet.pdf
14:59
It basically leaves behind a tiny little file that seems to be the actual file and when you try to access it, wasabi quickly downloads it from the bukcet to the location it is supposed to be in and then it works. But I mean even if you forego that feature, the automatic offloading of cold data is such a massive help
15:00
But with this cloudnas you can basically house like 8TB of storage on a 500GB drive .Which is what we are doing at some clients
Avatar
Avatar
definitelynotblackbeard
It basically leaves behind a tiny little file that seems to be the actual file and when you try to access it, wasabi quickly downloads it from the bukcet to the location it is supposed to be in and then it works. But I mean even if you forego that feature, the automatic offloading of cold data is such a massive help
Quick question. Do you install Wasabi Cloud NAS on the end computer or on a local server and then share this via network mount within the organisation?
Avatar
definitelynotblackbeard 09/04/2023 3:36 PM
So you can do both. But what we've done is install it on a file server. point it to a secondary drive, say G:. Then we share folders in that drive using SMB like normal. Wasabi obfuscates the offloading process using these stub files so from the consumers of the SMB shares, they know no difference but then on the file server, wasabi cloud nas offloads the cold storage. Lemme know if that answered the question lol
Avatar
Avatar
definitelynotblackbeard
So you can do both. But what we've done is install it on a file server. point it to a secondary drive, say G:. Then we share folders in that drive using SMB like normal. Wasabi obfuscates the offloading process using these stub files so from the consumers of the SMB shares, they know no difference but then on the file server, wasabi cloud nas offloads the cold storage. Lemme know if that answered the question lol
Got it. I am trying to understand what's possible what's not. We're currently running FUSE mount which basically gives you access to unlimited cloud NAS (S3 based). There is also VFS cache which could be tweaked to emulate "hot storage onloading", which would be the other way round from what you describe. The file that you've accessed recently would end up stored in a local cache, so next time when you access it, it's read from the local cache directly (no latency). The challenge with "cold storage offloading" is that this feature must be closely integrated with the native file system and since S3Drive is supposed to run on multiple OS's (and not all FS's would support this), that means we would have to make this feature e.g. Windows only or "move it away" (exactly the same way the Wasabi Cloud NAS does that) to separate software (probably would have to be Windows, due to NTFS support of https://learn.microsoft.com/en-us/windows-hardware/drivers/ifs/about-file-system-filter-drivers which I don't think it's possible on Linux and Mac) which would then have to be network mounted. The somewhat convoluted alternative would be to use FUSE mount as it is now, but providing custom cache implementation which would either read file from a local file system or cloud/S3 (depending on the availability). The S3Drive would also take care of cleaning up idle / cold data from the local FS based on some settings (e.g. 90 days). From a user point of view they would see hot files only in their local FS location and "all files" in the FUSE mounted location. They would have to be instructed to actually not use the local FS, but the FUSE mount instead. This would work on Windows, macOS and Linux. I am not sure how feasible is to share FUSE mount via SMB, I know that whilst technically possible, there are some challenges. Alternatively each user could work with their local FUSE mount, but any changes could be synced online via AMQ or other queue/notify mechanism) (edited)
Avatar
definitelynotblackbeard 09/04/2023 4:46 PM
Yeah not sure about the techincality on this implementation. As you said the cross platform is a major issue as it will see compatibility issues. So with the current sync options , might be able to create one that does the normal sync such as to rmeote etc, but then add some extra params such as if the file has not been touched in 90 days we will sync it up and remove it from the local FS. This is not as fancy as the wasabi bottomless NAS idea but atleast it will reclaim space on machines where file space is limited
Avatar
Avatar
definitelynotblackbeard
Yeah not sure about the techincality on this implementation. As you said the cross platform is a major issue as it will see compatibility issues. So with the current sync options , might be able to create one that does the normal sync such as to rmeote etc, but then add some extra params such as if the file has not been touched in 90 days we will sync it up and remove it from the local FS. This is not as fancy as the wasabi bottomless NAS idea but atleast it will reclaim space on machines where file space is limited
It's not as fancy as you say, but would be good start towards more advanced solutions and if SMB FUSE sharing works then from a user point of view they wouldn't see any difference, since the heavy lifting (in a slightly different way than Wasabi Cloud NAS) would be done by the S3Drive instance running on some Windows Server node. EDIT: It seems Rclone FUSE SMB sharing indeed works: https://forum.rclone.org/t/solved-is-it-possible-to-access-my-rclone-mount-as-a-samba-share/18335/6 (edited)
Avatar
Avatar
definitelynotblackbeard
Yeah not sure about the techincality on this implementation. As you said the cross platform is a major issue as it will see compatibility issues. So with the current sync options , might be able to create one that does the normal sync such as to rmeote etc, but then add some extra params such as if the file has not been touched in 90 days we will sync it up and remove it from the local FS. This is not as fancy as the wasabi bottomless NAS idea but atleast it will reclaim space on machines where file space is limited
I can also see that it's not even about: "last modified", but more about: "last accessed".
Avatar
Avatar
definitelynotblackbeard
Yeah not sure about the techincality on this implementation. As you said the cross platform is a major issue as it will see compatibility issues. So with the current sync options , might be able to create one that does the normal sync such as to rmeote etc, but then add some extra params such as if the file has not been touched in 90 days we will sync it up and remove it from the local FS. This is not as fancy as the wasabi bottomless NAS idea but atleast it will reclaim space on machines where file space is limited
When user adds a new file what should happen? Should it be automatically synced to Wasabi or should stay storred locally and only be synced to Wasabi when cold? (edited)
Avatar
definitelynotblackbeard 09/04/2023 5:37 PM
Wasabi you can adjust it but by default I think it should sync it to wasabi so a backup is made and then when it goes cold it should be offloaded from local storage to clear space
Avatar
@s3drive did you use go daddy or similar for setting up your website? i'm looking at a similar format / log in account / payment.
Avatar
Avatar
definitelynotblackbeard
Wasabi you can adjust it but by default I think it should sync it to wasabi so a backup is made and then when it goes cold it should be offloaded from local storage to clear space
Great, I've modified this card to reflect what we've discussed and what I've researched so far: https://s3drive.canny.io/feature-requests/p/file-offloading-cloud-nas-move-idle-files-to-cloud Can't give any exact ETA, but we will get to this.
Avatar
Avatar
buzz69.
@s3drive did you use go daddy or similar for setting up your website? i'm looking at a similar format / log in account / payment.
It's a NextJS based layout, payments and login use some ready libraries, but had to be heavily customized. I am not sure what GoDaddy offers, but if you have some "off-the-shelf" definitely go for it. (edited)
Avatar
Avatar
s3drive
It's a NextJS based layout, payments and login use some ready libraries, but had to be heavily customized. I am not sure what GoDaddy offers, but if you have some "off-the-shelf" definitely go for it. (edited)
great, thanks
17:52
i think there are quite a few, ready to go but its somewhat undefined what it can do.. i'll do more research!
pogox joined the server. 09/06/2023 10:36 AM
Avatar
@tom Hi Tom, do you have a png or similar of your logo we can link from our website? (edited)
maloboi joined the server. 09/09/2023 12:39 PM
Avatar
@tom I've got a Pro Standalone account on my profiles - is that backup going onto backblaze and i'm assuming it is limited to 10GB?
Avatar
Avatar
buzz69.
@tom I've got a Pro Standalone account on my profiles - is that backup going onto backblaze and i'm assuming it is limited to 10GB?
With Pro Standalone you can manage multiple profiles and configure them separately, but backup will work on currently selected one. There is a feature request to support multiple accounts operation: https://s3drive.canny.io/feature-requests/p/support-using-multiple-accounts-at-once As far I am concerned Backblaze offers free 10GB account: https://www.backblaze.com/cloud-storage/pricing They're in the middle of the pricing changes which if I understand will make the free account even better (more egress): https://www.backblaze.com/blog/2023-product-announcement/ You don't need Pro Standalone to use external Backblaze account or backup as such. You can also use free 10GB account that we manage. You don't need Pro Standalone to use the advanced features on account managed by us, we provide them together in one package. I hope this helps to understand our offering.
Avatar
ok to be honest I just signed up to support the project without thinking too much about the user case. I guess I can see why it would be useful to have multiple backup accounts on different providers for belt and braces security - ie your precious data backed up in more than one place. I would be interested in the use case that was originally intended for this feature?
gm1k. joined the server. 09/10/2023 8:52 PM
lucky_otter_54541 joined the server. 09/10/2023 10:03 PM
degenjef joined the server. 09/10/2023 10:06 PM
Avatar
hola
22:06
hey @buzz69.
22:07
@s3drive just upgraded and i think this app is very useful
sejjj joined the server. 09/10/2023 10:10 PM
Avatar
Avatar
sejjj
Click to see original message
Avatar
slow
Avatar
Good afternoon good folks
22:11
Hullo jefffj
22:11
I'm having issue with my albums showing under the media backup tab
22:11
Any tips?
22:11
22:13
But, they're their
22:13
There
Avatar
try making a support ticket? #support
Avatar
... there's 8 of us
Avatar
Plus I didn't see
Avatar
yeah i meant maybe someone will see it there and help
t_rott joined the server. 09/10/2023 10:23 PM
Avatar
Yo great proj
Avatar
Avatar
t_rott
Click to see original message
solidgord joined the server. 09/10/2023 10:40 PM
Avatar
Avatar
solidgord
Click to see original message
Avatar
Avatar
solidgord
Click to see original message
Sticker
Avatar
Howdy
jeffrey5166 joined the server. 09/11/2023 12:01 AM
Avatar
Avatar
solidgord
Click to see original message
Avatar
Avatar
jeffrey5166
Click to see original message
👍 1
Avatar
Avatar
t_rott
Click to see original message
Avatar
Avatar
sejjj
Click to see original message
Sticker
Avatar
Scprime boys blowing it up in here 😂
Avatar
it reads like @s3drive uses an S3 cloud storage platform for hosted S3Drive accounts
02:22
Prob should peek at XNS
02:28
I'm using S3Drive on my selfhosted relayer, works perfect
Avatar
Just set the fam up for iPhone backups. Using xns.tech for relayer with minio. Working perfect. 🤘
👍 1
Avatar
yeah same did you get the paid version
02:41
big spender
Avatar
tom's getting paid todsay
02:41
ha
Avatar
It’s priced very well
Avatar
yeah its great
02:42
sent like 7k photos from my phone. impressed how it wirked
Avatar
Yah getting there my self. House pipe slow upload. Need to go over to colo and warp speed 😂
Avatar
hi guys, glad you made it here, @degenjef already mentioned XNS to Tom 😎
👍 2
Avatar
Avatar
degenjef
sent like 7k photos from my phone. impressed how it wirked
yeah, really works well on xns.. and xns performs better than backblaze too
💪 1
Avatar
Backblaze is annoying.. Installed it for a comparison a while back
14:10
Too many pop ups
Avatar
Would be great to get XNS added to the list of officially supported clouds for S3Drive
Avatar
I second that
Avatar
Still uploading. Oofff lots of phone backups. 30GB so far and two more phones to go. 😂😎
Avatar
ya. I use S3Drive with XNS as well. backed up all me photos.
Avatar
nice
16:23
background proccesses will be nice but my 60GB will be done by then
Avatar
Hi, I believe you all come from another community that's around XNS, thanks for passing by!
Avatar
hey yeah we did! we are running XNS cloud relayers and using S3Drive with them
16:24
works really great
16:24
keeps the data backed up and very secure
16:25
and affordable
Avatar
I mean, as should any S3-compatible provider behave :p
Avatar
you'd hope so!
16:26
$7/tb, pay as you go, no expensive egress and all E2E encrypted
Avatar
are you from the XNS marketing department?
Avatar
im a licensed reseller 😉
16:27
and an angel investor
Avatar
ah, explains you want to spread the word
Avatar
we're speading your word too
16:28
telling our users to try S3Drive
Avatar
that's cool, however I'm afraid S3Drive is unable to promote any specific provider, we want to remain a pure S3 implementation and not recommend anything in particular
Avatar
i believe @buzz69. is writing up a tutorial
Avatar
tutorials are fine, however general conversations shouldn't diss any provider, and your affiliation should definitely be disclosed
Avatar
thats totally fair and im happy to disclose
liquidbread joined the server. 09/11/2023 4:32 PM
Avatar
Avatar
degenjef
$7/tb, pay as you go, no expensive egress and all E2E encrypted
please do whenever you send a message like that, most people here are users and not providers or affiliated to them, so we expect feedback to be from other standard users by default 😉
Avatar
liquidbread 09/11/2023 4:33 PM
Oh hai
16:33
haven't been green leaf in awhile
Avatar
thats fair. i was more speaking to you directly about those features tho
16:34
a bunch of us liked your app, and we saw you have a discord so we joined in
Avatar
yeah, no problem, I'm able to ask as well, I'm saying just in case since this community is slowly growing
👍 1
Avatar
but we'll be community minded
16:35
a cool idea might be letting users select roles based on their clouds? maybe giving app to cloud support if needed
just_mike2411 joined the server. 09/11/2023 4:37 PM
Avatar
Avatar
xenthys
that's cool, however I'm afraid S3Drive is unable to promote any specific provider, we want to remain a pure S3 implementation and not recommend anything in particular
so i when i installed I saw this message
16:40
Support for AWS S3, Backblaze, Wasabi, Scaleway, Storj, MinIO and any other S3 compatible provider. Sign-up for a free account, no credit card required.Aug 22, 2023 S3Drive: Cloud storage on the App Store - Apple
16:40
So thats what I meant would be cool to get XNS added to
16:41
less a promo, and more simply recognized
Avatar
I'll be honest, even Scaleway and Storj are a stretch so we should probably shorten this by only mentioning the major players that definitely don't need any recognition
16:45
You certainly know or can at least guess the challenges of publishing an app, where keywords matter and only what we believe will be searched will figure
Avatar
yeah ofc
16:47
i just saw that list of apps, esp including stroj (since XNS is distributed and blockchain) and wanted to ask about inclusion
16:47
but i think we're here to USE this app not just shill
Avatar
which is understadable, asking is always a good idea
Avatar
i paid for pro and a lots of these guys did or will too i think (edited)
16:47
so we're gonna use it lots
Avatar
I did too, I'm talking in the name of S3Drive for this specific matter but I'm not a developer myself
Avatar
i appreciate your honest convo too.
Avatar
Avatar
degenjef
i paid for pro and a lots of these guys did or will too i think (edited)
liquidbread 09/11/2023 4:48 PM
Yup, will most likely be using this within the week
Avatar
full disclosure, I worked a few years for Scaleway, I already left when I discovered S3Drive… and I believe it should be removed from the list doggokek
16:49
Storj's free tier was heavily reduced, so they're probably going to be removed too
Avatar
Avatar
xenthys
full disclosure, I worked a few years for Scaleway, I already left when I discovered S3Drive… and I believe it should be removed from the list doggokek
That's confirmed. We're removing Storj and Scaleway.
Avatar
hah
16:51
yeah i was asking to be added to a list if that list was growing, but if its being pared, then totally understand
16:52
sincere QQ - what do you charge for hosted cloud service?
16:52
(and i think i really misread that business model)
Avatar
As this grows I think a channel for wish list functionality would be good. I have a few items that I think would be good for the mobile app. I don’t want to clog gen pop up with them though.
Avatar
Avatar
degenjef
(and i think i really misread that business model)
nm thats on the main site lol
Avatar
Avatar
t_rott
As this grows I think a channel for wish list functionality would be good. I have a few items that I think would be good for the mobile app. I don’t want to clog gen pop up with them though.
Avatar
Ok thank you. Perfect.
16:55
Excited to see this move forward
Avatar
yeah bucket auto discovery would be great for self hosted
Avatar
as a self-hosted MinIO user, I'm not against it :p
16:56
especially for path-style URLs, where buckets behave more like root-level directories
Avatar
yeah, modern IAM gives admin privs to keys but setting up multiple profiles is a PITA
16:58
anyways, here for the growth!
Avatar
$S3D to the moon… wait
Avatar
lol
16:58
wen pancake swap SECRET_KEY
Avatar
aws s3 cp wallet.dat boket:/sekrit
Avatar
for real now, if you want to try this, I can hook you up with credits
17:00
just for knowledge
Avatar
maybe one day, but I don't have much free time to allocate for testing at the moment
Avatar
sure
17:01
im stuck at home on my weekened with covid so too much free time lol
Avatar
I have 12 TB (replicated) with my MinIO server, I paid like $700 for the hardware, it's way cheaper for me as a sysadmin to self-host
Avatar
yeah but whats your 3-2-1- backup solution ;P (edited)
17:03
duh (edited)
Avatar
4x4 TB in RAID 5 so 12 TB usable, the whole volume has a daily backup to cold storage priced at around 2€/TB/month, and that 12 TB volume is only a copy when I talk about important data
17:05
if I lose my memes, eh, I just have to scroll my DMs with friend lol
Avatar
haha yeah
17:07
we're def more SMB/Enterprise looking. Sincerly plan on suggesting your app to all my clients. I'm US based and talk a lot about data control. Getting their backups off Apple/Meta/ Etc
17:07
Phone app especially for these users
Avatar
Avatar
xenthys
4x4 TB in RAID 5 so 12 TB usable, the whole volume has a daily backup to cold storage priced at around 2€/TB/month, and that 12 TB volume is only a copy when I talk about important data
I know some that use Glacier Deep Archive, that's $0.00099 per GB. You don't really want to lose your data as if you add the restoration costs and bandwidth it gets pretty expensive... but well if you lose some data then you might well decide to drop it or suck the costs.
Avatar
yeah i saw a quote about two kinds of people. Those who havent lost data and those who backup properly
Avatar
For me it's worth it as long as I don't restore my data more than once a year… which is alright, if my NAS dies once a year I'm replacing it because it's definitely not a good one
Avatar
Avatar
degenjef
yeah i saw a quote about two kinds of people. Those who havent lost data and those who backup properly
see, that's where I'm smart and belong to the third kind: I lost someone else's data doggokek
17:11
in my defense, I was a kid and accidently dropped my mom's external hard drive
currypaul joined the server. 09/12/2023 3:49 PM
eelee joined the server. 09/12/2023 7:25 PM
Avatar
I wanted to try the system, but what was putting me off when i see a page that doesnt have any company address, name or identification in which country it operates. Many people would not trust with their data or skip it due to fear of scam. Friendly advice would be that you place transparent info about the team, where is the company based and where are the servers positioned.
Avatar
Avatar
eelee
I wanted to try the system, but what was putting me off when i see a page that doesnt have any company address, name or identification in which country it operates. Many people would not trust with their data or skip it due to fear of scam. Friendly advice would be that you place transparent info about the team, where is the company based and where are the servers positioned.
you can also use your own S3 buckets. S3Drive works really slick that way.
👍 1
Avatar
Avatar
eelee
I wanted to try the system, but what was putting me off when i see a page that doesnt have any company address, name or identification in which country it operates. Many people would not trust with their data or skip it due to fear of scam. Friendly advice would be that you place transparent info about the team, where is the company based and where are the servers positioned.
That's entirely fair point. You can find our current business address at the relevant places where you can get the software, that is App Store, Google Play and Microsoft Store. We're providing software (for you to use with your S3 account), but we're not providing the service just yet (except technical preview of free 10GB account). We're in the process of changing our operational model and switching the company type to something which is compatible with providing privacy friendly SaaS that's also responsible for keeping customers data safe. This is actually one of the things that's blocking us from providing paid managed account. We're working heavily on tech, but also exploring different laws and jurisdictions to make conscious decision compatible with what we do, but also where we live. Just to give you an idea, registering a business (limited company) + director service and virtual address takes couple hours to couple days, anyone could do that and present that on their website straight away. We're going little bit different route. You can expect more information about our new company, operational model etc. around Q2 2024. Stay tuned. (edited)
👍 5
xenthys pinned a message to this channel. 09/12/2023 9:02 PM
Avatar
Thanks for that great info Tom.
Avatar
ya good info
Avatar
@s3drive are you going to build your own data center?
Avatar
that requires a lot of money and people to take care of it, not the plan afaik
Avatar
Yeah I assumed!
22:23
So the plan is to resell?
Avatar
like the current trial is based on Backblaze, that seems to be the most sensible solution nowadays
Avatar
What if I could get you $4.99/tb pay as you go. No added fees?
22:28
Not trying to shill at all. Trying to work together on the same thing
22:30
That's not customer price. I'll talk to founder if you're interested in being a reseller
22:35
We give 2x free egress too
Avatar
Yay 3x free egress coming to B2 in October
Avatar
Large file downloads get stuck at processing for some reason
02:40
Shared links
Avatar
Avatar
zer0r00t
Yay 3x free egress coming to B2 in October
Avatar
we have free egress at home doggokek
Avatar
Avatar
degenjef
What if I could get you $4.99/tb pay as you go. No added fees?
I'll be honest with you. It's unlikely we would make any provider change at this stage. Our APIs / auth are already integrated closely and it's a cost/time/risk for us to make such change. We've been exploring this for quite a while and decided that we'll stick to reasonably priced, but reputable one. Before I worked for S3Drive, I've been using Backblaze as a dev for many years. Naturally I've suggested it for S3Drive. How much we pay for data is one thing... but the consequences when provider loses people's data is the other thing. Cheapest was iDrive (https://app.idrivee2.com/signup-reseller), comes out at $1.5/TB, can you beat it? We're not interested in being a reseller at all, however if you are interested to resell S3Drive under your brand and your storage we can handle this via Enterprise package (https://s3drive.app/pricing). We've got different tiers and billing modes (per user or percentage fee). If you're interested, please drop us an e-mail at: sales@s3drive.app, and include some details: Do you have an idea how S3 credentials would be managed? How users register on your website, is it e-mail/password or other forms of auth? Do you expect S3Drive to be integrated tightly with your auth system? Alternatively do you provide some means of credentials export (e.g. a formatted text, QR code, exported file etc.) that we could seamlessly import into S3Drive? How would you like to manage software releases and software updates? Do you have accounts on App Store / Google Play and are you comfortable managing them? We would then be able to come back to you and give you some rates. Thanks ! (edited)
10:25
The sorting is random for some reason
Avatar
Avatar
zer0r00t
The sorting is random for some reason
Is it Backblaze or some other provider?
Avatar
Backblaze
Avatar
Avatar
s3drive
I'll be honest with you. It's unlikely we would make any provider change at this stage. Our APIs / auth are already integrated closely and it's a cost/time/risk for us to make such change. We've been exploring this for quite a while and decided that we'll stick to reasonably priced, but reputable one. Before I worked for S3Drive, I've been using Backblaze as a dev for many years. Naturally I've suggested it for S3Drive. How much we pay for data is one thing... but the consequences when provider loses people's data is the other thing. Cheapest was iDrive (https://app.idrivee2.com/signup-reseller), comes out at $1.5/TB, can you beat it? We're not interested in being a reseller at all, however if you are interested to resell S3Drive under your brand and your storage we can handle this via Enterprise package (https://s3drive.app/pricing). We've got different tiers and billing modes (per user or percentage fee). If you're interested, please drop us an e-mail at: sales@s3drive.app, and include some details: Do you have an idea how S3 credentials would be managed? How users register on your website, is it e-mail/password or other forms of auth? Do you expect S3Drive to be integrated tightly with your auth system? Alternatively do you provide some means of credentials export (e.g. a formatted text, QR code, exported file etc.) that we could seamlessly import into S3Drive? How would you like to manage software releases and software updates? Do you have accounts on App Store / Google Play and are you comfortable managing them? We would then be able to come back to you and give you some rates. Thanks ! (edited)
thanks for all this, i saw your whitelabel offer and its def in the back of my mind. But i'm working mostly on SME and trying to leverage them off hypercloud. BUT i will be referring them to all use your app.
Avatar
Avatar
zer0r00t
The sorting is random for some reason
One question is it the order when you fetch the existing results from Backblaze or just after the upload? When you refresh, is it consistently "broken" or always random? (edited)
Avatar
Screenshot taken now. Uploaded yesterday
👍 1
20:03
Seems consistent
Avatar
Avatar
zer0r00t
Screenshot taken now. Uploaded yesterday
Thanks for reporting. There is indeed issue related to folders. We will have that addressed. Does issue apply to already uploaded files? In a previous screenshot you've posted some files, but can I assume it's just view straight after upload? Regardless, we'll try to fix the order of uploaded files as well.
Avatar
Avatar
s3drive
Thanks for reporting. There is indeed issue related to folders. We will have that addressed. Does issue apply to already uploaded files? In a previous screenshot you've posted some files, but can I assume it's just view straight after upload? Regardless, we'll try to fix the order of uploaded files as well.
I'd say around 5 mins after upload
21:09
Wait I'll open the same directory now
21:10
Yea same
21:11
Oh I do have to mention they were uploaded with rclone
Avatar
Avatar
zer0r00t
Oh I do have to mention they were uploaded with rclone
Ah, fair enough. As such we're not ordering results coming from S3. Since files with encrypted filename have original filepaths encrypted their order isn't actuall inline with the expected after decryption. This will have to wait until this gets implemented: https://s3drive.canny.io/feature-requests/p/implement-order-by-name-size-modified Thanks for the heads up, I wasn't aware of this myself.
Avatar
Avatar
zer0r00t
Screenshot taken now. Uploaded yesterday
The folder order will get fixed in a next release.
👍 1
Avatar
Avatar
zer0r00t
I'd say around 5 mins after upload
Improvements were released to Android, I would appreciate if you could check folder order (as well as Rclone uploaded file order), it should work now. Other platforms will receive this update over the next few days. If you have any more issues or would like to add a feature request please use #support, so we don't clutter up this channel.
brizio___ joined the server. 09/14/2023 12:53 PM
Avatar
Nice I'll try
brizio_54600 joined the server. 09/14/2023 4:32 PM
Avatar
Is there a process for Android updates? I don't see an update in the play store
Avatar
just log onto play store Jef, S3drive also provides prompt if you need to update..
cubityfirst joined the server. 09/15/2023 12:06 PM
Avatar
Welcome Cubity
snoo_Wave 1
jggcvghhhh joined the server. 09/17/2023 1:21 AM
emilia.a joined the server. 09/19/2023 4:30 PM
Avatar
Deal breaker is no background backup solution for the app. Meaning, you gotta stay in the app while the app does a backup of everything.
Avatar
I believe it is a work in progress
Avatar
Avatar
xenthys
I believe it is a work in progress
Any ETA?
Avatar
Only Tom would be able to answer, I can't guarantee anything at my level
paper5590 joined the server. 09/20/2023 1:50 AM
Avatar
Hey all! Just found this project by searching "rclone" on Mac's App Store, a very interesting surprise!
01:52
I'm interested to know how are photo thumbnails stored, is a thumbnail cache stored in S3? Or is it local only and therefore requires downloading all photos beforehand? (edited)
Avatar
Avatar
emilia.a
Deal breaker is no background backup solution for the app. Meaning, you gotta stay in the app while the app does a backup of everything.
It is high on our priorities list, however we've ran out of allocated time to implement it properly on both iOS/Android (very different approaches) and switched to other important features. We'll be revisiting this topic again. Realistically this is something we will address in Q1 2024, however there is a small we will have it ready before Christmas.
Avatar
Avatar
paper5590
Hey all! Just found this project by searching "rclone" on Mac's App Store, a very interesting surprise!
That's interesting. Search results positioning on App Store is always bit of a magic to me. BTW. We release S3Drive on Mac App Store with some delay, so if you want to be always up to date please use the signed AppImage: https://s3drive.app/desktop
Avatar
I’ll wait with buying enterprise for my company company then. (edited)
Avatar
Avatar
emilia.a
I’ll wait with buying enterprise for my company company then. (edited)
If you have any specific questions/needs regarding enterprise please drop us an e-mail leaving some info about your use case. It's an entirely different product with its own set of priorities.
Avatar
Avatar
paper5590
I'm interested to know how are photo thumbnails stored, is a thumbnail cache stored in S3? Or is it local only and therefore requires downloading all photos beforehand? (edited)
We load full file version and keep it in a local thumbnail cache. Yes it does require downloading all photos beforehand. In our legacy photo backup product, we've been generating thumbnails the moment when photos were backed up. We plan to implement this feature. Since S3Drive supports also existing file systems we would have to implement a process to generate thumbnails for existing resources, this would require fetching full image locally anyway (I mean we could offload to the back-end, but this would go against the E2E encrypted privacy model), so we haven't rushed this. (edited)
a_j_o_n joined the server. 09/20/2023 2:16 PM
Avatar
Avatar
a_j_o_n
Click to see original message
Sticker
👋 1
Avatar
fardinahmedshovon 09/21/2023 5:21 AM
when will auto backup system enable in s3 drive android app?
Avatar
Avatar
fardinahmedshovon
when will auto backup system enable in s3 drive android app?
What backup do you have in mind? Currently we can backup your albums as soon as you configure/select them. Backup needs app to be "open running" before we get to the background mode: https://s3drive.canny.io/feature-requests/p/background-media-backup
👍 1
oqitriad joined the server. 09/21/2023 12:47 PM
mizele joined the server. 09/21/2023 6:11 PM
Avatar
morethanevil 09/21/2023 6:43 PM
Made a post about this on Mastodon ☺
👍 1
Avatar
very nice!
Avatar
@s3drive I'm trying to update the app (MacOS), but it keeps telling me I have an outdated version. I downloaded the app through the website multiple times now, but still the same result
Avatar
Avatar
AD26
@s3drive I'm trying to update the app (MacOS), but it keeps telling me I have an outdated version. I downloaded the app through the website multiple times now, but still the same result
We've just updated macOS builds to the newest 1.5.3 - https://s3drive.app/changelog Please try now install newest DMG from our website. It should resolve your issues. What message did you get exactly from the app? Was it update more recent version available or perhaps that your version has expired? (edited)
pedro_52643 joined the server. 09/22/2023 7:49 PM
Avatar
Avatar
pedro_52643
Click to see original message
Sticker
Avatar
I really love your product!! That was definitely missing…. Simple, rclone, cross platform
👍 1
ruhascalin_ joined the server. 09/23/2023 5:17 PM
mondo_magic joined the server. 09/25/2023 10:27 AM
Avatar
Avatar
jggcvghhhh
I really love your product!! That was definitely missing…. Simple, rclone, cross platform
Thank you for these words. Please consider leaving us a review on App Store / Google Play and spread the words about the app. It really help us ! (edited)
👍 1
Avatar
mondo_magic 09/25/2023 4:07 PM
Why do I see the error "Bucket quota exceeded"?
Avatar
Avatar
mondo_magic
Why do I see the error "Bucket quota exceeded"?
Hi ! It's likely that you've exceeded the allocated storage. Bear in mind that by default all accounts have enabled versioning, so even if you delete file it counts towards quota until you do the hard delete or delete all file versions. Can you go to the left drawer and refresh the storage statistics?
Avatar
mondo_magic 09/25/2023 4:14 PM
I see 14.88 GB of 12 GB used 10.35 GB of current data 4.54 GB of versions
16:14
So the storage it's not unlimited?
16:16
Now I have deleted the trash and it's 11.16 GB of 12 GB used 10.35 GB of current data 836.14 MB of versions
Avatar
Avatar
mondo_magic
So the storage it's not unlimited?
Right, so you've managed to clean up things a little bit. Pardon my question, but where did you get this information that the storage is unlimited? (edited)
Avatar
Avatar
s3drive
Right, so you've managed to clean up things a little bit. Pardon my question, but where did you get this information that the storage is unlimited? (edited)
mondo_magic 09/25/2023 4:50 PM
I was searching on Google Play unlimited cloud storage and it gave me the result S3Drive app (edited)
Avatar
Avatar
mondo_magic
I was searching on Google Play unlimited cloud storage and it gave me the result S3Drive app (edited)
Fair enough, we don't offer unlimited storage and don't use that keyword anywhere, however using S3Drive you can connect to any S3 compatible back-end. This in principle gives you unlimited storage... but it doesn't necessarily imply free.
Avatar
Is rclone used behind the hood? Would it be easy to support Webdav in addition to S3? Just curious (edited)
Avatar
morethanevil 09/26/2023 1:36 PM
A small bug for importing all buckets from an endpoint: I already setup some buckets and they were imported again . Maybe the import should skip those buckets, which are already setup 🤔 Now I have duplicates, but I can easily remove them This is only a cosmetic bug
Avatar
Avatar
morethanevil
A small bug for importing all buckets from an endpoint: I already setup some buckets and they were imported again . Maybe the import should skip those buckets, which are already setup 🤔 Now I have duplicates, but I can easily remove them This is only a cosmetic bug
I assume that you've had the encryption keys set up for buckets that were duplicated? Currently new buckets are "merged in", but configuration item with encryption and without encryption key is treated separately. We should probably skip them, instead of creating duplicating entries. Going make a note.
Avatar
Avatar
paper5590
Is rclone used behind the hood? Would it be easy to support Webdav in addition to S3? Just curious (edited)
I am not sure what version are you using, but it's been added in 1.5.1 already: https://s3drive.app/changelog
Avatar
Avatar
s3drive
I am not sure what version are you using, but it's been added in 1.5.1 already: https://s3drive.app/changelog
Not Webdav server, webdav client
Avatar
Avatar
paper5590
Not Webdav server, webdav client
I see, well, for now we are fixated on S3, we have plans of supporting different back-ends though (https://s3drive.canny.io/feature-requests/p/add-support-for-google-drive-and-onedrive). There is some bigger internal work required to abstract S3 away. Once we have it done, we would then be able to implement any back-end relatively easy. Unfortunately that's not something we will be able to implement this year. Out of curiosity, do you mind sharing what's your use case? Where are you trying to connect?
Avatar
Avatar
s3drive
I see, well, for now we are fixated on S3, we have plans of supporting different back-ends though (https://s3drive.canny.io/feature-requests/p/add-support-for-google-drive-and-onedrive). There is some bigger internal work required to abstract S3 away. Once we have it done, we would then be able to implement any back-end relatively easy. Unfortunately that's not something we will be able to implement this year. Out of curiosity, do you mind sharing what's your use case? Where are you trying to connect?
Oh, it's just Hetzner Storage Share, not a big deal (not Storage Box, which I believe it's lower performance) (edited)
Avatar
Avatar
paper5590
Oh, it's just Hetzner Storage Share, not a big deal (not Storage Box, which I believe it's lower performance) (edited)
I am not aware of performance differences between these two, but probably the only supported way so far would be to set up CIFS mount to Storage Box (or the other one) and then expose it using S3 via MinIO, Garage, SeaweedFS or anything alike. (edited)
👍 1
Avatar
morethanevil 09/26/2023 5:58 PM
I used storageboxes before I switched to my own VPS with MinIO. The performance is awesome and the prices are very good, but limited functions.
Avatar
Avatar
s3drive
I assume that you've had the encryption keys set up for buckets that were duplicated? Currently new buckets are "merged in", but configuration item with encryption and without encryption key is treated separately. We should probably skip them, instead of creating duplicating entries. Going make a note.
morethanevil 09/26/2023 5:59 PM
Yes the ones with encryption were doubled.
mdavide joined the server. 09/28/2023 11:40 AM
Avatar
Avatar
mdavide
Click to see original message
micahflee joined the server. 09/30/2023 10:45 PM
Avatar
Hi @mdavide !
11:23
Hello @micahflee !
howyay joined the server. 10/03/2023 11:58 AM
barrrrtek joined the server. 10/05/2023 4:57 PM
Avatar
A feature request... I try to accomplish the following scenario: store data at home on my own SBC and rclone to my s3 account. Use s3drive to access the files from remote. This serves as a backup and easy possibility for remote access without opening my firewall (or use a VPN). I need read only, so this is fine that rclone only copies data in one direction. If I sync via rclone, the file (e.g. PDF) cannot be opened by s3drive app because the preview cannot be loaded (there is an error message). I assume that when files are handled via s3drive, the thumbnail is generated additionally - which does not happen with rclone obviously and opening the file fails in s3drive ("File preview not available") (edited)
Avatar
Avatar
jggcvghhhh
A feature request... I try to accomplish the following scenario: store data at home on my own SBC and rclone to my s3 account. Use s3drive to access the files from remote. This serves as a backup and easy possibility for remote access without opening my firewall (or use a VPN). I need read only, so this is fine that rclone only copies data in one direction. If I sync via rclone, the file (e.g. PDF) cannot be opened by s3drive app because the preview cannot be loaded (there is an error message). I assume that when files are handled via s3drive, the thumbnail is generated additionally - which does not happen with rclone obviously and opening the file fails in s3drive ("File preview not available") (edited)
Are you using Linux? This is the only platform where PDF preview isn't yet supported due to lack of unified renderer. I've added a roadmap item to track it: https://s3drive.canny.io/feature-requests/p/pdf-preview-support-on-linux
Avatar
Well, my SBC is Debian and using rclone 0.65. I try to open the PDF on iOS where it fails. My scenario (maybe clearer): stored data on linux SBC (raspberry) is sent via rclone to S3 and encrypted. Use iOS app to view the S3 bucket and try to open a synced PDF - and then the error message occurs in the iOS app and no file content is shown (edited)
Avatar
Avatar
jggcvghhhh
Well, my SBC is Debian and using rclone 0.65. I try to open the PDF on iOS where it fails. My scenario (maybe clearer): stored data on linux SBC (raspberry) is sent via rclone to S3 and encrypted. Use iOS app to view the S3 bucket and try to open a synced PDF - and then the error message occurs in the iOS app and no file content is shown (edited)
Can you please create an item at https://discord.com/channels/1069654792902815845/1102236355645419550 please? In principle there shouldn't be any issue with previewing a PDF on iOS. Perhaps there is an issue with the Rclone setup / decryption. https://docs.s3drive.app/advanced/#setup-with-rclone (edited)
Avatar
I will... (edited)
Avatar
Avatar
jggcvghhhh
I will... (edited)
In which case the issue is somewhere around caching with the app when file preview runs. I am going to pass that for devs to check. Thanks for letting me know ! (edited)
Avatar
Gm community
markpash joined the server. 10/07/2023 10:58 AM
tranquil_puppy_33809 joined the server. 10/10/2023 9:16 AM
strwb.moon joined the server. 10/11/2023 10:02 AM
Avatar
Hi people! I am not sure where I should ask this so sorry if I am mistaken but do you have plans to introduce a CLI app?
Avatar
Hi, you can ask here no worries, I have however don't have the answer so you'll have to wait for @s3drive to see it
Avatar
Avatar
strwb.moon
Hi people! I am not sure where I should ask this so sorry if I am mistaken but do you have plans to introduce a CLI app?
Hi there ! It's a matter of time. We plan to modify the current executable, so user can pass file path as an argument to upload: https://s3drive.canny.io/feature-requests/p/accept-file-as-path-argument This will likely grow over time with more and more options. What exactly would you like to achieve with a CLI? Bear in mind that since we're compatible with Rclone crypt you can achieve lots with an Rclone CLI: https://docs.s3drive.app/advanced/#setup-with-rclone
👍 1
gabrielebonini99 joined the server. 10/15/2023 3:45 PM
Avatar
Avatar
gabrielebonini99
Click to see original message
gabrielebonini99 10/15/2023 3:47 PM
Avatar
gabrielebonini99 10/15/2023 4:03 PM
Hello, is S3Drive going to replace PhotoSync for S3?
Avatar
Avatar
gabrielebonini99
Hello, is S3Drive going to replace PhotoSync for S3?
Hi, eventually yes, but no rush. We're solely focused on S3Drive for the past year or so. There are still couple features missing in S3Drive in order to reliably replace PhotoSync. Background upload features are still experimental in S3Drive and there is no function to check already uploaded assets. It will take us some time to deliver these features, before then PhotoSync can still be used. It has certain unique strenghts on Anrdroid that S3Drive doesn't yet. (edited)
Avatar
gabrielebonini99 10/15/2023 9:53 PM
Ok, thanks for the reply. Will there be the possibility to zoom photos on S3Drive?
Avatar
A feature request: faceID … currently, the app is not protected and the password is in plain text
Avatar
Avatar
jggcvghhhh
A feature request: faceID … currently, the app is not protected and the password is in plain text
👍 1
Avatar
Avatar
gabrielebonini99
Ok, thanks for the reply. Will there be the possibility to zoom photos on S3Drive?
Do you mean to zoom them during preview? If so, certainly we will have it added !
👍 1
Avatar
Just checking in, if I buy the subscription for S3Drive
12:15
and then it expires
12:16
Due to the fallback license, I'll be able to continue to use two way sync?
12:20
And when it says Self-hosted, does that just include the S3-compatible storage? Or is there a server component for S3Drive that I'm missing?
Avatar
Avatar
cubityfirst
Due to the fallback license, I'll be able to continue to use two way sync?
That's correct, once your subscription expires you will still be able to use all functions and features that were available at the moment that you've bought yearly subscription. You will get bugfixes and security updates and certain improvements, but some new paid functions (that were released after) may not be available to you until you buy a new license. (edited)
Avatar
Avatar
cubityfirst
And when it says Self-hosted, does that just include the S3-compatible storage? Or is there a server component for S3Drive that I'm missing?
In this case we're providing just the software / clients. It's at your discretion to self-host or alternatively buy S3 from someone (it means that we're not providing S3 storage). I think we're going to change this slogan, as it causes some confusion. (edited)
Avatar
cubityfirst 10/16/2023 3:40 PM
Yeah, it reads strangely.
ronco7120 joined the server. 10/17/2023 2:27 PM
Avatar
Avatar
ronco7120
Click to see original message
confident_rabbit_87075_49035 10/17/2023 5:46 PM
Avatar
Hi
zoftzoft joined the server. 10/20/2023 11:41 AM
Avatar
Hi @zoftzoft, welcome to S3Drive channel !
dorufin.gg joined the server. 10/20/2023 2:34 PM
rootdgc joined the server. 10/21/2023 7:18 AM
07:20
i already upgraded to pro, but after new version update I can't access all profiles, need help
Avatar
Avatar
rootdgc
Click to see original message
manu4529 joined the server. 10/21/2023 10:04 AM
Avatar
Avatar
rootdgc
i already upgraded to pro, but after new version update I can't access all profiles, need help
.rimdumdim joined the server. 10/22/2023 5:41 AM
ichigaya.9029 joined the server. 10/22/2023 2:52 PM
Avatar
Avatar
gabrielebonini99
Ok, thanks for the reply. Will there be the possibility to zoom photos on S3Drive?
Hi, this is to let you know that zooming photos will be included in a next release early next week !
👍 3
Avatar
gabrielebonini99 10/22/2023 6:07 PM
Ok, thank you 🙂
DamianPL joined the server. 10/23/2023 4:31 PM
simplewuji joined the server. 10/23/2023 4:53 PM
uplad joined the server. 10/25/2023 5:20 PM
saramcruiz_77863 joined the server. 10/26/2023 6:48 AM
krysius joined the server. 10/28/2023 10:53 AM
lorian9144 joined the server. 10/28/2023 6:17 PM
profrichd joined the server. 10/29/2023 9:14 PM
captivating_piglet_85648 joined the server. 10/30/2023 8:43 AM
Avatar
Avatar
captivating_piglet_85648
Click to see original message
captivating_piglet_85648 10/30/2023 8:49 AM
08:52
Good Morning everyone, perhaps it is just me, but I am currently not 100% sure about the licensing options. I would like to use S3drive with my own Minio storage and don't want to use the S3drive storage. If I would buy the lifetime license I would need to sign in and therefore would automaticly have the S3drive storage mounted right? How would the setup look like in my case without having my apps signed in? I want to use this strictly with my storage and it currently looks that the windows app offers all features without signing in?
Avatar
Avatar
captivating_piglet_85648
Click to see original message
Good morning, If you buy the lifetime license you'll be able to use all of the current and future features permanently (we'll be constantly updating this list - https://docs.s3drive.app/plans). Our current packages are designed to be used with 3rd party S3 endpoints, MinIO included. We're evolving and we may adjust our offer, licensing options or pricing in the future, but this wouldn't apply retroactively. That is, if you buy the Lifetime today, you simply keep these terms as it is unchanged. The main reason that you need to login to S3Drive using the registered e-mail/password is so that we can fetch the license and enable the Pro/Ultimate features in your app. That's true, that we currently include ~10GB testing account, it's optional though and included even in the free account. In the future we may sell the managed accounts as per our Roadmap: https://s3drive.canny.io/feature-requests/p/managed-plans-100gb-500gb-2tb however this something we still work on and won't happen this year. (edited)
Avatar
Avatar
captivating_piglet_85648
Good Morning everyone, perhaps it is just me, but I am currently not 100% sure about the licensing options. I would like to use S3drive with my own Minio storage and don't want to use the S3drive storage. If I would buy the lifetime license I would need to sign in and therefore would automaticly have the S3drive storage mounted right? How would the setup look like in my case without having my apps signed in? I want to use this strictly with my storage and it currently looks that the windows app offers all features without signing in?
Speaking of some features being available on Windows. What features you refer to specifically? It's true that some of them (e.g. two-way sync) are available for free currently, this is because they're during Beta phase, and as per our: https://s3drive.app/pricing we say that "Basic" account which is free gets the: "Beta features preview". ... also if you use our managed 10GB account (currently only for testing) then all of the features are naturally available (but only on this account - you can connect to your MinIO or other S3 endpoint by using the "Switch profile" option in the Settings menu or top right profiles icon). This actually allows you to play with the app little bit, before you decide to connect to your S3 endpoint. We'll make it all more clear (especially with the 10GB testing account), I can fully understand your confusion. (edited)
Avatar
Avatar
captivating_piglet_85648
Good Morning everyone, perhaps it is just me, but I am currently not 100% sure about the licensing options. I would like to use S3drive with my own Minio storage and don't want to use the S3drive storage. If I would buy the lifetime license I would need to sign in and therefore would automaticly have the S3drive storage mounted right? How would the setup look like in my case without having my apps signed in? I want to use this strictly with my storage and it currently looks that the windows app offers all features without signing in?
How would the setup look like in my case without having my apps signed in? I want to use this strictly with my storage and it currently looks that the windows app offers all features without signing in?
At the moment you need to be signed with your login/e-mail password, so we can fetch the license, but you can select any other S3 endpoint and use it, be it MinIO, AWS, Backblaze or anything. In the future we may actually introduce concept of an "offline" license, so logging to the S3Drive client with your e-mail/password wouldn't be necessary, but this doesn't come without drawbacks as well. Some anti-abuse mechanisms would have to be implemented, so we don't end up like Windows's FCKGW-RHQQ2... license. This would either mean that you would have to generate some activation key on our website from time to time and paste it to the app... or once you activate features in your app with some activation key you would have to deactivate it before you could use it on some other Window's client.
Avatar
captivating_piglet_85648 10/30/2023 9:27 AM
Thanks @s3drive got it. And I double posted the question on Discord as there was no confirmation message after I used the form on the website, so I was not sure that it has been sent.
09:28
I don't mind to be logged in with the client for the license 🙂
Avatar
Avatar
captivating_piglet_85648
Thanks @s3drive got it. And I double posted the question on Discord as there was no confirmation message after I used the form on the website, so I was not sure that it has been sent.
In principle that's how multiple profiles look like.
Avatar
Avatar
captivating_piglet_85648
Thanks @s3drive got it. And I double posted the question on Discord as there was no confirmation message after I used the form on the website, so I was not sure that it has been sent.
Thanks for letting me know about no confirmation message. We've "offloaded" that form to Formcarry and it seems there was some change on their end. We'll have it fixed. At least the message went through ! 🙂 (edited)
👍 2
Avatar
Requiring S3Drive to be online doesn't seem weird to me, I don't believe many people would use such an application offline, or rather in air-gaped environments. Allowing licensing servers in firewalls is quite common if you're on a restricted network, but even that should represent a minority. For mobile devices, they tend to be on BYOD networks or straight out over 4G/5G connections without any filtering. If you were offering a design software then sure, but for something that is connected by design it feels like a waste of time to me.
👍 2
Avatar
Hi there ! 👋 (edited)
borrk_ joined the server. 11/01/2023 12:22 PM
Avatar
Where can I find sync documentation? What is the difference between those options:
Avatar
Avatar
borrk_
Where can I find sync documentation? What is the difference between those options:
Hi, unfortunately there is no documentation yet as the development on this is still going. Please find excerpt from the code: tocloud, // Upload to remote, delete remotely if file was deleted locally tocloud_keepdeleted, // Won't remove file remotely if it was deleted locally tocloud_compat, // If file is removed remotely, local won't know that, it will be reuploaded on a next ocassion In principle: "To remote" will upload file to remote and delete it remotely if it was deleted locally. If file is deleted remotely it won't get re-uploaded again. "To remote (don't delete remotely)" - the same as "To remote", except it will keep file on the remote even if it was deleted locally. The above 2 options require bucket versioning support. The "compatibility mode" doesn't require versioning API, however that makes it not aware of any file changes in between, so it's simply blind one way copy instead of sync. I hope that helps little bit. We'll build documentation once we sort couple challenges related to E2E encryption with syncing, as depending how we manage to solve these problems it may influence the available options.
13:15
What's the ETA for syncing to/from android and background service for android? (edited)
13:19
and do we get transfer stats somewhere? I just set the tool to upload ~2k files (20GB total) and I'm curious whether this will be done in a few minutes, or in a few days.
Avatar
Avatar
borrk_
What's the ETA for syncing to/from android and background service for android? (edited)
There are significant improvements to Android background mode awaiting release (1.6.0) which will be deployed within a ~week. This will be part of: "Media backup" functionality. We will then be releasing the background mode on generic files/folders on Android combined with syncing modes, but there is no ETA just yet. We may release an MVP end of this year. There are no stats or aggregated info just yet... so far there is only "Transfers" tab with per file details, but nothing summarized as such. You may be able to get the required information from the Logs tab where you may find date and time when operations started and finished. (edited)
Avatar
Do you have debug logging? Now the tool is stuck processing single 86mb file and everything else is on waiting. The logs in GUI only say this:
18:51
Avatar
Avatar
borrk_
Do you have debug logging? Now the tool is stuck processing single 86mb file and everything else is on waiting. The logs in GUI only say this:
Is that one-way sync output? What platform? We know that sometimes upload queue gets stuck and timeout mechanism doesn't always reliably retry the process, but we haven't yet got to this.
Avatar
One way, Windows 10 to Backblaze.
Avatar
Avatar
borrk_
One way, Windows 10 to Backblaze.
Is this issue consistent on your end? In other words if you restart the app does it fail in a same way? Anyway, I am going to prioritise this issue internally.
drak4r joined the server. 11/02/2023 9:31 AM
umbragestudio joined the server. 11/02/2023 6:10 PM
Avatar
Avatar
s3drive
Is this issue consistent on your end? In other words if you restart the app does it fail in a same way? Anyway, I am going to prioritise this issue internally.
Sadly, it is. I already restarted a few times and it's same story (though I think on different files).
Avatar
umbragestudio 11/02/2023 10:41 PM
Hi there, question about usage. I'm using a tester account and I'm a bit confused. What is managed login? and how does it relate to the method of login where i connect with my access key and s3 endpoint etc? I guess it's showing up as two different profiles? Will a user be able to save a s3 bucket to a username and pw?
Avatar
Hi, managed user accounts are currently used for licensing and managed storage beta. They aren't mandatory and cannot be used to sync your app settings.
Avatar
umbragestudio 11/02/2023 11:34 PM
Can I still have a user and Pw login which is connected to my s3 buckets without having to enter access keys to access them everytime?
Avatar
Avatar
umbragestudio
Can I still have a user and Pw login which is connected to my s3 buckets without having to enter access keys to access them everytime?
If I understand you correctly, you're looking for a way to store and synchronize your S3 API credentials. It's pretty sensitive task and it's a job for a password manager, e.g. Bitwarden that we already support: https://s3drive.canny.io/feature-requests/p/password-autofill-support-for-bitwarden
Avatar
Avatar
s3drive
If I understand you correctly, you're looking for a way to store and synchronize your S3 API credentials. It's pretty sensitive task and it's a job for a password manager, e.g. Bitwarden that we already support: https://s3drive.canny.io/feature-requests/p/password-autofill-support-for-bitwarden
umbragestudio 11/03/2023 1:48 PM
Thanks Tom, I'll check that out. My use case is that Im looking to give s3 bucket access to several members of a startup team some of whom may not be technical at all. I would like them to be able to login easily with their own permissioned access key and be able to access some files periodically while in the field. I thought s3drive could be that interface for them since it is available on all platforms and mobile as well. I guess I am confused about the current intended use case scenario for the app, where the login vs access key login are completely different profiles. If you could, please help me understand
Avatar
Avatar
umbragestudio
Thanks Tom, I'll check that out. My use case is that Im looking to give s3 bucket access to several members of a startup team some of whom may not be technical at all. I would like them to be able to login easily with their own permissioned access key and be able to access some files periodically while in the field. I thought s3drive could be that interface for them since it is available on all platforms and mobile as well. I guess I am confused about the current intended use case scenario for the app, where the login vs access key login are completely different profiles. If you could, please help me understand
I know it may be little confusing, but that's because we support multiple platforms, use-cases and user bases. In principle, S3Drive connects directly to S3 endpoint (we call it profile) which is identified and authorized by the couple details (Key ID, secret, gateway, bucket name, region etc.). These details are something we don't manage, can't access nor store on our servers. Our software makes a connection to these details and it's up to the user to configure S3Drive so it knows where to connect. To the best extent we make some guesses (e.g. we allow user to select existing buckets) or we auto-detect region, but still at the very minimum Key ID, secret and S3 provider name/gateway would be required. Some of the app features are behind the paywall (that's how we can support development of S3Drive). On mobile you can buy such features through in-app purchase. Since there is no single unified payment mechanism for all platforms we've built one, so you can buy "all-platforms" package on our website. These are assigned to an e-mail/password account that we manage which is used by S3Drive to determine if you can use paid features (in the future account may be used by couple other features, e.g. online sync between devices, but let's not complicate it for now). Additionally when you login using e-mail/password managed by us, you can access test 10GB+ account to test the app's functionality. Behind the scenes it's S3 credentials, but we generate and supply them for you based on your e-mail/password. In the future we will be providing managed accounts (e.g. 100GB, 500GB, 2TB etc.), which will be expansion of our current model. We aim to remain 100% S3 compatible and allow user to connect to external S3 endpoint (they may buy it from some S3 cloud/provider or they even might host S3 on their own using MinIO, SeaweedFS, Garage, OpenStack Swift, Ceph etc.) I hope that helps you to understand how it works and why we support different account types. ... (edited)
Avatar
Avatar
umbragestudio
Thanks Tom, I'll check that out. My use case is that Im looking to give s3 bucket access to several members of a startup team some of whom may not be technical at all. I would like them to be able to login easily with their own permissioned access key and be able to access some files periodically while in the field. I thought s3drive could be that interface for them since it is available on all platforms and mobile as well. I guess I am confused about the current intended use case scenario for the app, where the login vs access key login are completely different profiles. If you could, please help me understand
... Since you want your coworkers securely login to the S3 endpoint there must be a way of passing the S3 details to the app. This can be an external mechanism, e.g. through password manager or app built-in mechanism (e.g. Single sign-on (SSO)), where user could provide their login/password (managed by some auth provider - where you can be an admin for instance). S3Drive would then contact that auth provider, authorize user and then request S3 credentials. I am happy to help you out on your use case. Do you mind sharing some info whether you have some auth system that's possible to connect to ... and where you get the S3 from? Does each user share bucket (and files as a result) with the other user? Is some private space/bucket required which shouldn't be by default accessible to other users? If you're not comfortable providing these details here, feel free to DM me. (edited)
Avatar
Avatar
s3drive
... Since you want your coworkers securely login to the S3 endpoint there must be a way of passing the S3 details to the app. This can be an external mechanism, e.g. through password manager or app built-in mechanism (e.g. Single sign-on (SSO)), where user could provide their login/password (managed by some auth provider - where you can be an admin for instance). S3Drive would then contact that auth provider, authorize user and then request S3 credentials. I am happy to help you out on your use case. Do you mind sharing some info whether you have some auth system that's possible to connect to ... and where you get the S3 from? Does each user share bucket (and files as a result) with the other user? Is some private space/bucket required which shouldn't be by default accessible to other users? If you're not comfortable providing these details here, feel free to DM me. (edited)
umbragestudio 11/03/2023 3:12 PM
Appreciate you taking the time! I am setting this up from scratch so there is no current system. Open to any solutions. The s3 will be wasabi or back blaze b2 with cloudflare to start with. Some bucket files will be shared with multiple users, some with only specific users and there is different levels of permission so some files are not accessible by default
15:14
It is mostly me setting up the buckets and file systems and making them available to be accessed for reference by the users. They will not usually be uploading or sharing but it could happen
Avatar
Avatar
umbragestudio
Appreciate you taking the time! I am setting this up from scratch so there is no current system. Open to any solutions. The s3 will be wasabi or back blaze b2 with cloudflare to start with. Some bucket files will be shared with multiple users, some with only specific users and there is different levels of permission so some files are not accessible by default
To not overcomplicate things from start, you could configure buckets, user API credentials and then restrict certain actions / locations using IAM (Wasabi does seem to support it) or simple restrictions that Backblaze offers - https://www.backblaze.com/docs/cloud-storage-application-keys (e.g. namePrefix) ... and then generate a JSON file, pass it to the user which could load it in-app using import feature. Not all details are required below, but this is to give you an idea that e.g. client-side encryption is also configurable. E.g. JSON: [ { "bucketName": "acme-internal-files", "keyId": "EVLJ2eXJukWUR9U17dyQqq6NPTi9mUu6scqpLCau", "applicationKey": "X9EiaepygvDK2S0fmMmFayehHoETDOphNP1r96PI", "endpoint": "https://s3.us-west-004.backblazeb2.com", "region": "us-west-004", "host": "s3.us-west-004.backblazeb2.com", "port": 443, "useSSL": true, "encryptionKey": "cG90YXRv", "rclonePlaintextKey": true, "filepathEncryptionEnabled": true, "rcloneDerivedKey": [ 116, 85, 199, 26, 177, 124, 134, 91, 132, ... ] } ] This may be a good start. We plan to implement QR code login, but the QR size limitation makes QR not a solution for all use cases. There are other means, e.g. QR code could transfer the "place holder ID" which would be then used to fetch the required details, but then again this setup would require more moving parts. We're very much open on this. (edited)
App keys control access to accounts and buckets.
Avatar
Avatar
umbragestudio
Appreciate you taking the time! I am setting this up from scratch so there is no current system. Open to any solutions. The s3 will be wasabi or back blaze b2 with cloudflare to start with. Some bucket files will be shared with multiple users, some with only specific users and there is different levels of permission so some files are not accessible by default
We've technical capabilities to integrate with any provider and we've built direct integration with Backblaze management API, however this is something we can currently offer through Enterprise package only: https://s3drive.app/pricing as it's not the off-the-shelf product which end user can easily install and then configure with couple clicks. (edited)
Avatar
Avatar
borrk_
Sadly, it is. I already restarted a few times and it's same story (though I think on different files).
We've dug down into this part of code and spotted couple issues and inefficiencies, expect improvements in this area in a next release within a ~week. In the meantime if you face any other challenges please let me know. Thanks !
Avatar
Avatar
s3drive
To not overcomplicate things from start, you could configure buckets, user API credentials and then restrict certain actions / locations using IAM (Wasabi does seem to support it) or simple restrictions that Backblaze offers - https://www.backblaze.com/docs/cloud-storage-application-keys (e.g. namePrefix) ... and then generate a JSON file, pass it to the user which could load it in-app using import feature. Not all details are required below, but this is to give you an idea that e.g. client-side encryption is also configurable. E.g. JSON: [ { "bucketName": "acme-internal-files", "keyId": "EVLJ2eXJukWUR9U17dyQqq6NPTi9mUu6scqpLCau", "applicationKey": "X9EiaepygvDK2S0fmMmFayehHoETDOphNP1r96PI", "endpoint": "https://s3.us-west-004.backblazeb2.com", "region": "us-west-004", "host": "s3.us-west-004.backblazeb2.com", "port": 443, "useSSL": true, "encryptionKey": "cG90YXRv", "rclonePlaintextKey": true, "filepathEncryptionEnabled": true, "rcloneDerivedKey": [ 116, 85, 199, 26, 177, 124, 134, 91, 132, ... ] } ] This may be a good start. We plan to implement QR code login, but the QR size limitation makes QR not a solution for all use cases. There are other means, e.g. QR code could transfer the "place holder ID" which would be then used to fetch the required details, but then again this setup would require more moving parts. We're very much open on this. (edited)
umbragestudio 11/04/2023 5:32 PM
Thanks Tom, I tested the json solution and it seem to be a simple solution. I think we will go ahead with this and see how it works
Avatar
Avatar
umbragestudio
Thanks Tom, I tested the json solution and it seem to be a simple solution. I think we will go ahead with this and see how it works
Cool, if you have some thoughts about that I am more than happy to hear it out. In principle import functionality was designed to supplement current export functionality and the format isn't the most optimal if the JSON is to be built outside of the app. For instance there is a repetition: host / gateway, or if you want to set the encryption key, both encryptionKey and generated: rcloneDerivedKey must be provided. If there is a need we could certainly simplify the format, so things gets smartly derived if not present. (edited)
Avatar
Avatar
s3drive
Cool, if you have some thoughts about that I am more than happy to hear it out. In principle import functionality was designed to supplement current export functionality and the format isn't the most optimal if the JSON is to be built outside of the app. For instance there is a repetition: host / gateway, or if you want to set the encryption key, both encryptionKey and generated: rcloneDerivedKey must be provided. If there is a need we could certainly simplify the format, so things gets smartly derived if not present. (edited)
umbragestudio 11/06/2023 6:35 PM
so right now the best way to do this is to generate the json by exporting from the app and send it out to be imported? It certainly could be easier to build them outside of the app. If encrypting the files, what would you recommend using to decrypt the files? There will be non-technical people handling this so I'm not sure adding another app will be easier
Avatar
Avatar
umbragestudio
so right now the best way to do this is to generate the json by exporting from the app and send it out to be imported? It certainly could be easier to build them outside of the app. If encrypting the files, what would you recommend using to decrypt the files? There will be non-technical people handling this so I'm not sure adding another app will be easier
Hi @umbragestudio, If you don't need encryption to be enabled by default, generating JSON by hand is rather easy. If you need encryption, then you can either instruct your users to set up some password (possible preshared if you want data from all users to be readable with a single key) after they import profile or please wait ~two weeks (we're busy at the moment with transfer tab fixes and iOS background uploads) and we will be able to improve the JSON, so only encryptionKey field is required to setup the encryption. Speaking of decryption, it's an open format. Naturally you can use S3Drive (on any platform) to access encrypted data (you'll need to access bucket with data and setup E2E with the same password that was initially used for encryption). You can also mount data using as network drive (that's possible from S3Drive after clicking on tray icon). Alternatively you can access data using rclone command, as we're 1:1 compatible with their encryption: https://rclone.org/crypt/#file-encryption In that case please visit our docs to understand how you can set up rclone command: https://docs.s3drive.app/advanced/#setup-with-rclone Then you would be able to use commands like copy: https://rclone.org/commands/rclone_copy/ or sync: https://rclone.org/commands/rclone_sync/ or couple others depending on your needs. There are couple options out there. (edited)
r1ant joined the server. 11/07/2023 9:08 AM
Avatar
Hi, is this normal?
Avatar
Avatar
r1ant
Hi, is this normal?
Having a result of 2/68 is normal yes, there's always a few false positives due to the software being able to do "dangerous" things such as encrypt and transfer files, which is something done by ransomware for example.
👍 3
10:42
That detection in your screenshot is based on machine learning, not known signatures, so this is a model that says "hmm, I'm having low suspicions this could be problematic software" and that's all. They can analyze features but not intent, that's their main issue.
Avatar
Avatar
r1ant
Hi, is this normal?
Alternatively you can use Microsoft verified binaries: https://docs.s3drive.app/install/#microsoft-apps Most people prefer .exe, however some prefer certain guarantees of Microsoft Store
lord_haliax. joined the server. 11/08/2023 6:53 AM
ner.u joined the server. 11/08/2023 4:22 PM
lore_90852 joined the server. 11/09/2023 3:45 PM
ouhznai joined the server. 11/10/2023 1:03 AM
dan_16543 joined the server. 11/11/2023 12:31 AM
Avatar
Quite a lot of newcomers, welcome all!
dvijuha joined the server. 11/13/2023 9:21 AM
barfittc joined the server. 11/13/2023 5:07 PM
nerdmuch joined the server. 11/14/2023 1:23 PM
hugh198_99550 joined the server. 11/15/2023 12:10 AM
enthiran_3.0 joined the server. 11/15/2023 12:55 AM
hugh1988 joined the server. 11/15/2023 2:43 AM
abrahamicworks joined the server. 11/16/2023 10:04 PM
Avatar
Avatar
umbragestudio
Thanks Tom, I tested the json solution and it seem to be a simple solution. I think we will go ahead with this and see how it works
Hi @umbragestudio, I've wanted to let you know that we've improved and simplified JSON import in our today's release. You can use this example minimal version: [ { "bucketName": "bucket-photos", "keyId": "keyId", "applicationKey": "applicationKey", "endpoint": "https://s3.pl-waw.scw.cloud", "encryptionKey": "cG90YXRv" } ] This would configure all necessary things and enable encryption with password: potato, the encryptionKey is base64 encoded plaintext password. (edited)
funtrade joined the server. 11/21/2023 4:16 AM
Avatar
Avatar
hugh198_99550
Click to see original message
22:20
hi, wondering if there any way to log in via web app and not have to put s3 credentials in each time? any way to have s3Drive remember them? thanks
Avatar
Avatar
hugh1988
hi, wondering if there any way to log in via web app and not have to put s3 credentials in each time? any way to have s3Drive remember them? thanks
Hi ! Configured buckets once setup should persist as they're stored in browser storage. Isn't it the case for you? Do you talk about managed credentials (login/password) or external S3 that you use? Once you setup your buckets you can then export them to JSON and have them re-imported on Web or other device. Alternatively you can create such JSON file by hand according to this format: https://docs.s3drive.app/setup/import/
Avatar
Avatar
s3drive
Hi @umbragestudio, I've wanted to let you know that we've improved and simplified JSON import in our today's release. You can use this example minimal version: [ { "bucketName": "bucket-photos", "keyId": "keyId", "applicationKey": "applicationKey", "endpoint": "https://s3.pl-waw.scw.cloud", "encryptionKey": "cG90YXRv" } ] This would configure all necessary things and enable encryption with password: potato, the encryptionKey is base64 encoded plaintext password. (edited)
umbragestudio 11/21/2023 11:54 PM
Thanks Tom, I'll try it out and see how it works!
Avatar
Avatar
s3drive
Hi ! Configured buckets once setup should persist as they're stored in browser storage. Isn't it the case for you? Do you talk about managed credentials (login/password) or external S3 that you use? Once you setup your buckets you can then export them to JSON and have them re-imported on Web or other device. Alternatively you can create such JSON file by hand according to this format: https://docs.s3drive.app/setup/import/
Hi tom, no it doesn't remember. I sign out and then sign back in and it only has my managed account with no s3 bucket attached.
arkeror joined the server. 11/23/2023 4:28 AM
zen_lynx_34763 joined the server. 11/23/2023 11:06 AM
manu4529 joined the server. 11/23/2023 10:05 PM
jskaall joined the server. 11/26/2023 3:24 PM
splat__ joined the server. 11/27/2023 9:59 PM
mr0v0 joined the server. 11/28/2023 7:42 AM
Avatar
Easy-to-use client that converts any S3 server into your personal encrypted file storage. Rclone compatible, mount as drive, WebDav server, file versioning.
Avatar
Hi there, do you have any question regarding our desktop clients?
farmer.jo joined the server. 11/29/2023 4:18 AM
Avatar
jeannesbond 11/29/2023 1:19 PM
hi, when i click upload files, the app always loading like this
Avatar
Hi @jeannesbond, can I ask you what's your platform and S3Drive version?
Avatar
Avatar
s3drive
Hi @jeannesbond, can I ask you what's your platform and S3Drive version?
jeannesbond 11/29/2023 1:22 PM
I'm using Xubuntu and S3Drive 1.6.4
Avatar
Avatar
jeannesbond
I'm using Xubuntu and S3Drive 1.6.4
Thanks. Would that be .deb, .AppImage or Flathub release?
Avatar
Avatar
s3drive
Thanks. Would that be .deb, .AppImage or Flathub release?
jeannesbond 11/29/2023 1:23 PM
.AppImage
Avatar
Avatar
jeannesbond
.AppImage
That's interesting. Can I ask you to check if there is anything useful in Logs?
Avatar
Avatar
s3drive
That's interesting. Can I ask you to check if there is anything useful in Logs?
jeannesbond 11/29/2023 1:28 PM
no Logs menu?
Avatar
Avatar
jeannesbond
no Logs menu?
It's inside the "About" section.
Avatar
Avatar
s3drive
It's inside the "About" section.
jeannesbond 11/29/2023 1:29 PM
Avatar
Avatar
jeannesbond
Click to see attachment 🖼️
Right, nothing useful there. How about: "Upload folder" options, does it work for you? What's your Xubuntu version? Just wondering what's the major difference between e.g. Ubuntu. Currently running the .AppImage release on 23.04 and Upload files seem to be working just fine.
Avatar
Avatar
s3drive
Right, nothing useful there. How about: "Upload folder" options, does it work for you? What's your Xubuntu version? Just wondering what's the major difference between e.g. Ubuntu. Currently running the .AppImage release on 23.04 and Upload files seem to be working just fine.
jeannesbond 11/29/2023 1:34 PM
nothing happened when Upload Folder clicked. I'm using Xubuntu 23.10
Avatar
Avatar
jeannesbond
nothing happened when Upload Folder clicked. I'm using Xubuntu 23.10
It's likely related to different "file chooser" implementation on Xubuntu/Xfce, we're using library which apparently supports only: zenity, qarma and kdialog. https://github.com/miguelpruivo/flutter_file_picker/issues/1282#issuecomment-1551924613 I will add this item to our internal items and try to play around in Xubuntu. In the meantime would you be happy to try out the Flathub version? https://flathub.org/en-GB/apps/io.kapsa.drive (Please note that it awaits 1.6.4 release which will be likely available later today or tomorrow). (edited)
Avatar
Avatar
jeannesbond
nothing happened when Upload Folder clicked. I'm using Xubuntu 23.10
Alternatively can you try installing either: zenity or kdialog on your OS and see if it solves the issue? It it does we will add it as a dependency to .AppImage. https://forum.juce.com/t/native-filechooser-not-used-on-linux-xfce/26347
Some users of my application have reported a problem: the native FileChooser on Linux, using XFCE desktop, never shows. Instead, the JUCE one shows. I of course make sure that I set the “useOSNativeDialogBox” to true when instantiating the FileChooser. On any other system I tested (Windows, Mac, Linux (Ubuntu/Mint), this works fine though, so ...
Avatar
Avatar
s3drive
Alternatively can you try installing either: zenity or kdialog on your OS and see if it solves the issue? It it does we will add it as a dependency to .AppImage. https://forum.juce.com/t/native-filechooser-not-used-on-linux-xfce/26347
jeannesbond 11/29/2023 1:48 PM
i'm install zenity and now can upload folder
Avatar
Avatar
jeannesbond
i'm install zenity and now can upload folder
That's good news. I assume you can also: "Upload files"? I am going to include zenity in our releases.
Avatar
Avatar
s3drive
That's good news. I assume you can also: "Upload files"? I am going to include zenity in our releases.
jeannesbond 11/29/2023 1:51 PM
yes can Upload Files too
Avatar
Avatar
jeannesbond
yes can Upload Files too
Perfect, thank you for taking time to report this !
Avatar
Avatar
s3drive
That's good news. I assume you can also: "Upload files"? I am going to include zenity in our releases.
jeannesbond 11/29/2023 1:52 PM
thank you so much for your help🙏
ravalash joined the server. 11/30/2023 5:44 PM
laure_79992 joined the server. 12/02/2023 12:54 PM
._mg. joined the server. 12/03/2023 6:34 PM
athrune joined the server. 12/03/2023 7:52 PM
Avatar
When I first put the S3 in S3Drive and it was successful, I saw the contents of my S3 (I only opened the folder) but why does my internet feel like it's downloading/uploading?
06:18
Even though all I did was open the folder and didn't open the file or download/upload anything
Avatar
I opened S3Drive, the internet immediately changed to like it was downloading/uploading
07:04
I closed S3Drive, the internet returned to normal, so I didn't dare open S3Drive because it would suck up my internet
07:05
I deleted the data + reinstalled then put my s3 data into s3drive again, it still didn't work the internet remains in the download/upload position
Avatar
The problem is like this
09:53
I don't do any file transfers but my internet network does things like downloading/uploading
Avatar
Hi @ner.u, Thank you for you report. I would bet that it tries to generate an image thumbnails which unfortunately require whole file to be downloaded internally. Once thumbnail generation started, then even if you change the folder which doesn't contain images, the generation is still going in the background until it's done and the cache is built. Can you perhaps try disabling Image thumbnails in the settings and see if it helps? It's a tough problem (thumbnails) to solve with things like S3, because in order to generate an image thumbnail whole file must be downloaded. We could in theory offload your mobile/data plan and generate thumbnail on our servers, but that would break the E2E encryption model where by definition the unencrypted content isn't supposed to go outside your phone. We also generate video thumbnails, but that is surprisingly less intensive, because we can decode only first frames of a video in order to obtain an image, which weighs usually way less than a high quality picture. Please let me know if disabling image thumbnails helped to mitigate this issue. We could also implement a switch, e.g. load thumbnails only on Wifi or similar.
Avatar
Avatar
s3drive
Hi @ner.u, Thank you for you report. I would bet that it tries to generate an image thumbnails which unfortunately require whole file to be downloaded internally. Once thumbnail generation started, then even if you change the folder which doesn't contain images, the generation is still going in the background until it's done and the cache is built. Can you perhaps try disabling Image thumbnails in the settings and see if it helps? It's a tough problem (thumbnails) to solve with things like S3, because in order to generate an image thumbnail whole file must be downloaded. We could in theory offload your mobile/data plan and generate thumbnail on our servers, but that would break the E2E encryption model where by definition the unencrypted content isn't supposed to go outside your phone. We also generate video thumbnails, but that is surprisingly less intensive, because we can decode only first frames of a video in order to obtain an image, which weighs usually way less than a high quality picture. Please let me know if disabling image thumbnails helped to mitigate this issue. We could also implement a switch, e.g. load thumbnails only on Wifi or similar.
I did that by turning off 'Show image/video thumbnails' and I didn't have any problems with my network anymore.. Thank you for helping resolve sir
👍 1
Avatar
Avatar
ner.u
I did that by turning off 'Show image/video thumbnails' and I didn't have any problems with my network anymore.. Thank you for helping resolve sir
Glad I could help !
backwards152 joined the server. 12/04/2023 8:46 PM
drannex joined the server. 12/04/2023 9:42 PM
Avatar
Avatar
s3drive
Hi @ner.u, Thank you for you report. I would bet that it tries to generate an image thumbnails which unfortunately require whole file to be downloaded internally. Once thumbnail generation started, then even if you change the folder which doesn't contain images, the generation is still going in the background until it's done and the cache is built. Can you perhaps try disabling Image thumbnails in the settings and see if it helps? It's a tough problem (thumbnails) to solve with things like S3, because in order to generate an image thumbnail whole file must be downloaded. We could in theory offload your mobile/data plan and generate thumbnail on our servers, but that would break the E2E encryption model where by definition the unencrypted content isn't supposed to go outside your phone. We also generate video thumbnails, but that is surprisingly less intensive, because we can decode only first frames of a video in order to obtain an image, which weighs usually way less than a high quality picture. Please let me know if disabling image thumbnails helped to mitigate this issue. We could also implement a switch, e.g. load thumbnails only on Wifi or similar.
Have you considered creating your own version of thumbs.db that windows used to use? that way a thumbnail that has already been autogenerated (on first load/upload) can be used? It wouldn't work (could, if offloaded into the windows/apple cache location) on mounted drives, but would inside the app/other views. (edited)
21:45
Also, currently on the website if you attempt to sign up for a plan, this is all that you see. This is in the latest Firefox on Windows, with uBlock + Tracking protection turned off.
21:46
21:47
console log of the data payload { "url": "/api/create-checkout-session", "data": { "price": { "id": "price_1NyfLNEv31gUd4RDtzV41wix", "interval": "year", "currency": "EUR", "unit_amount": 0 } }, "res": {} } (edited)
alexmanea. joined the server. 12/04/2023 10:55 PM
Avatar
Avatar
drannex
Have you considered creating your own version of thumbs.db that windows used to use? that way a thumbnail that has already been autogenerated (on first load/upload) can be used? It wouldn't work (could, if offloaded into the windows/apple cache location) on mounted drives, but would inside the app/other views. (edited)
Thanks for your suggestion. We've got a pretty loose item in our Roadmap: https://s3drive.canny.io/feature-requests/p/generate-thumbnails Yes we plan to implement thumbnail generation and store it in one location, so other S3Drive instances (and if possible other viewers e.g. native OS file explorer) could utilize it. If the OS caches are available to integrate with without too much hacking then you can expect we'll have it implemented over the next couple months.
Once generated and stored, this would speed up thumbnail loading times on different devices, reduce stutter and reduce bandwidth usage dramatically.
Avatar
Avatar
drannex
Also, currently on the website if you attempt to sign up for a plan, this is all that you see. This is in the latest Firefox on Windows, with uBlock + Tracking protection turned off.
Thanks, this is now resolved, sorry for the trouble.
foxtrotsierra joined the server. 12/05/2023 6:05 PM
jrd0701 joined the server. 12/06/2023 4:20 AM
Avatar
hey just paid for a ultimate account and its telling me i have a testing account
Avatar
Avatar
jrd0701
hey just paid for a ultimate account and its telling me i have a testing account
Hi @jrd0701, thank you for supporting the project. Testing account dialog is displayed once you "click into" the e-mail/password credentials regardless of whether you have Business, Ultimate, Pro or free account. There is a ~10-12GB account allocated, so user can test the app without need of connecting to external S3 provider. In order to set up new buckets please click the top right icon, you will then end up on Profiles page, from which you shall be able to add (or you can import via JSON - https://docs.s3drive.app/setup/import/ ) more buckets. In both Profiles page and drawer menu (as per attached screenshots) you shall be able to see your current plan name, e.g. Ultimate. If your license wouldn't work you would receive a yellow prompt as on the attached screenshot, if this is not what you're getting things shall be working just fine. Please let me know if this helps to resolve your issue. Thanks ! (edited)
Zero Knowledge E2E encrypted storage compatible with any S3 provider
Avatar
did this previously and was getting drive mount requires pro error when trying to mount drive, just followed your steps again and still getting same error
Avatar
Avatar
jrd0701
did this previously and was getting drive mount requires pro error when trying to mount drive, just followed your steps again and still getting same error
Ok clearly this isn't how it's supposed to work. Let me check couple things. I will get back to you promptly. (edited)
👍 1
Avatar
Avatar
jrd0701
did this previously and was getting drive mount requires pro error when trying to mount drive, just followed your steps again and still getting same error
In fact we've had an issue related to Business license which is now resolved. You shouldn't need to logout/login, but if you could visit Profiles page first (once again) and then try to set up the drive mount. (edited)
Avatar
Avatar
s3drive
In fact we've had an issue related to Business license which is now resolved. You shouldn't need to logout/login, but if you could visit Profiles page first (once again) and then try to set up the drive mount. (edited)
it appears to be working now, is there any way to automate the profile import ?, we are looking to deploy this for a client who needs to centralise there storage for off shore graphics designer team they have.
Avatar
Avatar
jrd0701
it appears to be working now, is there any way to automate the profile import ?, we are looking to deploy this for a client who needs to centralise there storage for off shore graphics designer team they have.
That's great, thanks for letting me know. In our standard version we have the JSON import: https://docs.s3drive.app/setup/import/#unencrypted-bucket We plan to come up with a workflow where end user could provide e.g. HTTPS address of SAML / OIDC SSO provider which could then in return reply the necessary S3 credentials for app to pick up and log user in. Once its built I am not sure if it's going to end in our public release, it might end up in our Enterprise version anyway. What would be your preferred approach for credentials management? (edited)
Avatar
not to sure JSON import and having to install winfsp makes it a manual process and hard to change the bucket access key if a staff member leaves.
Avatar
Avatar
jrd0701
not to sure JSON import and having to install winfsp makes it a manual process and hard to change the bucket access key if a staff member leaves.
We'll be improving in these areas. Rclone will be bundled with the app. Speaking of WinFSP, we shall be able to automate it little bit, at best detect and install it on the OS if it doesn't exist... at worst display clear dialog prompting user to click on and install software.
Avatar
Avatar
jrd0701
not to sure JSON import and having to install winfsp makes it a manual process and hard to change the bucket access key if a staff member leaves.
Speaking of credentials import, we need to spend some time to think about the options. Certainly some party needs to take this integration burden on them. We've modules to integrate with MinIO and Backblaze, but it's not really much given that every S3 provider has different API for managing credentials... so we've thought we'll kick start this by providing minimialistic generic API for credentials exchange, so our clients could implement it (and automate to some degree) themselves. There will be time in the future to further expand in this area, but our current priorities are elsewhere.
heavenly_kiwi_23017 joined the server. 12/06/2023 8:38 PM
Avatar
Upgraded myself from Pro Yearly to Ultimate Lifetime on the website then cancelled my Pro Yearly on Stripe, I hope this won't cause issues on your or Stripe's end. I also believe an automated cancellation is expected when you get another license, would I have been billed if I didn't check Stripe after upgrading?
Avatar
Avatar
xenthys
Upgraded myself from Pro Yearly to Ultimate Lifetime on the website then cancelled my Pro Yearly on Stripe, I hope this won't cause issues on your or Stripe's end. I also believe an automated cancellation is expected when you get another license, would I have been billed if I didn't check Stripe after upgrading?
Thank you for upgrading it really means a lot and helps us to deliver quicker on our: https://s3drive.app/roadmap Since our Stripe integration isn't currently aware of the upgrade, with our current implementation you would've been billed again. We'll be automating this process, in the meantime we're handling upgrades/refunds manually. Given that you obtain two valid licenses now, one perpetual fallback Pro (we've discontinued "perpetual fallback" model, but existing licences are valid forever - https://s3drive.app/faq?q=perpetual) and second one Ultimate, do you want me to cancel and refund (prorate'd) the Pro or perhaps you want to reassign it to a different account?
Avatar
I don't want a refund that's for sure, but I don't need the license either since I have a better one now. How about a giveaway here?
11:09
The giveaway doesn't need to be a discontinued perpetual fallback license either, it could be a standard 6-months Pro license for example.
11:12
In conclusion, feel free to do as you please as I don't really mind. I haven't used the app for some time and just got the Ultimate Lifetime license to support you.
❤️ 1
Avatar
morethanevil 12/07/2023 12:22 PM
Any ways to make a onetime donation for supporting? I buyed the Android version and it fits my need
Avatar
Avatar
morethanevil
Any ways to make a onetime donation for supporting? I buyed the Android version and it fits my need
I am really happy to hear that. I really do appreciate your donation offer, but I think the best support that we can get at this stage is to spread the love and information about S3Drive, leave us a review, or leave comment/recommendation on Reddit or other social media platform. We'll be soon needing help with the translations if that's something you would be interested in. If you ever need to upgrade your Android license to all devices (Ultimate Lifetime license): https://s3drive.app/pricing please do let me know ! (edited)
Avatar
morethanevil 12/07/2023 12:37 PM
And how about a pro license for one year as a giveaway? 🤔
12:37
People can try it out this way
12:38
You are the only one providing a working flatpak for S3 😁
🐧 1
Avatar
I don't think S3Drive is mature enough to host giveaways, raising money is something but adding burden isn't worth it for now in my opinion.
Avatar
Picked up an Ultimate Lifetime license aswell, I look forward to seeing where this goes c:
Avatar
cubityfirst 12/10/2023 1:09 PM
I'm not sure if I'm just blind or something
13:10
but I can't find where to activate the license in the app lol
heavenly_sparrow_07956 joined the server. 12/10/2023 1:35 PM
Avatar
Avatar
cubityfirst
Picked up an Ultimate Lifetime license aswell, I look forward to seeing where this goes c:
Thanks for supporting the project. Our roadmap (https://s3drive.canny.io/) is full of features and despite of our constant releases it actually grows faster than we can deliver, so if you would like us to prioritize certain features please express your interest by either adding a vote or just simply mention it here. Speaking of next major releases. We're on track to deliver support for plenty other back-ends: https://rclone.org/overview/ (please find the list) that will further open-up possibilities within the app.
Avatar
Avatar
cubityfirst
but I can't find where to activate the license in the app lol
Once you get it you'll need to login using your account within S3Drive. You should then be able to see your managed/license account in the Profiles like this, allowing you to use all of the Pro and Ultimate features.
Avatar
cubityfirst 12/10/2023 4:06 PM
Got it. Thanks 🙂
exboxtop joined the server. 12/11/2023 9:06 AM
Avatar
Avatar
exboxtop
Click to see original message
Avatar
Welcome !
_shld joined the server. 12/16/2023 10:56 AM
busy_dove_40283 joined the server. 12/17/2023 12:25 AM
Avatar
coldfusion0015 12/18/2023 7:17 AM
Hi Tom! Just bought the S3 Drive lifetime ultimate. Love your work. I might have a little bit of a unique use case, but wanted to submit a minor feature request. I'm running an S3 object storage on my home server (using minIO driver) and your app works with it very well. I have a large media library and was wondering if it's possible to allow streaming content directly into the built in media (video and audio) players on the Android (14) system? Rather than the app? (Using Content Provider component, and content://... URLs?)
❤️ 1
07:18
I'm open to adding the feature myself if those parts of the app are open source.
07:19
Also was wondering if file syncing (from cloud to phone storage) is currently possible on Android?
Avatar
Avatar
coldfusion0015
Hi Tom! Just bought the S3 Drive lifetime ultimate. Love your work. I might have a little bit of a unique use case, but wanted to submit a minor feature request. I'm running an S3 object storage on my home server (using minIO driver) and your app works with it very well. I have a large media library and was wondering if it's possible to allow streaming content directly into the built in media (video and audio) players on the Android (14) system? Rather than the app? (Using Content Provider component, and content://... URLs?)
Hi there and thank you for supporting the project. Since we run a cross-platform project, we're not using native players on each platform, but https://pub.dev/packages/media_kit library which in turn may or may not use native media player, but still aims to be optimized enough to provide a good playback experience. The reason that we've went with that library was that on top of fair mobile experience it provided pretty good desktop playout (including H/W support)... also we provide streaming of encrypted videos (which is somewhat complicated and fragile) and we were looking for a single library which we could adjust rather than doing that critical changes for every player on every platform. What's your goal behind using built-in player? Would you like to stream/player the video outside of S3Drive somehow or our existing player experience doesn't match your expectations? Technically we could fallback to https://exoplayer.dev/ on Android, but since we try to find a good balance between usability/functions/features and dev/maintenance costs we would really need to find a good reason to do so.
Avatar
Avatar
coldfusion0015
Hi Tom! Just bought the S3 Drive lifetime ultimate. Love your work. I might have a little bit of a unique use case, but wanted to submit a minor feature request. I'm running an S3 object storage on my home server (using minIO driver) and your app works with it very well. I have a large media library and was wondering if it's possible to allow streaming content directly into the built in media (video and audio) players on the Android (14) system? Rather than the app? (Using Content Provider component, and content://... URLs?)
Speaking of content://, since we operate on network resources, what we get with S3 is just a network URL, that we don't store locally (except the video cache) and pass directly to the video player. Since data isn't stored on Android device locally I don't think there is a method to expose it as a content URI. If I understand little bit more about your use case I might be able to come up with some other approach. (edited)
Avatar
coldfusion0015 12/18/2023 9:50 PM
Understood. My main reason for wanting to use a built in player is that the current music player view doesn't have any playback controls when playing audio and just shows a black screen while playing the audio. Not sure how easy it is to fix that, or if it's just easier to pass on a stream URL to an external player. My use case: Occasionally explore my data store, playing media content here and there (usually looking for something in the hierarchy of folders) before syncing it down to my device. Ideal use case: Just play everything right in the S3Drive app removing the need to sync files to my device, but I understand that S3Drive is not a media player. That's why I was wondering if it could be possible to integrate it with system media players.
Avatar
Do I have any offers on lifetime purchase. Please ?
21:56
Or any promotion code
Avatar
Avatar
coldfusion0015
Understood. My main reason for wanting to use a built in player is that the current music player view doesn't have any playback controls when playing audio and just shows a black screen while playing the audio. Not sure how easy it is to fix that, or if it's just easier to pass on a stream URL to an external player. My use case: Occasionally explore my data store, playing media content here and there (usually looking for something in the hierarchy of folders) before syncing it down to my device. Ideal use case: Just play everything right in the S3Drive app removing the need to sync files to my device, but I understand that S3Drive is not a media player. That's why I was wondering if it could be possible to integrate it with system media players.
S3Drive aims to be versatile in terms of supported files and media formats, so if audio playing isn't working as expected we will have a fix for that pretty soon. (edited)
Avatar
Avatar
coldfusion0015
Understood. My main reason for wanting to use a built in player is that the current music player view doesn't have any playback controls when playing audio and just shows a black screen while playing the audio. Not sure how easy it is to fix that, or if it's just easier to pass on a stream URL to an external player. My use case: Occasionally explore my data store, playing media content here and there (usually looking for something in the hierarchy of folders) before syncing it down to my device. Ideal use case: Just play everything right in the S3Drive app removing the need to sync files to my device, but I understand that S3Drive is not a media player. That's why I was wondering if it could be possible to integrate it with system media players.
In a next release there will be experimental player that supports playlists (you would be able to Play multiple audio files)... and supports background play-out. It's not perfect and there is no dark mode just yet, but it should work way better than what we have currently. Soon we shall be able load metadata, album name, cover picture... but we need to analyze what's feasible. How does that sound?
Avatar
Avatar
wolfefx
Do I have any offers on lifetime purchase. Please ?
Hey, You've convinced me to do the last one this year and before the price hike. https://s3drive.app/pricing?q=lifetime Please use: WINTER20 to get 20% 🛒 discount for Lifetime license s3drive. There are only 3 codes to redeem, so whoever is fastest gets S3Drive cheaper. Happy buying ! 🛍
s3drive pinned a message to this channel. 12/19/2023 10:49 AM
Avatar
jeannesbond 12/19/2023 4:37 PM
Hi, i'm trying to run S3Drive 1.6.5 AppImage on Void Linux, but only show blank white page. Are there any dependencies that might need to be installed?
Avatar
Avatar
jeannesbond
Hi, i'm trying to run S3Drive 1.6.5 AppImage on Void Linux, but only show blank white page. Are there any dependencies that might need to be installed?
Hi @jeannesbond, we received couple user reports that AppImage doesn't work as expected and we've included many improvements (related to dependencies and framework updates), these are already included in a next 1.7.0 release which is due to be released end of this month. I've created dev build for you to try out early and see if it resolves your issues, can you please give it a go and let me know if you get anything else than a blank white page? https://github.com/s3drive/app/releases/tag/1.7.0
Avatar
Avatar
s3drive
Hi @jeannesbond, we received couple user reports that AppImage doesn't work as expected and we've included many improvements (related to dependencies and framework updates), these are already included in a next 1.7.0 release which is due to be released end of this month. I've created dev build for you to try out early and see if it resolves your issues, can you please give it a go and let me know if you get anything else than a blank white page? https://github.com/s3drive/app/releases/tag/1.7.0
jeannesbond 12/19/2023 5:17 PM
I have tried version 1.7.0 and still blank white page like before
Avatar
Avatar
jeannesbond
I have tried version 1.7.0 and still blank white page like before
Is this running under a VM or some container perhaps?
Avatar
Avatar
s3drive
Is this running under a VM or some container perhaps?
jeannesbond 12/19/2023 5:19 PM
no, i'm running on real machine (laptop)
Avatar
Avatar
jeannesbond
no, i'm running on real machine (laptop)
I can't tell exactly what's the issue and we weren't able to try all distros, but the usual cause of a blank screen was lack of GPU H/W acceleration which our UI depends on (hence I asked about VM environment where H/W not always work properly). Does your environment have H/W acceleration enabled? Can you please tell the output of: glxinfo | grep "direct rendering" ? (edited)
Avatar
Avatar
s3drive
I can't tell exactly what's the issue and we weren't able to try all distros, but the usual cause of a blank screen was lack of GPU H/W acceleration which our UI depends on (hence I asked about VM environment where H/W not always work properly). Does your environment have H/W acceleration enabled? Can you please tell the output of: glxinfo | grep "direct rendering" ? (edited)
jeannesbond 12/19/2023 5:29 PM
Avatar
If you have an AMD GPU yes that should do. (edited)
Avatar
Avatar
s3drive
I can't tell exactly what's the issue and we weren't able to try all distros, but the usual cause of a blank screen was lack of GPU H/W acceleration which our UI depends on (hence I asked about VM environment where H/W not always work properly). Does your environment have H/W acceleration enabled? Can you please tell the output of: glxinfo | grep "direct rendering" ? (edited)
jeannesbond 12/19/2023 5:41 PM
return "Direct Rendering : Yes"
Avatar
Avatar
jeannesbond
return "Direct Rendering : Yes"
... and despite that still white screen? Can you please try resizing this blank windows, any visible change / screen artifact?
Avatar
Avatar
s3drive
... and despite that still white screen? Can you please try resizing this blank windows, any visible change / screen artifact?
jeannesbond 12/19/2023 5:44 PM
still blank white in full screen
Avatar
Avatar
jeannesbond
still blank white in full screen
I will make an internal ticket, can you please provide me your GPU details, desktop environment (xfce, GNOME, etc) and Void linux release version?
Avatar
Avatar
jeannesbond
still blank white in full screen
In the meantime would you be happy to try out the Flathub release? https://flathub.org/en-GB/apps/io.kapsa.drive
Avatar
Avatar
s3drive
I will make an internal ticket, can you please provide me your GPU details, desktop environment (xfce, GNOME, etc) and Void linux release version?
jeannesbond 12/19/2023 6:00 PM
GPU: AMD ATI Radeon R4/R5 Graphics DE: Xfce Release version: rolling release
Avatar
Avatar
s3drive
In the meantime would you be happy to try out the Flathub release? https://flathub.org/en-GB/apps/io.kapsa.drive
jeannesbond 12/19/2023 6:02 PM
i will learn about it
Avatar
Avatar
s3drive
In a next release there will be experimental player that supports playlists (you would be able to Play multiple audio files)... and supports background play-out. It's not perfect and there is no dark mode just yet, but it should work way better than what we have currently. Soon we shall be able load metadata, album name, cover picture... but we need to analyze what's feasible. How does that sound?
coldfusion0015 12/19/2023 7:27 PM
PLAYLISTS, background play and metadata? That sounds amazing! Can't wait for the next release now 😁
19:28
Seriously, that sounds awesome.
Avatar
coldfusion0015 12/19/2023 7:37 PM
Just bought an ultimate lifetime for all platforms.
❤️ 1
aaronthibault joined the server. 12/20/2023 12:29 PM
Avatar
aaronthibault 12/20/2023 12:42 PM
Love that you're doing this, it's what I was looking for. I have a question about S3 behavior and pricing. My understanding from reading through their replication FAQ is that any update to a file in S3 creates a copy and incurs a cost because the default is files that are uploaded are all immutable objects . Since I'll have a lot of large files I'm concerned about this -- can you help me understand, is my fear unfounded, or is there a strategy I need to employ - maybe using S3Drive helps with this - to keep my storage from ballooning, maybe with atomic file updates? Just concerned about 'surprise' AWS bills.
Avatar
Hi, editing large files will indeed require uploading the whole file every time. If you overwrite the old file and don't enable versioning, you should be fine because you don't store more data once the upload is finished, and AWS doesn't bill you for ingress to my knowledge. You will however need to be careful about egress fees if you automatically download new versions elsewhere, and operations themselves since more files (no matter their size) means more operations as a whole. You may want to wait for the Rclone integration, use a more standard file storage system for live files such as Google Drive, then use S3 to archive the ones you no longer plan to edit but still want to keep around.
12:55
The best way to know would be to perform a small scale test, see how everything behaves and analyse your S3 operations and costs on the AWS console.
_guest_45813 joined the server. 12/20/2023 3:22 PM
Avatar
Avatar
xenthys
Hi, editing large files will indeed require uploading the whole file every time. If you overwrite the old file and don't enable versioning, you should be fine because you don't store more data once the upload is finished, and AWS doesn't bill you for ingress to my knowledge. You will however need to be careful about egress fees if you automatically download new versions elsewhere, and operations themselves since more files (no matter their size) means more operations as a whole. You may want to wait for the Rclone integration, use a more standard file storage system for live files such as Google Drive, then use S3 to archive the ones you no longer plan to edit but still want to keep around.
aaronthibault 12/20/2023 6:28 PM
Thanks for your reply, it’s helpful and I’ll check out Rclone.
Avatar
Avatar
aaronthibault
Thanks for your reply, it’s helpful and I’ll check out Rclone.
You can wait for the next S3Drive update that will include Rclone features, so you won't have to install multiple software for the same task
👍 1
18:30
And you're welcome, glad I could help!
roberto_20232 joined the server. 12/22/2023 1:51 PM
alluring_sparrow_69851 joined the server. 12/26/2023 11:43 AM
cam00552 joined the server. 12/26/2023 5:46 PM
adamk3014 joined the server. 12/27/2023 6:55 PM
avantartist joined the server. 12/28/2023 4:52 PM
nlitend1_99179 joined the server. 12/28/2023 10:52 PM
fikanaka joined the server. 12/29/2023 10:12 AM
Avatar
mondo_magic 12/29/2023 1:36 PM
Hello! @everyone
pavitra.dev joined the server. 12/30/2023 6:12 AM
janhjanh joined the server. 01/01/2024 1:16 PM
whimsical_chipmunk_80199 joined the server. 01/01/2024 9:18 PM
motorolo_61023 joined the server. 01/03/2024 10:33 AM
ix23 joined the server. 01/03/2024 1:39 PM
Avatar
Avatar
jeannesbond
Hi, i'm trying to run S3Drive 1.6.5 AppImage on Void Linux, but only show blank white page. Are there any dependencies that might need to be installed?
jeannesbond 01/04/2024 4:17 PM
after updating my operating system today, now the app is working😁
👍 1
Avatar
Good news, although that means we won't know what caused the issue 😄
😆 1
Avatar
Avatar
xenthys
Good news, although that means we won't know what caused the issue 😄
jeannesbond 01/04/2024 4:29 PM
one of the updates was glibc, I don't understand about system but could it be because of that?
Avatar
depends on the version you had and what S3Drive requires, but even Debian's glibc should be alright so unless VoidLinux was seriously outdated I doubt it
👍 1
Avatar
hi all, I tried using the flatpak version but it only shows a blank white screen, it also seems like its not updated yet (still at 1.7.0, while latest is 1.7.1 i believe)
06:36
for the meantime im using the 1.7.1 appimage which works well
06:38
also, i noticed an issue with moving files, it prepended the destination directory to the "file-to-be-moved"?? so moving a file named file.png to test/ would rename it to testfile.png and the file is not moved the directory
06:39
for now im renaming the files manually like this, which seemed to work x)
Avatar
anyways, as a new user, i gotta say, the idea of using s3 for personal storage is really cool. i can now make use of cheap s3 services from my local hosting provider to host my files rather than paying to google, really love the idea. tho the app is kinda buggy sometimes, i hope it could get more polished in the future <3
06:49
i have a bit of a rant, i really need to know how deep i'm opening a folder is. it'd be awesome to have this display breadcrumbs instead of the name of the current folder. thanks
Avatar
Avatar
ix23
hi all, I tried using the flatpak version but it only shows a blank white screen, it also seems like its not updated yet (still at 1.7.0, while latest is 1.7.1 i believe)
There is a delay before Flathub picks up our release, we don't know how to resolve it just yet, so we wait patiently. We'll likely will have to tweak sandbox / folder permissions for the 1.7.1 sync feature to be able to interact with the local FS.
👍 1
Avatar
Avatar
ix23
also, i noticed an issue with moving files, it prepended the destination directory to the "file-to-be-moved"?? so moving a file named file.png to test/ would rename it to testfile.png and the file is not moved the directory
Sorry for that. It seems that we've introduced couple bugs related to copy/move in 1.7.0, we've now prioritized this and shall be able to release a hotfix at some point today.
Avatar
Avatar
ix23
i have a bit of a rant, i really need to know how deep i'm opening a folder is. it'd be awesome to have this display breadcrumbs instead of the name of the current folder. thanks
Cool idea, I've added it as a feature request: https://s3drive.canny.io/feature-requests/p/add-folder-breadcrumbs-in-the-navigation Since it's a small feature with pretty good value it's likely it will be implemented by the end of this month.
mrburzel joined the server. 01/05/2024 10:04 AM
Avatar
thanks tom for the quick response!
Avatar
Stupid question - I forgot my password ( https://s3drive.app/signin ) , the reocvery process sends me an email with a token, now I can view my lifetime purchase, but can't change or set a new password…
Easy-to-use client that converts any S3 server into your personal encrypted file storage. Rclone compatible, mount as drive, WebDav server, file versioning.
Avatar
passwort rest works now with android app but not on my mac
Avatar
@mrburzel E-mail/password change is available in the S3Drive web settings - https://web.s3drive.app/settings There is a link at the bottom of the account page. You should be logged in automatically if you're logged in on https://s3drive.app/account In the future account details change will be possible on our main website.
👍 1
Avatar
Hi Tom, does changing folder names only available to paid accounts?
Avatar
Avatar
AD26
Hi Tom, does changing folder names only available to paid accounts?
Hi, do you mean folder rename within bucket? Nope, it's free 🙂 Do you have any issue with folder name change?
Avatar
all is good after updating. I used to get "Invalid Header"
mrherbs_16732 joined the server. 01/09/2024 4:42 PM
starvstheforcesofevil joined the server. 01/10/2024 2:47 AM
vripan joined the server. 01/10/2024 11:24 AM
skybrow_1 joined the server. 01/12/2024 10:09 PM
Avatar
Avatar
s3drive
Hi, do you mean folder rename within bucket? Nope, it's free 🙂 Do you have any issue with folder name change?
Looks like I'm able to replace the folder name, but when I open the app again the folder name reverts back to original name, Same behaviour when creating a new folder
Avatar
Avatar
AD26
Looks like I'm able to replace the folder name, but when I open the app again the folder name reverts back to original name, Same behaviour when creating a new folder
What's your S3 provider? When you say "same behaviour when creating a new folder", do you mean that the newly created folder doesn't persist or anything else?
Avatar
Avatar
s3drive
What's your S3 provider? When you say "same behaviour when creating a new folder", do you mean that the newly created folder doesn't persist or anything else?
That's right. S3 provider is Storj
Avatar
Has the android drive mount been implemented yet?
Avatar
Avatar
AD26
That's right. S3 provider is Storj
Can you make sure that Versioning is disabled in the Settings? Storj doesn't support versioning just yet, but enabling this option might cause such weird behavior.
Avatar
Avatar
AD26
Has the android drive mount been implemented yet?
It's released, but it doesn't seem to be visible on anything below Android 14 and is read-only. Within a couple days we shall have it fixed and if possible we may implement basic write operations.
Avatar
Avatar
s3drive
It's released, but it doesn't seem to be visible on anything below Android 14 and is read-only. Within a couple days we shall have it fixed and if possible we may implement basic write operations.
I'm on Android 14. All I can see are OneDrive and Google Drive
Avatar
Avatar
s3drive
Can you make sure that Versioning is disabled in the Settings? Storj doesn't support versioning just yet, but enabling this option might cause such weird behavior.
Thanks, this fixes the folder renaming issue
pietroblu joined the server. 01/13/2024 4:19 PM
kino.pi joined the server. 01/13/2024 9:15 PM
Avatar
Avatar
AD26
I'm on Android 14. All I can see are OneDrive and Google Drive
We're awaiting a 1.7.4 fix release regarding the drive mount on Android. It's still read-only, but the visibility issues shall be resolved.
👍 1
harmonious_hare_52812 joined the server. 01/16/2024 1:21 AM
Avatar
morethanevil 01/16/2024 7:53 AM
A small improvement request. When viewing file details, it would be nice if the size would be in a human readable format.
Avatar
Avatar
morethanevil
A small improvement request. When viewing file details, it would be nice if the size would be in a human readable format.
Hi there, our aim was to display raw data in that functionality, so user has chance to verify the file integrity. Adding e.g. suffix (889KB) wouldn't hurt though, we will get it added in a next release !
👍 1
Avatar
Avatar
AD26
I'm on Android 14. All I can see are OneDrive and Google Drive
Hi, 1.7.4 is there. I am wondering if you can now see S3Drive? Please make sure that you've mount enabled in the settings (you can also try toggle off, then on again to reset settings). Another issue that we find is that on some phones e.g. Samsung mount isn't visible in the installed Files app, probably such space is reserved only for Big Guys, but no worries you can actually enable the native Files app either from the phone settings menu or by installing a shortcut to it: https://play.google.com/store/apps/details?id=com.marc.files&hl=en&gl=US
This app is a shortcut to the file manager of the settings app.
Avatar
Avatar
morethanevil
A small improvement request. When viewing file details, it would be nice if the size would be in a human readable format.
As promised, we'll have it included in a next release:
Avatar
morethanevil 01/16/2024 12:13 PM
Cool thank you It helps me to quick check if a certain backup is successful ☺
Avatar
Avatar
s3drive
Hi, 1.7.4 is there. I am wondering if you can now see S3Drive? Please make sure that you've mount enabled in the settings (you can also try toggle off, then on again to reset settings). Another issue that we find is that on some phones e.g. Samsung mount isn't visible in the installed Files app, probably such space is reserved only for Big Guys, but no worries you can actually enable the native Files app either from the phone settings menu or by installing a shortcut to it: https://play.google.com/store/apps/details?id=com.marc.files&hl=en&gl=US
I can now see it mounted on my Files app. Amazing work, Tom!
Deleted User joined the server. 01/17/2024 2:19 AM
tengas23 joined the server. 01/17/2024 2:22 AM
jlykos joined the server. 01/17/2024 2:29 AM
frpnzxxx joined the server. 01/17/2024 2:33 AM
Avatar
HI! When connected to Google Drive, i cannot view the images, I have to download it to view, here is a screenshot
Avatar
Avatar
frpnzxxx
HI! When connected to Google Drive, i cannot view the images, I have to download it to view, here is a screenshot
It may be because it's encrypted?
Avatar
is there any way to view the images?
Avatar
May I ask what is the maximum storage capacity? 👇 If I consumed 4TB Storage what is the cost? Thanks in advance (edited)
Avatar
Avatar
frpnzxxx
HI! When connected to Google Drive, i cannot view the images, I have to download it to view, here is a screenshot
Hi, We haven't yet implemented image preview for non-S3 back-ends, it will be available around Q1/Q2 2024 - https://s3drive.canny.io/feature-requests/p/implement-thumbnails-for-rclone-back-ends
Avatar
Avatar
tengas23
May I ask what is the maximum storage capacity? 👇 If I consumed 4TB Storage what is the cost? Thanks in advance (edited)
Hi, We're not selling storage just yet, the Ultimate plan allows you to use all of the available features of the app, but you'll need to choose the storage provider yourself, please find the guide: https://docs.s3drive.app/setup/bucket/#providers Once you click on the registered account regardless if you have a free or Ultimate plan you are getting 10GB testing account. there is a relevant monit to let you know that it's only for testing purposes. We will be providing plans this year, including 4TB and potentially lifetime deals, but that's not yet ready.
Zero Knowledge E2E encrypted storage compatible with any S3 provider
👍 1
Avatar
If I could have a lifetime 10 TB deal I'd be so stoked, it would cost so much upfront tho 💸
stem_76511 joined the server. 01/17/2024 3:14 PM
stem_20361 joined the server. 01/17/2024 8:18 PM
mrfreed. joined the server. 01/18/2024 12:39 AM
Avatar
Avatar
mrfreed.
Click to see original message
chriso1 joined the server. 01/18/2024 11:16 PM
piffio joined the server. 01/19/2024 12:10 PM
Avatar
hey tom, is there difference in github apk vs playstore?
Avatar
@AD26 Hi, currently yes, APK supports folder syncing from local FS: https://docs.s3drive.app/install/#apk-release Google Play release doesn't yet support it, but we're working on convincing Google that this use case is legitimate. (edited)
Avatar
I see. is that why I wasn't able to move files? With folder sync, it basically backs up (if chose to) my desired folder? (edited)
15:22
oh and does it auto update?
meticoeus joined the server. 01/21/2024 8:35 AM
Avatar
Avatar
AD26
I see. is that why I wasn't able to move files? With folder sync, it basically backs up (if chose to) my desired folder? (edited)
Sorry, can you refresh me on the move files issue? If issue still persist, can you please create a support item? Regardless, it's not related to Android permission issue that I've mentioned. Speaking of sync modes, there are 4 of them. On desktop it uses "file watcher" to sync immediately, on mobile syncing starts when app starts (configurable in the settings). Periodic sync (e.g. once every 15 minutes) will come soon at some point we will also implement "foreground live sync", that will run constantly, however we still haven't exactly decided how to implement with battery life in mind. (edited)
kimon.k joined the server. 01/22/2024 11:11 AM
Avatar
Avatar
kimon.k
Click to see original message
Avatar
Avatar
kimon.k
Click to see original message
Sticker
archerallstars joined the server. 01/23/2024 1:44 AM
star_ice_cream joined the server. 01/23/2024 2:36 PM
sgwszzh joined the server. 01/24/2024 8:08 AM
_replax joined the server. 01/24/2024 3:25 PM
crim3819 joined the server. 01/25/2024 8:15 PM
daison joined the server. 01/26/2024 1:22 AM
astrohgalaxy joined the server. 01/27/2024 12:31 PM
Avatar
Hi hi
Avatar
jeannesbond 01/27/2024 6:32 PM
Hello, I'm trying to install s3drive .deb version, but libmpv1 not available on debian bookworm repo
Avatar
morethanevil 01/27/2024 6:47 PM
Libmpv1 is outdated, use flatpak
👍 1
Avatar
The .deb package should accept libmpv2 tho
18:47
I believe @s3drive will have to see if that dependency is supported and can be allowed within the Debian package metadata, aka. install either libmpv1 or libmpv2.
Avatar
Avatar
jeannesbond
Hello, I'm trying to install s3drive .deb version, but libmpv1 not available on debian bookworm repo
Hi there, Would you be happy to try out this pre-release? https://github.com/s3drive/deb-app/releases/tag/1.7.7 I've added the: libmpv2 as an alternative, but don't really have capacity at the moment to test things out. Ideally movies should play out as normal, as MPV dependency is required by media library that we use: https://pub.dev/packages/media_kit (edited)
Avatar
Avatar
xenthys
I believe @s3drive will have to see if that dependency is supported and can be allowed within the Debian package metadata, aka. install either libmpv1 or libmpv2.
Thanks for the hint with the .deb alternative !
Avatar
Avatar
s3drive
Hi there, Would you be happy to try out this pre-release? https://github.com/s3drive/deb-app/releases/tag/1.7.7 I've added the: libmpv2 as an alternative, but don't really have capacity at the moment to test things out. Ideally movies should play out as normal, as MPV dependency is required by media library that we use: https://pub.dev/packages/media_kit (edited)
jeannesbond 01/27/2024 7:46 PM
Installed successfully and running normally😁
Avatar
Avatar
jeannesbond
Installed successfully and running normally😁
That's great, so we've managed to fix it all together. Thanks ! (edited)
s3drive 2
💪 1
Deleted User joined the server. 01/28/2024 8:42 PM
alaska9123 joined the server. 01/28/2024 8:43 PM
povey joined the server. 01/28/2024 11:37 PM
yesbad joined the server. 01/29/2024 2:25 PM
jakeabq_29738 joined the server. 01/29/2024 2:35 PM
benoit_52236 joined the server. 01/29/2024 3:32 PM
Avatar
benoit_52236 01/29/2024 3:48 PM
Just did a flatpak install on fedora and then flatpak run gives me: /app/extra/local/lib/s3drive/kapsa: error while loading shared libraries: libmpv.so.2: cannot open shared object file: No such file or directory (This is first time I've used flatpak though I did a test install on another app and that ran ok.) I can see that /var/lib/flatpak/app/io.kapsa.drive/..... has libmpv.so.1 (not 2) and that ldd on /var/lib/flatpak/app/io.kapsa.drive/...../extra/local/lib/s3drive/kapsa shows libmpv.so.2 => not found Have I done something wrong or is the package incorrect?
Avatar
It appears to be a package issue, S3Drive works with both to my knowledge so it should take any available between .1 and .2
Avatar
Avatar
benoit_52236
Just did a flatpak install on fedora and then flatpak run gives me: /app/extra/local/lib/s3drive/kapsa: error while loading shared libraries: libmpv.so.2: cannot open shared object file: No such file or directory (This is first time I've used flatpak though I did a test install on another app and that ran ok.) I can see that /var/lib/flatpak/app/io.kapsa.drive/..... has libmpv.so.1 (not 2) and that ldd on /var/lib/flatpak/app/io.kapsa.drive/...../extra/local/lib/s3drive/kapsa shows libmpv.so.2 => not found Have I done something wrong or is the package incorrect?
Thanks for your report. It seems we've introduced a bug with a recent release which in theory was supposed to pick up right: libmpv version. We're working to have it resolved promptly, please bear with us.
Avatar
Avatar
benoit_52236
Just did a flatpak install on fedora and then flatpak run gives me: /app/extra/local/lib/s3drive/kapsa: error while loading shared libraries: libmpv.so.2: cannot open shared object file: No such file or directory (This is first time I've used flatpak though I did a test install on another app and that ran ok.) I can see that /var/lib/flatpak/app/io.kapsa.drive/..... has libmpv.so.1 (not 2) and that ldd on /var/lib/flatpak/app/io.kapsa.drive/...../extra/local/lib/s3drive/kapsa shows libmpv.so.2 => not found Have I done something wrong or is the package incorrect?
Hey, this is now fixed: https://github.com/flathub/io.kapsa.drive/pull/28 but changes on Flathub takes some time to propagate, so if the build time updates here: https://flathub.org/en-GB/apps/io.kapsa.drive to something more recent than on the attached image, then it means it ended up in the official release. If you're in hurry you can build the Flatpak yourself using: git clone --recursive git@github.com:flathub/io.kapsa.drive.git cd io.kapsa.drive flatpak-builder --user --install --force-clean build-dir io.kapsa.drive.json ... however it does require some prior environment setup, like: flatpak install flathub org.freedesktop.Sdk//23.08 flatpak install flathub org.freedesktop.Platform flatpak install org.freedesktop.Sdk.Extension.vala/x86_64/23.08 We will be providing full guide, "how to compile Flatpak". (edited)
Avatar
Avatar
s3drive
Hey, this is now fixed: https://github.com/flathub/io.kapsa.drive/pull/28 but changes on Flathub takes some time to propagate, so if the build time updates here: https://flathub.org/en-GB/apps/io.kapsa.drive to something more recent than on the attached image, then it means it ended up in the official release. If you're in hurry you can build the Flatpak yourself using: git clone --recursive git@github.com:flathub/io.kapsa.drive.git cd io.kapsa.drive flatpak-builder --user --install --force-clean build-dir io.kapsa.drive.json ... however it does require some prior environment setup, like: flatpak install flathub org.freedesktop.Sdk//23.08 flatpak install flathub org.freedesktop.Platform flatpak install org.freedesktop.Sdk.Extension.vala/x86_64/23.08 We will be providing full guide, "how to compile Flatpak". (edited)
It is now live on Flathub.
skelhost_66575 joined the server. 01/30/2024 12:57 AM
dunk.dev joined the server. 01/30/2024 2:13 AM
Avatar
Avatar
s3drive
It is now live on Flathub.
benoit_52236 01/30/2024 9:04 AM
Great - reinstalled & it's starting now. Thanks a lot.
👍 1
svanggaard_43528 joined the server. 01/31/2024 4:27 PM
jamie_07275 joined the server. 01/31/2024 7:11 PM
mblerandd joined the server. 01/31/2024 8:14 PM
cliff_41894 joined the server. 01/31/2024 9:14 PM
Avatar
Hi Newcomers 👋 !
s3drive 1
thg666 joined the server. 02/01/2024 2:38 AM
luis_97112 joined the server. 02/01/2024 1:42 PM
detoxbkg joined the server. 02/01/2024 8:11 PM
drml_42049 joined the server. 02/02/2024 1:29 PM
jesseds joined the server. 02/05/2024 3:04 AM
jubilant_hare_38130 joined the server. 02/05/2024 5:16 PM
nez1136 joined the server. 02/05/2024 5:19 PM
balk_20641 joined the server. 02/08/2024 8:58 PM
gigaupdate joined the server. 02/09/2024 2:49 AM
ezerez joined the server. 02/09/2024 11:46 AM
jairoefe joined the server. 02/09/2024 5:06 PM
jesdav113 joined the server. 02/10/2024 2:36 PM
smoothdenis joined the server. 02/11/2024 2:00 AM
jack_82794 joined the server. 02/11/2024 3:42 AM
sparkling_papaya_05467 joined the server. 02/11/2024 12:39 PM
Deleted User joined the server. 02/11/2024 12:54 PM
xpresso. joined the server. 02/11/2024 8:20 PM
n1trotoluol joined the server. 02/12/2024 3:06 PM
mirsad_1 joined the server. 02/12/2024 10:41 PM
cowduck_ joined the server. 02/13/2024 2:14 AM
salcif joined the server. 02/13/2024 1:22 PM
Avatar
jeannesbond 02/13/2024 6:54 PM
Hello teams, just want to report, yesterday i'm trying to run S3Drive AppImage on Fedora (Xfce), but after double click, nothing happened (app not open). Today I try to run S3Drive Deb & AppImage on Debian 12.5 (Xfce), the result same as yesterday...
Avatar
Avatar
jeannesbond
Hello teams, just want to report, yesterday i'm trying to run S3Drive AppImage on Fedora (Xfce), but after double click, nothing happened (app not open). Today I try to run S3Drive Deb & AppImage on Debian 12.5 (Xfce), the result same as yesterday...
When you start AppImage, do you get anything in logs, e.g. : ./S3Drive-x86_64.AppImage (kapsa:2730352): Gdk-CRITICAL **: 09:39:57.636: gdk_window_get_state: assertion 'GDK_IS_WINDOW (window)' failed package:media_kit_libs_linux registered. flutter: *** sqflite warning *** You are changing sqflite default factory. Be aware of the potential side effects. Any library using sqflite will have this factory as the default for all operations. *** sqflite warning *** method call InitAppWindow method call InitSystemTray SystemTray::set_system_tray_info title: (null), icon_path: /tmp/.mount_S3DrivJ2GgY2/data/flutter_assets/assets/logos/logo_42.png, toolTip: (null) method call CreateContextMenu value_to_menu_item type:label, label:Show value_to_menu_item type:label, label:Hide value_to_menu_item type:label, label:Start drive mount value_to_menu_item type:label, label:Stop drive mount value_to_menu_item type:label, label:Start WebDav value_to_menu_item type:label, label:Stop WebDav value_to_menu_item type:label, label:Support value_to_menu_item type:label, label:Visit Website value_to_menu_item type:label, label:About value_to_menu_item type:label, label:Changelog value_to_menu_item type:label, label:Logs value_to_menu_item type:label, label:Version 1.7.11 method call SetContextMenu Just a question, did you try running Flatpak format? https://github.com/flathub/io.kapsa.drive/
Contribute to flathub/io.kapsa.drive development by creating an account on GitHub.
Avatar
Avatar
s3drive
When you start AppImage, do you get anything in logs, e.g. : ./S3Drive-x86_64.AppImage (kapsa:2730352): Gdk-CRITICAL **: 09:39:57.636: gdk_window_get_state: assertion 'GDK_IS_WINDOW (window)' failed package:media_kit_libs_linux registered. flutter: *** sqflite warning *** You are changing sqflite default factory. Be aware of the potential side effects. Any library using sqflite will have this factory as the default for all operations. *** sqflite warning *** method call InitAppWindow method call InitSystemTray SystemTray::set_system_tray_info title: (null), icon_path: /tmp/.mount_S3DrivJ2GgY2/data/flutter_assets/assets/logos/logo_42.png, toolTip: (null) method call CreateContextMenu value_to_menu_item type:label, label:Show value_to_menu_item type:label, label:Hide value_to_menu_item type:label, label:Start drive mount value_to_menu_item type:label, label:Stop drive mount value_to_menu_item type:label, label:Start WebDav value_to_menu_item type:label, label:Stop WebDav value_to_menu_item type:label, label:Support value_to_menu_item type:label, label:Visit Website value_to_menu_item type:label, label:About value_to_menu_item type:label, label:Changelog value_to_menu_item type:label, label:Logs value_to_menu_item type:label, label:Version 1.7.11 method call SetContextMenu Just a question, did you try running Flatpak format? https://github.com/flathub/io.kapsa.drive/
jeannesbond 02/15/2024 3:16 PM
the app not open after i click execute, both appimage and deb version (edited)
Avatar
Avatar
jeannesbond
the app not open after i click execute, both appimage and deb version (edited)
By any chance, can you start from command line?
satvika_39647 joined the server. 02/16/2024 8:01 AM
Avatar
Avatar
s3drive
By any chance, can you start from command line?
jeannesbond 02/16/2024 4:02 PM
doom.blah joined the server. 02/16/2024 9:23 PM
aristorn joined the server. 02/18/2024 10:44 PM
sitenevnews joined the server. 02/19/2024 10:42 AM
Avatar
n1trotoluol 02/19/2024 1:20 PM
A very interesting program, thanks to the developers. I want to buy the lifetime version. Are there any promotions or discounts planned using promotional codes? And another question: will the program be translated into other languages?
Avatar
Avatar
n1trotoluol
A very interesting program, thanks to the developers. I want to buy the lifetime version. Are there any promotions or discounts planned using promotional codes? And another question: will the program be translated into other languages?
Thanks for the good words ! We did have a pretty good Black Friday, however since we've added Rclone support end of December we plan to increase the price slightly, yet it's still possible to get the Lifetime before the price hike. We do have plans to translate it to other languages, however we haven't got to that just yet: https://s3drive.canny.io/feature-requests/p/translate-the-app-extract-translation-strings and given our ambitious roadmap: https://s3drive.app/roadmap2024 at best we may translate app only partially by the end of 2024.
infomealbox.it_97535 joined the server. 02/19/2024 3:07 PM
Avatar
infomealbox.it_97535 02/19/2024 4:18 PM
good afternoon
👋 1
Avatar
Avatar
infomealbox.it_97535
good afternoon
Buonasera !
Avatar
Avatar
s3drive
Thanks for the good words ! We did have a pretty good Black Friday, however since we've added Rclone support end of December we plan to increase the price slightly, yet it's still possible to get the Lifetime before the price hike. We do have plans to translate it to other languages, however we haven't got to that just yet: https://s3drive.canny.io/feature-requests/p/translate-the-app-extract-translation-strings and given our ambitious roadmap: https://s3drive.app/roadmap2024 at best we may translate app only partially by the end of 2024.
n1trotoluol 02/20/2024 7:04 AM
Greetings! Thank you very much for your quick response! I continue to study and test the capabilities of the application and have encountered the following problem: I want to synchronize media files with Backblaze storage, but it is important that the original file creation date is preserved when saving/restoring files from the storage to the device (since files in the gallery are sorted by creation date and if Do not restore the file creation date, then there will be chaos in the gallery). Is it possible to save/restore the creation or modification date of original files during synchronization?
Avatar
Avatar
n1trotoluol
Greetings! Thank you very much for your quick response! I continue to study and test the capabilities of the application and have encountered the following problem: I want to synchronize media files with Backblaze storage, but it is important that the original file creation date is preserved when saving/restoring files from the storage to the device (since files in the gallery are sorted by creation date and if Do not restore the file creation date, then there will be chaos in the gallery). Is it possible to save/restore the creation or modification date of original files during synchronization?
Can you please let me know what platform you use and whether you use Media Backup (mobile) or Sync (all platforms)? Modification date shall be preserved, we've added this in a : "[1.7.1] - 2024-01-04" release (https://s3drive.app/changelog). Creation date is trickier to implement reliably given that not all filesystems support it on platforms that we support and underlying Rclone library that we use for syncing doesn't use creation dates either. We will certainly think of implementing creation date, especially for macOS and Windows platform, or Unix the answer isn't simple.
Avatar
Avatar
s3drive
Can you please let me know what platform you use and whether you use Media Backup (mobile) or Sync (all platforms)? Modification date shall be preserved, we've added this in a : "[1.7.1] - 2024-01-04" release (https://s3drive.app/changelog). Creation date is trickier to implement reliably given that not all filesystems support it on platforms that we support and underlying Rclone library that we use for syncing doesn't use creation dates either. We will certainly think of implementing creation date, especially for macOS and Windows platform, or Unix the answer isn't simple.
n1trotoluol 02/20/2024 9:02 AM
I use S3Drive 1.7.10 on a phone with Android 12. I created a synchronization task for a folder on the phone (sending from the phone to Baskblaze), "Sync" synchronization mode. The "modification date" is not saved and cannot be restored.
mikel_94510 joined the server. 02/20/2024 4:38 PM
peter._20490 joined the server. 02/20/2024 9:06 PM
cojonees. joined the server. 02/20/2024 9:22 PM
Avatar
Hey guys, I wanted to ask if I got a ultimate license for my andriod if I can use the MacOS app to download files with it. The reason I ask is because when I try to download a zip on the app it says I need a ultimate license but I know I bought one in Google Play
Avatar
Hi - I'm coming from S3 Browser and they have an option to use a custom domain name that replaces the s3 url. See Attachment. I read somewhere this was planned for S3Drive. Is this still the case? Or is it already implemented and I cant find it in the app. Thanks for your time.
Avatar
Avatar
chriso1
Hi - I'm coming from S3 Browser and they have an option to use a custom domain name that replaces the s3 url. See Attachment. I read somewhere this was planned for S3Drive. Is this still the case? Or is it already implemented and I cant find it in the app. Thanks for your time.
Something similar was requested along the lines: https://s3drive.canny.io/feature-requests/p/allow-custom-download-url and https://s3drive.canny.io/feature-requests/p/allow-sharing-raw-unsigned-urls Sounds like we may have to prioritize it. Quick question, what's the use case for: "Custom host name" for you? Would that be, so in the shared URLs you have shorter name? What's the list of URLs on your screen? Can you connect to your bucket using your "Custom host name"? In which case you could pass it as a Gateway during login screen.
penguin_fai joined the server. 02/21/2024 8:57 AM
mentallyillcatgirl joined the server. 02/21/2024 9:13 PM
Avatar
mentallyillcatgirl 02/21/2024 9:14 PM
sup chads
👋 1
Avatar
How many gb you are offering on lifetime plan for 50 dolar
mixih joined the server. 02/21/2024 11:24 PM
Avatar
Hi, I'm getting a "Error: Exception: corrupted on transfer: md5 encrypted hash differ" on a one-way copy-mode sync (local->remote) to an encrypted vault in a S3 bucket (versioning on, object lock off) in IDrive E2 on android and Linux. Any idea how to fix this? Thanks! (edited)
Avatar
Avatar
s3drive
Something similar was requested along the lines: https://s3drive.canny.io/feature-requests/p/allow-custom-download-url and https://s3drive.canny.io/feature-requests/p/allow-sharing-raw-unsigned-urls Sounds like we may have to prioritize it. Quick question, what's the use case for: "Custom host name" for you? Would that be, so in the shared URLs you have shorter name? What's the list of URLs on your screen? Can you connect to your bucket using your "Custom host name"? In which case you could pass it as a Gateway during login screen.
Thanks for your time. - what's the use case for: "Custom host name" for you? We use our buckets to provide downloads of our assets for our customers. Videos and photos (Video production company) We use iDRIVE with multiple regions. All I'm looking to do is mask the domain name with our domain name. Everything else stays the same. I'm only using S3 APP to upload to our bucket and grab the original link from iDrice to give to the cutomer to download. Example S3 link from iDrive: dfgd1fg45d.la.idrive2-57.com/filname-123.zip When we convert to our own domain it looks like this: http:// la.domainname.com/filname-123.zip Would that be, so in the shared URLs you have a shorter name? Yes - It also looks legitimate from our domain name. Also when i Drive uses the cNAME domain name, the original idrive url is hidden. (And no one knows the actual bucket link) What's the list of URLs on your screen? All S3 browser does is mask the original link. The screenshot shows the original link, however, if you type your own domain name into the custom domain host name, those links will change from amazonaws.com to your domain name. That's all it does. Can you connect to your bucket using your "Custom host name"? Yes - because we already have a CNAME for the domain example: cdn.domainname.com configured. idrive guide here but I'm assuming others have a similar solution to cname: https://www.idrive.com/s3-storage-e2/cname-guide
Use your own domain name with IDrive® e2. Add and manage a CNAME record.
Avatar
Avatar
chriso1
Thanks for your time. - what's the use case for: "Custom host name" for you? We use our buckets to provide downloads of our assets for our customers. Videos and photos (Video production company) We use iDRIVE with multiple regions. All I'm looking to do is mask the domain name with our domain name. Everything else stays the same. I'm only using S3 APP to upload to our bucket and grab the original link from iDrice to give to the cutomer to download. Example S3 link from iDrive: dfgd1fg45d.la.idrive2-57.com/filname-123.zip When we convert to our own domain it looks like this: http:// la.domainname.com/filname-123.zip Would that be, so in the shared URLs you have a shorter name? Yes - It also looks legitimate from our domain name. Also when i Drive uses the cNAME domain name, the original idrive url is hidden. (And no one knows the actual bucket link) What's the list of URLs on your screen? All S3 browser does is mask the original link. The screenshot shows the original link, however, if you type your own domain name into the custom domain host name, those links will change from amazonaws.com to your domain name. That's all it does. Can you connect to your bucket using your "Custom host name"? Yes - because we already have a CNAME for the domain example: cdn.domainname.com configured. idrive guide here but I'm assuming others have a similar solution to cname: https://www.idrive.com/s3-storage-e2/cname-guide
Thanks for your detailed feedback, I can confirm that we'll be adding this feature. Hard to give any ETA, but next month certainly possible. (edited)
😍 1
Avatar
Avatar
s3drive
Thanks for your detailed feedback, I can confirm that we'll be adding this feature. Hard to give any ETA, but next month certainly possible. (edited)
Cheers Tom - Appreciate it - Thanks for your time.
memger joined the server. 02/22/2024 2:51 PM
mkfs joined the server. 02/22/2024 6:25 PM
Avatar
Avatar
mkfs
Click to see original message
Avatar
Avatar
chriso1
Cheers Tom - Appreciate it - Thanks for your time.
Hi @chriso1, we've got preview of this feature deployed to our web client. There are two options, one to not create a signature, the other one is to set custom domain. Once custom domain is set once, this setting will be preserved for this bucket. Please let me know whether this works for you and if you have any thoughts, then we can apply tweaks and include it in next release to other platforms. cc @xenthys Hi there, correct me if I'm wrong, but haven't you requested similar feature in the past?
😍 1
Avatar
Yes, you may want to note that unsigned URLs don't have an expiration since it's linked to the signature, I don't know if it's possible to make the UI actually show that to the end user
Avatar
Avatar
xenthys
Yes, you may want to note that unsigned URLs don't have an expiration since it's linked to the signature, I don't know if it's possible to make the UI actually show that to the end user
Good call, we'll replace the Link expiration with a warning once Unsigned URL option is selected.
Avatar
Otherwise good thanks, raw presigned + unsigned was indeed what I'm after!
Avatar
Avatar
s3drive
Hi @chriso1, we've got preview of this feature deployed to our web client. There are two options, one to not create a signature, the other one is to set custom domain. Once custom domain is set once, this setting will be preserved for this bucket. Please let me know whether this works for you and if you have any thoughts, then we can apply tweaks and include it in next release to other platforms. cc @xenthys Hi there, correct me if I'm wrong, but haven't you requested similar feature in the past?
Perfect! I just tested the unsigned url with a custom domain. That is exactly what I was looking for. Thank you!
Avatar
mentallyillcatgirl 02/22/2024 11:30 PM
frens
23:30
me haves questions
23:30
well
23:31
one really
23:31
so do I need to enable "end to end" encryption to make my data transferred securely
23:32
or am i stupid and its already encrypted when transmitted or something
Avatar
by default it's transmitted over HTTPS, so it's secure
Avatar
mentallyillcatgirl 02/22/2024 11:36 PM
ok swag just making sure
23:36
https my beloved
Avatar
end-to-end is when you don't trust the host, aka. it's encrypted and decrypted on the client
Avatar
mentallyillcatgirl 02/22/2024 11:36 PM
i was confused if i was gonna have to enable https myself lol
Avatar
there was a lame joke here, too lame to stay (edited)
Avatar
Avatar
xenthys
there was a lame joke here, too lame to stay (edited)
mentallyillcatgirl 02/22/2024 11:41 PM
another question
23:42
if i select to auto backup recent which contains everything would it back all of the seperate folders or combine it into one giant glob
Avatar
that's a good question, I don't have the answer sorry, maybe @s3drive will
Avatar
mentallyillcatgirl 02/22/2024 11:44 PM
this app is swag
Avatar
mentallyillcatgirl 02/23/2024 12:16 AM
@s3drive tom do u kno
Avatar
mentallyillcatgirl 02/23/2024 1:25 AM
omg hi dunk
Avatar
@mentallyillcatgirl from what I can see everything is uploaded into the same folder, also hi
01:27
Lemme see if just selecting recent will actually capture most folders properly or if it'll be unreliable
01:30
Seems to successfully grab everything, though again it's all just placed in the root of the backup location instead of being organised the same as it would be locally
Avatar
Avatar
dunk.dev
Seems to successfully grab everything, though again it's all just placed in the root of the backup location instead of being organised the same as it would be locally
mentallyillcatgirl 02/23/2024 1:41 AM
ah so you're saying it doesn't keep the subfolders and shit organized
Avatar
Yeah, sadly no subfolders, though since it's early days it may get added
Avatar
mentallyillcatgirl 02/23/2024 1:43 AM
🫡
lomsor joined the server. 02/23/2024 4:16 AM
Avatar
Hey Everyone. Been researching for days for ways to make S3 storage somewhat usable and still secure as well as looking into alternatives to S3 altogether but nothing came close to the requirements ... What I am missing is Mobile and and SSO on Mobile. I saw there has been talk about it a while back as well as some vague mentions on the website. I would be grateful to hear what the current status is on the matter of SSO in S3Drive (edited)
Avatar
Avatar
mentallyillcatgirl
if i select to auto backup recent which contains everything would it back all of the seperate folders or combine it into one giant glob
mentallyillcatgirl 02/23/2024 12:45 PM
oh noes i even did everything with individual albums and my b2 didnt seperate everything into seperate folders aaaaaah
12:46
its so over
Avatar
Avatar
mentallyillcatgirl
oh noes i even did everything with individual albums and my b2 didnt seperate everything into seperate folders aaaaaah
Hi @mentallyillcatgirl, In a next couple months we plan to improve media backup tool, so it preserves the album names as folders. Current version was primarily focused on reliably backing up photos/videos (incl. background mode) and there aren't any additional photo management options. Stay tuned ! (edited)
cdprotector joined the server. 02/23/2024 2:01 PM
Avatar
Avatar
s3drive
Hi @mentallyillcatgirl, In a next couple months we plan to improve media backup tool, so it preserves the album names as folders. Current version was primarily focused on reliably backing up photos/videos (incl. background mode) and there aren't any additional photo management options. Stay tuned ! (edited)
mentallyillcatgirl 02/23/2024 2:03 PM
tbh it's pretty great so far good job focusing on making things work first before adding 38261 features
👍 1
Avatar
Avatar
lomsor
Hey Everyone. Been researching for days for ways to make S3 storage somewhat usable and still secure as well as looking into alternatives to S3 altogether but nothing came close to the requirements ... What I am missing is Mobile and and SSO on Mobile. I saw there has been talk about it a while back as well as some vague mentions on the website. I would be grateful to hear what the current status is on the matter of SSO in S3Drive (edited)
Hi @lomsor, We haven't exactly started work on SSO. Would you be happy to tell me little more about your use case? We plan to execute work on SSO in a next couple months, although we don't have a clear designs just yet. In principle the idea is that you user will provide the SSO endpoint which after successfull auth could then inject S3 credentials (and custom config) into S3Drive and login user to the specified bucket. (edited)
Avatar
cdprotector 02/23/2024 2:06 PM
hi, I am testing available SW products for S3 storage /idrive e2/ direct mount to Linux/Mac/Win. For some strange reason Mountainduck is not working asking for Region server for every file/folder created on client OSs. So far only Expandrive is working. On reddit I get link to S3drive and now here I got problem: S3 connect is working, it mounts drive in Win/Linux but when I create folder/file in OS Explorer/Dolphin - the change does not amke into real S storage bucket. What I am doing wrong ?
14:07
When I create file in S3drive app - change is immediately visible also in S3 bucket
Avatar
Tom will have to confirm, but mounts typically see a lot of file changes compared to individual uploads, it's probable files are flushed from time to time or on exit to reduce bucket operations costs
Avatar
cdprotector 02/23/2024 2:16 PM
I tested to manualy invoke SYNC from Local to Remote to get changes "applied" but that does not take OS mounted drive changes into account. maybe I am understanding S3drive functionality wrong ? I wanted to have just mounted S3 bucket to local PC/notebooks the same way as Mapped drives in Windows.
14:17
I am open to pay for such functionality if it requires Ultimate account
Avatar
Not sure about anything in the current state as I only use the mobile app myself, it could also be an issue, I recomment posting in #support so Tom can handle it as soon as he's available, it'll end up there if it's a bug and will stay for future reference (edited)
Avatar
cdprotector 02/23/2024 2:23 PM
Thanks, will do more testing on mobile too
theone_63096 joined the server. 02/23/2024 2:53 PM
Avatar
Avatar
s3drive
Hi @lomsor, We haven't exactly started work on SSO. Would you be happy to tell me little more about your use case? We plan to execute work on SSO in a next couple months, although we don't have a clear designs just yet. In principle the idea is that you user will provide the SSO endpoint which after successfull auth could then inject S3 credentials (and custom config) into S3Drive and login user to the specified bucket. (edited)
Thanks for the update Tom. TLDR: We would like to use the temporary credentials generated trough "IAM Identity Center" or "AWS CLI Login" to access and mount S3 Buckets in S3Drive. If I interpret your plan correctly this sounds like what I am looking for. rclone seems to support this type of authentication (https://rclone.org/s3/#authentication) trough I don't see a (non headache inducing) way for me to get the credentials to rclone on mobile and I would like to have minimal setup for future users. We are using AWS best practices which state that the bucket shouldn't be publicly accessible and that there shouldn't be any long term credentials for it. This means no IAM Users with permanent access to resources like S3, instead IAM roles should be assumed trough IAM Identity center (SSO). Which generates temporary credentials with three elements with one of them being a time limited token. I would like to have all business applications be reachable trough SSO, either SAML2 or OAuth2. There are a couple of desktop apps for S3 that can work with temporary credentials but none for mobile. Currently on desktop it works like this: either the application or some script triggers "aws login" with the aws profile being preconfigured once beforehand. A browser opens and the user approves or logs in (password, MFA, etc.), then the three element credentials are generated (access key id, secret access key, session token) and saved in a credentials file and/or the environment variables. Then the app either looks at the environment or directly at the file and uses these credentials for access to S3. Ideally the token would be refreshed before it expires. (edited)
Avatar
Avatar
cdprotector
hi, I am testing available SW products for S3 storage /idrive e2/ direct mount to Linux/Mac/Win. For some strange reason Mountainduck is not working asking for Region server for every file/folder created on client OSs. So far only Expandrive is working. On reddit I get link to S3drive and now here I got problem: S3 connect is working, it mounts drive in Win/Linux but when I create folder/file in OS Explorer/Dolphin - the change does not amke into real S storage bucket. What I am doing wrong ?
On what OS you find this behavior? Can you please make sure that your: "Mount cache mode" is set to "Minimal"? This shall skip the Rclone VFS cache and make operations blocking until they end up on S3.
Avatar
Avatar
cdprotector
I tested to manualy invoke SYNC from Local to Remote to get changes "applied" but that does not take OS mounted drive changes into account. maybe I am understanding S3drive functionality wrong ? I wanted to have just mounted S3 bucket to local PC/notebooks the same way as Mapped drives in Windows.
Hi, can you please create #support item? In principle sync and mount maybe used for similar purposes, but they are fundamentally different. You would usually use mount if you want to interact with remote file system directly. If you need "blocking" behaviour, please set cache mode to Minimal (In the Settings). If you want to work as if it was "local" path, which will be eventually consistent on the remote side (once Rclone finalizes the upload), then use "Writes" or even "Full" cache - the issue with these cache modes is that there is no clear indication if process to copy changes to remote has finished. Another issue with mount cache is that your directory listing might be stale, especially if there is other user or process which modified changes remotely (S3) without your knowledge. You would usually use sync if you want to work locally and flush changes automatically (with file watchers) and periodically (with the timer set in the settings).
Avatar
Avatar
lomsor
Thanks for the update Tom. TLDR: We would like to use the temporary credentials generated trough "IAM Identity Center" or "AWS CLI Login" to access and mount S3 Buckets in S3Drive. If I interpret your plan correctly this sounds like what I am looking for. rclone seems to support this type of authentication (https://rclone.org/s3/#authentication) trough I don't see a (non headache inducing) way for me to get the credentials to rclone on mobile and I would like to have minimal setup for future users. We are using AWS best practices which state that the bucket shouldn't be publicly accessible and that there shouldn't be any long term credentials for it. This means no IAM Users with permanent access to resources like S3, instead IAM roles should be assumed trough IAM Identity center (SSO). Which generates temporary credentials with three elements with one of them being a time limited token. I would like to have all business applications be reachable trough SSO, either SAML2 or OAuth2. There are a couple of desktop apps for S3 that can work with temporary credentials but none for mobile. Currently on desktop it works like this: either the application or some script triggers "aws login" with the aws profile being preconfigured once beforehand. A browser opens and the user approves or logs in (password, MFA, etc.), then the three element credentials are generated (access key id, secret access key, session token) and saved in a credentials file and/or the environment variables. Then the app either looks at the environment or directly at the file and uses these credentials for access to S3. Ideally the token would be refreshed before it expires. (edited)
I will get back to you on that once I manage to try out couple things with our team. We would be really keen to push some SSO workflow forward. Speaking of desktop apps that you've used and worked for your use case, do you happen to recommend any of them? I would be happy to test that workflow personally and see if that's something we would be willing to incorporate in S3Drive.
Avatar
mentallyillcatgirl 02/23/2024 6:42 PM
i have a lot of work ahead of me lol
nez1136 joined the server. 02/23/2024 9:21 PM
Avatar
Avatar
s3drive
I will get back to you on that once I manage to try out couple things with our team. We would be really keen to push some SSO workflow forward. Speaking of desktop apps that you've used and worked for your use case, do you happen to recommend any of them? I would be happy to test that workflow personally and see if that's something we would be willing to incorporate in S3Drive.
Thanks! Back when I first set this up I didn't find many so I went with a tool called 'TntDrive'. It does work but I wouldn't recommend it. For my use case I had to write a script that injects the credentials into the environment, the tool was able to be set to read from them. It also required to be elevated. S3Browser from the same devs has an integrated authentication solution that works with SSO, I asked them why it wasn't in TntDrive and they said that the focus there was to be a service without requiring user interaction. In my recent research I came across a few more that seem a bit more streamlined. Cyberduck and Mountain Duck seems alright. I know they can do SSO but don't know if they also require an external script. I was on the lookout for mobile so didn't try anything new that didn't at least have support for Mobile OS.
alexandros3897 joined the server. 02/24/2024 9:57 AM
marmotte73_08656 joined the server. 02/24/2024 5:18 PM
marmotte73_24390 joined the server. 02/24/2024 5:20 PM
rawritsmeep joined the server. 02/25/2024 4:53 PM
humangpt joined the server. 02/25/2024 7:17 PM
Exported 1,669 message(s)
S3Drive - off-topic
Guild icon
S3Drive
Community / off-topic
For any conversation that doesn't fit in the #general channel.
Avatar
morethanevil 08/06/2023 7:03 PM
@xenthys I wanted to say thanks again for the policy. I said, I would share it and almost 20 people found it helpful within 12 hours 🌞
19:03
👍 1
19:03
This is on Lemmy ☺
Avatar
Avatar
morethanevil
@xenthys I wanted to say thanks again for the policy. I said, I would share it and almost 20 people found it helpful within 12 hours 🌞
You're welcome, glad it helped you, if it helps others that's a bonus haha
🌞 1
Avatar
Avatar
morethanevil
@xenthys I wanted to say thanks again for the policy. I said, I would share it and almost 20 people found it helpful within 12 hours 🌞
I am wondering if you also face directory cache listing issue on MinIO. Playing with MinIO and uploaded some files, then deleted them all, they've landed in Trash, but when I open Files, the directory structure remains even though these entries are effectively deleted. It's been many hours since delete took place, but the dir structure is still there. (edited)
Avatar
morethanevil 08/07/2023 8:22 AM
Do you use versioning for this bucket?
08:25
Test upload to a bucket with versioning
08:25
Far better view 😁
👍 1
08:26
Deleted all with normal delete
08:27
I can reload the bucket as I want, those elements are not coming back in s3drive
Avatar
Avatar
morethanevil
Do you use versioning for this bucket?
I do have versioning enabled and problem only affects folders. In other words if you delete a folder with some files it seems that empty "folder entry" still appears in the listing.
Avatar
morethanevil 08/07/2023 9:34 AM
Okay I test again
09:35
09:35
09:35
Avatar
... and then once you refresh view, what happens? (edited)
Avatar
morethanevil 08/07/2023 9:36 AM
Yes when I switch the tab I get your Problem
09:36
Yes folder reappears
09:36
Not reappears
09:36
It is recreated
09:37
I see the same in MinIO Webinterface
Avatar
It seems it's related to this issue: https://github.com/minio/minio/issues/10914#issuecomment-731380100 I am going to investigate that, something's not right with Minio's behavior
Avatar
morethanevil 08/07/2023 9:40 AM
Yes i tried to delete folder, it appears in the app as deleted but is still there in MinIO It does not get deleted in the first place
09:40
The app is correctly listing the bucket
Avatar
Well they way it all works it's maybe not complex, but convoluted. There is no concept of directories in S3, so there are sort of virtual directory entries. There are explicit folder entries (e.g. if key: "folder/" - slash is important) gets created and there are implicit entries (e.g. if key: "folder/file.txt" exists) then "folder" gets "derived" from the path. (edited)
Avatar
morethanevil 08/07/2023 9:43 AM
Okay nothing wrong I have a clue: You have versioning enabled, so deleted files are marked as deleted but are kept back The folder which contains is not empty in this case and can not get deleted I tried to normally delete in MinIO it did not work As i made hard delete (=deletes all versions) then it worked
09:43
So versioning is correctly working and S3Drive is listing right
09:44
Maybe you should add the option to show deleted files 🤔
09:44
A toggle in the menu would be okay
Avatar
Well, Trash is supposed to show deleted files really. It's actually using Versioning API to display what's deleted. It seems that MinIO incorrectly displays the directory listings if there are Delete Markers left and guys from Nextcloud developed a workaround/hack: https://github.com/nextcloud/files_versions_s3/issues/11#issuecomment-945771673 to hide these entries. (edited)
09:48
I am going to play with different S3 implementations to confirm my findings, but it seems this is purely MinIO related.
Avatar
that's a MinIOops I guess
👍 2
😸 1
Avatar
Avatar
s3drive
Well, Trash is supposed to show deleted files really. It's actually using Versioning API to display what's deleted. It seems that MinIO incorrectly displays the directory listings if there are Delete Markers left and guys from Nextcloud developed a workaround/hack: https://github.com/nextcloud/files_versions_s3/issues/11#issuecomment-945771673 to hide these entries. (edited)
morethanevil 08/07/2023 9:58 AM
Is there an issue related to that on MinIO Page? 🤔
Avatar
Avatar
morethanevil
Is there an issue related to that on MinIO Page? 🤔
Bear in mind that most of the cases where S3 is used is simply key<>value storage, where files metadata and structure/hierarchy is being kept elsewhere. Directories on S3 is literally a hack (which actually works) and using S3 natively as FS (that's what we do) is rather an edge case. I haven't found anything official really, as I was wasting my time trying to search for some "cache" settings... but after x hours and then node restart I've realized that there is more to this. (edited)
Avatar
morethanevil 08/07/2023 10:24 AM
I don't think it is about caching, it is more a point of view problem You have files in a folder and delete them. Now they are marked as deleted but versioning keeps them as expected. If you niw delete the folder and would get the mark of deleted, then you won't be able to restore the files because the folder is still deleted 🤔 And how would you list the deleted of deleted files?
10:25
Deletception 😂
10:26
MinIO would need to unmark the deleted files and would need to set it to the whole folder. But there is a expiry function for deleted files. This would be reset
10:26
This is what I think, or am I wrong
10:27
Avatar
Avatar
morethanevil
I don't think it is about caching, it is more a point of view problem You have files in a folder and delete them. Now they are marked as deleted but versioning keeps them as expected. If you niw delete the folder and would get the mark of deleted, then you won't be able to restore the files because the folder is still deleted 🤔 And how would you list the deleted of deleted files?
To put things simply, it works on AWS S3 it doesn't on MinIO. I am building some bash evidence and going to ask publicly on MinIO's Github. The issue isn't complex at all. Basically you have trash on Windows/Linux/macOS whatever. If you delete files from your computer, they land in Trash. We can say they're versioned as their latest version is available for restore. From a UI point of view, after deletion, you wouldn't expect for these deleted entries to appear in a location from where they were originally deleted. They're now in Trash (available for further deletion or restore) and shouldn't be present anywhere else. MinIO shows the folder hierarchy in the original location despite that it was all deleted and it's correct place is Trash. I don't think it's a correct behavior from purely "files&directories" UI point of view. (edited)
Avatar
morethanevil 08/07/2023 10:41 AM
Yes this makes sense
Avatar
... and it's also inconsistent, because it doesn't show deleted files, but it shows deleted directories only 🙂
Avatar
morethanevil 08/07/2023 10:45 AM
If you opened an issue, I would like have a link. Want to keep an eye on this
Avatar
Avatar
morethanevil
If you opened an issue, I would like have a link. Want to keep an eye on this
Hey, how are you doing? I am not sure if I actually ever replied to you, but that's the issue: https://github.com/minio/minio/issues/17810 In the meantime we've found one more issue and inconsistency with AWS S3: https://github.com/minio/minio/issues/18148 In other words if you create a tree like this. PUT folder/ PUT folder/file.txt then: LIST folder might not return you the folder/file.txt Apparently they mention it in here: https://min.io/docs/minio/container/operations/checklists/thresholds.html#id6 I am not sure, but we may have to change the way we create folders to overcome this issue. E.g. instead of folder/ we would rather create folder/.empty to not cause conflicting keys.
Avatar
morethanevil 10/20/2023 7:02 PM
Thanks for the reply, I read the thread. If you now have a workaround, it is good 🌞
Avatar
Avatar
morethanevil
Thanks for the reply, I read the thread. If you now have a workaround, it is good 🌞
Hey, how are you? Just FYI, we've included MinIO workaround in 1.6.0 release: https://s3drive.app/changelog
Avatar
morethanevil 11/25/2023 5:53 AM
Hey, I am fine but busy with my daughters ☺😁 I read about the workaround. Thanks
Avatar
That implies at least two girls, lucky man ! 🙂
Avatar
morethanevil 11/25/2023 9:09 AM
Twins ☝🏻😅 10y old
🤾‍♀️ 1
Avatar
Hi, what's the difference between the playstore ultimate plan and the one available in the website?
Avatar
I assume the Play Store one is more expensive? If so, that would be due to Google's fees, you can buy on the website directly if you're interested.
Avatar
Avatar
mizele
Hi, what's the difference between the playstore ultimate plan and the one available in the website?
Leaving price difference aside, in-app purchase on Android applies only Android. With iOS there is an Apple's Universal Purchase (https://developer.apple.com/support/universal-purchase/), so it's also linked to desktop macOS version. Licenses sold on our website are valid on all platforms.
Avatar
Avatar
s3drive
Leaving price difference aside, in-app purchase on Android applies only Android. With iOS there is an Apple's Universal Purchase (https://developer.apple.com/support/universal-purchase/), so it's also linked to desktop macOS version. Licenses sold on our website are valid on all platforms.
Ok thank you, so purchase on playstore is android only got it. Other question, a couple of months ago i was checking the subscriptions and if i remember correctly you were able to buy an annual license and keep the features that were releaesed during that year. Is it still available?
Avatar
That's our #general conversation, feel free to read the last few messages there blobwink
Avatar
how to reset a password? the link that I am receiving to my email always logged me in, instead of resetting it 😓
Avatar
web platform seems cannot reset a password properly, but I tried using my iPhone via Gmail to Safari it seems the app links get detected and properly goes to the Reset Password from the app. Thus, iOS app reset password works properly.
Avatar
Hi @daison, thanks for reporting, we will check the web platform. In principle the reset password link logs you in automatically and then redirect you to the password change: https://web.s3drive.app/password-change We're in the process of improving our auth provider to further improve this workflow.
Easy-to-use client that converts any S3 server into your personal encrypted file storage. Rclone compatible, mount as drive, WebDav server, file versioning.
👍 1
Avatar
I'm trying the music playlist feature, but no sound coming out even ringtones
04:46
I also noticed that APKs are not available anymore. Will you offer that in the future? Perhaps a self updating one? (edited)
04:50
And would it be possible to implement a media AI similar to Immich/Google Photos?
Avatar
Avatar
AD26
I'm trying the music playlist feature, but no sound coming out even ringtones
Thanks for letting me know. Does the play-out issue apply to all music media format? We've used APK as a workaround before Google approved our Folder sync permissions. We will likely provide APK in the future, but it does require some resources that we've redirected elsewhere. Media AI it's on the radar, but realistically we will start work on 2025, as 2024 is mostly about storage, syncing, integration with files and hosted plans.
Avatar
Yes, FLAC, MP3, and OPUS. it plays the song but no sound.
23:53
Re: APK. Not a deal breaker. It's nice for folks who are trying to avoid the Google Play Store. Probably a long shot, but is it possible to remove Google libraries for the Github APK?
23:57
Re: Media AI. That's exciting! I'm pretty content with how the app progressed.
Avatar
confident_rabbit_87075_49035 02/23/2024 4:49 PM
@AD26 FWIW I was using Obtanium to get the apk directly from github
Avatar
Avatar
AD26
Yes, FLAC, MP3, and OPUS. it plays the song but no sound.
In a newer release we've improved the audio player. We haven't found any issues with audio no playing. Can you provide your phone model and OS version please?
Avatar
Avatar
confident_rabbit_87075_49035
@AD26 FWIW I was using Obtanium to get the apk directly from github
Thanks for letting me know. I remember that I've used some alternative to Play Store, which wasn't using Google API, but could browse and install apps from Play Store. EDIT: Got it, it was Aurora Store (edited)
👍 1
Avatar
Avatar
s3drive
In a newer release we've improved the audio player. We haven't found any issues with audio no playing. Can you provide your phone model and OS version please?
it's a base s23 on android 14/oneui6 app version 1.7.12. so when i click the mp3 file, it does nothing, but clicking the open with plays the file. is this the inteded behaviour?
Avatar
Avatar
AD26
it's a base s23 on android 14/oneui6 app version 1.7.12. so when i click the mp3 file, it does nothing, but clicking the open with plays the file. is this the inteded behaviour?
That's definitely not intended. As long as it's an audio file it should be recognized as such (there is an .mp3 icon regardless for every audio file), therefore tapping on it shall by default open the audio player. With next release there will be an improvement, so encrypted audio files will be decrypted on the fly and played out. Perhaps your file was encrypted? (edited)
Exported 69 message(s)
S3Drive - Object lock / enterprise
Guild icon
S3Drive
general / Object lock / enterprise
Avatar
markus.berthold 06/30/2023 11:50 AM
Seems like the web client has the same issue:
11:50
No matter whether an object with the same name has existed before. (edited)
Avatar
Currently it's Discord, support@s3drive.app or https://github.com/s3drive/app/issues Since we already have it here, it's entirely fine, except it normally would be at our (https://discord.com/channels/1069654792902815845/1102236355645419550) channel. (edited)
11:51
The web client is run from the same codebase, so behavior will usually be the same.
11:52
What would be the expectation? I guess proper error message. In other words instead of 400 HTTP code we shall display the issue related to Object Lock / Compliance mode, am I right?
11:53
You've also mentioned that no subsequent upload works. Do you mean that no new file can be uploaded since this error, even if the new upload shouldn't fail because of the compliance settings?
Avatar
Avatar
s3drive
What would be the expectation? I guess proper error message. In other words instead of 400 HTTP code we shall display the issue related to Object Lock / Compliance mode, am I right?
markus.berthold 06/30/2023 12:11 PM
I have enabled the governance mode for the bucket. You can test on your own, I will send you the details in a direct message.
Avatar
Avatar
markus.berthold
I have enabled the governance mode for the bucket. You can test on your own, I will send you the details in a direct message.
That's great, if you could send me the details then it will be helpful in understanding the issue (edited)
Avatar
Thanks for the details, I've connected and got the issue: <?xml version="1.0" encoding="UTF-8"?><Error><Code>InvalidRequest</Code><Message>Content-MD5 HTTP header is required for Put Object requests with Object Lock parameters</Message><RequestId>...</RequestId><HostId>...</HostId></Error> I remember we've solved this issue in S3Drive's predecessor: https://play.google.com/store/apps/details?id=com.photosync.s3 but this didn't end up in S3Drive just yet. Fix: https://github.com/s3drive/app/issues/16#issuecomment-1257024140 In other words we need to add this header if compliance mode is enabled, but since we don't want to do it by default we'll likely add the configurable setting, which will get switched on automatically if we detect this error message. (edited)
12:24
Unless you have better idea how we could address that, that's the path we would likely take.
Avatar
There is a challenge that we need to think how to address, which is related to E2E encryption. In order to calculate the object MD5, we need to know the object contents... but with E2E encryption enabled, MD5 will have to be calculated from the encrypted content, which isn't available (because it's streamed) the moment where we send the initial HTTP requests. (edited)
Avatar
markus.berthold 06/30/2023 12:59 PM
Why do you need the unencrypted MD5 hash?
13:02
Or store additional properties in object metadata?
Avatar
https://docs.aws.amazon.com/AmazonS3/latest/userguide/object-lock-overview.html "If you configure a default retention period on a bucket, requests to upload objects in such a bucket must include the Content-MD5 header. For more information, see Put Object in the Amazon Simple Storage Service API Reference. " https://docs.aws.amazon.com/AmazonS3/latest/API/API_PutObject.html "The Content-MD5 header is required for any request to upload an object with a retention period configured using Amazon S3 Object Lock. For more information about Amazon S3 Object Lock, see Amazon S3 Object Lock Overview in the Amazon S3 User Guide. " Basically we would need to provide object's MD5 ahead of sending any data. With unencrypted data that's fine, we can calculate MD5 locally and then send the HTTP request. With the client-side encrypted data, this is more complicated, since we can't predict how the encrypted content would look like. We could for instance encrypt the object to local FS as a temporary file, then calculate MD5, then stream the encrypted version and then delete a temporary file. We could also do the same in-memory (wouldn't work for big files though). This has certain consequences and complexity though. (edited)
13:13
I am not sure if it's feasible, but we actually could follow the above mentioned workaround (streaming file before sending the HTTP request) for files < 5MB and for files >= 5MB we could use: https://docs.aws.amazon.com/AmazonS3/latest/API/API_CreateMultipartUpload.html API which doesn't seem to require Content-MD5. This API isn't available for files < 5MB, that's why for small files we would have to do it differently. We need to test if this workaround would work, because if it does, this feature would fit nicely in a work that we're doing at the moment: https://s3drive.canny.io/feature-requests/p/multipart-uploads-for-bigger-files (edited)
Avatar
markus.berthold 06/30/2023 1:41 PM
Now I know what you mean. But still all calculations must be done locally. I think MultipartUpload is the preferred way for bigger files. For file < 5MB the encryption +md5 hash could be calculated in memory IMHO.
13:45
I have a question about your E2E encryption: At the moment it looks like you are using a 128 Bit Master Key. What are your plans if you need to improve the E2E? In the future you maybe need to support different encryption types with different key length. This information should/could be part of the "key" which is presented or could be entered.
Avatar
markus.berthold 06/30/2023 1:53 PM
Also for object lock, what are your plans for specifying an individual retention time?
Avatar
Avatar
markus.berthold
Now I know what you mean. But still all calculations must be done locally. I think MultipartUpload is the preferred way for bigger files. For file < 5MB the encryption +md5 hash could be calculated in memory IMHO.
The UploadPart API to upload individual chunks still enforces the Content-MD5 though: https://docs.aws.amazon.com/AmazonS3/latest/API/API_UploadPart.html so chunk size would still have to manageable size for in-memory encryption. If we've used min. size which is 5MB that's fine (memory-wise), except it would limit the upper file size limit to 10k (max chunks) * 5MB = 50GB which in some cases is too small. https://docs.aws.amazon.com/AmazonS3/latest/userguide/qfacts.html We'll likely introduce setting with the preferred size which either user could control or/and would be reasonably pre-filled based on e.g. desktop/mobile or RAM amount.
Avatar
markus.berthold 06/30/2023 2:54 PM
Sounds good.
14:56
The Multi upload also would have the advantage that it might be faster. In my tests I only was able to utilize 8 Mbit/s per upload (with E2E). When multiple chunks are used (and you have multiple cpu cores) that might also be an improvement.
Avatar
Avatar
markus.berthold
I have a question about your E2E encryption: At the moment it looks like you are using a 128 Bit Master Key. What are your plans if you need to improve the E2E? In the future you maybe need to support different encryption types with different key length. This information should/could be part of the "key" which is presented or could be entered.
Current E2E protocol based on AES-GCM is our 2nd revision. Prior to that we supported AES-CBC. There was a transitionary period where we supported both protocols. We could distinct which cipher to apply, because all of ther required encryption scheme information is part of object's metadata (https://s3drive.app/images/aes_encryption.png) Next month or so we will be releasing improvements to our encryption scheme which will use STREAM protocol combined with AES-GCM: https://s3drive.canny.io/feature-requests/p/implement-chunked-encryption-using-stream-protocol This change will reflect the object's metadata. New objects will use new encryption scheme, where as existing objects will remain readable as they are currently. The fact that we use metadata to keep information about encryption makes us pretty flexible if we ever need to improve E2E encryption.
Avatar
Avatar
markus.berthold
I have a question about your E2E encryption: At the moment it looks like you are using a 128 Bit Master Key. What are your plans if you need to improve the E2E? In the future you maybe need to support different encryption types with different key length. This information should/could be part of the "key" which is presented or could be entered.
Master Key is currently 128 bit, however that's the KEK that encrypts CEK which is 256 bit. If we ever need to increase KEK size, that's fine.
Avatar
markus.berthold 06/30/2023 3:02 PM
I have not had a look at the object properties but your approach is good.
Avatar
Avatar
markus.berthold
I have not had a look at the object properties but your approach is good.
That's the approach that AWS used in their encryption scheme, so we've followed the same. This isn't the most universal approach, as there are some storages which do not support metadata, but since we're pretty fixed on S3, that's not an issue for us. (edited)
Avatar
markus.berthold 06/30/2023 3:05 PM
At least from my point of view that's enough. And if enything is (or was) part of the protocol it's not so easy to remove it from the protocol, so I would say it should be safe.
15:06
All storages which claims to use S3 should be compatible with it.
Avatar
Avatar
markus.berthold
The Multi upload also would have the advantage that it might be faster. In my tests I only was able to utilize 8 Mbit/s per upload (with E2E). When multiple chunks are used (and you have multiple cpu cores) that might also be an improvement.
Exactly as you say, there is a room for improvements in that area. With or without multipart upload we've been designing things, so parallelization is possible. For instance with AES-CBC you've had to encrypt "block by block", with AES-GCM you can parallelize encryption, but you would have to find pretty smart implementation or build your own that would allow you to do that. With recent STREAM (https://github.com/miscreant/meta/wiki/STREAM), we have the internal "chunks counter" and have more control over the encryption process (including breaking down encryption blob in to manageable chunks) without losing any of its properties (at least predictable size, random access, authentication, parallel encryption/decryption, reordering protection, truncation protection). (edited)
Avatar
Avatar
markus.berthold
The Multi upload also would have the advantage that it might be faster. In my tests I only was able to utilize 8 Mbit/s per upload (with E2E). When multiple chunks are used (and you have multiple cpu cores) that might also be an improvement.
The only limit is the sky and our technical ability to improve the clients parallel operations (applicable also for other operations, e.g. copy / rename), but this will eventually come. (edited)
Avatar
markus.berthold 06/30/2023 3:12 PM
I understand that at the moment object lock is not possible because of the missing md5 processing. I know it is hard to say but what is your estimation about the above? For the project I mentioned object lock and E2E are two things which are essential.
Avatar
Avatar
markus.berthold
I understand that at the moment object lock is not possible because of the missing md5 processing. I know it is hard to say but what is your estimation about the above? For the project I mentioned object lock and E2E are two things which are essential.
Combined with E2E it's slightly more complex than I've initially anticipated. It would make sense to implement it together with the Multipart upload. Non binding estimate would be that mid-July we shall have a prototype, which will certainly require tweaks, testing. If things go well (that is no more surprises to the protocol requirements) by the end of July this shall land on production. Does it sound reasonable? (edited)
👍🏻 1
15:21
We could workaround just for the sake of completeness and do it without Multipart upload (the local-file solution that I've mentioned). This would speed things up, but it's a double work for us (because ultimately it's a subpar solution which will require replacement anyway). With Multipart upload things are slightly longer, because we also need to combine it with the new encryption scheme release (in other words we don't want to fight with current non-streamable AES-GCM encryption combined with Multipart Upload). (edited)
Avatar
Avatar
markus.berthold
The Multi upload also would have the advantage that it might be faster. In my tests I only was able to utilize 8 Mbit/s per upload (with E2E). When multiple chunks are used (and you have multiple cpu cores) that might also be an improvement.
8 Mbit/s is rather slow. I guess you might've tried file which is bigger than 100MB? Unfortunately this falls back to software encryption which is xx times slower. This will change once we release STREAM protocol next month, which will make hardware encryption apply for all files sizes. (edited)
Avatar
Avatar
s3drive
8 Mbit/s is rather slow. I guess you might've tried file which is bigger than 100MB? Unfortunately this falls back to software encryption which is xx times slower. This will change once we release STREAM protocol next month, which will make hardware encryption apply for all files sizes. (edited)
markus.berthold 06/30/2023 7:09 PM
I made an test with 1 GB and this was the result. The smaller file sizes (10 MB) were realy quick.
Avatar
Avatar
markus.berthold
I made an test with 1 GB and this was the result. The smaller file sizes (10 MB) were realy quick.
Great to hear, anything below <100MB would usually be limited by a network speed, as hardware AES-GCM is pretty fast on a modern CPU. There are also 5 upload isolates, so if user uploads multiple files the load shall distribute evenly between 5 threads. (edited)
Avatar
Hi @markus.berthold I've just wanted to let you know that we've did some research and making good progress on the prototype. We shall have a beta version of S3Drive using new performant encryption scheme, supporting object lock, multipart upload and drive mount (on Windows, Mac and Linux) by the end of next week. Stabilizing these features would take us to the end of July, but we could certainly provide the (beta) build for you to have look. You've also mentioned possibility of setting up different passwords for different folders. We can certainly achieve it by implementing "vault" approach in a similar way as "rclone crypt" (https://rclone.org/crypt/). It's unlikely we will be able to make progress on that this month, but depending on the severity we could prioritize that over our other roadmap items. There are couple challenges that we're facing and we will have to decide to choose compatibility vs performance/security. In summary, we would like to use Rclone's disk mount (for its Windows support and pretty good caching settings), but we would have to make our cipher compatible with Rclone's which is subpar (no truncation protection, no key separation, not performant cipher (XSalsa20, 64KB chunks) for Web) comparing to what we've planned to release with STREAM approach. The other option would be to modify Rclone's to support our scheme, but then we lose compatibility that we could've accidentally gained and then we're ending up with a fork that we would have to maintain. Most realistically, in the short-term we could align with Rclone's ciphers even though it has some implications and web performance won't be great. In next stage we could squezze this model to the limit, perhaps we could liaise with Rclone maintainer's to align certain things, so we don't need to diverge at all. If this doesn't work we could then fork, upgrading cipher and maintaining compatbility with the older cipher is also easy, since Rclone's header contains the cipher versioning.
13:21
If you've some comments on this, that would be great, otherwise we're pushing with these changes... this will benefit anyone including companies and end-users. Did you find any other roadblocks with S3Drive? (edited)
Avatar
markus.berthold 07/04/2023 1:35 PM
I have not had the chance for further tests. I hope I can continue by end of the week.
13:40
Regarding the project: We propably have an appointment with the server manufacturer which has involved us in the project in the next weeks. So it might be the project will be delayed which would be good for us. You don't have to rush with the folder topic. Maybe we can workaround when we get in contact with the customer. The E2E together with object lock is of course still be an important topic.
Avatar
Thanks for letting me know. Speaking of E2EE, how important is the filename / filepath encryption? It would also be good to know to understand what are the requirements for the file sharing. Would files be shared within organisation or externally? There is an item which we need to execute to further improve security: https://s3drive.canny.io/feature-requests/p/secure-encrypted-sharing the challenge is that if we've applied the Rclone's cipher then our "Secure sharing" idea no longer works. (edited)
Avatar
Hi @markus.berthold, quick update from our side. Things went smoother than expected, so we've also decided to build and include filepath encryption in the next major release. We're pushing hard to release all of the improvements, including object lock support, drive mount (including Windows) and multipart upload as early as next week. If there is anything you would like to discuss I am available for a chat. (edited)
Avatar
markus.berthold 07/13/2023 10:24 AM
Hi Tom, I am on a business trip this week abd very limited in time. I am interested to do further testing with object lock when it's available. How are your plans regarding the object lock retention configuration settings?
Avatar
Avatar
markus.berthold
Hi Tom, I am on a business trip this week abd very limited in time. I am interested to do further testing with object lock when it's available. How are your plans regarding the object lock retention configuration settings?
We were mostly focused on technical solution in order to make Object Lock possible at all with E2E encryption given the requirements of MD5 hash generation. As such our testing environment had default retention configuration applied to bucket globally. We haven't really thought how to configure object lock mode from within the S3Drive, but since S3 provides these headers: x-amz-object-lock-mode: ObjectLockMode The Object Lock mode that you want to apply to this object. Valid Values: GOVERNANCE | COMPLIANCE x-amz-object-lock-retain-until-date: ObjectLockRetainUntilDate The date and time when you want this object's Object Lock to expire. Must be formatted as a timestamp parameter. x-amz-object-lock-legal-hold: ObjectLockLegalHoldStatus Specifies whether a legal hold will be applied to this object. For more information about S3 Object Lock, see Object Lock. Valid Values: ON | OFF It's a matter of providing sane settings UI where these settings can be applied. Depending on the requirements there could be multiple layers with override rules. For instance user could specify settings on the bucket level which would then be overridden by the settings on the folder level, then on the sub-folder level (and so on) down until the file level. We're open for suggestions how this should/could work.
Avatar
markus.berthold 07/13/2023 3:26 PM
Your suggestion with default and folder override sounds very good.
Avatar
Hi @markus.berthold, We've finally released things out, feel free to try out our recent major release: https://s3drive.app/changelog We're still resolving issues with Apple regarding the iOS and macOS releases, judging by the sluggish communication I would expect it would take couple more days. In principle you can use current iOS (1.4.0), but on macOS there is only unsigned .DMG version available which won't persist S3 credentials to Keychain properly. I would be glad to know if you find it an improvement and whether recent features satisfy your use case. In the meantime we're monitoring the release and working on couple improvements already.
Avatar
markus.berthold 07/26/2023 11:53 AM
Hi Tom, I hope I will find the time to test everything in the near future. Unfortunately I am very busy at the moment. Regarding the project I talked with you about: From a contact I have heard that a competitor offered the following solution: https://teamdrive.com/en/ So far I had no time to check the product. Maybe it could be interesting for you to know your competitors.
Avatar
Hi Markus, From what I've initially understood, Teamdrive is more like a closed-source version of Nextcloud and is pretty well-established business / product which offers quite rich set of collaboration tools including Office suite. With Teamdrive this comes at the cost of managing multiple moving parts, components: https://teamdrive.com/en/components-and-modules#enterprise and being responsible for multiple Docker, Apache, MySQL deployments, maintenance, updates and availability. Even the web client itself needs separate: "TeamDrive Webportal Server". This all needs to be handled on top of the S3 service that you either buy from 3rd party or host yourself. For some companies it's not a big deal, for some it's a deal breaker. Our idea behind S3Drive is entirely different. Our aim is to deliver value without putting on user burden of hosting anything else besides the S3. There is abundance of hosting providers which sell S3 as a service. Our web client is self-hosted and doesn't needs anything else than a modern browser. This comes at the huge challenge of building around the limitations of S3 protocol itself, but that's on us. Yes, there are many features which will never be as efficient on our side comparing to client<>server<>S3 architecture, but that's the price that we pay to stay compliant with the protocol. Some features with S3Drive might require external connection (e.g. cross-client sync) beside the S3, but our plan is to still use a open protocol (e.g. AMQP), so you can decide if you want to host the queue exchange yourself or buy AMQP as a service. We're all about protocols and recent move with 1:1 Rclone compatibility is another proof. TeamDrive is a different beast and we're not as feature rich, but if one needs pretty basic file management, backup, sync, that's where we shine and we can offer that for half the price. I do appreciate the link though and if you have more alternatives, I would be happy to digest, always good to learn ! (edited)
s3drive changed the channel name: Object lock / enterprise 07/31/2023 5:33 AM
Exported 50 message(s)
S3Drive - announcements
Guild icon
S3Drive
News / announcements
Avatar
Hi folks, Our macOS .DMG package (1.4.6) is now signed by Apple, so you shouldn't be required to tweak the security settings in order to run S3Drive. Even though we haven't received any response from Apple just yet, it all just magically started to work. All the best, Tom Related: https://discord.com/channels/1069654792902815845/1069654792902815848/1133116199958483056 https://developer.apple.com/forums/thread/118465?page=3
👍 1
🎉 1
Avatar
We've updated our Microsoft Apps MSIX release (1.4.6) https://apps.microsoft.com/store/detail/s3drive-cloud-storage/9NX2DN9Q37NS in case you prefer it over our standard .exe release: https://github.com/s3drive/app/releases/ Tom
🎉 1
Avatar
Hi S3Drive and MinIO users, If you're using S3Drive with MinIO you maybe interested in this issue that we've just raised: https://github.com/minio/minio/issues/17810 Basically if you face some issues with directories not being properly deleted (when versioning is enabled), please have a look on this Github link, read and either vote or comment. Thank you ! cc @xenthys @morethanevil UPDATE 10th Aug 2023. Official MinIO's response: https://github.com/minio/minio/issues/17810#issuecomment-1673581871 (Tl;dr; Their storage format doesn't make fixing this bug viable, they actually advertise it as a feature) (edited)
👍 2
😎 1
Avatar
Good news to our Linux users ! 🐧 🖥️ S3Drive is now available on Flathub: https://flathub.org/apps/io.kapsa.drive which is an alternative to our deb and AppImage packages: https://github.com/s3drive/app/releases cc @helios6509 cc @morethanevil (edited)
🎉 1
👍 2
❤️ 1
Exported 4 message(s)
S3Drive - changelog
Guild icon
S3Drive
News / changelog
Avatar
Hi folks, we've got a major update ready ! Today in a 1.3.0 release we've deployed early version of two-way and one-way sync for our desktop (Windows, macOS, Linux) clients. Over the next few months we will be adding new functions and features, improve sync performance and polish the conflict resolution algorithms. Please reach out to us if you come across an issue, as it vastly helps us to improve this tool ! (edited)
👀 1
13:28
Avatar
July update PART 1 Full changelog: https://s3drive.app/changelog It was a longer and more challenging month for us than usual, due to how everything is interconnected and enforced improvements in multiple different components. We don't complain too much and used that as an opportunity to completely improve the ecosystem. Due to many technical limitation we've moved away from AWS's AES-GCM (existing files can be normally opened, don't worry) and even tough we've initially built: https://github.com/miscreant/meta/wiki/STREAM cipher, in the end we've decided to go with Rclone's: https://rclone.org/crypt/#file-encryption There are couple improvements that we'll need to apply, but we're communicating with Rclone maintainers first, to see if it's something we can push to the standard instead of deviating from the current implementation: https://github.com/rclone/rclone/issues/7192 This allowed us to use existing Rclone drive mount, which was added to our desktop clients and can be controlled from newly introduced system tray icon. This will also allow us to deliver: WebDav endpoint and automatically resolved the need for the open source export tool. We haven't stopped on this and implemented filename and directory name encryption and we've made it 100% compatible with Rclone. On top of the existing E2E content encryption, this protects your file metadata, so your S3 won't have a clue what files you store at their servers. Introducing new encryption scheme wasn't compatible with our existing HTML/JS sharing template which was only supporting AES-GCM cipher. We've used that as an opportunity to completely overhaul the sharing module and currently serve the shared content from within the web app. Anytime you generate sharing links, they will be opened and decrypted inside the browser version of S3Drive which is much better experience and automatically provides all of the web features like video playout, ZIP download etc. (edited)
Avatar
July update PART 2 Full changelog: https://s3drive.app/changelog We were requested to build a support for default Object Lock (https://docs.aws.amazon.com/AmazonS3/latest/userguide/object-lock.html) configuration. This enforces: Content-MD5 header to be provided with the request. It was especially challenging when combined with E2E encryption, as this rendered the: "Chicken or the egg" dilemma, where we had to provide MD5 before sending any data, however when we encrypt data we auto-send it in chunks to not cause any memory issues. The solution was to implement Multipart Upload. It's a native S3 feature where file is uploaded in chunks. This allowed us to overcome any memory-hungry operations and divided upload of big files on a smaller manageable chunks. The positive side-effect is that if your file upload fails, when you retry file it will start from the last failure point (currently only works without encryption enabled). Finally, improving the encryption scheme allowed us to build decryption proxy, so we can convert the Rclone encrypted blob into video stream that's understandable by video players. That's how encrypted videos playout was implemented. It was deployed experimentally to all platforms. We didn't manage to build decryption proxy for Web and even if we did, the performance would be terrible (https://github.com/rclone/rclone/issues/7192), so we're temporarily hosting the proxy in our infrastructure. Since it poses some privacy risks, we've implemented BIG WARNING to the user. We've also implemented ZIP download for multiple selected files and delivered lots of bugfixes and performance improvements as usual. (edited)
Avatar
July update FINAL Full changelog: https://s3drive.app/changelog It's been a busy month, but a turning point for S3Drive. We've already received some feedback, bug reports and improvements requests, but it's still not enough to validate if we're going in the right direction. Please let us know, what would you like us to build next? Is there anything we can do to improve your experience with S3Drive? Stay secure, backed up and encrypted. Thank you ! Tom
Avatar
In August we've already released two minor versions, they're now deployed to all platforms. Changes: [1.4.7] - 2023-08-02 Resolve credentials persistence issue during E2E setup, Fix trash ordering, Refresh listings after filename encryption change, Display raw key for Rclone instead of legacy base64, [1.4.6+1] - 2023-08-01 Fix UTF8 / emoji character issues in text edit, Improve filename of taken photos/videos, Add profile switcher icon Thank you @morethanevil for contribution, your feedback was extremely helpful ! (edited)
🎉 1
Avatar
[1.4.8] - 2023-08-06 Add integration with password managers, Resolve video decryption proxy issues on Web, Fix Request Signature issues for bigger files on some S3 providers,
Avatar
August/September 2023 UPDATE 🚀 Most important features implemented: Allow sharing files from other apps and upload it to S3Drive (Android), Allow opening file externally, editing and saving it back to S3Drive - change is detected automatically, Add WebDav server for desktop, Import all buckets feature / autodiscovery, Folder ZIP download, Folder upload, Flathub release: https://flathub.org/apps/io.kapsa.drive Work in progress: Background media backup, Upload constraints (only wifi, only charger, battery not low), Custom backup location, Add a storage class option, Allow to share file from external app to S3Drive (iOS) Detailed changelog: (https://s3drive.app/changelog) [1.5.3] - 2023-09-22 Search by name, size, file type, date modified, Import all buckets feature, Folder ZIP download, Fix bucket listing for Web, Folder upload for Web [1.5.2] - 2023-09-14 Allow opening file externally, editing and saving it back to S3Drive, Fix alphabetic order of folders and filenames, Use “application/octet-stream” content type for encrypted paths, Allow refreshing results on mobile by pull, Add refresh button on desktop/web [1.5.1] - 2023-09-08 Allow sharing files from other apps and upload it to S3Drive, Add WebDav server for desktop, Fix version “prefix issue” match during hard delete, trash delete and rename operations, Fix remaining storage indicator invalid value [1.5.0] - 2023-08-21 Managed account with no bandwidth / API rate limit, Storage quota - display account plan capacity [1.4.9] - 2023-08-13 Fix swipe left/right on Android/iOS, Preserve folder path when quitting preview, Display port in profiles, Improve filename decryption for paths with mixed encrypted/unencrypted segments (edited)
🎉 1
🥳 1
Avatar
Up to date changelog: (https://s3drive.app/changelog) [1.7.0] - 2023-12-29 Add support for 70+ Rclone back-ends, Implement audio player with playlist and background play, Implement native mount on macOS without macFUSE or FUSE-T dependencies, Simplify mount on Windows, Linux, macOS, so no Rclone installation is required, Fix sort toggle setting not being preserved, Fix sub-folder issue during folder sync [1.7.1] - 2024-01-04 Introduce new syncing feature (copy, sync, two-way), Preserve file modification date using: x-amz-meta-mtime header [1.7.3] - 2024-01-08 Android file mount / integration with native file explorer (read-only), [1.7.5] - 2024-01-21 Introduce Android .APK release with local FS sync support, Add additional “Move” (Delete after copy) sync mode, Implement sync folder picker, Fix shared file whitespace issue on iOS [1.7.7] - 2024-01-27 Increase modification time precision, Improve character encoding to solve issues with Cubbit DS3, Add support for libmpv2 in .deb release, Resolve couple issues in Sync functionality (edited)
😍 2
👍 1
Exported 9 message(s)
S3Drive - 2 background process queued
Guild icon
S3Drive
support / 2 background process queued
Avatar
Can’t backup media in background
Avatar
Hi, background sync on iOS is limited to what OS allows. In most cases it runs some time after charged is connected (especially overnight). We don't have much control over this. ...also the execution time is limited, so it's better to do the initial sync not in the background, and then leave background sync to send "diffs".
Exported 2 message(s)
S3Drive - Access bucket with encrypted folder (instead of whole bucket)
Guild icon
S3Drive
support / Access bucket with encrypted folder (instead of whole bucket)
Avatar
Hi, I got an existing bucket that uses rclone crypt inside a specific folder. I'm afraid of turning on the option on S3Drive to use end-to-end encryption, because I believe it assumes the whole bucket is encrypted and not just a specific folder? I tried specifying a folder in the bucket name, but it doesn't accept slashes (edited)
Avatar
There is a feature that needs to be implemented: https://s3drive.canny.io/feature-requests/p/rclone-configuration-encrypt-only-specific-locations At the moment when E2E is enabled, it's being applied globally. Technically it is possible to setup two profiles pointing to same bucket, one encrypted globally and one unencrypted globally, but that setup isn't something we can recommend.
Avatar
Avatar
s3drive
There is a feature that needs to be implemented: https://s3drive.canny.io/feature-requests/p/rclone-configuration-encrypt-only-specific-locations At the moment when E2E is enabled, it's being applied globally. Technically it is possible to setup two profiles pointing to same bucket, one encrypted globally and one unencrypted globally, but that setup isn't something we can recommend.
I think I'd be ok with setting up a 2nd profile of the same bucket. Would you be able to tell where to find S3Drive's config on MacOS? P.S.: Currently I don't need the profile of the bucket unencrypted (1st profile), if that helps avoiding bugs/quirks Edit: I'm trying to move the files to the root folder, so it works nicely in S3Drive. Will let it run overnight (edited)
Exported 3 message(s)
S3Drive - Albums not showing in media sync
Guild icon
S3Drive
support / Albums not showing in media sync
Avatar
As the the title states, I have nothing showing in media sync tab. Android S22 running the most recent version of s3drive. I've allowed permissions Halp!!
👍 1
Avatar
Hi, Can you try accessing media from the: "Albums" bottom nav? Are you getting the permission prompt at all? Would be also interesting to see if you have anything interesting inside logs (long-tap version number at the bottom of About page).
Avatar
Everything seems to show normally in albums and files can open
15:17
Let me see logs
15:17
Avatar
Sorry, but I somehow missed this. Are you still experencing this issue? Am I correct to understand that you can't see the: "Media backup" after clicking the item in the drawer menu?
s3drive changed the channel name: Albums not showing in media sync 10/23/2023 9:23 AM
Exported 7 message(s)
S3Drive - Allow sharing raw unsigned URLs
Guild icon
S3Drive
support / Allow sharing raw unsigned URLs
Avatar
When you share a file, you can decide to use the raw pre-signed URL instead of S3Drive's link. The signature is however not necessary when the bucket / directory / file is publicly readable. For example, I have a bucket with a /public/ directory which is configured as world-readable. Whenever I share a file from this bucket, I just want https://domain.tld/bucket/public/file.ext
👍 1
Avatar
As an addition to this, having an option to choose the domain.tld infront of everything would be nice, so that you can bypass either using the S3 API link, or similar. For instance all three of the following links are technically valid, but from a shareable format for one of my buckets, the bottom would be most optimal, and being able to replace everything before the link and just appending */foldername/file.ext would be beneficial. https://d843ae90cab33e54f4d284bc65d2fd6a.r2.cloudflarestorage.com/sharex/2adrRMxSvi?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=c8e7807dd8cf0a5f005fd526f3279679%2F20230915%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20230915T112311Z&X-Amz-Expires=604679&X-Amz-SignedHeaders=host&X-Amz-Signature=47e2488e23043e971c1dc0d6b24235e225a18b5a4952efd6f263049c779b73e9 - https://pub-0ea304dc97d1413588965fb731c2d5e3.r2.dev/2adrRMxSvi - https://i.cubity.dev/2adrRMxSvi
Avatar
Thanks guys for your comments. Speaking of custom domain prefix (cc @cubityfirst), would this be applicable to signed URLs as well?
18:44
"When you share a file, you can decide to use the raw pre-signed URL instead of S3Drive's link. The signature is however not necessary when the bucket /
"As an addition to this, having an option to choose the domain.tld infront of everything would be nice, so that you can bypass either using the S3 API link, or
Avatar
cubityfirst 09/19/2023 6:44 PM
Personally, I don't care that much about Signed URLs
18:45
Thanks for adding it to the Roadmap 😄
18:45
I only tagged it on here because I was talking to Xen about it in an other Discord :)
Exported 7 message(s)
S3Drive - Android app player load .srt file
Guild icon
S3Drive
support / Android app player load .srt file
Avatar
Hello, I love the android app. Could you please add CC/subtitle feature for S3Drive player?
Avatar
Hi, Thanks for your feedback. Great idea and definitely doable. I've added it as a feature: https://s3drive.canny.io/feature-requests/p/video-player-support-subtitles can't promise anything but we may have it implemented in the upcoming months.
👏 1
Avatar
Great! I don't mind to pay another couple of bucks for the Android app if you implement the feature 😄 btw, if I encrypt it using S3Drive, will I be able to stream the video or I need to download the file first to play video?
Avatar
S3Drive supports encrypted video play-out, but bear in mind that it puts more strains on resources and battery life. We're implementing concept of vaults, so you can encrypt files selectively, e.g. encrypt family videos, but don't encrypt movies that you would like to watch. Speaking of couple of bucks, if you already have a lifetime subscription or in-app purchase this update will be included in one of the next updates. (edited)
Exported 4 message(s)
S3Drive - Android file mount
Guild icon
S3Drive
support / Android file mount
Avatar
confident_rabbit_87075_49035 08/24/2023 5:49 PM
It would be awesome to have the content of the S3 mounts as Android File provider. I am not an Android developer but the Davx5 app does exactly that with their WebDav mounts. I went ahead and scanned their AndroidManifest.xml and this is how they do it (plus implementation of course). https://github.com/bitfireAT/davx5-ose/blob/273deecbe49b9f0c5ae753353ad0f8a514c4c401/app/src/main/AndroidManifest.xml#L288-L296 Thank you for your hard work, using S3 Drive and liking it a lot!
DAVx⁵ is an open-source CalDAV/CardDAV suite and sync app for Android. You can also access your online files (WebDAV) with it. - bitfireAT/davx5-ose
👍 3
Avatar
Hi @confident_rabbit_87075_49035, Thanks for requesting this feature and providing some examples. We've got it on the radar: https://s3drive.canny.io/feature-requests/p/android-virtual-file-system, we don't have any exact ETA, but since it's pretty important feature we will have it implemented rather sooner than later.
Avatar
confident_rabbit_87075_49035 09/03/2023 7:07 PM
Hey thank you! It would definitely save me some sync troubles. My current workflow is: - download keepass db from S3 Drive - keepass merge from local - upload db to S3 Drive I could not find a better way but maybe there are others
Avatar
Hi @confident_rabbit_87075_49035, I've wanted to understand this feature little bit better. At the moment you can open Keepass DB using S3Drive, the issue is that you can't save it back and have it synced automatically. I believe that you need to use "Save as" and then manually upload it to the remote location using S3Drive. If we allowed to "Save" back to the same file and then detected the file change and subsequently synced file using S3Drive automatically would this resolve your use case? Is there anything else that you were proposing with the DavX5 example?
Avatar
confident_rabbit_87075_49035 09/05/2023 6:58 PM
yes, basically DAV mounts are visible in Android's main menu when you save
18:58
Keepassxc contains a save as feature but you cannot see the "Mount point" because S3 drive does not register a provider
19:00
this is what I see when I trigger the Save To
19:00
oops cannot send screenshots?
Avatar
I see, so it's actually different thing. I haven't investigated the "Mount point" as such, so far I've checked the workflow that can be used with e.g. Google Drive. In other words you can open file and don't need to use "Save as" to select the "Mount point", but instead you simply click Save and the Google Drive can pick up the change. That's something we could implement initially. In the long-run we could implement both (including the File Provider mount). (edited)
Avatar
confident_rabbit_87075_49035 09/05/2023 7:03 PM
👍 1
19:03
I see g drive but no option for S3 drive yeah
Avatar
Fair enough, thanks for the example. We're going to investigate how we could implement it for S3Drive.
👍 1
s3drive changed the channel name: Android file mount 09/06/2023 10:41 AM
Avatar
There is a clunky workaround before this gets implemented. Since S3Drive is 1:1 compatible with Rclone format (including the encryption) it would be possible to setup the WebDav endpoint to S3 using Rclone: https://rclone.org/commands/rclone_serve_webdav/ and then mount it using the DavX5. This would require hosting Rclone on a desktop / server though. It may be possible to actually do it from within the mobile (no desktop/sever required) using Rclone for Android: https://github.com/x0b/rcx (it seem to support encryption and WebDav), but I haven't tried that option. Since 1.5.1 S3Drive (due to be released) there will be an option to set up WebDav server on desktop. This also could be used together with DavX5. For a truly independent mobile experience though we need to implement it natively. We're building spec and will be able provide some timelines soon.
Avatar
confident_rabbit_87075_49035 09/20/2023 3:45 PM
Yeah I think that would work - I was actually thinking of mounting the S3 folder with s3fs on linux and expose it via a WebDav server (cause Davx can use that as file provider)
15:46
Thank you Tom, I would honestly gladly pay for such a premium feature (alongside the rest of S3 drive) cause it saves so much time 😄
Avatar
@confident_rabbit_87075_49035 WebDav server is already available on desktop clients: https://s3drive.app/changelog Alternatively you can use: s3fs and run the WebDav server yourself as you say, but you could also achieve the same with our native rclone mount which is likely going to be more performant than a POSIX compatible s3fs.
Avatar
confident_rabbit_87075_49035 09/21/2023 3:19 PM
I'll have to try rclone - do you happen to know how come it is more performant then a file system mount?
15:20
s3fs is indeed quite slow here
Avatar
In both cases they are FUSE mounts (virtual), but Rclone has additional VFS caching: https://rclone.org/commands/rclone_mount/#vfs-file-caching There is a nice comparison of 3 different approaches: http://gaul.org/talks/s3fs-tradeoffs/#1 Tradeoffs: http://gaul.org/talks/s3fs-tradeoffs/#24 If I am correct, Rclone approach is similar to goofys, whereas s3fs offers maximum POSIX compatibility at huge cost. E.g. listing directory with 1000 files will take up to 1000! requests with s3fs, however it will take just one with rclone / goofys. (edited)
👍 1
Avatar
confident_rabbit_87075_49035 09/21/2023 8:05 PM
thank you that's great to know!
Avatar
confident_rabbit_87075_49035 09/21/2023 8:31 PM
@s3drive sorry to ask you this but I am not an expert here I wonder what the implications are for me if there is no uid/gid support... Does that mean that if mounted locally I won't be able to specify group permissions for, say, a dir?
Avatar
I, too, was wondering if this is possible for Android. So, if I'm understanding this request correctly, we're able to mount S3Drive as a file system to replace Google Drive/One Drive? If so, that is something I'd be interested in. However, self-hosting a server is something I'd like to avoid.
Avatar
Avatar
confident_rabbit_87075_49035
@s3drive sorry to ask you this but I am not an expert here I wonder what the implications are for me if there is no uid/gid support... Does that mean that if mounted locally I won't be able to specify group permissions for, say, a dir?
@confident_rabbit_87075_49035 In principle S3 and S3Drive as is currently doesn't support/preserve native permissions or FS metadata (e.g. date modified / created). It is possible to emulate this (and that's what s3fs does - if I am correct) by storing that metadata on S3. The issue is that there is no easy way to query such data. Native S3 listing methods return up to 1000 results at once, but support only couple fields (file name, size, data uploaded etc.) and doesn't list any additional metadata, such metadata must be queried separately. Separate query means 1 request per single file, so basically s3fs in order to be POSIX compatible in some cases needs to issue 1000x times more requests. This has dramatic performance consequences. You're right you won't be able to specify group permissions for a dir. (Actually it may work, but such data won't be preserved when you remount). (edited)
👍 1
Avatar
confident_rabbit_87075_49035 09/22/2023 6:56 PM
I see, thanks! Maybe I don't need Posix if I use rclone, I definitely need it for exposing it via web server cause I don't want to use root or root group (edited)
18:57
the dir I am using has got ten files and it is kinda slow
Avatar
Avatar
AD26
I, too, was wondering if this is possible for Android. So, if I'm understanding this request correctly, we're able to mount S3Drive as a file system to replace Google Drive/One Drive? If so, that is something I'd be interested in. However, self-hosting a server is something I'd like to avoid.
Can't tell exactly when, but native mount for Android will come this year without any Webdav mounts or other tricks. There is some development required which isn't entirely easy given our cross-platform framework which is great, but some native functionality requires little bit more work.
👍 1
Avatar
confident_rabbit_87075_49035 09/22/2023 6:59 PM
oh no worries you guys are doing great work already and as I said I'd gladly pay for such a feature
👍 1
Avatar
Avatar
confident_rabbit_87075_49035
I see, thanks! Maybe I don't need Posix if I use rclone, I definitely need it for exposing it via web server cause I don't want to use root or root group (edited)
I am not exactly sure what's your setup / use case, but if I mount bucket directly from S3Drive (using tray icon), then the mount has the same user permission that app uses. No root required. Permissions of file&dirs: -rw-rw-r-- which is pretty default Rclone setting, but in principle we could add settings configuration to change it.
Avatar
confident_rabbit_87075_49035 09/22/2023 7:07 PM
yeah I am not using a GUI though on the server, if your app works as daemon I can do that
Avatar
Avatar
confident_rabbit_87075_49035
yeah I am not using a GUI though on the server, if your app works as daemon I can do that
We haven't actually thought about this use case, but given that this mount can be directly replaced with rclone command it's probably not a high priority. When you go to the app logs, you will see exactly what commands app executed on rclone binary. You can replicate the same on your server if you wish.
Avatar
confident_rabbit_87075_49035 09/22/2023 7:09 PM
cool
19:09
I'll try that out at some point
Avatar
Great, if you need my input I am happy to help out. I am pretty excited to see S3Drive to be used in a different scenarios 🙂
😃 1
Avatar
confident_rabbit_87075_49035 10/03/2023 4:31 PM
FWIW I followed your advice @s3drive and I am now mounting my folder with goofys - it's another ball game
Avatar
Avatar
confident_rabbit_87075_49035
FWIW I followed your advice @s3drive and I am now mounting my folder with goofys - it's another ball game
Great to hear that. We've been playing with goofys and even had an AWS client-side encryption compatible prototype, ultimately we've replaced it with Rclone, however experience with goofys and its codebase was pretty good. (edited)
Avatar
I'm interested in the same thing for iOS, using File Provider API. Same use-case of KeePass DB (edited)
Avatar
Avatar
s3drive
Great to hear that. We've been playing with goofys and even had an AWS client-side encryption compatible prototype, ultimately we've replaced it with Rclone, however experience with goofys and its codebase was pretty good. (edited)
confident_rabbit_87075_49035 10/04/2023 7:11 PM
Client-side encryption is also important for my use case but fortunately KeePass databases are already encrypted
Avatar
Avatar
paper5590
I'm interested in the same thing for iOS, using File Provider API. Same use-case of KeePass DB (edited)
We definitely plan to support provider API's on both Android and iOS, we're still looking for viable options of implementing this, as given our cross-platform framework this implementation isn't the easiest. Can't promise anything, but do hope we can get it running this quarter.
Avatar
Avatar
confident_rabbit_87075_49035
Client-side encryption is also important for my use case but fortunately KeePass databases are already encrypted
I am not sure if I missed that, but was there any specific reason you went for goofys instead of https://rclone.org/commands/rclone_mount/ ? Did it perform better or perhaps being pure S3 was easier to set up?
Avatar
confident_rabbit_87075_49035 10/04/2023 7:20 PM
goofys was easier to setup - I just added a line in my /etc/fstab
19:20
rclone would have been "a very tiny bit" more work (like, writing/finding a systemd service or a wrapper script) (edited)
Avatar
I was hoping Flutter would take care of it 😮
Avatar
That perfectly makes sense. Actually interesting how such a relatively small points play role in decision making.
Avatar
Avatar
paper5590
I was hoping Flutter would take care of it 😮
On the contrary 🙂
Avatar
confident_rabbit_87075_49035 10/04/2023 7:23 PM
yeah - well you are right, this is my home server and I have to do things during my "free" time - which of course is already close to zero
19:23
(I know you perfectly know what I am talking about lol) (edited)
19:30
one quirk of goofys is that it does not seem to work with the systemd automount feature (that mounts on demand)
19:32
oh wait a second - this rclone feature would have solved my issue
Mount the remote as file system on a mountpoint.
Avatar
Hi @confident_rabbit_87075_49035, How are things? I've just wanted to let you know since couple weeks there is a new sync feature which may satisfy your Keepass workflow (https://discord.com/channels/1069654792902815845/1144327683073908797/1147971175415304274). You can use: "Open with" feature on Android and open file externally in Keepass app. When you save your file this change shall be captured by the S3Drive and synced back to your S3 back-end. Similar mechanism apply for any other file type, e.g. you can open .txt file externally, modify it and then when you save it back it will be captured by the S3Drive. We are still working on File provider as requested, but perhaps this can also improve your workflow. I would be keen to hear if this works for you, thanks ! (edited)
Discord is the easiest way to communicate over voice, video, and text. Chat, hang out, and stay close with your friends and communities.
Avatar
confident_rabbit_87075_49035 11/11/2023 8:09 PM
I will definitely try out, seems to fit well 😃
Exported 51 message(s)
S3Drive - App hangs on Android
Guild icon
S3Drive
support / App hangs on Android
Avatar
When browsing files, scrolling down the pictures i'm trying to view appear slowly - when i click on image for preview, it sometimes loads, sometimes app stops and goes back to home screen or just freezes and I have to close. Seems like a phone memory issue.
👍 1
Avatar
Thanks, do you have E2E enabled? If that's the case is it possible for you to disable E2E and see if there is any change? What's your phone model and Android version?
Avatar
no, E2E disabled, my storage is backing up via node which encrypts. One plus 11 pro oxygen 13.1
Avatar
The S3Drive app on windows also just hangs for me whenever I made a sync folder... It synced one file and now it just keeps getting stuck
s3drive changed the channel name: App hangs on Android 08/13/2023 4:14 PM
Exported 5 message(s)
S3Drive - Audio files preview on Windows / Linux client
Guild icon
S3Drive
support / Audio files preview on Windows / Linux client
Avatar
Audio files preview on Windows / Linux client
Exported 2 message(s)
S3Drive - B2 bandwidth alliance
Guild icon
S3Drive
support / B2 bandwidth alliance
Avatar
How do you route b2 files through CloudFlare to take advantage of bandwidth alliance?
Avatar
You would need to configure your domain name on Cloudflare then configure your B2 bucket to use said domain name. With the Cloudflare proxy enabled, you would essentially be using your bucket as a CDN. Please note Cloudflare has a 100 MB upload limit and 512 MB download limit, which can be limiting depending on how you plan to use your bucket. This is also a general indication, not related whatsoever to S3Drive.
Avatar
Within the app is it possible to use a custom domain name?
Avatar
Whenever you connect to S3 bucket through S3Drive you need to provide gateway. In that case you wouldn't provide B2 gateway, but the Cloudflare proxy.
Exported 5 message(s)
S3Drive - Black Video Thumbnail
Guild icon
S3Drive
support / Black Video Thumbnail
Avatar
Hi, sorry if my English is not very good, because here I use Google Translate, but I hope you can understand what I want to convey. I want to ask why the thumbnail of the video I uploaded only shows a black preview? I will provide some screenshots regarding the problem I am experiencing, and if this problem can be resolved, I plan to start subscribing because this application is very interesting! *Activate the image description feature so you can see my explanation for each image (edited)
Avatar
Hi, no worries, I can understand you just fine ! What's your video format (.mov, .mp4 etc.?) It doesn't seem your file have an extension, which could make format guessing harder. Can you please add extension according to format (you can use rename) and try again?
Avatar
Avatar
s3drive
Hi, no worries, I can understand you just fine ! What's your video format (.mov, .mp4 etc.?) It doesn't seem your file have an extension, which could make format guessing harder. Can you please add extension according to format (you can use rename) and try again?
I've used the mp4 format on every video, but the results are still the same...
Avatar
Quick question, do you use E2E encryption?
Avatar
Avatar
s3drive
Quick question, do you use E2E encryption?
Yes, you can see in the picture that I have attached
Avatar
Ah yes sorry, I haven't zoomed in. Unfortunately we don't yet support thumbnails for encrypted videos just yet. The underyling library that we use for generating thumbnail doesn't yet understand the encrypted file. Given our exciting new features and roadmap. We will have this feature implemented, around ~Q3 2024. (edited)
Avatar
after I experimented for a few hours, I found out what might be the problem.. when I enable E2E Encryption, the thumbnails on the videos don't appear, However, if E2E is not activated thumbnails will be visible
Avatar
Avatar
s3drive
Ah yes sorry, I haven't zoomed in. Unfortunately we don't yet support thumbnails for encrypted videos just yet. The underyling library that we use for generating thumbnail doesn't yet understand the encrypted file. Given our exciting new features and roadmap. We will have this feature implemented, around ~Q3 2024. (edited)
it turned out exactly as I expected
Avatar
That's right, but obviously if file is already encrypted then disabling E2E wouldn't help. Anyway, thanks for your feedback, I've created quick item to track this: https://s3drive.canny.io/feature-requests/p/encrypted-video-thumbnails
Avatar
Avatar
s3drive
That's right, but obviously if file is already encrypted then disabling E2E wouldn't help. Anyway, thanks for your feedback, I've created quick item to track this: https://s3drive.canny.io/feature-requests/p/encrypted-video-thumbnails
Yes, what I mean is that when you disable E2E before uploading a video, the thumbnail will be visible
Avatar
Yep, that's right. Stay tuned for the update 🙂
Avatar
Avatar
s3drive
That's right, but obviously if file is already encrypted then disabling E2E wouldn't help. Anyway, thanks for your feedback, I've created quick item to track this: https://s3drive.canny.io/feature-requests/p/encrypted-video-thumbnails
sorry I have 2 last questions.. Firstly, why when I delete a file in storage/trash, the file appears again when I refresh it
Avatar
Can you please open another support item please? Please also specify your S3 provider.
Avatar
Avatar
s3drive
Can you please open another support item please? Please also specify your S3 provider.
i have tried two s3 providers, namely Synology C2 and Backblaze B2 but the results are still the same
11:39
even when I tried with a trial account without s3 service, I still had this problem
Exported 15 message(s)
S3Drive - Buckets with list only permissions
Guild icon
S3Drive
support / Buckets with list only permissions
Avatar
I'm trying to mount a s3 bucket that has a root that only has listbucket permission. What other permissions are required to mount what is essentially a directory index?
Avatar
S3Drive performs a read check, trying to read some non-existent key which then shall respond with: NoSuchKey message. App as such wouldn't be usable with read permission, so we haven't really implemented support for listing only buckets. You may be better of using raw aws s3 or aws s3api commands. If you aim to mount your bucket you can do so outside of S3Drive, but in an S3Drive compatible manner, please find our guide how to configure bucket: https://docs.s3drive.app/advanced/#setup-with-rclone I am not 100% sure whether Rclone requires anything else than listing permissions though, but in principle it should work. Then you can issue: https://rclone.org/commands/rclone_mount/ manually. If you want to see the exact commands that S3Drive would've used, you can mount some other bucket from S3Drive and copy out commands from application logs (available on the about me page). What's your use case by the way? This will certainly help me to come up with something that works for you ! (edited)
Avatar
Use case is replacing a VPN & a NAS for a small business. The NAS is archive data (customer/job intonation)
13:35
Thank you, i'll take a look at the advanced sample guide
Avatar
... so in other words you're looking for a way to look at file names / directory structure without having specific read/write access to those files?
Avatar
With the bucket root, yes
23:00
S3 browser works fine (too complicated for the users), and I found a different "S3 drive" that I was able to access the sub directories directly, but would prefer to access the root with a read only directory list, with permissions (already works) to access the sub directories.
23:01
From my understanding, I should be able to just add a missing permission to the root that allows s3drive to do it's read check with. I just need to know what permission is necessary
Avatar
We perform https://docs.aws.amazon.com/AmazonS3/latest/API/API_GetObject.html on the: .s3drive_bucket_read_test key. Once you get past that check your listings should work just fine. We will add an option to get past that check in one of the next releases.
Retrieves objects from Amazon S3. To use GET , you must have READ access to the object. If you grant READ access to the anonymous user, you can return the object without using an authorization header.
Avatar
I've tested behavior in our most recent (yet unreleased) 1.6.1 version. Given the S3 permissions: { "Version": "2012-10-17", "Statement": [ { "Effect": "Allow", "Action": [ "s3:List*" ], "Resource": "*" } ] } bucket can be set up without problems despite the read check. Upload/download naturally wouldn't work, but that's expected. (Please note that these error responses come from 1.6.1 version which is due to be released. In older version errors might be rendered differently). Drive mount does also seem to mount properly and listing works. What's your permission set and S3 provider which gets you to: "Access denied"? I would be happy to try that out. Thanks ! (edited)
Avatar
Thank you for the detailed response. My provider is wasabi, and here's the permissions Main bucket policy, shared by all users { "Version": "2012-10-17", "Statement": [ { "Sid": "AllowUserToSeeBucketListInTheConsole", "Effect": "Allow", "Action": [ "s3:GetBucketAcl", "s3:GetBucketCORS", "s3:GetBucketLogging", "s3:GetBucketNotification", "s3:GetBucketObjectLockConfiguration", "s3:GetBucketPolicy", "s3:GetBucketTagging", "s3:GetBucketVersioning", "s3:GetLifecycleConfiguration", "s3:ListBucketMultipartUploads", "s3:ListBucketVersions", "s3:ListMultipartUploadParts", "s3:ListAllMyBuckets", "s3:GetBucketLocation" ], "Resource": "arn:aws:s3:::*" }, { "Sid": "AllowStatement2A", "Effect": "Allow", "Action": "s3:ListBucket", "Resource": "arn:aws:s3:::buckentname", "Condition": { "StringEquals": { "s3:delimiter": "/", "s3:prefix": "" } } } ] } policy for one of the sub directories { "Version": "2012-10-17", "Statement": [ { "Sid": "AllowRootAndHomeListingOfCompanyBucket", "Effect": "Allow", "Action": "s3:*", "Resource": "arn:aws:s3:::bucketname/Folder1/*" }, { "Sid": "AllowStatement2A", "Effect": "Allow", "Action": "s3:ListBucket", "Resource": "arn:aws:s3:::bucketname", "Condition": { "StringEquals": { "s3:delimiter": "/", "s3:prefix": [ "", "Folder1" ] } } }, { "Sid": "AllowListingOfUserFolder", "Effect": "Allow", "Action": "s3:ListBucket", "Resource": "arn:aws:s3:::bucketname", "Condition": { "StringLike": { "s3:prefix": "Folder1/*" } } } ] }
s3drive changed the channel name: Buckets with list only permissions 11/21/2023 9:46 PM
Avatar
Hi, I've had chance to test Wasabi and in fact there is: AccessDenied when trying to login using your attached: Main bucket policy. We'll support this use case and it will work with Wasabi. After setting a bucket user will receive a message: Read check has failed. S3Drive functionality may not work properly., but then will be able to proceed and list files. This will be available in a next 1.6.3 release available in a couple days. (edited)
Avatar
Hi again, this is now partially deployed. It's released everywhere except iOS, macOS (only App Store, .dmg is released) and Windows (only Microsoft Store, .exe is released).
Exported 14 message(s)
S3Drive - Can't exit video player on iPad
Guild icon
S3Drive
support / Can't exit video player on iPad
Avatar
Can't exit video player on iPad. Do you have one, Tom? There's no X button or anything alike (edited)
Avatar
I've had a quick look. It seems we need to improve the preview screens. You should get the "Preview" bar with the back arrow in the verical position, but apparently it's hidden (for videos) on the horizontal preview for a better preview experience. We will make it appear after touching the screen and make it disappear automatically after a short amount of time. Alternatively to quit the preview, you may try swipe left/right to "move away" from the video player to other file preview (if you have one). It seems that the swiping experience isn't greatest. We will try to make it more smooth. We will prioritize these topics and address them hopefully this month.
👍 1
Avatar
Hi @paper5590 , we've made significant improvements to our preview functions. It's still an early release and few more improvements is coming. Most importantly you shall be able to quit the player with the "back arrow". More on preview improvements (https://s3drive.app/changelog): Implement photo zooming, Add smooth swipe left/right media preview, Fix album pictures preview, Add file name caption Please update your version. I would be keen to know if this resolved your issue. Thanks !
👍 1
Avatar
Looks the issue I reported is fixed, but here's a new issue, the seek bar's position is too low, I'm on an iPhone mini now (edited)
Avatar
Thanks for letting me know. We'll have it addressed in a next release. (edited)
Avatar
Hi again, I've thought to ask how it's going and whether you face any other issues with the player? We've addressed the "seek bar" issue in one of the previous releases. Thanks !
Avatar
Avatar
s3drive
Hi again, I've thought to ask how it's going and whether you face any other issues with the player? We've addressed the "seek bar" issue in one of the previous releases. Thanks !
I still can't seek, it's too close to the bottom
Avatar
We'll further move it up in a next release within a ~week.
Avatar
Hi again, we've further moved it up in our today's release. Please let me know if you're finding it any better. Thanks !
Avatar
Avatar
s3drive
Hi again, we've further moved it up in our today's release. Please let me know if you're finding it any better. Thanks !
Hi, thanks for the update. It's tolerable, but not comfortable yet - the sweeping motion is often confused for the gesture for closing the app
17:04
It's tolerable in the sense that if I'm careful, I can seek the video, but not something that one does at first try
Avatar
Thanks for your feedback, we'll aim to further improve this. We're taking lots of shortcuts to bring the most value out of the development time and focus on "quick wins". We'll further reiterate on this to make it comfortable. (edited)
👍 1
Avatar
Still looking forward an improvement, still struggled a lot to seek (edited)
01:53
Actually, non full screen mode has the same issue, full screen is better
Avatar
Sorry for not getting back to you sooner. Can you please confirm if this issue applies purely to an iPad?
Avatar
Avatar
s3drive
Sorry for not getting back to you sooner. Can you please confirm if this issue applies purely to an iPad?
Confirmed, on iPhone mini it looks good. The iPad is an iPad Pro 11" in horizontal mode (edited)
Exported 16 message(s)
S3Drive - Can't open markdown file
Guild icon
S3Drive
support / Can't open markdown file
Avatar
how to open it
Avatar
The first prompt says (translated to english): "Allow "S3Drive" to install apps? Apps installed from external sources have not been checked for security. Is it allowed to install apps from this source? After allowing the installation, it will be detected online." I am not sure why, but your phone treats this .md as if it was the installation package (e.g. .apk) instead of opening list of apps, so you could select some text file editor. I suspect that this has something todo with your phone security settings, but may well be something in the file. Is it possible by any chance if you could send this file over? Feel free to send it to me directly: tom@s3drive.app
s3drive changed the channel name: Can't open markdown file 08/07/2023 8:18 AM
Avatar
i send markdown file to you just now, i can open this md file on apple iphone,but can't open it on this phone
👍 1
Avatar
other text file,like json file also can't open
Avatar
I can open this file in external text editor just fine, I am using Samsung with Android 13. It's hard for me to tell why on your phone it behaves differently, perhaps you could could mess around in the Default Apps settings to see what app is supposed to open text files: https://www.howtogeek.com/43135/how-to-change-the-default-application-for-android-tasks/
Avatar
i set txt default app ,it doesn't work
09:16
i am using oneplus 11
Avatar
I will think about it, but I don't have a clue at the moment. We plan to implement in-app markdown preview: https://s3drive.canny.io/feature-requests/p/markdown-files-preview which shall at least help in your case. By the way, can you download file locally and then open it?
Avatar
ok,tks ,i can open it locally
10:32
Avatar
Cool, so did you have to download it first or it now opens OK?
Avatar
I have to download first, then open anther app to find this file, it's not convenient😩
Avatar
I don't really have OnePlus 11 to test things out. Let's leave this issue here, perhaps there are some other users affected in which case we'll try to find some pattern when it happens and think about the solution. Thanks for your report ! (edited)
Avatar
ok ,thank you
Exported 15 message(s)
S3Drive - Can't purchase a subscription plan
Guild icon
S3Drive
support / Can't purchase a subscription plan
Avatar
backwards152 12/04/2023 8:48 PM
Getting a blank pop up when trying to select the business plan on monthly. The popup is blank and it does nothing to my account.
👍 1
Avatar
I have the same problem when I select any plan
Avatar
Thanks for reporting. In fact we've had a technical issues during subscription purchase that we've now resolved. Sorry for the trouble.
s3drive changed the channel name: Can't purchase a subscription plan 12/07/2023 6:57 PM
Exported 4 message(s)
S3Drive - Clicking the X closes/hides the main window but app still runs in taskbar
Guild icon
S3Drive
support / Clicking the X closes/hides the main window but app still runs in taskbar
Avatar
Also a warning before closing the app while a drive is mounted would be nice as well. Thanks!
Avatar
Hi @hugh1988, thanks for reporting. Is that the macOS app? In principle macOS has issues closing itself if NFS mount is running. The temporary solution is to either use force exit or use macFUSE/FUSE-T mount as explained in our guide: https://docs.s3drive.app/install/#macos_1 We're working on improving this, but the ultimate solution is that macOS native integration with Finder, skipping the NFS/FUSE layes altogether. https://s3drive.canny.io/feature-requests/p/macos-native-file-mount EDIT: I've now realized that you're probably using Windows based on your other support item. In which case it seems like app may not want to close if mount is performing any operations or e.g. file/folder is open without mount directory preventing mount from finishing gracefully. We will aim to add a relevant prompt ! (edited)
Avatar
Ah sorry Tom, I didn't make that very clear this was a feature request rather than reporting a bug! It would be handy to be able to close s3Drive windo but still have the drive mounted, so any file transfers copying dont get interrupted if the window is closed. But perhaps just a warning that there is a drive mounted before quitting would be enough. Thanks
Avatar
Thanks. I understand now. The best option is to use: "Hide" from the tray icon and not to misclick the X. We plan to modify X behaviour so app actually minimizes its window and moves to tray instead of quitting. If user wanted to quite the app they would have to do it explicitly by a quit option from an app or tray icon. Would that work for you?
Exported 4 message(s)
S3Drive - Connect to Google Drive
Guild icon
S3Drive
support / Connect to Google Drive
Avatar
"and my last question is, Do we have to subscribe to Ultimate if we want to use Google Drive or other cloud storage?" "can i try to connect my google drive using just a basic account as a test?" originally asked by @fikanaka
14:20
Please find a link to our documentation: https://docs.s3drive.app/setup/import_rclone/#example-configs which explains how to prepare a Google config which you would then import in the app: https://docs.s3drive.app/setup/import_rclone/
Zero Knowledge E2E encrypted storage compatible with any S3 provider
Avatar
Avatar
s3drive
Please find a link to our documentation: https://docs.s3drive.app/setup/import_rclone/#example-configs which explains how to prepare a Google config which you would then import in the app: https://docs.s3drive.app/setup/import_rclone/
several hours have passed, but I still experience config errors, please help me 😭
19:30
Avatar
Do you have rclone command installed on your desktop anywhere? Whilst running Rclone using Termux on Android might be suficient we've never tried that.
19:33
Can you let me know how did you generate your config?
Avatar
Avatar
s3drive
Can you let me know how did you generate your config?
I just used a code editor application, after exporting the configuration from rclone, I edited the file name to json and changed some of the config a little...
19:41
I'm sure that's not the right way, but that's all I know 😌
19:42
Maybe later I'll just send a video so you can see where I went wrong
Avatar
As you can see it's all not exactly user friendly, soon you will be able to login using your username/password, but currently the setup through Rclone is required... and this is little bit fragile. In principle you need to configure Google Drive on your desktop in a way that if you type: rclone ls driveName: shall give you some files in the listing. Alternatively you can use about command, e.g.: rclone about driveName: and you should get e.g.: Total: 7 GiB Used: 611.346 MiB Free: 6.403 GiB If you're not getting these results, STOP and try setting back-end again using: rclone config as mentioned here: https://docs.s3drive.app/setup/import_rclone/ If things are working good for you at this stage, then use: rclone config dump command in order to extract all configs, then manually select, copy and paste the relevant Google Drive config into S3Drive (click new "+" and import). (edited)
Avatar
Avatar
s3drive
As you can see it's all not exactly user friendly, soon you will be able to login using your username/password, but currently the setup through Rclone is required... and this is little bit fragile. In principle you need to configure Google Drive on your desktop in a way that if you type: rclone ls driveName: shall give you some files in the listing. Alternatively you can use about command, e.g.: rclone about driveName: and you should get e.g.: Total: 7 GiB Used: 611.346 MiB Free: 6.403 GiB If you're not getting these results, STOP and try setting back-end again using: rclone config as mentioned here: https://docs.s3drive.app/setup/import_rclone/ If things are working good for you at this stage, then use: rclone config dump command in order to extract all configs, then manually select, copy and paste the relevant Google Drive config into S3Drive (click new "+" and import). (edited)
Actually, I don't really understand it, but I'll try
20:12
Thank you for helping me a lot, I am sure this application project will be successful in the future.. and in the near future I will start subscribing to this cool application
👍 1
20:14
I hope the 3 things I asked can be improved in the future ☺
Exported 13 message(s)
S3Drive - Corrupted on transfer - Rclone, sync local -> remote
Guild icon
S3Drive
support / Corrupted on transfer - Rclone, sync local -> remote
Avatar
Hi, I'm getting a "Error: Exception: corrupted on transfer: md5 encrypted hash differ" on a one-way copy-mode sync (local->remote) to an encrypted vault in a S3 bucket (versioning on, object lock off) in IDrive E2 on android and Linux. Any idea how to fix this? Thanks! Originally from here: https://discord.com/channels/1069654792902815845/1069654792902815848/1210005577422340148
23:56
Hi @mixih Thanks for your bug report. Quick question, is the vault remote configured manually via Rclone as crypt or is it configured by S3Drive automatically via E2E settings? Did I understand correctly, that on Linux it behaves exactly the same?
Avatar
Hi, it's configured as a native s3 bucket as documented here: https://docs.s3drive.app/setup/import/ using a json file. I have a custom encryption key specified and path encryption enabled using the encryptionKey and filePathEncryption attributes respectively. I am encountering the same thing in the Linux flutter app (both are configured using the same json file if that may be causing it), where it seems to create the folder tree (though strangely there is no place holder file there, even though S3 is supposed to be a flat object store that emulates folders...), and then stop due to the MD5 mismatch. I can upload files and folders normally without any issue by using the manual upload button on both the Android phone and the Linux computer, it seems to be a problem specifically related to the custom path sync feature. (edited)
Personal storage compatible with S3, WebDav and 70+ other Rclone back-ends
Avatar
Thanks for letting me know. We'll release Rclone update from 1.65.1 to 1.65.2 in a next release end of this week / Monday, if this doesn't resolve this issue, then we'll escalate.
👍 1
Exported 4 message(s)
S3Drive - CORS setup Backblaze
Guild icon
S3Drive
support / CORS setup Backblaze
Avatar
avantartist 12/28/2023 6:08 PM
Hi. Looking for some basic setup help. I setup Backblaze B2 buckets and installed the S3Drive app. I was able to make connections to my buckets and able to upload files. I purchased lifetime ultimate S3 and can no longer connect to my backblaze, i had deleted the original profile that was created when I was testing. I can create and upload files on S3Drive apps but don't see them in my backblaze buckets. I've tried creating new buckets and creating new api's but now I can't get the api's to connect when i try and add a new profile. should my backblaze be connected to my ultimate managed profile? I'm receiving a XMLHttpRequest Error to set up CORS (I didn't do this originally) I tried setting them to: Share everything in this bucket with every origin. Please let me know what I'm doing wrong.
Avatar
Hi, thank you for supporting us. You only need an Ultimate account for S3Drive to recognize your license, so you can use all of the paid features. I am not sure if you've seen it already, but we've got a specific guide to setting up Backblaze bucket: https://docs.s3drive.app/setup/#create-bucket You'll need to setup CORS on your bucket first in order to use the web client: https://web.s3drive.app/
08:56
Here is the: "Set up CORS" setting. If you have multiple accounts, including managed / ultimate account you obviously need to switch to your "Backblaze" bucket as indicated on screenshots I've just attached.
Avatar
CORS setting needs to be applies for each new bucket separately... and last time when we've tested Backblaze's: "Share everything in this bucket with every origin" setting it didn't work for us.
Avatar
avantartist 12/29/2023 2:49 PM
Hi @s3drive I’ll give it another try. What’s the specific CORS setting I should use?
Avatar
If you use: "Set up CORS" option, S3Drive will set it up for you, if you would like to set it up yourself please find this post: https://discord.com/channels/1069654792902815845/1136595431934132265/1136703365842206780 (edited)
s3drive changed the channel name: CORS setup Backblaze 12/29/2023 4:05 PM
Avatar
Avatar
s3drive
Here is the: "Set up CORS" setting. If you have multiple accounts, including managed / ultimate account you obviously need to switch to your "Backblaze" bucket as indicated on screenshots I've just attached.
avantartist 12/29/2023 5:54 PM
@s3drive I think I got it sorted out. Thanks for the prompt response!
👍 1
Exported 8 message(s)
S3Drive - Cubbit CORS issues in Web app "Exception: DioException [connection error]"
Guild icon
S3Drive
support / Cubbit CORS issues in Web app "Exception: DioException [connection error]"
Avatar
Everything downloads 0 bytes and gives this message when previewing a text file in the web app. Any idea why? Uploading files seems to work though
Avatar
Hi, This one is likely something CORS related. Feel free to: "Set up CORS" from the settings menu (ideally from a mobile/desktop client) and try again. What's your S3 provider? I would give it a go and check where the issue might be. (edited)
Avatar
ah okay. I tried to set up CORS but it get error "Failed: Not Implemented" so i guess my S3 provider cubbit.io does not support it yet. although they do advertise "100% S3 compatible". Perhaps i need to enable it some how. i'll ask them. thanks (edited)
Avatar
Based on my experience and couple user's bug reports Cubbit is pretty far from being 100% S3 compatible, but most providers have its own quirks be it MinIO or Backblaze. If I can ask, what made you choose Cubbit? I can see some increased interest around them since couple weeks.
Avatar
Of course! Yeah they're still in their early days for S3 which makes bug fixing for you difficult i bet! But they offered a pay-once option a few years ago where you connect your own hard drives to their 'cell' for cloud storage. It was a great idea but was reaaaly slow. They're shutting down their web app and old protocol, and moving completely to S3 so i've now got 4TB of S3 but no way to use it as a personal cloud. Until now! 😁 They have said they'll be making desktop and mobile apps at some point but i won't hold by breath! here's their kickstarter from 5 years ago if you're interested! https://www.kickstarter.com/projects/cubbit/cubbit-reinventing-the-cloud Thanks again, really glad I found S3Drive!
World's first distributed cloud is here. Privacy by design, forever-free, lightning-fast, expandable up to 4TB and more. Join the Swarm
👍 1
s3drive changed the channel name: Cubbit CORS issues in Web app "Exception: DioException [connection error]" 11/23/2023 1:43 PM
Exported 6 message(s)
S3Drive - Cubbit - Encountering 403
Guild icon
S3Drive
support / Cubbit - Encountering 403
Avatar
Aloha, I am using the S3Drive App on Android (v1.7.6). The error is currently happening for some files of various filetypes consistently. In this example I used a pdf. I can access other pdf files without a problem. I am connected to my s3 provider cubbit.io. Over the webpage of the provider I can access the files without a problem.
Avatar
Hi @alaska9123, coincidentally we've improved character encoding for Cubbit in version 1.7.7 based on some user reports: https://s3drive.app/changelog Please update to 1.7.7 and let me know if problem still persist. The issue was caused by the: ( and ) and $ characters only for buckets were versioning was disabled. If you still face this problem even after updating the S3Drive, please send me the full filepath (including special characters - feel free to redact standard alphanumerics for privacy), bucket name and settings (versioning, object lock etc.).
s3drive changed the channel name: Cubbit - Encountering 403 01/28/2024 10:55 PM
Exported 3 message(s)
S3Drive - Decrypt files on Android
Guild icon
S3Drive
support / Decrypt files on Android
Avatar
confident_rabbit_87075_49035 12/26/2023 3:16 AM
Hi there, here is one use case and feel free to dismiss it if there's a better way. I have a bunch of files encrypted with a GPG key on Backblaze. I don't trust the service with my keys so I rolled my very easy script for that. These files are app backups, configuration, etc... Now, on PC it's very easy to have a sync-ed folder and something that decrypts. On Android sometimes I need a backup file (for the email app, say). So I download it and decrypt it with OpenKeyChain. This is a bit cumbersome and it would be awesome to have a better way 😃 Thanks for listening!
Avatar
... so you would be interested in S3Drive supporting PGP encrypted files natively? I will add this to our feature requests, we will consider implementing it once there is enough interest. At the moment we deem Rclone's encryption to be sufficient for files security and privacy. In the nearest future we plan to further improve cipher: https://github.com/rclone/rclone/issues/7192 and/or connect with Cryptomator cipher: https://docs.s3drive.app/setup/cryptomator/
We're running S3Drive (GUI for S3 on desktop, mobile, web) and recently aligned with Rclone's encryption scheme for better interoperability and features like drive mount and Webdav that we ...
Zero Knowledge E2E encrypted storage compatible with any S3 provider
Avatar
confident_rabbit_87075_49035 01/03/2024 6:21 PM
Yes well gpg via OpenKeychain, for instance, on Android would be awesome. Thanks for considering it!
18:21
The thing is rclone can't be used on Android can it?
Avatar
We've been integrated with Rclone crypt since release: [1.4.0] - 2023-07-21 (https://s3drive.app/changelog), it can be enabled in the Settings (it's called E2E on our end, but it's essentialy 1:1 compatible). Most recent release: [1.7.0] - 2023-12-29 provides full integration with Rclone allowing you to use 70+ back-ends on top of S3 (more on that here: https://docs.s3drive.app/setup/import_rclone/). One of the back-ends is crypt (https://rclone.org/crypt/) which means you can use S3Drive to encrypt your data and store it on Dropbox or whenever you want. In a 1.7.1 release which we will release in a few days there will be an option to sync from local file system as well as (on Android, iOS and macOS this option won't be initially available due to different permission systems, we'll need to provide workaround), between different back-ends, so you can e.g. upload some files to Dropbox, some files to Google Cloud and then sync certain folders between them as you need. (edited)
Avatar
confident_rabbit_87075_49035 01/04/2024 5:59 PM
Oh that's cool then - in terms of permissions, the pattern other apps follow is to let you specify a folder yourself, and to ask permission for accessing that only. I will try to post an example of that flow. I guess the next release will solve my problem then, I can use rclone on desktop and on Android. that's cool and will save me a lot of scripting 😄
18:03
18:03
this is from the Neo Store app
Avatar
Actually 1.7.1 release is now a thing ! We love the idea of permissions to only specific folder, the challenge is that these operate on so called Content URIs instead of classic file system (you can notice on your video it starts with content://). That makes it incompatible with classic software, Rclone included. That's why our best solution so far is to aim for MANAGE_EXTERNAL_STORAGE permission which fortunately and unfortunately gives access to the filesystem: https://developer.android.com/training/data-storage/manage-all-files#operations-allowed-manage-external-storage In the long run we could reimplement some syncing logic and make it compatible with these Content URIs... but since Rclone does damn good job already we're not really keen to reinvent the wheel, add maintenance/risks and spend at least couple months initially just to get it right. (edited)
Avatar
confident_rabbit_87075_49035 01/04/2024 6:58 PM
It makes a lot of sense yeah. I guess it is fine to allow access to everything as temporary solution and then improve later. Many apps do that actually (but I always try to avoid giving that very broad permission if I can). Thanks for the thorough explanation!
Avatar
confident_rabbit_87075_49035 01/05/2024 4:29 PM
So If I understand correctly I will be able to mount a bucket in Android and S3 will decrypt the contents of the files (and show me the files names?) transparently? (edited)
Avatar
Avatar
confident_rabbit_87075_49035
So If I understand correctly I will be able to mount a bucket in Android and S3 will decrypt the contents of the files (and show me the files names?) transparently? (edited)
You will be able to access S3 and other endpoints (regardless if they use client-side encryption), using native file explorer on Android, but that's a different feature than the one mentioned above: https://s3drive.canny.io/feature-requests/p/android-mount-point We're also working on it and making good progress. If things go well, then by the end of this month it will be available as an MVP (no streaming initially, so big files will require lots of RAM)
Implement virtual file system on Android using Storage Access Framework / File provider which would allow users to list/open/save files directly from S3Drive,
17:23
... but syncing is a different feature: https://s3drive.canny.io/feature-requests/p/add-syncbackup-for-folders-on-android which is almost there, except we need an approval from Google which we will hopefully get this month as well.
Currently S3Drive supports one-way media (photos&videos) backup to S3. We should add support for custom file type.
👍 1
Exported 13 message(s)
S3Drive - Default sort filter
Guild icon
S3Drive
support / Default sort filter
Avatar
The sort filter seems to reset when entering into the app or other folders. There does not seem to be to be way to have the filter stick through the session or just default to descending with date modified etc. which ends up with how I prefer sort things newest at the top. Maybe holding down on something to make it stick to the sort order would be nice or maybe i missed something. Another thing would be to reduce folder / preview view. Allowing me to either decrease image size to small, medium, large or huge. With this I could maybe get more than just 2 files side by side. The other bugs I have seem to be with folder cache duplication probably need to where I get 2 of each folder all the time. Hopefully does not come across as rant the app great just some things that are bothering me.
Avatar
Hi, thanks for this great feedback. It seems sorting behavior isn't intended, we'll have it fixed. Speaking of folder / preview view, do you mean that tiles in a grid view are too big by default and you would like more granular size control? Speaking of folder cache duplication, is there any chance that within that duplicated folder you have two files where one is encrypted and the other isn't? I would appreciate if you could send me an example or screenshot... perhaps there are some other commonalities? Does it apply to some folders more frequently etc.?
Avatar
I think you are one to something but it’s maybe duplicate files I’ll do some testing but I have group of files that are category and and others that are specific. at times files will be both folders at least they would be the same hash but may not be the same name
01:05
Yeah I mean the grid view is just too large. Would cool to get some smaller grid sizes. Understand that there might be performance impact
Avatar
Could not reproduce the in another bucket with same files. for the duplicate images. Wondering if something was a bit screwy with cache. I'll update if i see it again. I have since just decided to move buckets.
Exported 5 message(s)
S3Drive - DNS wildcard virtual-hosted-style bucket support
Guild icon
S3Drive
support / DNS wildcard virtual-hosted-style bucket support
Avatar
morethanevil 08/17/2023 6:08 PM
This is a subdomain on a new server. I created a bucket named backup too. Now I can not add this bucket, because the app thinks it is in the URL. The complete URL with the bucket name would be: backup.backup.mymte.de I added a bucket test on the same server. Works without issue
Avatar
It's a tricky one, we strip the bucket name from the sub-domain, because some S3 providers provide the endpoint on their dashboard with the bucket name included and if we haven't stripped the bucket name, the resulting endpoint in such format: "backup.backup.mymte.de" wouldn't actually work in that case. Unfortunately you've discovered legitimate case where this doesn't work as expected on your end. We probably won't remove the stripping logic as I am sure that other users would complain. The option is to rebuild the S3 screen, perhaps implement "provider dropdown", so each provider would have some custom additions to make using S3Drive easier. I am going to create a roadmap item for that. I am not sure if there is any easier approach to address this issue. (edited)
Avatar
morethanevil 08/17/2023 9:34 PM
As a workaround I could rename the bucket. This is not a problem 🙂 It is a rare case
s3drive changed the channel name: Virtual-hosted-style bucket wildcard DNS support 09/03/2023 1:09 PM
s3drive changed the channel name: DNS wildcard virtual-hosted-style bucket support 09/03/2023 1:10 PM
Exported 6 message(s)
S3Drive - Failed to upload / incompatible provider
Guild icon
S3Drive
support / Failed to upload / incompatible provider
Avatar
Hi, I've a Samsung S23+, using a cloud provider trought S3 and connected my bucket in S3 Drive app. List/Download files is working fine! But i can't upload any file, even the smallest ones, like 4 bytes. Is there anyway to debug my app locally or someone to help, for fix this?
Avatar
Hi, thanks for your report. What's your S3 provider? Is there any additional information in the Transfers -> tab (Err)? Can you have a look whether there is something useful in About -> Logs?
Avatar
The file dont reached 'Transfers Err' tab, on logs i've this
Avatar
Thanks. Is it possible that you don't have write permissions to the bucket or your IAM settings (if you have one) prevent you from writing to a bucket? It would certainly help if you've provided your S3 provider and configuration.
Avatar
Can you check your dm please
s3drive changed the channel name: Failed to upload / incompatible provider 02/06/2024 6:38 PM
Avatar
It was concluded that S3 provider doesn't support: x-amz-meta-mtime header (https://docs.aws.amazon.com/fsx/latest/LustreGuide/posix-metadata-support.html) and was 403 rejecting the request. On the plus side this made us improve our error reporting, so if request fails like this it will be correctly capture in the Transfers error (1.7.8 release).
Amazon FSx for Lustre automatically transfers Portable Operating System Interface (POSIX) metadata for files, directories, and symbolic links (symlinks) when importing and exporting data to and from a linked data repository on Amazon S3. When you export changes in your file system to its linked data repository, FSx for Lustre also exports POSIX ...
Exported 7 message(s)
S3Drive - Filenames aren't being decrypted on existing bucket (encrypted with rclone crypt)
Guild icon
S3Drive
support / Filenames aren't being decrypted on existing bucket (encrypted with rclone crypt)
Avatar
My rclone config: [b2] type = b2 account = 123 key = 123 hard_delete = true #endpoint = https://s3.eu-central-003.backblazeb2.com [b2-crypt] type = crypt remote = b2:mybucket password = 123
Avatar
Thanks for your report. You may be missing the base64 encoding for the: filename_encoding Please find related issue: https://discord.com/channels/1069654792902815845/1069654792902815848/1136223933201387550 Recommended full Rclone config: https://discord.com/channels/1069654792902815845/1069654792902815848/1135157727216279585 We will be aiming to improve our guides, so this step is better documented.
Avatar
Confirmed, will be re-uploading all files with the suggested config (filaname_encoding)
07:30
Thanks
Exported 4 message(s)
S3Drive - File reappears after deletion
Guild icon
S3Drive
support / File reappears after deletion
Avatar
From @fikanaka "when I delete a file in storage/trash, the file appears again when I refresh it" "i have tried two s3 providers, namely Synology C2 and Backblaze B2 but the results are still the same" https://discord.com/channels/1069654792902815845/1190809909336473610/1190980541621751829
11:42
Is it possible that you've enabled Versioning in S3Drive app whereas versioning it's not enabled on your Backblaze/Synology bucket?
11:42
In other words, what are your versioning settings inside the app and on your Backblaze/Synology accounts?
Avatar
Avatar
s3drive
In other words, what are your versioning settings inside the app and on your Backblaze/Synology accounts?
Please watch the following video, and let me know if any settings are wrong
👍 1
Avatar
We've performed couple tests and we can confirm there is an issue with Synology delete which will be resolved in a next release (couple days). We haven't noticed any issues with Backblaze delete regardless of versioning settings.
12:28
By the way, thanks for the cool and helpful video !
Avatar
Avatar
s3drive
We've performed couple tests and we can confirm there is an issue with Synology delete which will be resolved in a next release (couple days). We haven't noticed any issues with Backblaze delete regardless of versioning settings.
Honestly, I'm confused about how to set versioning on Backblaze, can you help me?
12:35
where can I change the versioning settings?
12:35
Lifecycle settings
12:35
It's enabled by default
Avatar
Avatar
s3drive
Click to see attachment 🖼️
then after I open the lifecycle what should I do?
Avatar
If you want to enable versioning you don't need to do anything. It shall be enabled by default (first option). If you want to disable versioning use: "Keep only the last version of the file" option. (edited)
Avatar
OK, thanks for the answer
12:52
and my last question is, Do we have to subscribe to Ultimate if we want to use Google Drive or other cloud storage?
Avatar
Avatar
fikanaka
and my last question is, Do we have to subscribe to Ultimate if we want to use Google Drive or other cloud storage?
Yes Ultimate will be required to use all the features. We're still working on billing specifics, perhaps single non-S3 account will be allowed in either Pro or Basic version. At the moment it all free as still during (beta), however Ultimate can be bought early with big discount as a subscription (with price lock) or lifetime license. (edited)
Avatar
Avatar
s3drive
Yes Ultimate will be required to use all the features. We're still working on billing specifics, perhaps single non-S3 account will be allowed in either Pro or Basic version. At the moment it all free as still during (beta), however Ultimate can be bought early with big discount as a subscription (with price lock) or lifetime license. (edited)
can i try to connect my google drive using just a basic account as a test?
Avatar
Yeah sure, please find the docs: https://docs.s3drive.app/setup/import_rclone/
Zero Knowledge E2E encrypted storage compatible with any S3 provider
Exported 18 message(s)
S3Drive - glibc issues Debian 12.5 and Fedora (XFCE)
Guild icon
S3Drive
support / glibc issues Debian 12.5 and Fedora (XFCE)
03:28
Hi @jeannesbond, I've moved this to separate support ticket. Could you please try running this test release which bundles also the libc6? https://github.com/s3drive/appimage-app/releases/tag/1.7.11%2B1 Can you also give me an output of: ldd --version ? https://lindevs.com/check-glibc-version-in-linux and output from libc e.g.: /lib/x86_64-linux-gnu/libc.so.6 -> GNU C Library (Ubuntu GLIBC 2.31-0ubuntu9.7) stable release version 2.31. ... also if you could send me an output of: strings /usr/lib/x86_64-linux-gnu/libstdc++.so.6 | grep GLIBCXX this isn't related to AppImage libstdc, but your OS, but may help me to understand this issue. If we don't manage to solve it that way, then I will have to find test it on real Debian / Fedora, not sure if this is XFCE related though. Sorry for not getting back to you sooner, but we're pretty low on resources at the moment. (edited)
Avatar
jeannesbond 02/17/2024 7:50 AM
ldd --version
07:52
ldd which cat | grep libc
07:54
strings /usr/lib/x86_64-linux-gnu/libstdc++.so.6 | grep GLIBCXX
07:56
Try to run app via terminal, return
Avatar
Is it possible to upgrade your glibc on your OS, so when: strings /usr/lib/x86_64-linux-gnu/libstdc++.so.6 | grep GLIBCXX command is used it shows: GLIBCXX_3.4.32? https://stackoverflow.com/a/77075793/2263395 Couple weeks ago, there was an upgrade to our build machine, which may or may not affected the newest glibc required. If possible I would still advise to use Flatpak release which is supposed to solve these issues. In the meantime we'll try to confirm if we can somehow bundle glibc of fallback to older version.
I am using Ubuntu 22.04.3 LTS in WSL. I successfully built and installed GCC 13.2.0 from source. This is how I configured it: ../gcc/configure --host=x86_64-pc-linux-gnu --disable-multilib --enable-
Avatar
yeah, i think better using flatpak now
12:16
Thanks for the response and explanation, Tom. Very helpful.🙏
👍 1
Exported 9 message(s)
S3Drive - How does S3Drive Handle Duplicate Photo Names in Backups?
Guild icon
S3Drive
support / How does S3Drive Handle Duplicate Photo Names in Backups?
Avatar
After backing up my photos using the S3Drive app, I attempted to delete them from my iPhone. I noticed that the files remained in my S3 bucket, which is great. However, I'm curious about what will happen if I reached that photo incremental with the same name, like 'IMG_555.heic.' Will it replace the existing 'IMG_555.heic' in S3? Keep in mind that this refers to a different photo, one that is older or newer but has the same name, inshort different MD5 sum.
Avatar
Hi, these numbers are directly related iOS local internal identifiers: https://developer.apple.com/documentation/photokit/phasset/1624732-fetchassets That is, different photo on a same device is guaranteed to have a different identifier, unless you erase your device and start over again. There is some unconfirmed comment that these identifiers has changed in the history after updating the iOS version: https://stackoverflow.com/questions/40094728/phobject-localidentifier-reliability/46819559#46819559 Which I can't confirm or refute. In which case it's better to play safe and always enable the: "Versioning" on your S3 bucket (or what endpoint you use?), so if this ever happened you could always restore your photos. There are also more complex scenarios, like same photo on a different iOS device (e.g. if you've synced your media between the devices using iCloud). Currently with our local ID approach these photos would be uploaded from one and the other device, receiving different IDs, but there wouldn't be a risk of collision because different device use different upload prefix (configurable from the settings), so unless you use two same iOS models you would be fine. We'll be further improving this in the future by using the: https://developer.apple.com/documentation/photokit/phphotolibrary/2909179-cloudidentifiers ... or given our cross-platform needs, we will handle hashes ourselves, so we have one truly working approach for photo deduplication that works across all platforms not just iOS. I hope this answer your question. Stay backed up and encrypted !
Avatar
Thanks Tom for this great insight you've given, will read more about it. 👏
Exported 3 message(s)
S3Drive - How do I mount as drive in windows?
Guild icon
S3Drive
support / How do I mount as drive in windows?
Avatar
I've just paid for Ultimate, installed Rclone and WinFSP, but i'm still not seeing any option to mount as a drive in the windows app. Any advice? Thank you
hugh1988 changed the channel name: How do I mount as drive in windows? 11/15/2023 2:55 AM
Avatar
Hi, thank you for supporting S3Drive ! Option to mount is in the app tray. Screenshot attached comes from Linux, but the tray menu looks pretty much the same on Windows (edited)
Avatar
ah thank you! Feeling silly now. 😅
Avatar
No worries, you're not the first asking about this, so perhaps the fault is on us. 🙂 We may add additional option from the settings menu to slightly improve chances of people finding it.
Avatar
that would be great, thanks!
Exported 6 message(s)
S3Drive - How to drive mount on MacOS?
Guild icon
S3Drive
support / How to drive mount on MacOS?
Avatar
Hi, I can't see the option to drive mount (v1.5.3), I'm on MacOS. Is this feature implemented? On the website it says "Drive mount". Thanks in advance! (edited)
02:28
I can't find a WebDAV option either...
Avatar
Hi, it's once you click the tray icon.
👍 1
Avatar
Once I hit "start drive mount" the app crashes and closes. I'm on 1.5.0 from app store.
Avatar
@mdavide We haven't explicitly made it clear, however you need to have macFUSE installed (in case you don't have it installed). Please find the instructions: https://github.com/macfuse/macfuse/wiki/Getting-Started Once you have it installed, yet it still doesn't work, can you please go to application Logs and copy the rclone mount line with all the parameters and execute in the terminal. Is there any additional info / error?
Exported 5 message(s)
S3Drive - How to get payment receipt?
Guild icon
S3Drive
support / How to get payment receipt?
Avatar
Thank you for your supporting S3Drive ! Your support item made us review our checkout process and in fact auto-receipt wasn't enabled. We've fixed that this morning so these details are available on the account page, but it will only apply for new subscriptions/license purchases going forward. I've sent couple last receipts manually, if you haven't received a receipt by now, can you please PM me your e-mail, so I can make sure its sent to you? (edited)
Avatar
It was in my spam folder for some reason, just saw it. Thanks!
Exported 3 message(s)
S3Drive - How to setup S3Drive and encrypt files?
Guild icon
S3Drive
support / How to setup S3Drive and encrypt files?
Avatar
I have like over 15 gigs of hentai collection and i want to store them in a secure cloud but how do i even use s3drive!? how to create an acc.!?
Avatar
Hi @lorian9144, please find our FAQ: https://s3drive.app/faq?q=howto In principle you'll need to register an S3 account at some provider: https://docs.s3drive.app/setup/#s3-providers Then you'll have to setup API details: https://docs.s3drive.app/setup/#initial-setup which you use to connect from the S3Drive. You'll need to enable E2E encryption in the Settings (you'll be asked to provide your password which will be used to encrypt your assets). Once it's all done you can then safely upload your files. You will be able to access your files on all devices as long as you connect using same API details and setup same E2E encryption password. I hope that helps a bit. (edited)
Avatar
I cant connect, I have successfully registered and setup API details and enabled encryption whatever
Avatar
Hi again @lorian9144 You need to swap around first two rows. KeyID is first, applicationKey comes second. Since you've shared these keys already in public, once you set it up, please regenerate them for your own safety. Enabling encryption on the Backblaze side wouldn't hurt, but that's Server Side Encryption which means Backblaze at any time can read your data (I am not saying they will, only that they have such technical possibility). If you really aim to protect your privacy, you'll need to enable client-side encryption in S3Drive. (edited)
👌 1
Avatar
@s3drive i did it!! Thanks, kind mister!!
09:10
😊
Avatar
Perfect, depending on your needs you may want to adjust your S3 provider. As far I am concerned Backblaze offers 10GB free account. There are some providers offering little bit more than that, but as always there are some gotchas.
Avatar
which ones offering bit more than that!? I just tried Cloudfare R2 and its okay, good but personally i think backblaze is better than this
Avatar
Whilst I can't recommend any. There are couple others. https://c2.synology.com/en-global/object-storage/overview - 15GB https://www.storj.io/pricing - 25GB There is also Scaleway, they claim 75GB, but there are some gotchas. The Storage Class needs to be configured: https://lowendspirit.com/discussion/4389/scaleways-free-75gb-object-storage S3Drive supports custom Storage Class configuration, however it is a paid feature.
s3drive changed the channel name: How to setup S3Drive and encrypt files? 11/02/2023 11:25 AM
Exported 10 message(s)
S3Drive - In-app purchase doesn't work
Guild icon
S3Drive
support / In-app purchase doesn't work
Avatar
i already upgraded to pro, but after new version update I can't access all profiles, need help
Avatar
Hi @rootdgc, Thanks for supporting us. Quick question are you using at least 1.5.8 version? Did you buy through our website or in-app? On what platform (Android/iOS/desktop) you can't access Pro? (edited)
Avatar
I am using android
07:52
yes it is 1.5.8
Avatar
Can you please PM me your Order ID?
Avatar
where to find Order ID ?
Avatar
If it's in-app purchase there was an e-mail from Google with subject like: "Your Google Play Order Receipt". If you bought it through our website (https://s3drive.app/), then if you send me your e-mail I will be able to find it. (edited)
07:59
only can see that
Avatar
Ok cool, that's an in-app purchase, bear with me. (Feel free to remove your e-mail from the message above to avoid any SPAM issues in the future)
08:04
Right, so can you please let me know what happen when you try to use multiple profiles? I assume you get the "Upgrade prompt"? If that's correct can you please click: "Upgrade" button (don't worry you won't be billed twice), so the app can "restore" purchase from the Google.
Avatar
@rootdgc Just wondering if you managed to resolve the issue? (edited)
08:29
that's when I clicked upgrade to pro
08:30
then I clicked "got it" but still can't access other profiles
Avatar
Right, I am really sorry for this inconvenience. Can I ask you please to register an account and then log-in to your Android app using the e-mail/password? I will be able to activate you all the features using our alternative payment system. In the meantime we're investigating the issues with Google payment. There is a long list of developers affected by the technical in-app-payment issue, only couple % of customers gets affected: https://code.google.com/archive/p/marketbilling/issues/14#makechanges (edited)
08:35
Avatar
@rootdgc We've found root cause of this issue and we're developing a fix which will likely be available later today. If you can't wait until this time, please register an account and I will activate Pro features by e-mail. Sorry for the trouble.
s3drive changed the channel name: In-app purchase doesn't work 10/21/2023 10:39 AM
Avatar
ok, thank you, I will wait for app update
Avatar
Just to give you an update. The fix was sent to Google Play review team yesterday morning, however they seem to have a delay over the weekend. I expect that they will approve this update overnight. I will update this post once this is resolved.
Avatar
Hi @rootdgc , I've wanted to let you know that root cause of this issue is addressed in a recent 1.5.9 release. Please update your app in order to have it resolved. Thank you for your patience and sorry for the trouble. If for some reason you still experience an issue please let me know. Thanks, Tom
Avatar
ok, tq
07:11
it has been resolved, worked flawlessly, great job
👍 1
Exported 24 message(s)
S3Drive - iOS App How To Copy Files to Local
Guild icon
S3Drive
support / iOS App How To Copy Files to Local
Avatar
Hey Guys, thanks for your amazing App. I consider to buy it to use it as a sync for my KeePass and various files from my S3 space. At the moment I try to find out, how to use the app corrctly and set up a sync with an encrypted S3 drive which seems to work. Unfortunately I can only make the file available offline but have no idea where to find it in the ios file system. Is there anything I'm thinking wrong here? Also maybe another feature request: when encrypting with rclone I am able to set up encoded filenames and directories seperatly, in your app it is only available together. maybe a seperation would be nice to be more compatible to rclone. another one: encryption in rclone can be done with 2 passwords (e.g. password and salt) I would like to use this also in your app. So, thats enough for one post I guess, thanks in advance for your help 🙂
Avatar
Hi @currypaul, thanks for kind words. Offline files uses app internal location within iOS ecosystem. I am going to confirm with the team what location is it exactly and whether there are ways to access it externally. I've added a feature to refresh offline versions automatically: https://s3drive.canny.io/feature-requests/p/refresh-offfline-versions (it's been sitting in the internal pipeline for quite a while). I am not sure if this is going to solve your needs, but we're not far from deploying feature to "Allow opening file and save it back directly to cloud": https://s3drive.canny.io/feature-requests/p/allow-to-open-file-and-save-it-back It works so far on desktop and Android and we're porting it to iOS. Rclone 2nd password and salt are in our roadmap: https://s3drive.canny.io/feature-requests/p/support-2nd-rclone-crypt-password https://s3drive.canny.io/feature-requests/p/add-support-for-custom-rclone-salt "when encrypting with rclone I am able to set up encoded filenames and directories seperatly" Our aim so far was to keep things simple and with the least amount of options provide default "secure" workflow. We will be gradually adding up more advanced options to satisfy power users. To understand correctly. Would you like to control whether to encrypt directory names separately to encrypting file names ... or you talk about allow to set up "prefix" / vault locations (at the moment all encryption settings apply to all locations in the bucket).
Avatar
In both cases whether file is offline or not, you can use: "Open" feature which will open file externally. From that point you shall be able to use e.g.: "Save to Files" iOS option. (edited)
Avatar
Hi @s3drive , thanks for the quick reply. "Rclone 2nd password and salt are in our roadmap:" Perfect, thank you "Our aim so far was to keep things simple and with the least amount of options provide default "secure" workflow." This sounds reasonable for me, thanks a lot for the explanation. I just wanted to ask, but yes, I'm encrypting everything, so it is enough in the current state Regarding "Allow opening file and save it back directly to cloud" this would be perfect for me. I would love to see that feature on ios to open and modify files I have on an S3 sync. Unfortunately the "open" feature does not work for me, as my files get an .bin extension when syncing via rclone without name encryption. so I need to download it and rename, what is not possible so easy. I will try again with an fully encrypted file, maybe it works then.
Avatar
Avatar
currypaul
Hi @s3drive , thanks for the quick reply. "Rclone 2nd password and salt are in our roadmap:" Perfect, thank you "Our aim so far was to keep things simple and with the least amount of options provide default "secure" workflow." This sounds reasonable for me, thanks a lot for the explanation. I just wanted to ask, but yes, I'm encrypting everything, so it is enough in the current state Regarding "Allow opening file and save it back directly to cloud" this would be perfect for me. I would love to see that feature on ios to open and modify files I have on an S3 sync. Unfortunately the "open" feature does not work for me, as my files get an .bin extension when syncing via rclone without name encryption. so I need to download it and rename, what is not possible so easy. I will try again with an fully encrypted file, maybe it works then.
If you get .bin extension it does look to me as if you weren't using the filename encryption for these files. This is the config that works with S3Drive: https://discord.com/channels/1069654792902815845/1069654792902815848/1135157727216279585 If filename encryption is off: https://rclone.org/crypt/#crypt-filename-encryption (default is standard), then the .bin suffix gets added. We don't really support stripping the .bin suffix, that's why in the config that we recommend we suggest (Discord link above) we suggest to disable it: https://rclone.org/crypt/#crypt-suffix Given that you already have some data, perhaps we could reconsider support for: .bin stripping for users which used the default setting before running it all up in compatibility with S3Drive. (edited)
Avatar
Yes, I deactivated the file name encryption of my bucket to test the functionality of the app before I buy it. I will try to set my bucket up tithout the suffix, maybe it works better then. Thanks a lot for your help until this point 🙂
Exported 6 message(s)
S3Drive - IOS background backup
Guild icon
S3Drive
support / IOS background backup
Avatar
appreciate you have made inroads on this with the added features (thanks!), but iphone is still not working in background. Android is working fine though - thanks
Avatar
Hey there, sorry for the trouble, it's something that keeps as awake at night 🙂 We're almost there and it works on our debug releases, but for some reason it doesn't work on live release. We're tracing the issue down. We hope to have it solved this month, we then plan to implement couple other tricks & hacks and gotchas suggested by the community to make it more "background" like, because these two modes differ a lot between iOS and Android. Stay tuned for next updates ! (edited)
👍 1
Avatar
great news, many thanks for the update!
Exported 3 message(s)
S3Drive - iOS in-app subscription doesn't seem to work
Guild icon
S3Drive
support / iOS in-app subscription doesn't seem to work
Avatar
I have paid for one month, but I have not Ultimate version. When I am trying to “turn on background backup” I get a message “Background backup media requires Ultimate version” Money was paid.
Avatar
Hi, Thank you for supporting the project and sorry for the issue that you experience. I am having difficulties looking up the orders on the Apple side in order to verify what's going, I am not sure if this issue is related to issue that you experience. I am sorry to ask, but is it possible for you by any chance to register an account: https://s3drive.app/signin and then login to your app? I would then enable your Ultimate subscription via alternate billing before we resolve issue with the Apple Payment? Thanks !
Avatar
sitenevnews 02/19/2024 1:36 PM
anetlcht@gmail.com
Avatar
Sorry, one more thing, can you click on Ultimate plan: https://s3drive.app/pricing so your account ends up added to the billing system. (edited)
Privacy friendly storage available for anyone. Privacy is one of the crucial human rights. We providing a generous package for free which is subsidized by paid users.
Avatar
Can you also try visiting the About page and clicking the: "Restore purchases"? If you don't have that button, do you have the: "Upgrade" button?
Avatar
sitenevnews 02/19/2024 2:38 PM
These two buttons are inactive
14:45
I need ultimate for this 🙂 How can we make it?
Avatar
Please visit the Profiles page again, the Free plan shall change to Ultimate plan, I've activated 180 days trial before we solve the Apple payment issue. Can you please verify? (edited)
👍 1
Avatar
sitenevnews 02/19/2024 2:52 PM
Thanks, seems it works
s3drive changed the channel name: iOS in-app subscription doesn't seem to work 02/19/2024 11:51 PM
Avatar
Subscription related issues shall be resolved in 1.7.14 on iOS and 1.7.15 (macOS). Sorry for the troubles. (edited)
Exported 11 message(s)
S3Drive - Login / switch profile issue
Guild icon
S3Drive
support / Login / switch profile issue
Avatar
morethanevil 10/06/2023 3:46 PM
I got the message that the login to my MinIO failed, but when I click "switch anyway" it works without problems. I tried to reset the complete app, but still have the same problem. It does not matter, wether the folder is encrypted or not. This is the first bug, the second one is a little bit annoying. When I tap the back button on the profile switcher after I got this message, it does not go back to the last screen, it sometimes just leaves the app 😄 Maybe for exiting the app a double tap can be used.
Avatar
Thanks, I am going to retest the workflow. In a recent release we've upgraded the auth library to reduce chances of being logged out from the managed account, but apparently it may've affected the profiles screen. Speaking of MinIO failed login, can you actually see if there is anything useful in logs? Did you use import/export feature? In other words is it possible that the affected MinIO profile was imported/reimported? (edited)
Avatar
morethanevil 10/06/2023 5:54 PM
Where are the logs in the app? In minio I don't get any useful information
17:54
I imported all buckets, as I reseted the app
Avatar
Avatar
morethanevil
Where are the logs in the app? In minio I don't get any useful information
Avatar
morethanevil 10/07/2023 3:37 AM
Found them 😋 Maybe you can move the logs in the about page as an item like changelog, webpage etc.
Avatar
morethanevil 10/07/2023 7:00 AM
Tried again with latest update to v1.5.7 a few minutes ago
Avatar
@morethanevil We're aware of the "IsarError" and fix is due to be released. The temporary fix is usually to click the Login button again.
07:26
The "authorization header" thing is expected for MinIO with custom region set. S3Drive detects region and retries the request.
Avatar
morethanevil 10/07/2023 7:43 AM
Okay, then I will try with next release and report 😃
👍 1
Avatar
Just to let you know, that the update is already Live. I am keen to hear if it resolved your issue.
Avatar
morethanevil 10/07/2023 10:36 AM
Installed and tried again. Works now 🌞 Issue solved
s3drive changed the channel name: Login / switch profile issue 10/07/2023 10:55 AM
Exported 14 message(s)
S3Drive - Modification date isn't preserved on Android
Guild icon
S3Drive
support / Modification date isn't preserved on Android
Avatar
"I use S3Drive 1.7.10 on a phone with Android 12. I created a synchronization task for a folder on the phone (sending from the phone to Baskblaze), "Sync" synchronization mode. The "modification date" is not saved and cannot be restored." Moved from: https://discord.com/channels/1069654792902815845/1069654792902815848/1209424903711752243 (edited)
s3drive changed the channel name: Modification date isn't preserved on Android 02/20/2024 9:06 AM
Avatar
Hi @n1trotoluol, I've moved this as support item / bug report. Thank you for sending these details. Do you get anything in the headers? The last modified field date that we display early on gets directly from S3 and is technically last modified on the remote side, but in fact the real local modification date is stored as: x-amz-meta-mtime header. (edited)
09:12
09:13
Out of curiosity what fancy console is that on Android?
Avatar
n1trotoluol 02/20/2024 9:43 AM
It seems I figured it out, x-amz-meta-mtime actually stores the correct modification date, I didn’t pay attention to this field at first. It turns out that if you simply download a separate file from the storage, then it is downloaded without saving the modification date, but if you make a task to synchronize a remote folder with a local one using the Sync mode, then the date is actually restored from x-amz-meta-mtime. I’m very glad that there is an opportunity so quickly with the nuances of synchronization. The console for Android that I use is Termux ( https://f-droid.org/en/packages/com.termux/ )(also available on Google Play) is very helpful when you need to use console commands)
Avatar
It turns out that if you simply download a separate file from the storage, then it is downloaded without saving the modification date,
What would be the expected behavior? If you download file using S3Drive, so it's saved to Downloads folder, do you think it should set last modified date on file according to this header?
(edited)
Avatar
Avatar
s3drive
It turns out that if you simply download a separate file from the storage, then it is downloaded without saving the modification date,
What would be the expected behavior? If you download file using S3Drive, so it's saved to Downloads folder, do you think it should set last modified date on file according to this header?
(edited)
n1trotoluol 02/21/2024 6:33 AM
There is no obvious answer here. The whole problem here is the use of the "Download folder" in question. It is usually convenient to use this folder when all files are downloaded into it with the current date and time, to make it easier to sort and search for recently downloaded files. But it also happens that you need to download some files with the original date; this is still mostly a backup program. Alternatively, you can, for example, when you click the "Download" button, display a pop-up window with the ability to select a path (where to download) and a checkbox with the option to restore the file modification date, then, if necessary, you could turn it on and select the path where to download. Although, I am very glad that dates and times are restored during synchronization - this was truly important for me. Really very convenient and useful program.
Exported 8 message(s)
S3Drive - Mount not working on Mac with Fuse-T
Guild icon
S3Drive
support / Mount not working on Mac with Fuse-T
Avatar
I'm using s3drive version 1.6.5, rclone version 1.65, and fuse-t version 1.0.33. Attached is the log when i click start drive mount. Nothing shows up in my user folder. Any thoughts? (edited)
Avatar
I needed to uninstall and reinstall Fuse-T. (edited)
18:42
Is there a way to make the volume not have such a long string name?
Avatar
Since 1.7.0 version that we plan to release end of this week FUSE-T and Rclone installation will no longer be required. We'll add an option to configure mount names early 2024.
👍 1
Avatar
great! I am looking forward to using this tool and the new features to come.
Avatar
Hopefully the newly integrated mounted drive in 1.7 will have good performance with uploading high qty's of larger files. using Fuse-T and Rclone currently is pretty unstable and crashes Finder. Using the app is much better currently (edited)
Avatar
Hi @cam00552 and Happy New Year. We're currently at 1.7.2 (DMG) which brings the native NFS mount skipping the FUSE-T / macFUSE layers. If you face any challenges with the new NFS mount you can always keep using the old one with the settings toggle (especially when old mount works both with FUSE-T but also macFUSE kernel extension which is more cumbersome to install but offers better performance). More about all that: https://docs.s3drive.app/install/#macos_1 I would be really keen to know how it performs for you. Speaking of mass upload, we've been tweaking our app so the "Folder upload" can do it efficiently. I am sure that eventually we will make the mount performance comparatively good.
Zero Knowledge E2E encrypted storage compatible with any S3 provider
Exported 7 message(s)
S3Drive - Need help setting up
Guild icon
S3Drive
support / Need help setting up
Avatar
pavitra.dev 12/30/2023 6:17 AM
Hi, I've just bought a subscription online and I need help setting up. I have all the s3 keys with me. But when I log in, It shows the ultimate plan only. If I add a new profile, will I lose the ultimate benefits? How do I set the credentials in the ultimate profile?
Avatar
Hi, Thank you for supporting the project. You only need an Ultimate plan, so S3Drive can fetch your license and enable you all of the premium features. On top of that there is a testing account associated with your user account, so you can test the app on a real S3 storage before you buy the app. No matter what you do you can't lose any Ultimate features, especially when my records show that you've bought an lifetime license that never expires. Please find couple screenshots which indicate how you can set up S3 credentials after you've logged in using managed / Ultimate account. (edited)
Avatar
Thank you!
Exported 3 message(s)
S3Drive - Persistent S3Drive on Windows
Guild icon
S3Drive
support / Persistent S3Drive on Windows
Avatar
I have gotten S3Drive during the Black Friday offer out of interest of the drive mount feature as a persistent cloud storage. I have managed to set it up, but have observed that every time I boot up Windows, I have to first open S3Drive then mount it by right-clicking on the taskbar. Would it be possible to add an option to mount it on Windows startup? (edited)
Avatar
Hi @arkeror, thank you for supporting us ! Option for desktop auto-start is on our roadmap: https://s3drive.canny.io/feature-requests/p/desktop-autostart I will make sure that we add an option to auto mount drive when app starts. We'll likely have it added within the next few weeks !
Avatar
Thanks for the reply, looking forward to it!
Avatar
Hi @arkeror, this feature now landed in just released 1.6.4 version. 🚀 At the moment app starts with full UI, in the future we will fix it, so once it starts it's minimized and stays in tray which I believe would be preferred for most users.
Avatar
That's great to hear! Thanks for the hard work C:
👍 3
Exported 5 message(s)
S3Drive - PhotoSync for S3 not syncing
Guild icon
S3Drive
support / PhotoSync for S3 not syncing
Avatar
I have selected a bunch of folders for auto-upload. But nothing seems to happen. Are they not supposed to upload the contents of the folder? Or do I need to select every file to sync?
Avatar
Hi @pjort.kat, just to make sure that we're on the same page. Are we talking about PhotoSync Android app, S3Drive syncing on desktop or S3Drive media backup on mobile? (edited)
Avatar
It is two different problems, this I am describing here is the PhotoSync ANdroid app
Avatar
Existing files needs to be synced manually, there is a range select to help you with that however if folder is marked for auto-upload and upload constraints are met (only wifi, low battery, charger connected etc.) then any new photo you take shall be synced automatically. There is also a feature which would help you to manage upload status if you switch to a new phone and connect to bucket previously used with PhotoSync (it would recognize file names and mark as uploaded accordingly).
17:27
In S3Drive you can backup existing photos when selecting a folder (prompt asks whether to upload existing or only new), however we don't yet support background upload (something that PhotoSync does): https://s3drive.canny.io/feature-requests/p/background-media-backup
Exported 5 message(s)
S3Drive - Privacy folder / folder lock screen
Guild icon
S3Drive
support / Privacy folder / folder lock screen
Avatar
fardinahmedshovon 09/29/2023 1:08 AM
Include Privacy folder or folder lock system
Avatar
Thanks for adding feature request, can you elaborate on that please? We plan to implement lock screen: https://s3drive.canny.io/feature-requests/p/lock-screen What's the Privacy folder? (edited)
s3drive changed the channel name: Privacy folder / folder lock screen 10/30/2023 5:29 PM
Exported 3 message(s)
S3Drive - Question: API calls for permission settings
Guild icon
S3Drive
support / Question: API calls for permission settings
Avatar
Hi, I would like to setup the (minimum) permissions on my bucket for S3Drive, but I don't know which permissions are actually needed. I thought this info would be useful for others too, but every storage provider security control is different. I recommend to document the used S3 API calls per features what everybody can then translate to their storage provider's security settings. This is probably easy to reach with some search in the source code. Features that I think should be mapped to a list of S3 API calls (this is probably redundant): - "to local" sync - "to local without delete" sync - "to remote" sync - "to remote without delete" sync - "to remote, compatibility mode" sync - "two way" sync - media backup - versioning enabled - multipart upload - MD5 verification - default file listing - trash tab (listing) - recent tab (listing) - thumbnail generation - cache generation / refresh - offline files on mobile (edited)
👍 1
Avatar
We will aim to prepare documentation on this using references to: https://docs.aws.amazon.com/AmazonS3/latest/API/Welcome.html At the very basic we use V2 listing, HEAD/stat (Show info feature), GET/PUT (via Presigned URLs). For delete we use POST/delete. Copying/moving files uses PUT/copy within a bucket followed by delete (if it aims to emulate move) and version delete (if it's hard delete). On top of that we use Versioning API if available (for recent / trash and couple other features). Then there is Multipart API for uploads. This all is combined with additional parameters (e.g. version ID), prefix/delimter for recursive and non-recursive listings or range queries for video streaming... but as far I am concerned parameters are not part of the IAM / permission, so perhaps these are not necessary. In principle all file operations operate on presigned URLs, there are couple exceptions (e.g. creating a file or folder). Speaking of sync, we won't be able to publish it all exactly just yet, since there are couple edge cases we haven't solved. As you can imagine there are some challenges related to the fact that S3 was never designed with efficient syncing in mind... and we're not done on the final workflow for efficient sync. Just to give you an idea. The GET operation provides date in a lower precision (RFC7231) with no milliseconds, however listings have miliseconds included. In order to determine whether sync is needed, shall we use additional LIST (time and cost) to get the exact timestamp, use hashes (what about E2E encryption?) or support both depending on conditions and user configuration (pain to maintain)? (edited)
Explains the Amazon S3 API operations, related request and response structures, and error codes to enable you to store data in the cloud.
Exported 2 message(s)
S3Drive - Quick guide on using Rclone decryption outside S3Drive
Guild icon
S3Drive
support / Quick guide on using Rclone decryption outside S3Drive
Avatar
Hi. I just discovered this great backup tool today and subscribed with the plan. I was wondering if you can possibly set up a quick guide on how to decrypt files using rclone outside of s3drive if backed to backblaze b2. I searched the web but couldn't understand how to decrypt files while downloading them or at least from local even though i have found a possible link which may have indirectly explained it from their forum. Thank you. Decrypting files after downloaded from remote - Help and Support - rclone forum https://forum.rclone.org/t/decrypting-files-after-downloaded-from-remote/17759
Hello, I'm pretty sure this has been asked and answered before, but I am failing to find a close enough match here, or elsewhere in my searching for comfort. Closest I found was this the thread at the forum here: /t/decrypt-partial-version-of-crypt/4683. Which I think answers the question, but I wanted to be super clear before I planned on the ...
Avatar
Hi @crim3819, In principle you need to point crypt Rclone remote to the remote which stores the encrypted data, that could be an external remote or local remote (remote is just a name/concept of Rclone and even though FS is local, it is also called remote). We provide a guide how to set this up and decrypt/encrypt files outside of S3Drive given they're present on some external remote, that is S3 server: https://docs.s3drive.app/advanced/#sample In this guide: s3drive_crypt points to a bucket within s3drive_remote (which is a S3 provider). If your files are already downloaded then you would need to point your s3drive_crypt to your local FS remote instead. That technically means that within: s3drive_crypt you would replace line: remote = s3drive_remote:<bucket_name> with path to your FS, e.g: remote = C:\MyEncryptedData I hope that helps, if you need any assistance on that please let me know. (edited)
Personal storage compatible with S3, WebDav and 70+ other Rclone back-ends
Avatar
Thank you very much kind sir. Wish you all the best.
s3drive changed the channel name: Quick guide on using Rclone decryption outside S3Drive 01/28/2024 10:55 PM
Exported 4 message(s)
S3Drive - Respect MIME Type when previewing files
Guild icon
S3Drive
support / Respect MIME Type when previewing files
Avatar
cubityfirst 10/16/2023 1:08 PM
All of the images that I have uploaded to my bucket don't include an extension, but they do have a file type associated with them. When I click on these extensionless files in S3Drive, nothing happens. It says that the preview is unavailable.
👍 1
Avatar
As you point out we rely on extension to detect the file type. MIME type information isn't available for us when we list the files, so we can't really efficiently determine the file type (and display proper file type / icon upfront). We would have to query each S3 key separately which would have horrendous performance impact. What we could do, upon clicking on the file, instead of displaying "Preview not available", we could silently fetch metadata and based on MIME type we could deduct that's indeed an image or video or something else and then open valid preview. The issue is that it still wouldn't work with encryption enabled. When we upload files we set MIME type to octet stream to not reveal the file contents. This makes this feature applicable to existing buckets with unencrypted files without extension. Can I ask what's your use case having files without extension? (edited)
Avatar
Hi @cubityfirst, sorry for reaching to you directly. We would be happy to include this feature in our roadmap, but I am trying to understand the use case behind files without extension.
Avatar
cubityfirst 10/20/2023 5:08 PM
Oh sorry, I've been crazy busy. The only reason is so that when I'm linking files directly from the bucket, it doesn't show. I could have some other middleware of sorts to strip / allow stripped extensions but at the moment I just upload files with stripped extensions.
17:08
It's probably a super low priority feature because in the grand scheme of things it's probably literally just me. It's just something that I noticed while browsing.
Avatar
Fair enough. I will add this to our internal queue, so we have it in mind when we do changes around file preview etc. Shouldn't be really hard to implement. Thanks for taking time to report this.
Exported 6 message(s)
S3Drive - Right-click context menu on desktop
Guild icon
S3Drive
support / Right-click context menu on desktop
Exported 1 message(s)
S3Drive - S3Drive flatpak - libsecret error
Guild icon
S3Drive
support / S3Drive flatpak - libsecret error
Avatar
Upon starting io.kapsa.drive the application window stays pure white and it gives the error Gtk-Message: 02:13:03.143: Failed to load module "canberra-gtk-module" (kapsa:2): Gdk-CRITICAL **: 02:13:03.199: gdk_window_get_state: assertion 'GDK_IS_WINDOW (window)' failed package:media_kit_libs_linux registered. ** (kapsa:2): WARNING **: 02:13:03.433: libsecret_error: \xa4Z\xe8\x94Ob (edited)
Avatar
Thanks for reporting. What's your host OS? Can you try installing the: gnome-keyring on your host OS? Are you trying to run S3Drive for the first time or perhaps the issue is new?
Avatar
Arch linux with kernel 6.7.2 and gnome keyring is installed with the latest version available to me (1:42.1) This is technically my 2nd time running s3drive, the first time I had an issue you already released a fix for, namely the libmpv.so.2 issue
Avatar
It does seem to be Arch linux specific issue likely related to keychain unlocking, although I didn't manage to find 100% solution just yet. Need to configure Archlinux host (VM won't work for S3Drive) to try things out. In the meantime I've found something about: seahorse package and the necessity of unlocking keyrings. https://stackoverflow.com/a/77338413/2263395 As soon as I find a clear solution I will let you know.
I am on Arch Linux: Linux (desktop) • linux • linux-x64 • Arch Linux 6.4.8-arch1-1 and I am trying to use flutter secure storage but I keep getting this error: ** (home_services_customer:147...
Avatar
I tried seahorse to see if I could get a bit more info and I got the following, not sure if it will help; Unlocking the default keyring changes the libsecret_error to #8\xaf\u0006dY Temporarily removing the password from the default keyring changes the libsecret_error to R9\u001b\xc2\xc1[
Avatar
Thank for your input. We've further tweaked Flathub to fix the FUSE mount which wasn't working properly (and still won't until we get further approval - https://github.com/flathub-infra/flatpak-builder-lint/pull/276), but also added some additional rules required for Gnome keyring: https://github.com/flathub/io.kapsa.drive/pull/31/files Build will refresh in a couple hours: https://flathub.org/en-GB/apps/io.kapsa.drive so by the morning (GMT+1 here) it shall be available. I would then appreciate if you could have a look if it solves the issue. If not we will have to dig deeper.
Avatar
It's live, it may've solved the libsecret issue, but hard to tell. Certainly FUSE mount will need to wait until this gets approved - https://github.com/flathub-infra/flatpak-builder-lint/pull/276
Avatar
Just tested and the app launches now, I'll let you know if I face any other issues
Avatar
That's great news, thanks for letting me know.
Avatar
We've got FUSE fixed and approved, before build gets published by the Flathub (will take couple hours), you can use: flatpak install --user https://dl.flathub.org/build-repo/79739/io.kapsa.drive.flatpakref cc @benoit_52236
Avatar
It's all live.
Exported 11 message(s)
S3Drive - S3Drive Location
Guild icon
S3Drive
support / S3Drive Location
Avatar
motorolo_61023 01/03/2024 10:44 AM
Hi. Why does the S3Drive application use my location on Windows 11? Is it necessary? Can I disable it?”
Avatar
Hi, thanks for your feedback. S3Drive doesn't need location, you can certainly remove location permission to S3Drive. Quick question, do you use .exe release or Microsoft Store release? Did you receive any location permisison request prompt from the S3Drive or perhaps location permission was given to it by default? We're going to investigate why actually it's being reported as if we were using location. (edited)
Avatar
motorolo_61023 01/04/2024 12:36 AM
Hi. Thank you for your prompt response. I'm using the Microsoft Store release. I didn't get any location permission prompt, so I guess it was given by default. I realized the location icon was being shown on the system tray just after using S3Drive for the first or second time. (edited)
Exported 3 message(s)
S3Drive - S3 endpoint and CORS setup
Guild icon
S3Drive
support / S3 endpoint and CORS setup
Avatar
Hi i just setup an s3 bucket on aws and struggling now with accessing it S3Drive app https://web.s3drive.app/loginS3. I created already the accesskey but where can i find the s3-enpoint for my bucket or how do i create it? Many thanks already for any help 🙂
S3Drive allows you to use any of the S3 compatible file storage (e.g. AWS, Backblaze, Wasabi, Scaleway, Storj, iDrive, MinIO etc.) as your Zero Knowledge E2E encrypted cloud storage.
Avatar
morethanevil 08/03/2023 10:45 AM
The endpoint is the URL to connect You can see yours in the docs of AWS ☺https://docs.aws.amazon.com/general/latest/gr/rande.html
Find the endpoints for AWS services.
Avatar
Oh ok, cool thanks. But now i stumble into the next error ^^: "It seams that your bucket isnt configured for web. Please setup CORSE settings". And i can find those settings in my S3-bucket, but have no idea what hast to be there to work with S3Drive? Can you maybe help me also with that one 🥹
Avatar
morethanevil 08/03/2023 1:03 PM
Enable cross-origin resource sharing by setting a CORS configuration on your bucket using the AWS Management Console, the REST API, or the AWS SDKs.
13:03
Bookmark the aws docs, they are helpful if you run into trouble ☺
Avatar
yeah thought so too, and found that already. But which json construct do i need exactly for working with S3Drive? That is my problem currently
Avatar
ok, the following did the trick. GET must be also added to make it working. Thanks for your help ☺️ [ { "AllowedHeaders": [ "*" ], "AllowedMethods": [ "GET", "PUT", "POST", "DELETE" ], "AllowedOrigins": [ "https://web.s3drive.app" ], "ExposeHeaders": [] } ]
🎉 1
Avatar
morethanevil 08/03/2023 2:40 PM
Thanks for sharing your solution 🌞
Avatar
Hi @alex_50852 , In S3Drive there is a: "Set up CORS" button in the Settings menu which can set this up for you. At the moment we use this configuration, which is slightly too heavy due to legacy encryption that we still need to support. <CORSConfiguration xmlns="http://s3.amazonaws.com/doc/2006-03-01/"> <CORSRule> <ID>S3Drive</ID> <AllowedOrigin>https://web.s3drive.app</AllowedOrigin> <AllowedMethod>GET</AllowedMethod> <AllowedMethod>HEAD</AllowedMethod> <AllowedMethod>POST</AllowedMethod> <AllowedMethod>PUT</AllowedMethod> <AllowedMethod>DELETE</AllowedMethod> <MaxAgeSeconds>3600</MaxAgeSeconds> <ExposeHeader>etag</ExposeHeader> <ExposeHeader>x-amz-meta-x-amz-key</ExposeHeader> <ExposeHeader>x-amz-meta-x-amz-iv</ExposeHeader> <ExposeHeader>x-amz-meta-x-amz-cek-alg</ExposeHeader> <ExposeHeader>x-amz-meta-x-amz-wrap-alg</ExposeHeader> <ExposeHeader>x-amz-meta-x-amz-key-v2</ExposeHeader> <ExposeHeader>x-amz-meta-x-amz-tag-len</ExposeHeader> <ExposeHeader>x-amz-meta-x-amz-unencrypted-content-length</ExposeHeader> <ExposeHeader>x-amz-version-id</ExposeHeader> <ExposeHeader>x-amz-meta-key</ExposeHeader> <ExposeHeader>x-amz-meta-iv</ExposeHeader> <ExposeHeader>x-amz-meta-chunk</ExposeHeader> <ExposeHeader>x-amz-meta-cek-alg</ExposeHeader> <ExposeHeader>x-amz-meta-s3drive</ExposeHeader> <AllowedHeader>*</AllowedHeader> </CORSRule> </CORSConfiguration> Please note that in your configuration there are at least couple things missing which may affect some features. For instance HEAD HTTP operation or: x-amz-version-id and x-amz-meta-s3drive (optional) headers. (edited)
👍 1
s3drive changed the channel name: S3 endpoint and CORS setup 08/03/2023 4:53 PM
Avatar
Thanks for the solution. Yeah, as i tried first to setup it with the web-client, i could not access the settings-menu without atleast partly correct CORS settings set for the bucket. But did it now and it worked as i updated them with the "ExposeHeader" fields, etc...
Avatar
Avatar
alex_50852
Thanks for the solution. Yeah, as i tried first to setup it with the web-client, i could not access the settings-menu without atleast partly correct CORS settings set for the bucket. But did it now and it worked as i updated them with the "ExposeHeader" fields, etc...
Technically on the first web login without valid CORS you should've received an error message from S3Drive and prompt to set up the CORS with the link/button. Upon clicking on the prompt the: "Set up CORS" shall be routed through proxy managed by us to overcome CORS limitations on the browser side. If this hasn't happened, then either the CORS settings were partially there or we've failed to detect that. Do you mind sharing what S3 provider are you using?
Avatar
i think then smth went wrong. Cause yes i received the error message on the first weg login, but without the option for a link or button to setup CORS. It was really just the alert message on the buttom and clicking on it doesnt do anything. My S3 Provider is AWS and initially the CORS settings there were blank as i searched for it after the first try to login. And only after may partially correct CORS settings i could login and find then with your help the button in the settings to correct the CORS settings automatically.
Exported 13 message(s)
S3Drive - Save file as [NOT into browser cache]
Guild icon
S3Drive
support / Save file as [NOT into browser cache]
Avatar
szirok_03617 09/01/2023 10:24 AM
please add support to download using save file as, not into browser storage. Lets say on c: drive i have 1gb free space, so i want to save 5gb file on e: drive where i have 200gb free space. i cant because web app downloads to cache on c please add possibility to download using save file as at start, not first to cache
👍 2
Avatar
Thanks for your suggestion. If your file isn't encrypted, then you can use: "Share link" option and then select: "Raw S3 presigned URL". You will get the direct link to your resource which you can use in your browser or any download client. If encryption is enabled there is no decrypted resource URL that we could expose so you could "right click" on it and "Save file as". I am not up to date with the File System API: https://developer.mozilla.org/en-US/docs/Web/API/FileSystemFileHandle/createWritable and whether nowadays it is possible. Do you know any other web-app which offers E2E encryption and have this feature implemented? I would be keen to check out if and how they've managed to achieve it.
s3drive changed the channel name: Save file as [NOT into browser cache] 09/03/2023 1:06 PM
Exported 3 message(s)
S3Drive - Self-signed SSL certificates
Guild icon
S3Drive
support / Self-signed SSL certificates
Avatar
There is an underlying shortcoming in the technology that w use for the S3Drive which results in user managed CAs on the system level not being included in the system HTTP library. There is a relevant issue that will hopefully be able to resolve it: https://github.com/dart-lang/sdk/issues/48056 There are some workarounds that we could implement by allowing user to upload their certificates to the app e.g. https://api.flutter.dev/flutter/dart-io/SecurityContext/setTrustedCertificates.html or by allow certificate whitelisting (even if they fail chain validation)... however this feature isn't the highest priority given our other work. Let's use this item to keep track of the updates. (edited)
👍 1
Exported 1 message(s)
S3Drive - Slow decryption speed browser
Guild icon
S3Drive
support / Slow decryption speed browser
Avatar
By: @AD26 "Moreover, when using the web app, downloads always fail and awfully slow for a 2mb photo. With the app, it works as normal, but similar download speeds." Originally: https://discord.com/channels/1069654792902815845/1069654792902815848/1140770134672285816
07:37
I assume that you're talking about speed for Rclone encrypted objects (the ones that you've uploaded recently / since you've installed 1.4.0+ version). We're trying to influence some improvements to Rclone encryption scheme which would be more performant on Web: https://github.com/rclone/rclone/issues/7192 Regardless of the outcome there are couple improvements that we work on, most importantly so the decryption process doesn't affect UI responsiveness. No matter what, 2MB photo should work without any problems. What's your OS and browser version?
Avatar
Hi Tom, I appreciate the swift response. I'm using Brave browser v116 on MacOS. Yes, small file upload speeds are normal. Download speeds would be problematic once I start to accumulate large files.
Avatar
Basically files encrypted via AES-GCM will be fast up until 100MB size. This is the threshold for hardware acceleration. Anything above falls back to memory safe, but slow software implementation of this cipher. With Rclone's, performance shall be consistent for files of all sizes, faster than AES-GCM > 100MB, but slower than previous AES-GCM HW accelerated mode. We're aware of certain current problems with web performance, I've specifically created a roadmap item to give some visibility to it: https://s3drive.canny.io/feature-requests/p/improve-encryptiondownload-experience-on-web This needs some time though, as before we rush with the "push to the limits" optimizations perhaps there is an easier way, where Rclone cipher could support Web performant ciphers, we're discussing these options here: https://github.com/rclone/rclone/issues/7192
Exported 4 message(s)
S3Drive - Storj Rclone upload missing ETag - can't open/download files
Guild icon
S3Drive
support / Storj Rclone upload missing ETag - can't open/download files
Avatar
Scenario: 1) Data is stored on a Linux machine and synced to S3 bucket with encryption 2) iOS file tries to open PDF 3) Opening PDF fails with "File preview not available" Same happens on macOS (edited)
Avatar
You've said: "rclone 0.65" https://discord.com/channels/1069654792902815845/1069654792902815848/1159811026582241290, are you sure version number is correct? https://rclone.org/changelog/ You've mentioned that problem has gone after clearing thumbnail cache. Is that correct? If that's the case the issue is somewhere around caching with the app when file preview runs. We're going to check if we can improve that (e.g. corrupted cache/local file can be detected automatically).
Avatar
Sorry, rclone v1.64.0 Clearing the cache worked in a previous version, in the current version doesn't help... (edited)
Avatar
Are you using filename encryption? Does the name get correctly decrypted? Can you try opening a file externally: "Open with" on iOS? It would be good to rule out a possible decryption issue. If you go to "Logs" (long-tap version number on about page), is there any error there? (edited)
Avatar
Yes, I use filename and directory encryption. I can see the files and directories, that works. Open With does not work as well
11:47
Problem so far only with PDFs... TXT and JPEG works
Avatar
Did you manage to check the logs? If file can't be opened externally than either this process fail decryption file, or there is a permission issue with the tmp directory on iOS or the PDF format isn't right. There should be something in logs if there is a failure for the first two items. (edited)
Avatar
how can I open the logs? Long pressing "About" where on iOS? Same problem is on MacOS, there the logs are empty (edited)
Avatar
Avatar
s3drive
Did you manage to check the logs? If file can't be opened externally than either this process fail decryption file, or there is a permission issue with the tmp directory on iOS or the PDF format isn't right. There should be something in logs if there is a failure for the first two items. (edited)
TXT and JPEG works, only PDF fails...strange
Avatar
Avatar
jggcvghhhh
how can I open the logs? Long pressing "About" where on iOS? Same problem is on MacOS, there the logs are empty (edited)
It's the drawer menu that you open with top-left icon, then there is "About" menu item. Once you open About page, then at the very bottom there is a version number that you need to long-tap in order to open Logs.
Avatar
ah.... #0 Preview failed:.... Null check operator used on a null value, status 500
Avatar
Avatar
jggcvghhhh
ah.... #0 Preview failed:.... Null check operator used on a null value, status 500
Right, at least tells us that app failed at some point. Let me check that.
Avatar
Avatar
jggcvghhhh
how can I open the logs? Long pressing "About" where on iOS? Same problem is on MacOS, there the logs are empty (edited)
On macOS, can you try downloading a file? Does it appear in Download folder? Does it have non-zero size? Does it open externally? (edited)
12:14
Download does not work, open externally does not work as well (edited)
12:20
This is my rclone config [s3drive] type = crypt filename_encoding = base64 remote = storj:s3drive3333 password = <password> filename_encryption = standard directory_name_encryption = true suffix = none storj is configured separately with standard parameters, no suffix, encoding etc.
Avatar
I will get back to you. There is some error that occurs during file fetch, but we actually fail to capture it properly hence the: "Null check..." issue.
👍 1
Avatar
We've prepared 1.5.7 macOS release which improves error handling in that area and adds new feature: "Show info" which can be used to display object S3 raw data including it's headers. It likely won't fix your download/preview issue, but will likely help us to narrow down where the issue is. It's available in pre-release: https://github.com/s3drive/app/releases/tag/1.5.7, feel free to install it now and will be released ~early next week. Please also attach "Show info" output. This is available in the file context menu at the bottom, after enabling it in the settings.
Avatar
Install the version, turned on object info and when I try to get the object info, the following screen appears
07:20
07:21
If I upload a PDF via S3drive app, opening it afterwards works
Avatar
Thanks for letting me know, it seems that Storj uses different date format (it's actually related to user device locale settings, nothing to do with Storj in the response) we'll have it resolved. Since we've also improved logging, can you please try previewing/downloading PDF and check the logs? Previously there was: "Null check..." issue, but now there is a chance there will be more details to it. (edited)
Avatar
In the meantime we've also updated the macOS build to hopefully resolve the FormatException issue with: "Show info": https://github.com/s3drive/app/releases/tag/1.5.7
Avatar
Object Info..
Avatar
Perfect ! That explains a bit. There is no valid ETag coming from the S3 API. Is that Storj?
12:33
BTW. If thats Storj, are you running Storj gateway yourself or use their public endpoint? (edited)
Avatar
I use the public endpoint with storj (edited)
12:34
I try with B2 and let you know
Avatar
I tried the same scenario with backblaze, and it works out of the box. so it really seems to be related to storj
18:02
Same config as with storj (edited)
Avatar
Thanks for letting me know @jggcvghhhh Hi @storj-derek, sorry for reaching to you directly, but I've thought you could shed some light on this issue and help us to resolve it. In summary, in some cases Storj doesn't return ETag. I don't know any other S3 API which does this. Basically ETag is always expected to be present. In some cases (e.g. multipart upload) it might have different format, but it is never empty/null. Is this issue some specific design of Storj S3 Gateway or perhaps is this a bug? I've found similar issue here, but apparently it's now resolved: https://github.com/storj/storj/issues/3761 (edited)
It appears that the gateway does not send the ETag. This causes S3DataError: BotoClientError: ETag from S3 did not match computed MD5 messages on file upload by the python-boto clients such as dupl...
08:51
@jggcvghhhh Just a question, does it specifically happen for: ".pdf" files uploaded via Rclone? In other words if you upload: ".txt" file via Rclone does Etag gets correctly generated? (edited)
Avatar
Yes, txt is fine and can open it. PDF fails
Avatar
I won't be able to solve issues on the Storj level, but I've tried to set up Rclone with crypt in order to reproduce the request that leads to an object without valid ETag on the Storj side. I am using rclone v1.63.0 and configured my storage like: [storj] type = s3 provider = Other access_key_id = <redacted> secret_access_key = <redacted> endpoint = https://gateway.storjshare.io [storj_crypt] type = crypt filename_encoding = base64 remote = storj:my-photos password = <redacted> filename_encryption = standard directory_name_encryption = true suffix = none I've then copied test pdf like this: rclone copy test.pdf storj_crypt: and I get valid object with ETag and openable within S3Drive. Can you post your Rclone storj remote configuration? You've initially posted config, but that's just crypt: https://discord.com/channels/1069654792902815845/1159814485515710525/1159827592732479590
Avatar
I use type = storj #instead of type=s3 Try that tomorrow. Thanks a lot for your efforts! (edited)
Avatar
Avatar
jggcvghhhh
I use type = storj #instead of type=s3 Try that tomorrow. Thanks a lot for your efforts! (edited)
Glad I can help. Based on this comparison: https://rclone.org/storj/ you may want to benefit from S3 back-end anyway.
Use the s3 backend and one of the S3 compatible Hosted Gateways to increase upload performance and reduce the load on your systems and network. Uploads will be encrypted and erasure-coded server-side, thus a 1GB upload will result in only in 1GB of data being uploaded to storage nodes across the network.
At the bottom there is a limitation of Storj backend
Limitations: Storj backend: rclone checksum is not possible without download, as checksum metadata is not calculated during upload
I don't know much about Storj, but perhaps this would explain the ETag issues. In other words, when uploading file through Storj (non-S3) API the hash is never calculated. If you upload it through S3 gateway, then MD5 (aka ETag) gets calculated (stored as metadata in Storj) and then retrieved through S3 API. This table: https://rclone.org/overview/ specifically shows thay Storj has no hashing, whereas: Amazon S3 (or S3 compatible) has: MD5.
👍 2
s3drive changed the channel name: Storj rclone upload missing ETag - can't open/download files 10/10/2023 10:17 AM
s3drive changed the channel name: Storj Rclone upload missing ETag - can't open/download files 11/11/2023 7:10 PM
Exported 39 message(s)
S3Drive - Sync media from mobile to desktop
Guild icon
S3Drive
support / Sync media from mobile to desktop
Avatar
so, say i've got my S3drive on my phone with media backup enabled and I want those photos etc on my desktop as well - i appreciate I can grab files individually no problem but is there a way to sync the automatic upload to a desktop file? eg the whole file and all contents as per attached?
👍 1
s3drive changed the channel name: Sync media from mobile to desktop 09/03/2023 10:29 AM
Avatar
Hi @buzz69. , there is no direct sync from mobile to desktop, however once your mobile uploaded folder correctly to S3 you can then sync this folder to your desktop using for instance: "To local" sync option. You will then need to select the local folder first and then type your remote S3 folder: LE2123.
Avatar
see i knew there was a way! - thanks so much.
Exported 4 message(s)
S3Drive - Trash error
Guild icon
S3Drive
support / Trash error
Avatar
fardinahmedshovon 09/21/2023 5:16 AM
Showing this error in trash. #general
Avatar
@fardinahmedshovon Your bucket doesn't seem to support versioning which is required for Trash to function. If you go to the settings you can disable Versioning which will reconfigure the app. Unfortunately Trash option will become hidden, but you won't face this error anymore.
Exported 2 message(s)
S3Drive - Trash Files are not deleting
Guild icon
S3Drive
support / Trash Files are not deleting
Avatar
I was trying to delete 1300+ pics in my trash , but every time I delete it just deletes one pic from the whole.
👍 1
Avatar
confident_rabbit_87075_49035 08/24/2023 8:39 PM
I also found this to be true
Avatar
Hi @wolfefx , @confident_rabbit_87075_49035 Thank you for reporting this issue. What's your S3 provider? Is there any error/warning in the app logs? (Long-tap on version number at the bottom of About me page).
Avatar
AWS S3
Avatar
This is behaviour that I am finding when I am deleting multiple files from Trash using: "Delete all versions". S3Drive fetches the version IDs for each object in trash and then issues batch delete for all IDs at the end, after which files shall be permanently deleted. I've added the improvement item to improve speed of this process: https://s3drive.canny.io/feature-requests/p/improve-speed-of-delete-in-trash When you delete files do you also get this pop-up? What's the end result? Am I correct to understand that only 1 files gets deleted out of all that you've selected? Do you use object lock? (edited)
Avatar
confident_rabbit_87075_49035 09/03/2023 7:10 PM
@confident_rabbit_87075_49035 mine is backblaze
Avatar
@confident_rabbit_87075_49035 Given that you face this issue as well, what's the app behaviour exactly? Can you help us to reproduce it? In my comment above I was trying to delete ~101 items and all were removed from the list and effectively deleted from S3. (edited)
Exported 7 message(s)
S3Drive - Using Cloudflare's R2 (S3 Compatible)
Guild icon
S3Drive
support / Using Cloudflare's R2 (S3 Compatible)
Avatar
I am using Cloudflare's R2 S3 Compatible Object Storage. I used the S3Drive mobile application for Android. After successful login it shows this error and does not list the objects. MinioError: ListObjectsV2 search parameter maxKeys not implemented
👍 1
Avatar
Hi @secrethash and thanks for reporting this issue. In fact we haven't been using S3Drive with Cloudflare previously. It does seem that they doesn't support maxKeys parameter that we're using even though its support is advertised as implemented: https://developers.cloudflare.com/r2/api/s3/api/ We'll implement a workaround and have it deployed over a next few days if not sooner. I will let you know once it's released. Stay tuned ! (edited)
👍 1
Avatar
Thank you @s3drive for your help. I appreciate it.
06:02
Alternatively, should I report this issue to Cloudflare too? I also checked their api docs and they have mentioned to support maxKeys param.
Avatar
@secrethash Definitely, there is no harm reaching out to Cloudflare. We've addressed the max keys issue and waiting for Google to approve the release on Play Store which shall happen within next ~12-24 hours. Unfortunately in the meantime we've found out that there is no content-length header in the response (e.g. during file download/open). We rely on it to display transfer progress results as well as to make certain predicaments related to encryption. In theory we could implement content-length workaround, but it would take us little bit while. We're going investigate first whether it is possible to enable that header. I know that Cloudflare has some logic behind the content-length header which in some cases is provided and in some isn't... we'll have a look on it as well, however if you're going to reach out Cloudflare it is something you can ask about as well. Thanks (edited)
🔥 1
Avatar
Great @s3drive I just got the update from Google Play Store and it works like a charm now.
17:49
I will surely contact Cloudflare's support and address the issue to them. I will update you with there response too.
Avatar
Hey @s3drive I guess the problem with maxKeys problem could be similar to this issue on community post. Could you please confirm? https://community.cloudflare.com/t/accessing-r2-from-databricks/506230
Hi all, I’m trying to read a dataset in r2 from databricks, but encountering an issue (full log below). Seems to be something related to incompatibility between R2 and S3. Has anyone encountered this and/or know of a solution? Thanks AWSBadRequestException: listStatus on s3a://indexed-xyz/ethereum/decoded/logs/v1.2.0/partition_key=ff/dt=2023: ...
Avatar
@secrethash Related to maxKeys, but underlying error message is different. Since in this post there is no full request headers/params I can't tell exactly.
18:28
@secrethash ...also good news is that we've found another workaround how to resolve: content-length issue on mobile and desktop clients. Web client fix will have to wait little bit longer (because we've no control of content-length header in the browser). Basically if: accept-encoding HTTP request header includes gzip Cloudflare seem to skip content-length altogether. We're testing couple things right now, but if things go well we'll be able to release it promptly. Related: https://community.cloudflare.com/t/no-content-length-header-when-content-type-gzip/492964 (edited)
18:32
Just to confirm, can I ask you how your Cloudflare R2 endpoint looks like? Is it something like: https://some_numbers_and_letters.r2.cloudflarestorage.com ?
Avatar
Avatar
s3drive
Just to confirm, can I ask you how your Cloudflare R2 endpoint looks like? Is it something like: https://some_numbers_and_letters.r2.cloudflarestorage.com ?
Yes, it's basically https://{YOUR_ACCOUNT_ID}.r2.cloudflarestorage.com/ The Account ID is a 32 digit alpha-numeric ID.
Avatar
Avatar
s3drive
@secrethash ...also good news is that we've found another workaround how to resolve: content-length issue on mobile and desktop clients. Web client fix will have to wait little bit longer (because we've no control of content-length header in the browser). Basically if: accept-encoding HTTP request header includes gzip Cloudflare seem to skip content-length altogether. We're testing couple things right now, but if things go well we'll be able to release it promptly. Related: https://community.cloudflare.com/t/no-content-length-header-when-content-type-gzip/492964 (edited)
That's great 🔥
18:47
It looks like R2 is having some compatibility issues relating to S3 Driver. I hope they fix these issues soon.
Avatar
Hi @secrethash, we've released the 1.2.5 update (Android) which addresses these issues. I would appreciate if you could let me know if it all works for you now. 📁
Avatar
Hey @s3drive , I gave it a go.. it works perfectly. Some downloads were failing in the previous version but after the update it works perfectly. Great work! I appreciate it a lot 🔥
👍 1
Avatar
That's fantastic. I really appreciate that you've took time to report this issue. If you have any other issues or feature ideas don't hesitate to reach out to me directly. We will be releasing this update to desktop clients over the next few days. Thanks !
Avatar
Getting a Socket exception when uploading files to Cloudflare R2. I posted a screenshot image in the #general area.
Avatar
Hi @grahamc1984, thanks for reporting this. Just a question, do you have in-app E2E enabled? What's the approximate size of files that you upload? If you disable E2E (assuming you have it enabled) does it resolve this issue?
Avatar
Yes, E2E is enabled. Files are all 1.5 to 2.5 MB in size. I will try without E2E later today.
Avatar
grahamc1984 05/24/2023 2:36 PM
I tried with E2E off and this made no difference. I also tried with a faster Internet connection (5 Mbps UL) and there is no problem. It only happens on a slow Internet connection (320 Kbps UL) and only on some of the files. With 28 files in the folder typically 8 or 9 would work and 19 or 20 would fail. With 6 files in the folder 4 or 5 would work and 1 or 2 would fail. Although the link speed is low the connection is completely stable. If anything can be done to make it more tolerant of low connection speeds this would be helpful.
Avatar
Avatar
grahamc1984
I tried with E2E off and this made no difference. I also tried with a faster Internet connection (5 Mbps UL) and there is no problem. It only happens on a slow Internet connection (320 Kbps UL) and only on some of the files. With 28 files in the folder typically 8 or 9 would work and 19 or 20 would fail. With 6 files in the folder 4 or 5 would work and 1 or 2 would fail. Although the link speed is low the connection is completely stable. If anything can be done to make it more tolerant of low connection speeds this would be helpful.
Thanks, it's helpful for us, so we can build a reliable testing environment where we can reproduce it (and test the fix). We will be looking to address that one and it might be possible to resolve by allowing to set different connection buffer sizes.
Avatar
grahamc1984 05/26/2023 9:55 AM
When an upload has failed, in the Failed column there is a retry icon (circular arrow), pressing this it says 'Queued file for upload' but no retry happens and nothing appears in the Waiting or Running columns.
Avatar
Avatar
grahamc1984
When an upload has failed, in the Failed column there is a retry icon (circular arrow), pressing this it says 'Queued file for upload' but no retry happens and nothing appears in the Waiting or Running columns.
When retry is clicked, item gets added to the queue and the upload process starts immediately (unless it was running already), so in most cases it won't appear in Waiting column. The Running column will display it only after receiving first transfer update which on a slower connections might take longer than expected. Such state is undesirable as it creates some sort of vacuum where item isn't displayed anywhere. This is addressed already on desktop clients, but will be released later today on Android and iOS. In other words after item is picked from Waiting it shall appear immediately as Running. I am not sure if this is the issue that you have experienced though, as in principle item shall appear in Running anyway and eventually in Done/Failed and it doesn't seem to be case from what I understand. We will investigate it further. In the meantime we've also thought about adding "retry all" option to at alleviate the SocketException issue which may create too many entries to retry individually. I will let you know about progress on all that. Thanks !
Avatar
Avatar
grahamc1984
When an upload has failed, in the Failed column there is a retry icon (circular arrow), pressing this it says 'Queued file for upload' but no retry happens and nothing appears in the Waiting or Running columns.
The "retry all" option is successfully deployed. There are more improvements regarding the upload process coming soon. If despite that you still experience an issue with retry being not effective please let me know, so we can be aware of improvements needed in that area as well. Thanks !
Avatar
This is to let you know that there will be improvement in this area this month with the release of a new streaming cipher: https://s3drive.canny.io/feature-requests/p/implement-chunked-encryption-using-stream-protocol
Protocol: https://github.com/miscreant/meta/wiki/STREAM This is to speed-up encryption/decryption of bigger files, since after some threshold we fallback to
Avatar
Hi @grahamc1984, I was wondering if you're still experiencing the: "SocketException" issues? We've had a major release this month: https://s3drive.app/changelog which completely changed the way we process, buffer, encrypt, data when sending to S3. This may or may not fixed the issue, that's why I've thought I am going to check this out with you. Thanks ! (edited)
Exported 27 message(s)
S3Drive - Video player stuck on macOS
Guild icon
S3Drive
support / Video player stuck on macOS
Avatar
S3Drive's video player is stuck, MacOS .dmg. Whole S3Drive's UI hangs Example .mp4 video: (VP9 video encoding) https://transfer.sh/Sb5O9qiijo/1JhJpEIOx7k.mp4 (edited)
Avatar
Quick question, does the issue appear for encrypted or unencrypted video?
09:24
I've checked it on my end on macOS and works fine in both unencrypted/encrypted form. Since I am running latest development build there is a small chance that if there was an issue it's gone by now (we need to release the 1.5.5 though, which will be mid/end this week). Can I ask if you run M1/M2 or Intel Mac?
Avatar
It's for encrypted video, and I'm using Intel Mac
Avatar
Please give us a moment, we'll spinning up our Intel Mac environment to try reproduce this. We're doing development (and testing) on M1, so there maybe some differences. Decryption of video stream on the fly is pretty resource intensive process, do you mind sharing what are your specs (model / revision) ?
08:53
Can you please try playing the unencrypted stream to rule out any other issues (format etc.)?
Avatar
Looks like unencrypted isn't working either. I'm using an iMac 21.5" 2019 (4K display), Intel i5 CPU
Avatar
We couldn't reproduce this issue on our end. In our case this exact file work smoothly both encrypted/unencrypted on `2014 Mac Mini with Intel i5 for both 1.5.3 and latest development version. We've just released new DMG with some updates to our framework and most recent video playing library version. I am not sure if this is going to solve issue on your end, but it's worth trying. It does seem like we need to get our hands on 4K screen, as this is the difference in our environments so far.
Avatar
I remember it worked once, but then never worked again
20:15
When I get the time I'll restart the computer
Avatar
A computer restart didn't make any difference (edited)
16:22
Is there any sort of cache for the video player? Any button to clean it? (edited)
Avatar
Not really, there is no video cache on macOS as such, so nothing to clear. Hmm, two things. Can you please try downloading a video to confirm if S3Drive can actually open&save file on your side? Can you try the most recent pre-release version? https://github.com/s3drive/app/releases/tag/1.5.7 Whilst (yet again) it's not targeted at your issue exactly, as we're working on it bit blindly (can't reproduce on our side), there are couple other changes (improved package signature and further improvements to video plugin) which may improve this situation. (edited)
Avatar
Avatar
s3drive
Not really, there is no video cache on macOS as such, so nothing to clear. Hmm, two things. Can you please try downloading a video to confirm if S3Drive can actually open&save file on your side? Can you try the most recent pre-release version? https://github.com/s3drive/app/releases/tag/1.5.7 Whilst (yet again) it's not targeted at your issue exactly, as we're working on it bit blindly (can't reproduce on our side), there are couple other changes (improved package signature and further improvements to video plugin) which may improve this situation. (edited)
Surprisingly, the new version worked 👀
👍 1
Avatar
Whilst I am not 100% sure about the fix, as I couldn't reproduce the issue on my side. Still... let's call it a win ! 🚀 Thanks for your patience. 1.5.7 will be released live early next week, but you can comfortably stay at your pre-release build.
👍 1
s3drive changed the channel name: Video player stuck on macOS 10/07/2023 5:33 PM
Exported 16 message(s)
S3Drive - Web S3 profiles doesn't seem to persist
Guild icon
S3Drive
support / Web S3 profiles doesn't seem to persist
Avatar
Initially from @hugh1988 https://discord.com/channels/1069654792902815845/1069654792902815848/1176647612544336052 "hi, wondering if there any way to log in via web app and not have to put s3 credentials in each time? any way to have s3Drive remember them? ...it doesn't remember. I sign out and then sign back in and it only has my managed account with no s3 bucket attached."
19:33
Hi @hugh1988, just so I understand the issue better. Once you sign out, it is expected that S3Drive will remove your current profile from the list. Technically the current "sign out" for a managed account is more like: "remove S3 details and any associated data with these credentials", because there is no concept of log out. Do I understand correctly that after you "sign out" you also lose potentially other S3 credentials that you've configured? If that's the case can you let me know what happen if you don't "sign out" but instead force refresh web client? Does it persist your credentials or are they also lost? Please also specify what's your browser, browser version and OS. Thanks !
Avatar
I think i see where i was going wrong. If I switch to profile with my email address (not a s3 bucket) then sign out and back in again my s3 bucket is still on the list. But if I sign out when s3 bucket is selected/active the credentials get deleted and need to be manually added again. I realise now is also the case for the desktop apps. Perhaps the 'sign out' should always just sign out of the managed credentials. If I want to delete my S3 bucket credentials I can always do that from the profiles list right? Thanks! (edited)
Avatar
You're right. I am just thinking whether to rename it to: "Remove credentials" instead (only for non-managed one)... and if you want to "Sign out" from managed credentials you would be able to do so from the Profiles screen (X button on the right side) or by switching to and using the "Sign out" option.
Exported 4 message(s)
S3Drive - Windows app black screen
Guild icon
S3Drive
support / Windows app black screen
Avatar
dantheman61 08/17/2023 6:07 PM
I setup 2 way sync and now the Windows app just has black screen. I am used IDrive e2
Avatar
Sorry for the delay. Unfortunately it happens from time to time and we're having difficulties fixing that. The quick fix is to resize/maximize window and the content shall come back.
Exported 2 message(s)
S3Drive - Windows app hangs if there's lots of data in the drive mount cache
Guild icon
S3Drive
support / Windows app hangs if there's lots of data in the drive mount cache
Avatar
I tried to upload about 100GB+ of photos using the 'drive mount' feature. They copied very quickly in a few mins, obviously they are being copied to a temporary location and then S3 Drive is uploading them in the background. Once windows indicated the transfer was complete I quit S3 Drive. Obviously most of that data is uploaded yet. When starting S3 Drive now, the app hangs for around 15-20 mins, just a blank window, but I can see S3 Drive using all my upload bandwidth and photos appearing one by one if i check on my phone. I'd like to stop this upload now. Where is this temporary cache location so I can delete it and hopefully stop the transfer? And is caching needed? perhaps we can have an option to have drive mount caching turned off, (there is an option in rclone for this i think). I would find it more useful to see the actual transfer progress and know when it is completed. Thank you
👍 1
Avatar
Hi and thanks for your feedback. What's your OS? We're using VFS cache with writes setting which is pretty much required for the write mode to function properly. We could possible disable it on Windows and Linux with some limitations: https://rclone.org/commands/rclone_mount/#limitations and still keep the writes mode, but on macOS it wouldn't be possible. For Linux see: ~/.cache/rclone/vfs I would suspect it's going to be similar on Windows: $HOME/.config/rclone/vfs and macOS. Strange that S3Drive hangs, it's probably some bug where mount process takes extre ordinary time to load? the cache before returning the mount to the app and it's blocking the main thread. Deleting the VFS cache although not convenient shall resolve this issue. We will be able to provide couple more options, e..g. disable cache, set max age... and most importantly set the max size: vfs-cache-max-size. Based on your comment I've increased priority on this and you can expect improvements in one of the next releases. Just please let me know what's your OS for reference. Thanks !
Avatar
Ah nice one Tom that's great. Yeah i've realised it's not just on app start up when S3Drive hangs, but also if i start drive mount while the app is open and working. Im on Windows 10. Cheers
Avatar
Hi again, we've released hotfix in 1.7.3 which shall resolve mount blocking the app UI on Windows/Linux and there was also another issue causing issues mounting unencrypted S3 buckets on all platforms. The rest improvements regarding VFS cache will come next and soon, as we need to research topic little bit further. Please let me know if 1.7.3 behaves little bit better for you. It still doesn't address the underlying VFS issue that you've mentioned, but at least now you shall be able to go to the settings to disable mount and e.g. disable auto start if you came across any issues. Thanks !
Avatar
Thanks Tom! S3Drive was still unresponsive for 13 mins (i timed it). I wonder if the update didn't install because it's still saying 1.7.2 in the taskbar, even though the installer said 1.7.3. I've tried uninstalling and re-installing and it still says 1.7.2. Cheers (edited)
Avatar
Thanks for letting me know and sorry for the trouble, there was an issue on the build side where old executable was packaged instead (we need to fix our build scripts !), but it's now resolved, we've updated 1.7.3 build for Windows. (edited)
Avatar
No worries at all. 1.7.3 fixes this problem! Still takes a while for the drive to mount, but S3Drive is functional during this time. Thank you.
Avatar
That's great to hear, the mount settings will come next and this shall resolve most of the issues that you're experiencing. If you have any feedback on this or other functionality please let me know, we're really trying hard to mature this project.
Avatar
Hi @hugh1988, In our 1.7.6 release we've added the cache setting option, which defaults to Minimal, that is transfers are blocked until they're uploaded to the remote. Changing it to Writes changes the behavior to what it was previously. Detailed description of cache settings can be found here: https://rclone.org/commands/rclone_mount/#vfs-cache-mode-off I hope this already improves the situation.
Mount the remote as file system on a mountpoint.
Exported 9 message(s)
S3Drive - Windows sync hangs
Guild icon
S3Drive
support / Windows sync hangs
Avatar
From @pjort.kat "The S3Drive app on windows also just hangs for me whenever I made a sync folder... It synced one file and now it just keeps getting stuck"
16:19
Hi @pjort.kat, can you let me know what sync type are you using, is it one-way (if so, which one?) or two-ways?
Avatar
One-way
Avatar
Avatar
pjort.kat
One-way
Which mode exactly? Can you let me know how many files you have in this folder approximately? Do you have E2E enabled? What S3 provider are you using? When you go to logs (longtap on version number in the footer on About page) is there any specific error or perhaps repeated log entry which may indicate some "looping behavior"?
Avatar
To Remote (don't delete remotely)
Exported 5 message(s)
S3Drive - Write-only bucket / Multiple users on access ID
Guild icon
S3Drive
support / Write-only bucket / Multiple users on access ID
Avatar
I've kind of tested this and it seems to work but checking its 'permitted'. If I want to issue access to multiple parties with write only access to files to take photos/vid - would this be acceptable use? this would be incredibly useful for the use purpose i'm thinking of.. ie, upload of photo confirmation directly to a company file for verification purposes.
Avatar
We haven't tested write-only or read-only buckets and as such S3Drive requires both write and read permissions to function properly. However if app works with limited sets of permission for your use case, there is no harm using it like this. Even though we're designing app so it requires minimum set of permissions or operations for its functions it may happen that some feature might not work properly in the future. E.g. if you upload a file, the existing file would be overwritten, if versioning is enabled the previous version would remain restorable however if versioning isn't enabled the existing file version is lost. In the future we might actually perform read first in order to display prompt to the user to ask if they actually wan't to ovewrite the file. Such read would've failed if there is no read permission to the bucket, so we would have to fail gracefully in order to not break things in your case. Our aim is to not break workflows, but if by any chance it's not easy/possible to implement such graceful failure handling we may be required to prioritize features based on app standard usage.
18:27
As such there is no issue with having multiple users on one access ID. It's not a best security practice, but no technical issue from S3 or S3Drive perspective.
Avatar
great, the read write thing might not be an issue in reality, but just a bit of a light bulb moment for its use case
s3drive changed the channel name: Write-only bucket / Multiple users on access ID 09/07/2023 7:38 AM
Exported 5 message(s)