S3Drive - general

@Tom are you going to build your own data center?

that requires a lot of money and people to take care of it, not the plan afaik

Yeah I assumed!

10:23 PM

So the plan is to resell?

like the current trial is based on Backblaze, that seems to be the most sensible solution nowadays

What if I could get you $4.99/tb pay as you go. No added fees?

10:28 PM

Not trying to shill at all. Trying to work together on the same thing

10:30 PM

That's not customer price. I'll talk to founder if you're interested in being a reseller

10:35 PM

We give 2x free egress too

Yay 3x free egress coming to B2 in October

Large file downloads get stuck at processing for some reason

2:40 AM

Shared links

zer0

Yay 3x free egress coming to B2 in October

BTW. If you route through Cloudflare it's free: https://www.backblaze.com/blog/backblaze-and-cloudflare-partner-to-provide-free-data-transfer/

we have free egress at home doggokek

jef

What if I could get you $4.99/tb pay as you go. No added fees?

I'll be honest with you. It's unlikely we would make any provider change at this stage. Our APIs / auth are already integrated closely and it's a cost/time/risk for us to make such change. We've been exploring this for quite a while and decided that we'll stick to reasonably priced, but reputable one. Before I worked for S3Drive, I've been using Backblaze as a dev for many years. Naturally I've suggested it for S3Drive. How much we pay for data is one thing... but the consequences when provider loses people's data is the other thing. Cheapest was iDrive (https://app.idrivee2.com/signup-reseller), comes out at $1.5/TB, can you beat it? We're not interested in being a reseller at all, however if you are interested to resell S3Drive under your brand and your storage we can handle this via Enterprise package (https://s3drive.app/pricing). We've got different tiers and billing modes (per user or percentage fee). If you're interested, please drop us an e-mail at: sales@s3drive.app, and include some details: Do you have an idea how S3 credentials would be managed? How users register on your website, is it e-mail/password or other forms of auth? Do you expect S3Drive to be integrated tightly with your auth system? Alternatively do you provide some means of credentials export (e.g. a formatted text, QR code, exported file etc.) that we could seamlessly import into S3Drive? How would you like to manage software releases and software updates? Do you have accounts on App Store / Google Play and are you comfortable managing them? We would then be able to come back to you and give you some rates. Thanks ! (edited)

Tom

BTW. If you route through Cloudflare it's free: https://www.backblaze.com/blog/backblaze-and-cloudflare-partner-to-provide-free-data-transfer/

Nice

10:25 AM

The sorting is random for some reason

zer0

The sorting is random for some reason

Is it Backblaze or some other provider?

Backblaze

Tom

I'll be honest with you. It's unlikely we would make any provider change at this stage. Our APIs / auth are already integrated closely and it's a cost/time/risk for us to make such change. We've been exploring this for quite a while and decided that we'll stick to reasonably priced, but reputable one. Before I worked for S3Drive, I've been using Backblaze as a dev for many years. Naturally I've suggested it for S3Drive. How much we pay for data is one thing... but the consequences when provider loses people's data is the other thing. Cheapest was iDrive (https://app.idrivee2.com/signup-reseller), comes out at $1.5/TB, can you beat it? We're not interested in being a reseller at all, however if you are interested to resell S3Drive under your brand and your storage we can handle this via Enterprise package (https://s3drive.app/pricing). We've got different tiers and billing modes (per user or percentage fee). If you're interested, please drop us an e-mail at: sales@s3drive.app, and include some details: Do you have an idea how S3 credentials would be managed? How users register on your website, is it e-mail/password or other forms of auth? Do you expect S3Drive to be integrated tightly with your auth system? Alternatively do you provide some means of credentials export (e.g. a formatted text, QR code, exported file etc.) that we could seamlessly import into S3Drive? How would you like to manage software releases and software updates? Do you have accounts on App Store / Google Play and are you comfortable managing them? We would then be able to come back to you and give you some rates. Thanks ! (edited)

thanks for all this, i saw your whitelabel offer and its def in the back of my mind. But i'm working mostly on SME and trying to leverage them off hypercloud. BUT i will be referring them to all use your app.

zer0

The sorting is random for some reason

One question is it the order when you fetch the existing results from Backblaze or just after the upload? When you refresh, is it consistently "broken" or always random? (edited)

Screenshot taken now. Uploaded yesterday

1

8:03 PM

Seems consistent

zer0

Screenshot taken now. Uploaded yesterday

Thanks for reporting. There is indeed issue related to folders. We will have that addressed. Does issue apply to already uploaded files? In a previous screenshot you've posted some files, but can I assume it's just view straight after upload? Regardless, we'll try to fix the order of uploaded files as well.

Tom

Thanks for reporting. There is indeed issue related to folders. We will have that addressed. Does issue apply to already uploaded files? In a previous screenshot you've posted some files, but can I assume it's just view straight after upload? Regardless, we'll try to fix the order of uploaded files as well.

I'd say around 5 mins after upload

9:09 PM

Wait I'll open the same directory now

9:10 PM

Yea same

9:11 PM

Oh I do have to mention they were uploaded with rclone

zer0

Oh I do have to mention they were uploaded with rclone

Ah, fair enough. As such we're not ordering results coming from S3. Since files with encrypted filename have original filepaths encrypted their order isn't actuall inline with the expected after decryption. This will have to wait until this gets implemented: https://s3drive.canny.io/feature-requests/p/implement-order-by-name-size-modified Thanks for the heads up, I wasn't aware of this myself.

zer0

Screenshot taken now. Uploaded yesterday

The folder order will get fixed in a next release.

1

zer0

I'd say around 5 mins after upload

Improvements were released to Android, I would appreciate if you could check folder order (as well as Rclone uploaded file order), it should work now. Other platforms will receive this update over the next few days. If you have any more issues or would like to add a feature request please use #support, so we don't clutter up this channel.

brizio joined the server. 9/14/2023 12:53 PM

Nice I'll try

brizio joined the server. 9/14/2023 4:32 PM

Is there a process for Android updates? I don't see an update in the play store

just log onto play store Jef, S3drive also provides prompt if you need to update..

CubityFirst joined the server. 9/15/2023 12:06 PM

Welcome Cubity

1

jggcvghhhh joined the server. 9/17/2023 1:21 AM

EmiIia joined the server. 9/19/2023 4:30 PM

Deal breaker is no background backup solution for the app. Meaning, you gotta stay in the app while the app does a backup of everything.

I believe it is a work in progress

Xenthys®

I believe it is a work in progress

Any ETA?

Only Tom would be able to answer, I can't guarantee anything at my level

Paper joined the server. 9/20/2023 1:50 AM

Hey all! Just found this project by searching "rclone" on Mac's App Store, a very interesting surprise!

1:52 AM

I'm interested to know how are photo thumbnails stored, is a thumbnail cache stored in S3? Or is it local only and therefore requires downloading all photos beforehand? (edited)

EmiIia

Deal breaker is no background backup solution for the app. Meaning, you gotta stay in the app while the app does a backup of everything.

It is high on our priorities list, however we've ran out of allocated time to implement it properly on both iOS/Android (very different approaches) and switched to other important features. We'll be revisiting this topic again. Realistically this is something we will address in Q1 2024, however there is a small we will have it ready before Christmas.

Paper

Hey all! Just found this project by searching "rclone" on Mac's App Store, a very interesting surprise!

That's interesting. Search results positioning on App Store is always bit of a magic to me. BTW. We release S3Drive on Mac App Store with some delay, so if you want to be always up to date please use the signed AppImage: https://s3drive.app/desktop

I’ll wait with buying enterprise for my company company then. (edited)

EmiIia

I’ll wait with buying enterprise for my company company then. (edited)

If you have any specific questions/needs regarding enterprise please drop us an e-mail leaving some info about your use case. It's an entirely different product with its own set of priorities.

Paper

I'm interested to know how are photo thumbnails stored, is a thumbnail cache stored in S3? Or is it local only and therefore requires downloading all photos beforehand? (edited)

We load full file version and keep it in a local thumbnail cache. Yes it does require downloading all photos beforehand. In our legacy photo backup product, we've been generating thumbnails the moment when photos were backed up. We plan to implement this feature. Since S3Drive supports also existing file systems we would have to implement a process to generate thumbnails for existing resources, this would require fetching full image locally anyway (I mean we could offload to the back-end, but this would go against the E2E encrypted privacy model), so we haven't rushed this. (edited)

ajon joined the server. 9/20/2023 2:16 PM

ajon

Click to see original message

1

when will auto backup system enable in s3 drive android app?

ShovoN

when will auto backup system enable in s3 drive android app?

What backup do you have in mind? Currently we can backup your albums as soon as you configure/select them. Backup needs app to be "open running" before we get to the background mode: https://s3drive.canny.io/feature-requests/p/background-media-backup

1

OQTRIAD joined the server. 9/21/2023 12:47 PM

Mic joined the server. 9/21/2023 6:11 PM

Made a post about this on Mastodon

️

1

very nice!

@Tom I'm trying to update the app (MacOS), but it keeps telling me I have an outdated version. I downloaded the app through the website multiple times now, but still the same result

InfiniteAds559

@Tom I'm trying to update the app (MacOS), but it keeps telling me I have an outdated version. I downloaded the app through the website multiple times now, but still the same result

We've just updated macOS builds to the newest 1.5.3 - https://s3drive.app/changelog Please try now install newest DMG from our website. It should resolve your issues. What message did you get exactly from the app? Was it update more recent version available or perhaps that your version has expired? (edited)

Pedro joined the server. 9/22/2023 7:49 PM

Pedro

Click to see original message

I really love your product!! That was definitely missing…. Simple, rclone, cross platform

1

ruhascalin joined the server. 9/23/2023 5:17 PM

Mondo Magic joined the server. 9/25/2023 10:27 AM

jggcvghhhh

I really love your product!! That was definitely missing…. Simple, rclone, cross platform

Thank you for these words. Please consider leaving us a review on App Store / Google Play and spread the words about the app. It really help us ! (edited)

1

Why do I see the error "Bucket quota exceeded"?

Mondo Magic

Why do I see the error "Bucket quota exceeded"?

Hi ! It's likely that you've exceeded the allocated storage. Bear in mind that by default all accounts have enabled versioning, so even if you delete file it counts towards quota until you do the hard delete or delete all file versions. Can you go to the left drawer and refresh the storage statistics?

I see 14.88 GB of 12 GB used 10.35 GB of current data 4.54 GB of versions

4:14 PM

So the storage it's not unlimited?

4:16 PM

Now I have deleted the trash and it's 11.16 GB of 12 GB used 10.35 GB of current data 836.14 MB of versions

Mondo Magic

So the storage it's not unlimited?

Right, so you've managed to clean up things a little bit. Pardon my question, but where did you get this information that the storage is unlimited? (edited)

Tom

Right, so you've managed to clean up things a little bit. Pardon my question, but where did you get this information that the storage is unlimited? (edited)

I was searching on Google Play unlimited cloud storage and it gave me the result S3Drive app (edited)

Mondo Magic

I was searching on Google Play unlimited cloud storage and it gave me the result S3Drive app (edited)

Fair enough, we don't offer unlimited storage and don't use that keyword anywhere, however using S3Drive you can connect to any S3 compatible back-end. This in principle gives you unlimited storage... but it doesn't necessarily imply free.

Is rclone used behind the hood? Would it be easy to support Webdav in addition to S3? Just curious (edited)

A small bug for importing all buckets from an endpoint: I already setup some buckets and they were imported again . Maybe the import should skip those buckets, which are already setup

Now I have duplicates, but I can easily remove them This is only a cosmetic bug

Morethanevil

A small bug for importing all buckets from an endpoint: I already setup some buckets and they were imported again . Maybe the import should skip those buckets, which are already setup

Now I have duplicates, but I can easily remove them This is only a cosmetic bug

I assume that you've had the encryption keys set up for buckets that were duplicated? Currently new buckets are "merged in", but configuration item with encryption and without encryption key is treated separately. We should probably skip them, instead of creating duplicating entries. Going make a note.

Paper

Is rclone used behind the hood? Would it be easy to support Webdav in addition to S3? Just curious (edited)

I am not sure what version are you using, but it's been added in 1.5.1 already: https://s3drive.app/changelog

Tom

I am not sure what version are you using, but it's been added in 1.5.1 already: https://s3drive.app/changelog

Not Webdav server, webdav client

Paper

Not Webdav server, webdav client

I see, well, for now we are fixated on S3, we have plans of supporting different back-ends though (https://s3drive.canny.io/feature-requests/p/add-support-for-google-drive-and-onedrive). There is some bigger internal work required to abstract S3 away. Once we have it done, we would then be able to implement any back-end relatively easy. Unfortunately that's not something we will be able to implement this year. Out of curiosity, do you mind sharing what's your use case? Where are you trying to connect?

Tom

I see, well, for now we are fixated on S3, we have plans of supporting different back-ends though (https://s3drive.canny.io/feature-requests/p/add-support-for-google-drive-and-onedrive). There is some bigger internal work required to abstract S3 away. Once we have it done, we would then be able to implement any back-end relatively easy. Unfortunately that's not something we will be able to implement this year. Out of curiosity, do you mind sharing what's your use case? Where are you trying to connect?

Oh, it's just Hetzner Storage Share, not a big deal (not Storage Box, which I believe it's lower performance) (edited)

Paper

Oh, it's just Hetzner Storage Share, not a big deal (not Storage Box, which I believe it's lower performance) (edited)

I am not aware of performance differences between these two, but probably the only supported way so far would be to set up CIFS mount to Storage Box (or the other one) and then expose it using S3 via MinIO, Garage, SeaweedFS or anything alike. (edited)

1

I used storageboxes before I switched to my own VPS with MinIO. The performance is awesome and the prices are very good, but limited functions.

Tom

I assume that you've had the encryption keys set up for buckets that were duplicated? Currently new buckets are "merged in", but configuration item with encryption and without encryption key is treated separately. We should probably skip them, instead of creating duplicating entries. Going make a note.

Yes the ones with encryption were doubled.

TrkDemon joined the server. 9/28/2023 11:40 AM

TrkDemon

Click to see original message

micahflee joined the server. 9/30/2023 10:45 PM

Hi @TrkDemon !

11:23 AM

Hello @micahflee !

*SnowLLM-69B joined the server. 10/3/2023 11:58 AM

barrrrtek joined the server. 10/5/2023 4:57 PM

A feature request... I try to accomplish the following scenario: store data at home on my own SBC and rclone to my s3 account. Use s3drive to access the files from remote. This serves as a backup and easy possibility for remote access without opening my firewall (or use a VPN). I need read only, so this is fine that rclone only copies data in one direction. If I sync via rclone, the file (e.g. PDF) cannot be opened by s3drive app because the preview cannot be loaded (there is an error message). I assume that when files are handled via s3drive, the thumbnail is generated additionally - which does not happen with rclone obviously and opening the file fails in s3drive ("File preview not available") (edited)

jggcvghhhh

A feature request... I try to accomplish the following scenario: store data at home on my own SBC and rclone to my s3 account. Use s3drive to access the files from remote. This serves as a backup and easy possibility for remote access without opening my firewall (or use a VPN). I need read only, so this is fine that rclone only copies data in one direction. If I sync via rclone, the file (e.g. PDF) cannot be opened by s3drive app because the preview cannot be loaded (there is an error message). I assume that when files are handled via s3drive, the thumbnail is generated additionally - which does not happen with rclone obviously and opening the file fails in s3drive ("File preview not available") (edited)

Are you using Linux? This is the only platform where PDF preview isn't yet supported due to lack of unified renderer. I've added a roadmap item to track it: https://s3drive.canny.io/feature-requests/p/pdf-preview-support-on-linux

Well, my SBC is Debian and using rclone 0.65. I try to open the PDF on iOS where it fails. My scenario (maybe clearer): stored data on linux SBC (raspberry) is sent via rclone to S3 and encrypted. Use iOS app to view the S3 bucket and try to open a synced PDF - and then the error message occurs in the iOS app and no file content is shown (edited)

jggcvghhhh

Well, my SBC is Debian and using rclone 0.65. I try to open the PDF on iOS where it fails. My scenario (maybe clearer): stored data on linux SBC (raspberry) is sent via rclone to S3 and encrypted. Use iOS app to view the S3 bucket and try to open a synced PDF - and then the error message occurs in the iOS app and no file content is shown (edited)

Can you please create an item at https://discord.com/channels/1069654792902815845/1102236355645419550 please? In principle there shouldn't be any issue with previewing a PDF on iOS. Perhaps there is an issue with the Rclone setup / decryption. https://docs.s3drive.app/advanced/#setup-with-rclone (edited)

I will... (edited)

jggcvghhhh

I will... (edited)

In which case the issue is somewhere around caching with the app when file preview runs. I am going to pass that for devs to check. Thanks for letting me know ! (edited)

Gm community