Guild icon
S3Drive
Community / general
For all on-topic discussion about S3Drive or related storage providers.
Avatar
Avatar
szirok
Click to see original message
ParadoxDude 8/23/2023 8:27 PM
8:27 PM
I was trying to create a support post but, I am unable to
8:28 PM
To report a bug
8:28 PM
In app
Avatar
Ari 8/24/2023 4:09 PM
Hi all, is there a place for low priority feature requests 😄 I have got one
Avatar
Avatar
Ari
Hi all, is there a place for low priority feature requests 😄 I have got one
Xenthys® 8/24/2023 4:43 PM
Hi, you can request them in #support, there's a tag for that, don't worry about priorities yet since this community isn't very active at the moment
👍 1
yossie joined the server. 8/26/2023 6:07 AM
Deleted User joined the server. 8/26/2023 11:49 PM
𝖠𝗆𝗈𝗌 joined the server. 8/27/2023 11:29 AM
Avatar
szirok 9/1/2023 7:48 AM
please add support to download using save file as, not into browser storage. Lets say on c: drive i have 1gb free space, so i want to save 5gb file on e: drive where i have 200gb free space. i cant because web app downloads to cache on c
7:48 AM
please add possibility to download using save file as at start, not first to cache
zigFort joined the server. 9/1/2023 6:34 PM
Avatar
Avatar
zigFort
Click to see original message
zigFort 9/1/2023 6:35 PM
Avatar
Xenthys® 9/1/2023 10:45 PM
Hi, welcome!
Cody joined the server. 9/4/2023 9:22 AM
WhyIsTheRumGone joined the server. 9/4/2023 11:43 AM
Avatar
Avatar
WhyIsTheRumGone
Click to see original message
WhyIsTheRumGone 9/4/2023 11:43 AM
Avatar
WhyIsTheRumGone 9/4/2023 12:01 PM
Hey @Tom , I would like to buy the pro version since I want the mounted drive option. But I've had less than sub par experiences with other mount drive applications, which is how I landed up with yours. Is there a way to get like a 7 day trial to test the mounted drive option to see if it is worth it?
Avatar
Avatar
WhyIsTheRumGone
Hey @Tom , I would like to buy the pro version since I want the mounted drive option. But I've had less than sub par experiences with other mount drive applications, which is how I landed up with yours. Is there a way to get like a 7 day trial to test the mounted drive option to see if it is worth it?
Tom 9/4/2023 1:52 PM
Hi @WhyIsTheRumGone , Our billing integration with Stripe doesn't yet support trial, but you can test all app's capabilities by creating a free account (https://s3drive.app/account) and use the free 10GB allocated storage plan, as long as you login to S3Drive app with the same credentials. Behind the scenes there is an S3 cluster that we manage. Pro version allows you to use all these features but with your custom S3 endpoint. (edited)
Avatar
WhyIsTheRumGone 9/4/2023 1:52 PM
Gotcha thank you i will try trhat out
1:53 PM
Also, follow up. I know the app is not open source, but do you all have a contribers system where other devs can help fix issues / add features?
Avatar
Avatar
WhyIsTheRumGone
Hey @Tom , I would like to buy the pro version since I want the mounted drive option. But I've had less than sub par experiences with other mount drive applications, which is how I landed up with yours. Is there a way to get like a 7 day trial to test the mounted drive option to see if it is worth it?
Tom 9/4/2023 1:53 PM
Behind the scenes we're using: https://rclone.org/commands/rclone_mount/, so if that option works for you, S3Drive works pretty much the same, except it's "clickable" from the app. You can also use Rclone mount yourself outside S3Drive, but the data (including encrypted data) will stay compatible between S3Drive and Rclone. (edited)
🤟 1
Avatar
Avatar
WhyIsTheRumGone
Also, follow up. I know the app is not open source, but do you all have a contribers system where other devs can help fix issues / add features?
Tom 9/4/2023 1:58 PM
For this to work the app doesn't need to be FOSS, but at least source open. Whilst we've had that in mind it doesn't fit with our current revenue stream. We don't have enough capacity to properly manage open-source community and at this stage we think that having full control on the project direction allows us to focus on deliverables, build lean and deploy fast. With open-source we would likely receive dozens of pull requests for features which are not part of the streamline, yet we would have to dedicate resources to maintain, test, fix, refactor etc. As long as we get enough revenue from selling data plans (due to be released Q4 - https://s3drive.app/pricing - monthly/yearly), and not the software itself, we could then think of making clients open source: https://s3drive.app/faq?q=opensource as both sides may benefit from this move. (edited)
Avatar
WhyIsTheRumGone 9/4/2023 2:06 PM
gotcha that makes a lot of sense. So for now it's feature requests and github issues that will push the development forward from our side? Is there a tiered system such as if you have x license we prioritize your issues etc?
Avatar
Avatar
WhyIsTheRumGone
gotcha that makes a lot of sense. So for now it's feature requests and github issues that will push the development forward from our side? Is there a tiered system such as if you have x license we prioritize your issues etc?
Tom 9/4/2023 2:14 PM
Mostly yes. We don't have any formal decision process on this. If something gets added by the community we then prioritize internally based on multiple factors, general interest, development time etc. For bigger number of licenses and very custom features (not part of the general roadmap) we have an Enterprise plan - https://s3drive.app/pricing where we can provide quotes on custom features/integrations and discounts. Do you have anything in mind in terms of features / bugs? We can discuss this here or via different channels. (edited)
Avatar
WhyIsTheRumGone 9/4/2023 2:21 PM
Gotcha. Yeah this is not on an enterprise level altough I work with large companies who might benefit from this app. I am gonna test it and if it works well I might recommend it to our project teams. We currently use Gladinet which works fine but your client(s) seem so much smoother etc. As for features and bugs, I like identifying possible new features and bugs especially if I like the app so if I can communicate them here that would be cool. Just started using this today but the things I have for now are:
  • When you close the desktop client, in windows, it should auto minimize to tray to ensure sync jobs keep on running. Right now, I go in, change stuff or look for a file and then when I hit the X it closes the whole app.
2:22 PM
  • File offloading / Cloudnas. If we could add a feature where files in a targeted folder will be checked for last modified etc and if it hasn't been modified in x days (whatever user specifies) it is removed from the local machine but still stays in the s3 bucket. Kinda how onedrive / wasabi cloud nas does it
Avatar
Avatar
WhyIsTheRumGone
Gotcha. Yeah this is not on an enterprise level altough I work with large companies who might benefit from this app. I am gonna test it and if it works well I might recommend it to our project teams. We currently use Gladinet which works fine but your client(s) seem so much smoother etc. As for features and bugs, I like identifying possible new features and bugs especially if I like the app so if I can communicate them here that would be cool. Just started using this today but the things I have for now are:
  • When you close the desktop client, in windows, it should auto minimize to tray to ensure sync jobs keep on running. Right now, I go in, change stuff or look for a file and then when I hit the X it closes the whole app.
Tom 9/4/2023 2:30 PM
We've got that one internally, but created public roadmap item: https://s3drive.canny.io/feature-requests/p/desktop-app-minimize-to-tray-dont-close At the moment you can use tray icon and "Hide" option or simply minimize the app. It's a small item, but then the actual solution given our tech / cross-platform wasn't entirely easy we haven't implemented it straight away.
🤟 1
Avatar
Avatar
WhyIsTheRumGone
  • File offloading / Cloudnas. If we could add a feature where files in a targeted folder will be checked for last modified etc and if it hasn't been modified in x days (whatever user specifies) it is removed from the local machine but still stays in the s3 bucket. Kinda how onedrive / wasabi cloud nas does it
Tom 9/4/2023 2:31 PM
That's interesting. I've added an item: https://s3drive.canny.io/feature-requests/p/file-offloading-cloudnas-delete-idle-files-locally Do you have some additional docs about the behavior / use-cases?
jguzmansulb joined the server. 9/4/2023 2:31 PM
Avatar
Avatar
Tom
That's interesting. I've added an item: https://s3drive.canny.io/feature-requests/p/file-offloading-cloudnas-delete-idle-files-locally Do you have some additional docs about the behavior / use-cases?
WhyIsTheRumGone 9/4/2023 2:58 PM
Yeah this is a game changer. If wasabi wasn't so damn expensive with this tech it would be paid for already. This explains it well :https://www.siscloudservices.com/storage/content/our-services/data-center-on-cloud/wasabi/20230117-sis-wasabi-cloud-nas-data-sheet.pdf
Image attachment
2:59 PM
It basically leaves behind a tiny little file that seems to be the actual file and when you try to access it, wasabi quickly downloads it from the bukcet to the location it is supposed to be in and then it works. But I mean even if you forego that feature, the automatic offloading of cold data is such a massive help
3:00 PM
But with this cloudnas you can basically house like 8TB of storage on a 500GB drive .Which is what we are doing at some clients
Avatar
Avatar
WhyIsTheRumGone
It basically leaves behind a tiny little file that seems to be the actual file and when you try to access it, wasabi quickly downloads it from the bukcet to the location it is supposed to be in and then it works. But I mean even if you forego that feature, the automatic offloading of cold data is such a massive help
Tom 9/4/2023 3:26 PM
Quick question. Do you install Wasabi Cloud NAS on the end computer or on a local server and then share this via network mount within the organisation?
Avatar
WhyIsTheRumGone 9/4/2023 3:36 PM
So you can do both. But what we've done is install it on a file server. point it to a secondary drive, say G:. Then we share folders in that drive using SMB like normal. Wasabi obfuscates the offloading process using these stub files so from the consumers of the SMB shares, they know no difference but then on the file server, wasabi cloud nas offloads the cold storage. Lemme know if that answered the question lol
Avatar
Avatar
WhyIsTheRumGone
So you can do both. But what we've done is install it on a file server. point it to a secondary drive, say G:. Then we share folders in that drive using SMB like normal. Wasabi obfuscates the offloading process using these stub files so from the consumers of the SMB shares, they know no difference but then on the file server, wasabi cloud nas offloads the cold storage. Lemme know if that answered the question lol
Tom 9/4/2023 4:41 PM
Got it. I am trying to understand what's possible what's not. We're currently running FUSE mount which basically gives you access to unlimited cloud NAS (S3 based). There is also VFS cache which could be tweaked to emulate "hot storage onloading", which would be the other way round from what you describe. The file that you've accessed recently would end up stored in a local cache, so next time when you access it, it's read from the local cache directly (no latency). The challenge with "cold storage offloading" is that this feature must be closely integrated with the native file system and since S3Drive is supposed to run on multiple OS's (and not all FS's would support this), that means we would have to make this feature e.g. Windows only or "move it away" (exactly the same way the Wasabi Cloud NAS does that) to separate software (probably would have to be Windows, due to NTFS support of https://learn.microsoft.com/en-us/windows-hardware/drivers/ifs/about-file-system-filter-drivers which I don't think it's possible on Linux and Mac) which would then have to be network mounted. The somewhat convoluted alternative would be to use FUSE mount as it is now, but providing custom cache implementation which would either read file from a local file system or cloud/S3 (depending on the availability). The S3Drive would also take care of cleaning up idle / cold data from the local FS based on some settings (e.g. 90 days). From a user point of view they would see hot files only in their local FS location and "all files" in the FUSE mounted location. They would have to be instructed to actually not use the local FS, but the FUSE mount instead. This would work on Windows, macOS and Linux. I am not sure how feasible is to share FUSE mount via SMB, I know that whilst technically possible, there are some challenges. Alternatively each user could work with their local FUSE mount, but any changes could be synced online via AMQ or other queue/notify mechanism) (edited)
Avatar
WhyIsTheRumGone 9/4/2023 4:46 PM
Yeah not sure about the techincality on this implementation. As you said the cross platform is a major issue as it will see compatibility issues. So with the current sync options , might be able to create one that does the normal sync such as to rmeote etc, but then add some extra params such as if the file has not been touched in 90 days we will sync it up and remove it from the local FS. This is not as fancy as the wasabi bottomless NAS idea but atleast it will reclaim space on machines where file space is limited
Avatar
Avatar
WhyIsTheRumGone
Yeah not sure about the techincality on this implementation. As you said the cross platform is a major issue as it will see compatibility issues. So with the current sync options , might be able to create one that does the normal sync such as to rmeote etc, but then add some extra params such as if the file has not been touched in 90 days we will sync it up and remove it from the local FS. This is not as fancy as the wasabi bottomless NAS idea but atleast it will reclaim space on machines where file space is limited
Tom 9/4/2023 4:54 PM
It's not as fancy as you say, but would be good start towards more advanced solutions and if SMB FUSE sharing works then from a user point of view they wouldn't see any difference, since the heavy lifting (in a slightly different way than Wasabi Cloud NAS) would be done by the S3Drive instance running on some Windows Server node. EDIT: It seems Rclone FUSE SMB sharing indeed works: https://forum.rclone.org/t/solved-is-it-possible-to-access-my-rclone-mount-as-a-samba-share/18335/6 (edited)
Avatar
Avatar
WhyIsTheRumGone
Yeah not sure about the techincality on this implementation. As you said the cross platform is a major issue as it will see compatibility issues. So with the current sync options , might be able to create one that does the normal sync such as to rmeote etc, but then add some extra params such as if the file has not been touched in 90 days we will sync it up and remove it from the local FS. This is not as fancy as the wasabi bottomless NAS idea but atleast it will reclaim space on machines where file space is limited
Tom 9/4/2023 4:55 PM
I can also see that it's not even about: "last modified", but more about: "last accessed".
Avatar
Avatar
WhyIsTheRumGone
Yeah not sure about the techincality on this implementation. As you said the cross platform is a major issue as it will see compatibility issues. So with the current sync options , might be able to create one that does the normal sync such as to rmeote etc, but then add some extra params such as if the file has not been touched in 90 days we will sync it up and remove it from the local FS. This is not as fancy as the wasabi bottomless NAS idea but atleast it will reclaim space on machines where file space is limited
Tom 9/4/2023 5:17 PM
When user adds a new file what should happen? Should it be automatically synced to Wasabi or should stay storred locally and only be synced to Wasabi when cold? (edited)
Avatar
WhyIsTheRumGone 9/4/2023 5:37 PM
Wasabi you can adjust it but by default I think it should sync it to wasabi so a backup is made and then when it goes cold it should be offloaded from local storage to clear space
Avatar
Buzz69 9/4/2023 5:45 PM
@Tom did you use go daddy or similar for setting up your website? i'm looking at a similar format / log in account / payment.
Avatar
Avatar
WhyIsTheRumGone
Wasabi you can adjust it but by default I think it should sync it to wasabi so a backup is made and then when it goes cold it should be offloaded from local storage to clear space
Tom 9/4/2023 5:46 PM
Great, I've modified this card to reflect what we've discussed and what I've researched so far: https://s3drive.canny.io/feature-requests/p/file-offloading-cloud-nas-move-idle-files-to-cloud Can't give any exact ETA, but we will get to this.
Avatar
Avatar
Buzz69
@Tom did you use go daddy or similar for setting up your website? i'm looking at a similar format / log in account / payment.
Tom 9/4/2023 5:49 PM
It's a NextJS based layout, payments and login use some ready libraries, but had to be heavily customized. I am not sure what GoDaddy offers, but if you have some "off-the-shelf" definitely go for it. (edited)
Avatar
Avatar
Tom
It's a NextJS based layout, payments and login use some ready libraries, but had to be heavily customized. I am not sure what GoDaddy offers, but if you have some "off-the-shelf" definitely go for it. (edited)
Buzz69 9/4/2023 5:51 PM
great, thanks
5:52 PM
i think there are quite a few, ready to go but its somewhat undefined what it can do.. i'll do more research!
pogox joined the server. 9/6/2023 10:36 AM
Avatar
Buzz69 9/9/2023 11:33 AM
@tom Hi Tom, do you have a png or similar of your logo we can link from our website? (edited)
MaloBoi joined the server. 9/9/2023 12:39 PM
Avatar
Buzz69 9/10/2023 10:09 AM
@tom I've got a Pro Standalone account on my profiles - is that backup going onto backblaze and i'm assuming it is limited to 10GB?
Avatar
Avatar
Buzz69
@tom I've got a Pro Standalone account on my profiles - is that backup going onto backblaze and i'm assuming it is limited to 10GB?
Tom 9/10/2023 6:55 PM
With Pro Standalone you can manage multiple profiles and configure them separately, but backup will work on currently selected one. There is a feature request to support multiple accounts operation: https://s3drive.canny.io/feature-requests/p/support-using-multiple-accounts-at-once As far I am concerned Backblaze offers free 10GB account: https://www.backblaze.com/cloud-storage/pricing They're in the middle of the pricing changes which if I understand will make the free account even better (more egress): https://www.backblaze.com/blog/2023-product-announcement/ You don't need Pro Standalone to use external Backblaze account or backup as such. You can also use free 10GB account that we manage. You don't need Pro Standalone to use the advanced features on account managed by us, we provide them together in one package. I hope this helps to understand our offering.
Avatar
Buzz69 9/10/2023 8:34 PM
ok to be honest I just signed up to support the project without thinking too much about the user case. I guess I can see why it would be useful to have multiple backup accounts on different providers for belt and braces security - ie your precious data backed up in more than one place. I would be interested in the use case that was originally intended for this feature?
gm1k joined the server. 9/10/2023 8:52 PM
jef joined the server. 9/10/2023 10:03 PM
jef joined the server. 9/10/2023 10:06 PM
Avatar
jef 9/10/2023 10:06 PM
hola
10:06 PM
hey @Buzz69
10:07 PM
@Tom just upgraded and i think this app is very useful
STEPHEN joined the server. 9/10/2023 10:10 PM
Avatar
Avatar
STEPHEN
Click to see original message
STEPHEN 9/10/2023 10:10 PM
Avatar
jef 9/10/2023 10:10 PM
slow
Avatar
STEPHEN 9/10/2023 10:10 PM
Good afternoon good folks
10:11 PM
Hullo jefffj
10:11 PM
I'm having issue with my albums showing under the media backup tab
10:11 PM
Any tips?
10:11 PM
Image attachment
10:13 PM
But, they're their
Image attachment
10:13 PM
There
Avatar
jef 9/10/2023 10:16 PM
try making a support ticket? #support
Avatar
STEPHEN 9/10/2023 10:17 PM
... there's 8 of us
Avatar
jef 9/10/2023 10:17 PM
ha
Avatar
STEPHEN 9/10/2023 10:17 PM
Plus I didn't see
Avatar
jef 9/10/2023 10:17 PM
yeah i meant maybe someone will see it there and help
t_rott joined the server. 9/10/2023 10:23 PM
Avatar
t_rott 9/10/2023 10:23 PM
Yo great proj
Avatar
Avatar
t_rott
Click to see original message
STEPHEN 9/10/2023 10:23 PM
gord joined the server. 9/10/2023 10:40 PM
Avatar
Avatar
gord
Click to see original message
STEPHEN 9/10/2023 11:14 PM
Avatar
Avatar
gord
Click to see original message
jef 9/10/2023 11:20 PM
Sticker
Avatar
gord 9/10/2023 11:20 PM
Howdy
Jeffrey W Pearson joined the server. 9/11/2023 12:01 AM
Avatar
Avatar
gord
Click to see original message
t_rott 9/11/2023 12:37 AM
Avatar
Avatar
Jeffrey W Pearson
Click to see original message
gord 9/11/2023 12:45 AM
👍 1
Avatar
Avatar
t_rott
Click to see original message
gord 9/11/2023 12:45 AM
Avatar
Avatar
STEPHEN
Click to see original message
gord 9/11/2023 12:45 AM
Sticker
Avatar
STEPHEN 9/11/2023 2:20 AM
Scprime boys blowing it up in here 😂
Avatar
jef 9/11/2023 2:22 AM
it reads like @Tom uses an S3 cloud storage platform for hosted S3Drive accounts
2:22 AM
Prob should peek at XNS
2:28 AM
I'm using S3Drive on my selfhosted relayer, works perfect
Avatar
t_rott 9/11/2023 2:39 AM
Just set the fam up for iPhone backups. Using xns.tech for relayer with minio. Working perfect. 🤘
👍 1
Avatar
jef 9/11/2023 2:41 AM
yeah same did you get the paid version
2:41 AM
big spender
Avatar
t_rott 9/11/2023 2:41 AM
Yup
Avatar
jef 9/11/2023 2:41 AM
tom's getting paid todsay
2:41 AM
ha
Avatar
t_rott 9/11/2023 2:41 AM
It’s priced very well
Avatar
jef 9/11/2023 2:42 AM
yeah its great
2:42 AM
sent like 7k photos from my phone. impressed how it wirked
Avatar
t_rott 9/11/2023 2:43 AM
Yah getting there my self. House pipe slow upload. Need to go over to colo and warp speed 😂
Avatar
Buzz69 9/11/2023 6:55 AM
hi guys, glad you made it here, @jef already mentioned XNS to Tom 😎
👍 2
Exported 100 message(s)
Timezone: UTC+0