S3Drive - RAM Usage Problem in Linux Mint

Hi, I'm using Linux Mint 22, and my app version is 1.13.0. In the desktop version, I have problem with downloading. While I can dowload small files (less than 1GB), if I try to downlad bigger files, the usage of RAM hits quickly 16 GB and the app crashes. Just recently I tried to download a video file (1.7 GB). First, it gave error ("download connection closed"), in second try, the usage of RAM hit 16GB, and the app crashed. What can be the problem?

Thanks, we will run couple tests to see if there is any regression on our end. In principle big file download shouldn't really use that much memory, as we don't buffer file in RAM, but instead write directly to the file system. What release do you use? Flathub, AppImage etc.? Do you have E2E enabled? Is that Rclone or S3 endpoint? (edited)

Hi Tom, thanks for the answer. It is Flathub release, E2E enabled with Rclone. In the earlier versions, I did not have this problem. But I cannot really say after which version it began. By the way, I convinced my girlfriend to subscribe your storage plan with licence, and tryed in her machine (which is a different machine with Linux Mint 22, Flathub release, E2E enabled with Rclone) and got the same problem.

Ludwig

Hi Tom, thanks for the answer. It is Flathub release, E2E enabled with Rclone. In the earlier versions, I did not have this problem. But I cannot really say after which version it began. By the way, I convinced my girlfriend to subscribe your storage plan with licence, and tryed in her machine (which is a different machine with Linux Mint 22, Flathub release, E2E enabled with Rclone) and got the same problem.

We've tried ourselves using Flathub release on crypt that was pointing to previously configured Dropbox endpoint. We've then uploaded 2,9GB video file and requested download after that. According to htop the RAM usage (RES) was quite fine and wasn't growing during download it was hovering between 330-350M. That was on Ubuntu 24.04 host. I've started to wonder if RAM problem that you seem to experience is somehow connected to Mint. Are you running S3Drive directly on the host or perhaps using VM or containerization of some sort? Do you have some specific FS overlay thay may perhaps try to store files (or some their portion) in-memory? (edited)

Hi Tom, I have been using Mint as it is, without any VM or additional containerization. These are my logs:

10:12 AM

This is from the app, when recieved "connection closed" error:

10:13 AM

these are my system logs, when app crashed with high RAM usage:

Ludwig

these are my system logs, when app crashed with high RAM usage:

Thanks for these screenshots, they show that OOM killer killed Kopia (backups?) process and infact S3Drive. Would it be possible for you to send me a screenshot showing the RAM usage of S3Drive before download starts and at some point during the big file download transfer?

Yes, I use Kopia back up in the background. I do not understand why OOM killed it. These are screenshots before downloading and during the downloading:

Hi Tom, now I noticed something interesting. If I try to download the big file not through download button, but mounting the storage in my computer and copy pasting file to my desktop, it downloads without any problem.

That's indeed an interesting finding. You've said you're using E2E with Rclone, what's the underlying back-end/remote that crypt points to? Sorry for these specific questions, but I am trying to narrow down all the variables.

Hi @Ludwig, we still haven't managed to reproduce this issue. We're awaiting for a stronger office machine, so we can conveniently install multiple Linux VMs (incl. Mint) and then try to reproduce the issue on this distro specifically. In the meantime if you could tell us what's your dest back-end, so we can get the test environment right that would be appreciated. Thanks!

Hi @Ludwig, We've configured Mint 22 machine in the meantime and tried to initiate download of a ~2.1GB file. We use pCloud with crypt wrapped (we've configured crypt from the Accounts settings whilst connected to pCloud and S3Drive switched automatically to crypt). It seems to us that standard download doesn't seem to affect RAM at all (screenshots). Can you let us know what back-end you use? (We've tested on pCloud). Can you try using latest version and see if problem still exists? Thanks!

11:15 AM

Hi again @Ludwig, Unfortunately we can't reproduce this issue and there wasn't any update from your end. I am going to mark this issue as closed. If you come across this issue again, please let us know, as we would be really keen to solve any performance / resource related issues.