save

Author: alainabbas

.gitignore

@@ -5,3 +5,4 @@
 /.idea
 /rootfs/cn_s3_api/__pycache__
 .DS_Store
+conf/id_ed25519

data/storage/README.md

@@ -0,0 +1,42 @@
+# syncS3
+sync a local folder to S3. 
+
+## Description 
+SyncS3 is a little utlity that watch file changes in a directory and push them in a S3 
+it uses notification of the kernel to see what files are wrote 
+
+## How to use it 
+All is ready in a docker image. You have just to set some parameters 
+
+### docker-compose.yml
+```
+services: 
+ app:
+    env_file: .env
+    build: .
+    container_name: "sync"
+    volumes:
+      - ./data/storage:/data
+      - ./logs:/var/log/s3sync
+```
+the directory to watch must mounted in volume. In this exemple (for bareos : /home/docker/bareos-sd/data/storage)
+
+### variables 
+fichier .env
+```
+## Endpoint S3 
+S3_ENDPOINT=https://s3.rbx.io.cloud.ovh.net/
+## Key Id
+S3_KEY_ID=xx
+## Secret
+S3_KEY_SECRET=xx
+## Region
+S3_REGION=RBX
+## bucket
+S3_BUCKET=My-Bucket
+## dir_source (always /data) mounted volume
+DIR_SOURCE=/data 
+## Prefix S3 exemple file foo.txt will be named /data-sd1/foo.txt in S3
+S3_DIR_DEST=/data-sd1 
+```
+

docker-compose.yml

@@ -6,3 +6,4 @@ services:
     volumes:
       - ./data/storage:/data
       - ./logs:/var/log/s3sync
+      - ./conf:/conf

rootfs/template/config_sftp.conf

@@ -1,7 +1,7 @@
 [config]
 type=sftp
-host= ${SFTP_HOST}
-user= ${SFTP_USER}
+host=${SFTP_HOST}
+user=${SFTP_USER}
 private_key_file=${SFTP_PRIVATE_KEY_FILE}
 dir_source=${DIR_SOURCE}
 dir_dest=${DIR_DEST}

rootfs/utils/sftp_utils.py

@@ -10,7 +10,7 @@ def open_ssh_conn():
     try :
         pkey = paramiko.Ed25519Key.from_private_key_file(key_file)
     except Exception as e:
-        # print("An exception occurred: {}".format(e))
+        print("An exception occurred reading key: {}".format(e))
         pass
     try:
         pkey = paramiko.RSAKey.from_private_key_file(key_file)