Skip to content
This repository has been archived by the owner on Feb 26, 2020. It is now read-only.

File size zero bytes after rsync #139

Open
spirann opened this issue Jul 15, 2017 · 1 comment
Open

File size zero bytes after rsync #139

spirann opened this issue Jul 15, 2017 · 1 comment

Comments

@spirann
Copy link

spirann commented Jul 15, 2017 •
edited
Loading

Context

  • svfs version : 0.9.1
  • storage provider : OVH
  • product : Cloud Storage
  • OS : Linux Ubuntu Server 16.04.2 LTS
  • rsync : version 3.1.1 protocol version 31

Steps to reproduce this issue :

  1. Container is mounted via fstab :
    pcs /media/OVH-1 svfs username=xxx,password=yyy,tenant=zzz,region=AAA,container=BBB,uid=1000,gid=120,mode=0770,attr,connect_timeout=5m,segment_size=2500 0 0
  2. Choose a large file to transfert : in my case 6.6G
  3. rsync -rtWh --ignore-existing --inplace --progress <folder_with_large_file:FWLF> /media/OVH-1/
  4. During transfert ls -lh /media/OVH-1/FWLF/LF.ext shows the file growing
  5. After transfert the size is 0

Results you expected :

Keep it size

Results you observed :

Size is 0

Debug log :

[Lots of writes ;)]
DEBU[2017-07-15T15:48:14+02:00] -> [ID=0x13b68] Write 127408         source=fuse
DEBU[2017-07-15T15:48:14+02:00] <- Write [ID=0x13b69 Node=0x7 Uid=1000 Gid=1001 Pid=21825] 0x1 131072 @7041315248 fl=WriteLockOwner lock=15591134572160120185 ffl=OpenWriteOnly  source=fuse
DEBU[2017-07-15T15:48:14+02:00] -> [ID=0x13b69] Write 131072         source=fuse
DEBU[2017-07-15T15:48:14+02:00] <- Write [ID=0x13b6a Node=0x7 Uid=1000 Gid=1001 Pid=21825] 0x1 3664 @7041446320 fl=WriteLockOwner lock=15591134572160120185 ffl=OpenWriteOnly  source=fuse
DEBU[2017-07-15T15:48:14+02:00] -> [ID=0x13b6a] Write 3664           source=fuse
DEBU[2017-07-15T15:48:14+02:00] <- Write [ID=0x13b6b Node=0x7 Uid=1000 Gid=1001 Pid=21825] 0x1 14903 @7041449984 fl=WriteLockOwner lock=15591134572160120185 ffl=OpenWriteOnly  source=fuse
DEBU[2017-07-15T15:48:14+02:00] -> [ID=0x13b6b] Write 14903          source=fuse
DEBU[2017-07-15T15:48:14+02:00] <- Setattr [ID=0x13b6c Node=0x7 Uid=1000 Gid=1001 Pid=21825] size=7041464887 handle=0x1 lockowner  source=fuse
DEBU[2017-07-15T15:48:14+02:00] -> [ID=0x13b6c] Setattr valid=1m0s ino=12381652586948231162 size=7041464887 mode=-rwxrwx---  source=fuse
DEBU[2017-07-15T15:48:14+02:00] <- Flush [ID=0x13b6d Node=0x7 Uid=1000 Gid=1001 Pid=21825] 0x1 fl=0x0 lk=0xd85ed649baea7579  source=fuse
DEBU[2017-07-15T15:48:14+02:00] -> [ID=0x13b6d] Flush                source=fuse
DEBU[2017-07-15T15:48:14+02:00] <- Release [ID=0x13b6e Node=0x7 Uid=0 Gid=0 Pid=0] 0x1 fl=OpenWriteOnly rfl=0 owner=0x0  source=fuse
DEBU[2017-07-15T15:48:14+02:00] <- Getattr [ID=0x13b6f Node=0x8 Uid=1000 Gid=1001 Pid=21825] 0x0 fl=0  source=fuse
DEBU[2017-07-15T15:48:14+02:00] -> [ID=0x13b6f] Getattr valid=1m0s ino=12334951539984183433 size=4096 mode=drwxrwx---  source=fuse
DEBU[2017-07-15T15:48:14+02:00] <- Lookup [ID=0x13b70 Node=0x8 Uid=1000 Gid=1001 Pid=21825] "FWLF"  source=fuse
DEBU[2017-07-15T15:48:15+02:00] -> [ID=0x13b6e] Release              source=fuse
2017/07/15 15:48:29 Unsolicited response received on idle HTTP channel starting with "HTTP/1.0 408 Request Time-out\r\nCache-Control: no-cache\r\nConnection: close\r\nContent-Type: text/html\r\n\r\n<html><body><h1>408 Request Time-out</h1>\nYour browser didn't send a complete request in time.\n</body></html>\n"; err=<nil>
[10+ Request time-out removed]
DEBU[2017-07-15T15:48:38+02:00] -> [ID=0x13b70] Lookup 0x10 gen=7 valid=1m0s attr={valid=1m0s ino=9556793983302189787 size=4096 mode=drwxrwx---}  source=fuse
DEBU[2017-07-15T15:48:38+02:00] <- Forget [ID=0x13b72 Node=0x10 Uid=0 Gid=0 Pid=0] 1  source=fuse
DEBU[2017-07-15T15:48:38+02:00] <- Lookup [ID=0x13b71 Node=0x8 Uid=1000 Gid=1001 Pid=21825] "FWLF"  source=fuse
DEBU[2017-07-15T15:48:38+02:00] -> [ID=0x13b72] Forget               source=fuse
DEBU[2017-07-15T15:48:38+02:00] -> [ID=0x13b71] Lookup 0x10 gen=8 valid=1m0s attr={valid=1m0s ino=9556793983302189787 size=4096 mode=drwxrwx---}  source=fuse
DEBU[2017-07-15T15:48:38+02:00] <- Forget [ID=0x13b74 Node=0x4 Uid=0 Gid=0 Pid=0] 1  source=fuse
DEBU[2017-07-15T15:48:38+02:00] <- Forget [ID=0x13b73 Node=0x7 Uid=0 Gid=0 Pid=0] 1  source=fuse
DEBU[2017-07-15T15:48:38+02:00] -> [ID=0x13b74] Forget               source=fuse
DEBU[2017-07-15T15:48:38+02:00] -> [ID=0x13b73] Forget               source=fuse
DEBU[2017-07-15T15:48:38+02:00] <- Forget [ID=0x13b75 Node=0x5 Uid=0 Gid=0 Pid=0] 1  source=fuse
DEBU[2017-07-15T15:48:38+02:00] -> [ID=0x13b75] Forget               source=fuse
DEBU[2017-07-15T15:48:38+02:00] <- Forget [ID=0x13b76 Node=0x3 Uid=0 Gid=0 Pid=0] 1  source=fuse
DEBU[2017-07-15T15:48:38+02:00] -> [ID=0x13b76] Forget               source=fuse
DEBU[2017-07-15T15:48:38+02:00] <- Forget [ID=0x13b77 Node=0x2 Uid=0 Gid=0 Pid=0] 1  source=fuse
DEBU[2017-07-15T15:48:38+02:00] -> [ID=0x13b77] Forget               source=fuse
DEBU[2017-07-15T15:48:38+02:00] <- Lookup [ID=0x13b78 Node=0x10 Uid=1000 Gid=1001 Pid=21825] "LF.ext"  source=fuse
DEBU[2017-07-15T15:48:38+02:00] -> [ID=0x13b78] Lookup 0x2 gen=9 valid=1m0s attr={valid=1m0s ino=12381652586948231162 size=7041464887 mode=-rwxrwx---}  source=fuse
DEBU[2017-07-15T15:48:38+02:00] <- Setattr [ID=0x13b79 Node=0x2 Uid=1000 Gid=1001 Pid=21825] atime=2017-07-15 15:48:38.333225849 +0200 CEST atime=now mtime=2017-07-14 01:46:17.575382912 +0200 CEST handle=INVALID-0x0  source=fuse
DEBU[2017-07-15T15:48:38+02:00] -> [ID=0x13b79] Setattr valid=1m0s ino=12381652586948231162 size=7041464887 mode=-rwxrwx---  source=fuse
DEBU[2017-07-15T15:48:38+02:00] <- Setattr [ID=0x13b7a Node=0x2 Uid=1000 Gid=1001 Pid=21825] mode=-rw-rw-r-- handle=INVALID-0x0  source=fuse
DEBU[2017-07-15T15:48:38+02:00] -> [ID=0x13b7a] Setattr error=operation not supported  source=fuse
DEBU[2017-07-15T15:48:38+02:00] <- Setattr [ID=0x13b7b Node=0x10 Uid=1000 Gid=1001 Pid=21824] atime=2017-07-15 15:48:38.78122826 +0200 CEST atime=now mtime=2017-07-14 23:25:22.602638648 +0200 CEST handle=INVALID-0x0  source=fuse
DEBU[2017-07-15T15:48:38+02:00] -> [ID=0x13b7b] Setattr valid=1m0s ino=9556793983302189787 size=4096 mode=drwxrwx---  source=fuse

Additional information :
@Notmarrco
Copy link

I can confirm, with a simple shutil.copy( and an only 130Mo file. 😞

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@spirann @Notmarrco