Performance

Performance testing for PYBAG v 0.3.0.

For previous version PYBAG v0.2.0 full test results you can view here.

All tests given for command line interface. For GUI results is same.

First synchronization - in this time all files from origin copied to bag. this is a long synchronization.
Second synchronization - in this time scan all files in bag and origin for changes and copy only changed files. This a general mode of synchronization, - this mode is fast.
Backup roots - this mode used for backup, and in this mode synchronization is up 2 times faster then in standart mode. But in this mode you must not manualy change files in bag.

As you can see new version PYBAG is fast!

Difference between previous and new version is great. In huge backup about 24 GB new version up 5 times faster then old for second synchronization and more then 8 times faster in first synchronization (second synchronization - 4 minutes again 44 minutes and 47 minutes again 7 hours in first synchronization). Also in first synchronization I recomend turn off report (option -gx ) and view it only for errors or conflicts, it save you from large output for each new file.

Test 1 - Normal, ext3 (hdd) - ext3 (hdd)

Test synchronizing between same hard drive from one directory to other.

System configuration
Dell Inspiron 1525 T8300: Core2Duo 2.4 GHz, RAM 2 GB OS: Linux Ubuntu 10.04 Python 2.6.5 wxPython 2.8.10.1 File systems: origin: EXT3, HDD 5400 bag: same as origin

Items (files, folders) count: 1040 items (849 files, 188 folders, 3 symlinks).
Items size: 20 867 KBytes.
Testing result in seconds.

Command options	Description	PYBAG v 0.3.0	PYBAG v 0.2.0 (previous version)
-l1 -v3 -m0 (First synchronization)	CLI. Logging on. Verbosity 3. Debug off.	Summary = 0,514 Read = 0,255 Compare = 0,003 Synchronize = 0,232 Clear = 0,001 Save = 0,023	Summary = 6,454 Read = 1,761 Compare = 0,318 Synchronize = 2,738 Clear = 0,005 Save = 1,632
-l1 -v3 -m0 (Second synchronization)	CLI. Logging off. Verbosity 3. Debug off.	Summary = 0,464 Read = 0,409 Compare = 0,005 Synchronize = 0,024 Clear = 0,001 Save = 0,025	Summary = 2,822 Read = 0,908 Compare = 0,185 Synchronize = 0,193 Clear = 0,002 Save = 1,534
-l1 -v3 -m0 (Second synchronization, but roots marked as backup)	CLI. Logging on. Verbosity 3. Debug off. Backuped roots.	Summary = 0,310 Read = 0,255 Compare = 0,005 Synchronize = 0,024 Clear = 0,001 Save = 0,025
-l0 -v2 -m0 -t0 -gx (Second synchronization)	CLI. Logging off. Verbosity 2. Debug off. Report off.	Summary = 0,442 Read = 0,387 Compare = 0,005 Synchronize = 0,024 Clear = 0,001 Save = 0,025

Test 2 - Normal, ext3 (hdd) - fat32 (flashdrive)

This is working files synchronization test. Test synchronizing between hard drive and flashdrive.

System configuration
Dell Inspiron 1525 T8300: Core2Duo 2.4 GHz, RAM 2 GB OS: Linux Ubuntu 10.04 Python 2.6.5 wxPython 2.8.10.1 File systems: origin: EXT3, HDD 5400 bag: FAT32, USB2.0-FlashDrive Transcend JF150

Items (files, folders) count: 4803 items (4198 files, 603 folders, 2 symlinks).
Items size: 63 346 KBytes.
Testing result in seconds.

Command options	Description	PYBAG v 0.3.0	PYBAG v 0.2.0 (previous version)
-l1 -v3 -m0 (First synchronization)	CLI. Logging on. Verbosity 3. Debug off.	Summary = 2,336 Read = 1,237 Compare = 0,013 Synchronize = 0,975 Clear = 0,003 Save = 0,108	Summary = 17,505 Read = 5,180 Compare = 1,276 Synchronize = 9,211 Clear = 0,009 Save = 1,829
-l1 -v3 -m0 (Second synchronization)	CLI. Logging off. Verbosity 3. Debug off.	Summary = 2,242 Read = 2,049 Compare = 0,022 Synchronize = 0,057 Clear = 0,004 Save = 0,111	Summary = 8,215 Read = 4,586 Compare = 0,990 Synchronize = 0,889 Clear = 0,006 Save = 1,744
-l1 -v3 -m0 (Second synchronization, but roots marked as backup)	CLI. Logging on. Verbosity 3. Debug off. Backuped roots.	Summary = 1,430 Read = 1,244 Compare = 0,017 Synchronize = 0,060 Clear = 0,003 Save = 0,105

IF YOU LIKE PYBAG AND FOUND IT USEFUL WHEN YOU CAN DONATE TO AUTHOR SOME MONEY HERE.

If you do not want donate money then you can treat the author cap of coffee and pizza.

THANK YOU.

Test 3 - Huge, ext3 (hdd) - fat32 (hdd)

This is backup test.

As view from result - first synchronization is very slow becouse need copy all files to bag (copying speed is neer then copy throw system file manager). The next synchronization is more and more faster.

System configuration
Dell Inspiron 1525 T8300: Core2Duo 2.4 GHz, RAM 2 GB OS: Linux Ubuntu 10.04 Python 2.6.5 wxPython 2.8.10.1 File systems: origin: EXT3, HDD 5400 bag: FAT32, USB2.0-HDD 5400

Items (files, folders) count: 320 630 items (294 019 files, 26 611 folders, no symlinks).
Items size: 24,068 GBytes.

Command options	Description	PYBAG v 0.3.0	PYBAG v 0.2.0 (previous version)
-l0 -v3 -m0 -gx (First synchronization)	CLI. Logging off. Verbosity 3. Debug off. Report off.	Summary = 2 874 s (47 m : 54 s) Read = 202,4 s (3 m : 22,4 s) Compare = 0,807 s Synchronize = 2 660 s (44 m : 20 s) Clear = 0,303 s Save = 10,07 s
-l0 -v3 -m0 -g (Second synchronization)	CLI. Logging off. Verbosity 3. Debug off. Report on.	Summary = 224 s (3 m : 44 s) Read = 210 s (3 m : 30 s) Compare = 1,09 s Synchronize = 3,08 s Clear = 0,334 s Save = 9,6 s
-l1 -v3 -m0 -g -b1 (Second full synchronization)	CLI. Logging on. Verbosity 3. Debug off. Report on. Full synchronization	Summary = 557 s (9 m : 17 s) Read = 542 s (9 m : 02 s) Compare = 1,4 s Synchronize = 3,3 s Clear = 0,31 s Save = 9,4 s

-l1 -v2 -m0 -dbagall (First synchronization)	CLI. Logging on. Verbosity 2. Debug off. Forced to bag.		Summary = 25 467 s (7 h : 04 m : 27 s) Read = 540 s (09 m : 00 s) Compare = 69 s Synchronize = 24 834 s (6 h : 53 m : 54 s) Clear = 0,55 s Save = 22 s
-l1 -v2 -m0 -dbagall (Second synchronization)	CLI. Logging on. Verbosity 2. Debug off. Forced to bag.		Summary = 2 695 s (44 m : 55 s) Read = 2 520 s (42 m : 00 s) Compare = 72 s Synchronize = 81 s Clear = 0,51 s Save = 21,5 s