Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Fix bugs in migration script (#4501)
* fix argument -t * fix path can not find error - upload to wrong destination * fix format * modify logging info * fix delete bundle issue * add more checks when deleting * add checks * change sanity check in migration * test logging * fix dir size check * fix sanity check * fix is dir * black * fix * modify dependencies * add migration * add more logging * add try-catch * add more try catch * fix logging format * test all bundles * test all bundles * add migration * add migration * change the way to get bundle uuid * fix format * add logging level * check linked bundle * change linked bundle * add file size check * add file size counter * clean up files * 1) Fix major bug that caused many bundles to be skipped as being linked even though they weren't linked. 2) remove dependency on a file to determine which bundles to delete and what their original locations were. * Fix some issues * Added in timing code * Updated migration script to fix a few timing bugs * change disk usage calculation * fix format * Added in -k and added in multiprocessing * Fix bugs * Finalize migration script * Add in multiprocessing * minor comments * Fix minor error with logic for when to upload bundle * One more update to that pesky if statement: I think I got it working now * Fix formatting --------- Co-authored-by: Ashwin Ramaswami <[email protected]> Co-authored-by: AndrewJGaut <[email protected]>
- Loading branch information