Skip to content

Commit

Permalink
Fix bugs in migration script (#4501)
Browse files Browse the repository at this point in the history
* fix argument -t

* fix path can not find error - upload to wrong destination

* fix format

* modify logging info

* fix delete bundle issue

* add more checks when deleting

* add checks

* change sanity check in migration

* test logging

* fix dir size check

* fix sanity check

* fix is dir

* black

* fix

* modify dependencies

* add migration

* add more logging

* add try-catch

* add more try catch

* fix logging format

* test all bundles

* test all bundles

* add migration

* add migration

* change the way to get bundle uuid

* fix format

* add logging level

* check linked bundle

* change linked bundle

* add file size check

* add file size counter

* clean up files

* 1) Fix major bug that caused many bundles to be skipped as being linked even though they weren't linked. 2) remove dependency on a file to determine which bundles to delete and what their original locations were.

* Fix some issues

* Added in timing code

* Updated migration script to fix a few timing bugs

* change disk usage calculation

* fix format

* Added in -k and added in multiprocessing

* Fix bugs

* Finalize migration script

* Add in multiprocessing

* minor comments

* Fix minor error with logic for when to upload bundle

* One more update to that pesky if statement: I think I got it working now

* Fix formatting

---------

Co-authored-by: Ashwin Ramaswami <[email protected]>
Co-authored-by: AndrewJGaut <[email protected]>
  • Loading branch information
3 people authored Oct 10, 2023
1 parent bf1dff7 commit 73b4d7e
Show file tree
Hide file tree
Showing 3 changed files with 292 additions and 98 deletions.
Loading

0 comments on commit 73b4d7e

Please sign in to comment.