Code

Cleaning and updating master#177

Code

Open

Neeratyoy wants to merge 155 commits intodevelopautoml/HPOBench:developfrom LCs_Aug22automl/HPOBench:LCs_Aug22Copy head branch name to clipboard

+1,686-1,422

Commits

Commits on Jun 23, 2021

• Adding sample RF space for tabular collection design

  Neeratyoy

  committed
  b2155dd

  Copy full SHA for b2155dd

• Placeholder SVM benchmark to interface tabular data collection

  Neeratyoy

  committed
  ce405e6

  Copy full SHA for ce405e6

Commits on Jun 24, 2021

• Writing common ML benchmark class for tabular collection

  Neeratyoy

  committed
  2ef3af8

  Copy full SHA for 2ef3af8

• Adding placeholder for HistGradientBoostedClassifier

  Neeratyoy

  committed
  61b6963

  Copy full SHA for 61b6963

• Minor code cleaning

  Neeratyoy

  committed
  a5d0217

  Copy full SHA for a5d0217

Commits on Jun 26, 2021

• Reformatting output dict + option to add more metrics

  Neeratyoy

  committed
  3def203

  Copy full SHA for 3def203

Commits on Jun 28, 2021

• Removing redundant import

  Neeratyoy

  committed
  750cc7d

  Copy full SHA for 750cc7d

Commits on Jun 30, 2021

• Decoupling storage of costs for each metric

  Neeratyoy

  committed
  e7665e6

  Copy full SHA for e7665e6

Commits on Jul 1, 2021

• Including test scores in objective

  Neeratyoy

  committed
  47fe4cd

  Copy full SHA for 47fe4cd

• Documenting the structure of information in each fn eval.

  Neeratyoy

  committed
  2d085ec

  Copy full SHA for 2d085ec

Commits on Jul 2, 2021

• Some decisions on lower bound for subsample fidelity

  Neeratyoy

  committed
  2da9d5c

  Copy full SHA for 2da9d5c

Commits on Jul 6, 2021

• AbstractBenchmark update for fidelity option + including XGBoost

  Neeratyoy

  committed
  751d2e9

  Copy full SHA for 751d2e9

Commits on Jul 7, 2021

• Adding sample RF space for tabular collection design

  Neeratyoy

  committed
  3f84afb

  Copy full SHA for 3f84afb

• Placeholder SVM benchmark to interface tabular data collection

  Neeratyoy

  committed
  09b296a

  Copy full SHA for 09b296a

• Writing common ML benchmark class for tabular collection

  Neeratyoy

  committed
  af4f593

  Copy full SHA for af4f593

• Adding placeholder for HistGradientBoostedClassifier

  Neeratyoy

  committed
  df2462d

  Copy full SHA for df2462d

• Minor code cleaning

  Neeratyoy

  committed
  4d1d2d6

  Copy full SHA for 4d1d2d6

• Reformatting output dict + option to add more metrics

  Neeratyoy

  committed
  299e592

  Copy full SHA for 299e592

• Removing redundant import

  Neeratyoy

  committed
  c46321d

  Copy full SHA for c46321d

• Decoupling storage of costs for each metric

  Neeratyoy

  committed
  17f6634

  Copy full SHA for 17f6634

• Including test scores in objective

  Neeratyoy

  committed
  7de891f

  Copy full SHA for 7de891f

• Documenting the structure of information in each fn eval.

  Neeratyoy

  committed
  ec316c3

  Copy full SHA for ec316c3

• Some decisions on lower bound for subsample fidelity

  Neeratyoy

  committed
  e7f69b9

  Copy full SHA for e7f69b9

• AbstractBenchmark update for fidelity option + including XGBoost

  Neeratyoy

  committed
  edb3e7f

  Copy full SHA for edb3e7f

• Merge branch 'thesis-paper' of https://github.com/Neeratyoy/HPOBench into thesis-paper

  Neeratyoy

  committed
  642027b

  Copy full SHA for 642027b

Commits on Jul 8, 2021

• Option to load data splits from disk

  Neeratyoy

  committed
  9e907e6

  Copy full SHA for 9e907e6

Commits on Jul 12, 2021

• Reordering data load to work for different cases

  Neeratyoy

  committed
  f0d4f36

  Copy full SHA for f0d4f36

Commits on Jul 14, 2021

• Updating source of SVM HP range

  Neeratyoy

  committed
  dbeae7c

  Copy full SHA for dbeae7c

• Adding Tabular Benchmark class

  Neeratyoy

  committed
  f277a2e

  Copy full SHA for f277a2e

Commits on Jul 15, 2021

• Adding TabularBenchmark interface + easy import

  Neeratyoy

  committed
  60d5646

  Copy full SHA for 60d5646

Commits on Jul 16, 2021

• Adding LR space

  Neeratyoy

  committed
  c4100fd

  Copy full SHA for c4100fd

Commits on Jul 19, 2021

• Standardizing fidelity space definitions

  Neeratyoy

  committed
  9c6dcdb

  Copy full SHA for 9c6dcdb

• Standardizing HPs + Adding NN space

  Neeratyoy

  committed
  74b6919

  Copy full SHA for 74b6919

• Small placeholder for testing

  Neeratyoy

  committed
  785055e

  Copy full SHA for 785055e

Commits on Jul 20, 2021

• Updating NN HP space + Helper function for TabularBenchmark

  Neeratyoy

  committed
  0159a35

  Copy full SHA for 0159a35

• Adding fidelity range retrieval utility to TabularBenchmark

  Neeratyoy

  committed
  e9e097a

  Copy full SHA for e9e097a

Commits on Jul 21, 2021

• Enforcing subsample lower bound check inside objective

  Neeratyoy

  committed
  4797109

  Copy full SHA for 4797109

• Bug fix + adding precicion as metric

  Neeratyoy

  committed
  dbb7327

  Copy full SHA for dbb7327

Commits on Jul 22, 2021

• Fixing param spaces and model building for LR, SVM

  Neeratyoy

  committed
  7d5ca57

  Copy full SHA for 7d5ca57

Commits on Jul 26, 2021

• TabularBenchmark edit to read compressed files and query a dataframe

  Neeratyoy

  committed
  a6d94bb

  Copy full SHA for a6d94bb

Commits on Jul 27, 2021

• Not evaluating training set to save time

  Neeratyoy

  committed
  93b6908

  Copy full SHA for 93b6908

• Fidelity change for trees + NN space change

  Neeratyoy

  committed
  8164eb0

  Copy full SHA for 8164eb0

Commits on Jul 29, 2021

• Final RF space

  Neeratyoy

  committed
  6916c9c

  Copy full SHA for 6916c9c

• Final XGB space

  Neeratyoy

  committed
  8e5912b

  Copy full SHA for 8e5912b

Commits on Jul 30, 2021

• Final HistGB space

  Neeratyoy

  committed
  6968ac3

  Copy full SHA for 6968ac3

Commits on Aug 2, 2021

• Finalizing RF, XGB, NN

  Neeratyoy

  committed
  79dd1f3

  Copy full SHA for 79dd1f3

• TabularBenchmark edit to process only table and metadata

  Neeratyoy

  committed
  ca1e0d4

  Copy full SHA for ca1e0d4

Commits on Aug 4, 2021

• Merge remote-tracking branch 'origin/development' into PR_Multi-fidelity-tabular-benchmarks

  PhMueller

  committed
  87133ed

  Copy full SHA for 87133ed

• Merge remote-tracking branch 'origin/development' into PR_Multi-fidelity-tabular-benchmarks

  PhMueller

  committed
  6096204

  Copy full SHA for 6096204

Commits on Aug 11, 2021

• TabularBenchmark

  Show description for 0d70d36
  PhMueller

  committed
  0d70d36

  Copy full SHA for 0d70d36

• Pycodestyle

  PhMueller

  committed
  12ebce8

  Copy full SHA for 12ebce8

• Flake8

  PhMueller

  committed
  873781e

  Copy full SHA for 873781e

• Adapt ML Benchmark Template to fit with current API

  PhMueller

  committed
  532a905

  Copy full SHA for 532a905

• Corret Datamanager.

  Show description for 9dbd61c
  PhMueller

  committed
  9dbd61c

  Copy full SHA for 9dbd61c

• Finalize HistGB Benchmarks

  Show description for 0304146
  PhMueller

  committed
  0304146

  Copy full SHA for 0304146

Commits on Aug 16, 2021

• Write OpenML Datamanager

  PhMueller

  committed
  3e95d19

  Copy full SHA for 3e95d19

• Unify interface for the other ml benchmarks.

  PhMueller

  committed
  f3fbd58

  Copy full SHA for f3fbd58

• Flake + Pep

  PhMueller

  committed
  e57fbcb

  Copy full SHA for e57fbcb

• Add Container Interface

  PhMueller

  committed
  f6131ea

  Copy full SHA for f6131ea

• Mark task_id as required.

  PhMueller

  committed
  36bc391

  Copy full SHA for 36bc391

• Adapt Interfaces

  PhMueller

  committed
  a5c7d62

  Copy full SHA for a5c7d62

• Fix minor errors.

  PhMueller

  committed
  c5f6979

  Copy full SHA for c5f6979

• Fix minor errors.

  PhMueller

  committed
  48af58d

  Copy full SHA for 48af58d

• Pylint

  PhMueller

  committed
  cf24488

  Copy full SHA for cf24488

Commits on Aug 17, 2021

• Init Model can handle now Configurations

  PhMueller

  committed
  528dde1

  Copy full SHA for 528dde1

• PR Requests: Rename Classes

  PhMueller

  committed
  6bdf5c0

  Copy full SHA for 6bdf5c0

• PR Requests: Move dependencies to correct directory

  PhMueller

  committed
  b8b30a5

  Copy full SHA for b8b30a5

• PR Requests: Tabular Benchmarks - Remove unnecessary class definition

  PhMueller

  committed
  875c594

  Copy full SHA for 875c594

• PR Requests: Minor improvments

  PhMueller

  committed
  8891e33

  Copy full SHA for 8891e33

• PR Requests: Update upper bounds of the fidelities

  PhMueller

  committed
  75f345d

  Copy full SHA for 75f345d

• PR Requests: Remove OriginalTabBenchmarks

  PhMueller

  committed
  8c2ab6c

  Copy full SHA for 8c2ab6c

• PR Requests: Revert the query function

  PhMueller

  committed
  e24d537

  Copy full SHA for e24d537

• PR Requests: Minor improvements

  PhMueller

  committed
  3c4f375

  Copy full SHA for 3c4f375

• Pycodestyle

  PhMueller

  committed
  6fc7f57

  Copy full SHA for 6fc7f57

• Add missing requirements

  PhMueller

  committed
  0430c68

  Copy full SHA for 0430c68

• Minor Improvements

  Show description for 3eb3a2d
  PhMueller

  committed
  3eb3a2d

  Copy full SHA for 3eb3a2d

• ADD container recipes

  PhMueller

  committed
  fa691f7

  Copy full SHA for fa691f7

Commits on Aug 19, 2021

• PR: Fix path in tabular data loader

  PhMueller

  committed
  f64917e

  Copy full SHA for f64917e

• PR: Remove casting configspace to np.floats

  PhMueller

  committed
  b95d2a5

  Copy full SHA for b95d2a5

• PR: Move everything back from ml_mmfb/ to ml/

  PhMueller

  committed
  d7d7a2d

  Copy full SHA for d7d7a2d

• PR: Remove pybnn from the init.

  Show description for be641f8
  PhMueller

  committed
  be641f8

  Copy full SHA for be641f8

• PR: Cleanup

  PhMueller

  committed
  7bc25bc

  Copy full SHA for 7bc25bc

• PR: Fix Tests

  PhMueller

  committed
  b0d9b7f

  Copy full SHA for b0d9b7f

• Adding public URLs for tabular benchmark

  Neeratyoy

  committed
  59bd905

  Copy full SHA for 59bd905

• Merge branch 'PR_Multi-fidelity-tabular-benchmarks' into add-tabular-urls

  Neeratyoy

  committed
  6576e99

  Copy full SHA for 6576e99

• Adding more models

  Neeratyoy

  committed
  f576fb3

  Copy full SHA for f576fb3

Commits on Aug 20, 2021

• Updating figshare URLs with new public ones

  Neeratyoy

  committed
  63f5177

  Copy full SHA for 63f5177

• PR Fix URLs and dependencies

  PhMueller

  committed
  5335831

  Copy full SHA for 5335831

Commits on Aug 21, 2021

• Updating URL for SVM data

  Neeratyoy

  committed
  cf9b4ef

  Copy full SHA for cf9b4ef

Commits on Aug 23, 2021

• Updating Tabular bench URLs

  Neeratyoy

  committed
  ed7d23e

  Copy full SHA for ed7d23e

Commits on Aug 25, 2021

• PR Fix URLs and dependencies

  PhMueller

  committed
  9181bbb

  Copy full SHA for 9181bbb

• PR Fix URLs and dependencies

  PhMueller

  committed
  451ff08

  Copy full SHA for 451ff08

Commits on Aug 26, 2021

• Updating RF benchmark URL

  Neeratyoy

  authored
  310b11e

  Copy full SHA for 310b11e

• Updating XGB URL

  Neeratyoy

  authored
  f01286b

  Copy full SHA for f01286b

Commits on Aug 27, 2021

• PR Fix tests

  PhMueller

  committed
  12b72b1

  Copy full SHA for 12b72b1

• New Urls

  PhMueller

  committed
  41aa96b

  Copy full SHA for 41aa96b

Commits on Aug 30, 2021

• Trigger Rebuild.

  PhMueller

  committed
  c23e354

  Copy full SHA for c23e354

• Fix Dataloader Assertion

  PhMueller

  committed
  1fa684c

  Copy full SHA for 1fa684c

Commits on Aug 31, 2021

• Merge branch 'PR_Multi-fidelity-tabular-benchmarks' into add-tabular-urls

  Neeratyoy

  authored
  5f015a6

  Copy full SHA for 5f015a6

Commits on Sep 1, 2021

• Merge branch 'development' into add-tabular-urls

  Neeratyoy

  authored
  11c57bf

  Copy full SHA for 11c57bf

Commits on Oct 1, 2021

• Redesigning reporting of val-test evaluations on query type

  Neeratyoy

  committed
  bfb3876

  Copy full SHA for bfb3876

Commits on Oct 6, 2021

• Merge branch 'development' into add-tabular-urls

  Neeratyoy

  committed
  8d7ea97

  Copy full SHA for 8d7ea97

• inference cost key fix

  Neeratyoy

  committed
  6394521

  Copy full SHA for 6394521

Commits on Oct 18, 2021

• Merge branch 'development' into tabular_v2

  Neeratyoy

  committed
  9776824

  Copy full SHA for 9776824

• Basic redesign of data collected on raw objective

  Neeratyoy

  committed
  460ae8c

  Copy full SHA for 460ae8c

Commits on Nov 10, 2021

• Merge branch 'add-tabular-urls' into tabular_v2

  Neeratyoy

  committed
  381eeaf

  Copy full SHA for 381eeaf

• Restructuring first iteration

  Neeratyoy

  committed
  cdd222f

  Copy full SHA for cdd222f

Commits on Nov 11, 2021

• Updating ML benches version with revisions

  Neeratyoy

  committed
  e1bb210

  Copy full SHA for e1bb210

• Minor update

  Neeratyoy

  committed
  815da34

  Copy full SHA for 815da34

Commits on Nov 15, 2021

• Adding model size info LR SVM NN

  Neeratyoy

  committed
  462549c

  Copy full SHA for 462549c

• Adding model size metric for RF, XGB

  Neeratyoy

  committed
  e6e77a3

  Copy full SHA for e6e77a3

• Enforcing minor PEP constraints

  Neeratyoy

  committed
  b79bc2d

  Copy full SHA for b79bc2d

Commits on Nov 16, 2021

• Minor fixes to MLP and LR

  Neeratyoy

  committed
  2f97931

  Copy full SHA for 2f97931

Commits on Dec 19, 2021

• Recording LCs for LR, RF, MLP

  Neeratyoy

  committed
  aeebf8f

  Copy full SHA for aeebf8f

Commits on Jan 3, 2022

• Updating LR benchmark for LC collection

  Neeratyoy

  committed
  48a88dd

  Copy full SHA for 48a88dd

• Updating RF bench with LC collection

  Neeratyoy

  committed
  e4c699f

  Copy full SHA for e4c699f

• Updating MLP bench with LC collection

  Neeratyoy

  committed
  a8f551f

  Copy full SHA for a8f551f

Commits on Jan 4, 2022

• Adding minor check

  Neeratyoy

  committed
  0a47c59

  Copy full SHA for 0a47c59

Commits on Jan 5, 2022

• Cleaning up seed usage in ML classes

  Neeratyoy

  committed
  20546a7

  Copy full SHA for 20546a7

Commits on Jan 7, 2022

• Cleaning LC collection code for ML benchmarks

  Neeratyoy

  committed
  bfc42cc

  Copy full SHA for bfc42cc

• Merge branch 'tabular_v2' into LCs

  Neeratyoy

  committed
  15e8e1b

  Copy full SHA for 15e8e1b

• Making LCs branch primary for experiments

  Neeratyoy

  committed
  9734da1

  Copy full SHA for 9734da1

Commits on Jan 9, 2022

• Adding option to record LC every k iterations

  Neeratyoy

  committed
  0b4dc1f

  Copy full SHA for 0b4dc1f

• Updating LR to collect LC every k iterations

  Neeratyoy

  committed
  46addaa

  Copy full SHA for 46addaa

• Updating RF to collect LC every k iterations

  Neeratyoy

  committed
  e2033df

  Copy full SHA for e2033df

Commits on Feb 6, 2022

• Adding LC collection option to MLP

  Neeratyoy

  committed
  67a3a32

  Copy full SHA for 67a3a32

Commits on May 30, 2022

• Updating tabular benchmark data for ML benchmarks

  Neeratyoy

  committed
  1544e1f

  Copy full SHA for 1544e1f

• version update for tabular benchmark

  Neeratyoy

  committed
  225a82b

  Copy full SHA for 225a82b

Commits on Jun 2, 2022

• Updating container information for ML benches

  Neeratyoy

  committed
  fd25d57

  Copy full SHA for fd25d57

Commits on Jun 3, 2022

• Bug fix for containers and fidelity space

  Neeratyoy

  committed
  0ad578f

  Copy full SHA for 0ad578f

Commits on Aug 31, 2022

• Updating container version used for experiments

  Neeratyoy

  committed
  dfa2034

  Copy full SHA for dfa2034

Commits on Apr 3, 2023

• Merge branch 'master' into LCs_Aug22

  Neeratyoy

  committed
  5731307

  Copy full SHA for 5731307

Commits on Apr 4, 2023

• Incorporating Pkg updates from @PhMueller on the 'development' branch

  Neeratyoy

  committed
  e6b39de

  Copy full SHA for e6b39de

• Fixing test cases

  Neeratyoy

  committed
  143ada5

  Copy full SHA for 143ada5

• Test case fix

  Neeratyoy

  committed
  dacb1db

  Copy full SHA for dacb1db

• Fixing dependencies

  Neeratyoy

  committed
  b2e2bb5

  Copy full SHA for b2e2bb5

Commits on Apr 28, 2023

• NAS201 tests: static methods inaccessible when importing the container version of class

  Neeratyoy

  committed
  49d9343

  Copy full SHA for 49d9343

• Pkg version to fix OD test failing

  Neeratyoy

  committed
  68d4a09

  Copy full SHA for 68d4a09

• Fixing failing OD test

  Neeratyoy

  committed
  676c121

  Copy full SHA for 676c121

• Fixing test cases + updating README

  Neeratyoy

  committed
  7013305

  Copy full SHA for 7013305

• Unit testing fix

  Neeratyoy

  committed
  0c76f2b

  Copy full SHA for 0c76f2b

Commits on Jun 5, 2023

• Fixing test cases

  Neeratyoy

  committed
  a8459e2

  Copy full SHA for a8459e2

• Trying pandas missing fix in ODE container

  Neeratyoy

  committed
  1e21e51

  Copy full SHA for 1e21e51

• Reverting pkg dependency

  Neeratyoy

  committed
  412b376

  Copy full SHA for 412b376

Commits on Jun 6, 2023

• Fixing xgboost local example

  Neeratyoy

  committed
  900988b

  Copy full SHA for 900988b

• Fixes

  Neeratyoy

  committed
  0341105

  Copy full SHA for 0341105

• Fixing example pkg dependency

  Neeratyoy

  committed
  d20e5a7

  Copy full SHA for d20e5a7

Commits on Aug 24, 2023

• Fixing OD unit test

  Neeratyoy

  committed
  8f00437

  Copy full SHA for 8f00437

• Removing deprecated torch dependency for OD

  Neeratyoy

  committed
  8d37916

  Copy full SHA for 8d37916

Commits on Oct 9, 2023

• Updates to fix tests

  Neeratyoy

  committed
  a11793d

  Copy full SHA for a11793d

• merge update

  Neeratyoy

  committed
  f06aa0b

  Copy full SHA for f06aa0b

Commits on Nov 10, 2023

• Updating container recipes to point to correct branch

  Neeratyoy

  committed
  dc2bab9

  Copy full SHA for dc2bab9

• Updating container information and source registry

  Neeratyoy

  committed
  e511a4f

  Copy full SHA for e511a4f

• Updating container URLs and maintainer

  Neeratyoy

  committed
  220cccd

  Copy full SHA for 220cccd

• Typo fix

  Neeratyoy

  committed
  890971d

  Copy full SHA for 890971d