Skip to content

Commit

Permalink
Iterate w15: Wrap up (#53)
Browse files Browse the repository at this point in the history
* iterate t1t2

* restructure and iterate

* cleanup

* wrap up

* iterate
  • Loading branch information
ja-thomas authored Jun 22, 2022
1 parent 3c68318 commit ad153b5
Show file tree
Hide file tree
Showing 39 changed files with 950 additions and 849 deletions.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
File renamed without changes
File renamed without changes.
File renamed without changes.
File renamed without changes
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
File renamed without changes.
File renamed without changes.
File renamed without changes
File renamed without changes.
File renamed without changes.
Binary file added w14_pratical_considerations/practical.pdf
Binary file not shown.
File renamed without changes.
36 changes: 0 additions & 36 deletions w14_pratical_considerations/t01_big_picture.tex

This file was deleted.

Binary file not shown.
96 changes: 96 additions & 0 deletions w14_pratical_considerations/t01_intro.tex
Original file line number Diff line number Diff line change
@@ -0,0 +1,96 @@
\input{t00_template.tex}

\usepackage[normalem]{ulem}
\usepackage{pifont}
\usepackage{relsize}
\renewcommand{\lit}[1]{{\smaller\color{black!60}[#1]}}
\title[AutoML: Practical]{AutoML: Practical Considerations}
\subtitle{Introduction}
\author[Janek Thomas]{Bernd Bischl \and Frank Hutter \and Lars Kotthoff\newline \and Marius Lindauer \and \underline{Janek Thomas} \and Joaquin Vanschoren}

\begin{document}

\maketitle


%----------------------------------------------------------------------
%----------------------------------------------------------------------

\begin{frame}{From HPO to AutoML}
So far we covered
\begin{itemize}
\item HPO as black-box optimization
\begin{itemize}
\item Grid- and random search, EAs, BO
\end{itemize}
\item Speedup techniques for HPO
\begin{itemize}
\item Multi-fidelity, meta-learning, ...
\end{itemize}
\item Multi-objective HPO
\begin{itemize}
\item NSGA-II, ParEGO, ...
\end{itemize}
\item Neural Architecture Search (NAS)
\begin{itemize}
\item One-Shot approaches, DARTS, ...
\end{itemize}
\end{itemize}

\vspace{1cm}

$\longrightarrow$ So far we haven't talked (much) about practical considerations.

\end{frame}

\begin{frame}{From HPO to AutoML}
\begin{center}
\includegraphics[width = 0.9\linewidth]{images/18_AutoML-Components-Overview-Infographic_corrected.png}
\end{center}
\end{frame}

\begin{frame}{What is missing?}
\begin{columns}
\begin{column}{0.5\textwidth}
What do I need to know as an AutoML user?
\begin{itemize}
\item \sout{Nothing, because it is automatic.}
\item Understand limitations of AutoML and framework.
\item Know how to interpret the results.
\item Maybe: Data cleaning and feature extraction.
\end{itemize}

\vspace{1em}

Ingredients to implement an AutoML system?
\begin{itemize}
\item HPO algorithm
\item ML / Pipeline framework
\item Parallelization / Multi-fidelity
\item Process encapsulation and time capping
\item ...
% \item (Preprocessing)
\end{itemize}
\end{column}%
\begin{column}{0.5\textwidth}
\begin{center}

Practitioners view:
\scalebox{0.45}{
\input{tikz/true_automl_overview.tex}
}
\vspace{1em}

Academic view:
\scalebox{0.45}{
\input{tikz/automl_overview.tex}
}

\end{center}
\end{column}
\end{columns}
\end{frame}



\end{document}
Binary file added w14_pratical_considerations/t02_prepro.pdf
Binary file not shown.
Loading

0 comments on commit ad153b5

Please sign in to comment.