-
Notifications
You must be signed in to change notification settings - Fork 149
Expand file tree
/
Copy path03_agenda.html
More file actions
194 lines (170 loc) · 7.84 KB
/
Copy path03_agenda.html
File metadata and controls
194 lines (170 loc) · 7.84 KB
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
<!doctype html>
<html lang="en">
<head>
<meta charset="utf-8">
<title>Apache Spark 2 Workshop - Day 3</title>
<meta name="description" content="Apache Spark 2 Workshop - Day 3">
<meta name="author" content="Jacek Laskowski">
<meta name="apple-mobile-web-app-capable" content="yes" />
<meta name="apple-mobile-web-app-status-bar-style" content="black-translucent" />
<meta name="viewport" content="width=device-width, initial-scale=1.0, maximum-scale=1.0, user-scalable=no, minimal-ui">
<link rel="stylesheet" href="css/reveal.css">
<link rel="stylesheet" href="css/theme/beige.css" id="theme">
<!-- Code syntax highlighting -->
<link rel="stylesheet" href="lib/css/zenburn.css">
<!-- Printing and PDF exports -->
<script>
var link = document.createElement( 'link' );
link.rel = 'stylesheet';
link.type = 'text/css';
link.href = window.location.search.match( /print-pdf/gi ) ? 'css/print/pdf.css' : 'css/print/paper.css';
document.getElementsByTagName( 'head' )[0].appendChild( link );
</script>
<!-- https://github.com/hakimel/reveal.js/issues/174 -->
<style>
.slides .header {
position: absolute;
top: 0px;
right: 0px;
}
.slides .footer {
position: absolute;
bottom: 0px;
left: 35%;
}
</style>
<!--[if lt IE 9]>
<script src="lib/js/html5shiv.js"></script>
<![endif]-->
</head>
<body>
<div class="reveal">
<div class="slides">
<div class="footer">
<small>Copyright ©2017 Jacek Laskowski</small>
</div>
<section class="intro" data-transition="zoom">
<p>
<img width="15%" style="background:none; border:none; box-shadow:none;" data-src="images/spark-logo.png">
<img width="30%" src="images/ValueAmplify_Logo_Final_medium.jpg" style="border: 0">
</p>
<h1>Spark 2.0 / Scala Workshop <small>Day 3</small></h1>
<h4><a href="https://blog.jaceklaskowski.pl">Jacek Laskowski</a> / <a href="https://twitter.com/jaceklaskowski">@jaceklaskowski</a> / <a href="https://github.com/jaceklaskowski">GitHub</a> / <a href="http://bit.ly/mastering-apache-spark">Mastering Apache Spark Notes</a></h4>
</section>
<section>
<section id="agenda-day1">
<h2>Modules - Day 1 (1 of 2)</h2>
<ul>
<li>The Elements of Apache Spark (<i>aka</i> Why Spark)</li>
<li>Tools Intro - IntelliJ IDEA and Scala Worksheet</li>
<li>Introduction to Scala (<i>aka</i> Why Scala)</li>
<li>Spark Setup and Your First Spark Application</li>
<li><b>Exercise</b>: My First Scala Application (using IntelliJ IDEA)</li>
</ul>
</section>
<section>
<h2>Modules - Day 1 (2 of 2)</h2>
<ul>
<li>Introduction to sbt and sbt-assembly</li>
<li><b>Exercise</b>: Running Scala Application from Command Line</li>
<li>Introduction to Spark SQL using spark-shell and Spark's web U</li>
<li><b>Exercise</b>: My First Spark SQL Application (using IntelliJ IDEA)</li>
<li>Introduction to spark-submit and run-example</li>
<li><b>Exercise</b>: spark-submit Your Spark App / run-example SparkPi</li>
</ul>
</section>
</section>
<section>
<section id="agenda-day2">
<h2>Agenda - Day 2 (1 of 2)</h2>
<ul>
<li>Introduction to Spark SQL</li>
<li>SparkSession — The Entry Point</li>
<li>DataSource API — Loading and Writing Datasets</li>
<li><b>Exercise</b>: My First Spark SQL Application (using IntelliJ IDEA)</li>
<li>Spark Architecture and Cluster Managers</li>
<li><b>Exercise</b>: spark-submit Your Spark App / run-example SparkPi</li>
</ul>
</section>
<section>
<h2>Agenda - Day 2 (2 of 2)</h2>
<ul>
<li>Using Functions and Operators in Spark SQL</li>
<li>Exercise: Executing Queries from Command-Line / CSV</li>
<li>Web UI</li>
<li>Scala functions and UDFs in Spark SQL</li>
<li>Exercise: Scala functions and UDFs</li>
</ul>
</section>
</section>
<section>
<section id="agenda-day3">
<h2>Agenda - Day 3 (1 of 2) / Today</h2>
<ul>
<li>Spark Properties and Spark History Server</li>
<li><b>Exercise</b>: Executing Queries from Command-Line / CSV</li>
<li>Spark SQL Aggregation and Window Operators</li>
<li><b>Exercise</b>: Using Aggregations and Windows with datasets in CSV files</li>
</ul>
</section>
<section>
<h2>Agenda - Day 3 (2 of 2) / Today</h2>
<ul>
<li>Introduction to Spark MLlib</li>
<li>ML Pipelines</li>
<li><b>Exercise</b>: Using LogisticRegression in a Standalone Application</li>
<li>Spark Standalone cluster on Azure Template</li>
</ul>
</section>
</section>
<section id="questions" style="text-align: left">
<h1>Questions?</h1>
<p>
<ul>
<li>Read <a href="https://bit.ly/mastering-apache-spark">Mastering Apache Spark 2</a>
<ul>
<li>https://bit.ly/mastering-apache-spark</li>
</ul>
</li>
<li>Follow <a href="https://twitter.com/jaceklaskowski">@jaceklaskowski</a> on twitter</li>
<li>Upvote <a href="http://stackoverflow.com/users/1305344/jacek-laskowski">my activities on StackOverflow</a></li>
<li>Use <a href="https://github.com/jaceklaskowski">Jacek's code at GitHub</a></li>
<li>Read <a href="https://medium.com/@jaceklaskowski">Jacek Laskowski @ Medium</a></li>
<li>Visit <a href="https://blog.jaceklaskowski.pl">Jacek Laskowski's blog</a></li>
</ul>
</p>
</section>
</div>
</div>
<script src="lib/js/head.min.js"></script>
<script src="js/reveal.js"></script>
<script>
// Full list of configuration options available at:
// https://github.com/hakimel/reveal.js#configuration
Reveal.initialize({
controls: true,
progress: true,
history: true,
center: true,
transition: 'slide', // none/fade/slide/convex/concave/zoom
// Optional reveal.js plugins
dependencies: [
{ src: 'lib/js/classList.js', condition: function() { return !document.body.classList; } },
{ src: 'plugin/markdown/marked.js', condition: function() { return !!document.querySelector( '[data-markdown]' ); } },
{ src: 'plugin/markdown/markdown.js', condition: function() { return !!document.querySelector( '[data-markdown]' ); } },
{ src: 'plugin/highlight/highlight.js', async: true, condition: function() { return !!document.querySelector( 'pre code' ); }, callback: function() { hljs.initHighlightingOnLoad(); } },
{ src: 'plugin/zoom-js/zoom.js', async: true },
{ src: 'plugin/notes/notes.js', async: true }
]
});
</script>
<script>
(function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
(i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
})(window,document,'script','//www.google-analytics.com/analytics.js','ga');
ga('create', 'UA-45999426-3', 'auto');
ga('send', 'pageview');
</script>
</body>
</html>