FreeCourseSite com Udemy CCA 175 Spark and Hadoop Developer Certification Scala

/01 Introduction/

001 CCA 175 Spark and Hadoop Developer - Curriculum.mp4

001 Introduction-to-the-course.txt

002 About-big-data-labs.txt

002 Using labs for preparation.mp4

/02 Scala Fundamentals/

003 Introduction and Setting up of Scala.mp4

003 Scala-Fundamentals-Introduction-and-Setting-up.txt

003 ScalaFundamentals.pptx

004 Setup Scala on Windows.mp4

004 Setup-Scala-on-Windows.txt

005 Basic Programming Constructs.mp4

005 Basic-Programming-Constructs.txt

006 Functions.mp4

006 Functions.txt

007 Object Oriented Concepts - Classes.mp4

007 Object-Oriented-Concepts-Classes.txt

008 Object Oriented Concepts - Objects.mp4

008 Object-Oriented-Concepts-Objects.txt

009 Object Oriented Concepts - Case Classes.mp4

009 Object-Oriented-Concepts-Case-Classes.txt

010 Collections - Seq Set and Map.mp4

010 Collections.txt

011 Basic Map Reduce Operations.mp4

011 Basic-Map-Reduce-Operations.txt

012 Setting up Data Sets for Basic IO Operations.mp4

012 Setting-up-Data-Sets-for-Basic-I-O-Operations.txt

013 Basic IO Operations and using Scala Collections APIs.mp4

013 Basic-I-O-Operations-and-using-Scala-Collections-APIs.txt

014 Tuples.mp4

014 Tuples.txt

015 Development Cycle - Developing Source code.mp4

015 Development-Cycle-Developing-Source-Code.txt

016 Development Cycle - Compile source code to jar using SBT.mp4

016 Development-Cycle-Compile-source-code-to-jar-using-SBT.txt

017 Development Cycle - Setup SBT on Windows.mp4

017 Development-Cycle-Setup-SBT-on-windows.txt

018 Development Cycle - Compile changes and run jar with arguments.mp4

018 Development-Cycle-Compile-changes-and-run-jar-with-arguments.txt

019 Development Cycle - Setup IntelliJ with Scala.mp4

019 Development-Cycle-Setup-IntelliJ-with-Scala.txt

020 Development Cycle - Develop Scala application using SBT in IntelliJ.mp4

020 Development-Cycle-Develop-Scala-application-using-SBT-in-IntelliJ.txt

/03 Getting Started/

021 Introduction and Curriculum.mp4

021 Introduction-and-Curriculum.txt

022 Setup Environment - Options.mp4

022 Setup-Environment-Options.txt

023 Setup Environment - Locally.mp4

023 Setup-Environment-Locally.txt

024 Setup Environment - using Cloudera Quickstart VM.mp4

024 Setup-Environment-using-Cloudera-Quickstart-VM.txt

025 Using itversitys big data labs.mp4

025 Using-itversity-s-big-data-labs.txt

026 Using Windows - Putty and WinSCP.mp4

026 Using-Windows-Putty-and-WinSCP.txt

027 Using Windows - Cygwin.mp4

027 Using-Windows-Cygwin.txt

028 HDFS Quick Preview.mp4

028 HDFS-Quick-Preview.txt

029 YARN Quick Preview.mp4

029 YARN-Quick-Preview.txt

030 Setup Data Sets.mp4

030 Setup-Data-Sets.txt

/04 Data Ingestion - Apache Sqoop/

031 Introduction and Objectives.mp4

031 Introduction-and-Objectives.txt

032 Accessing Sqoop Documentation.mp4

032 Accessing-Sqoop-Documentation.txt

033 Preview of MySQL on labs.mp4

033 Preview-of-MySQL-on-labs.txt

034 Sqoop connect string and validating using list commands.mp4

034 Sqoop-connect-string-and-validating-using-list-commands.txt

035 Run queries in MySQL using eval.mp4

035 Run-queries-in-MySQL-using-eval.txt

036 Sqoop Import - Simple Import.mp4

036 Sqoop-Import-Simple-Import.txt

037 Sqoop Import - Execution Life Cycle.mp4

037 Sqoop-Import-Execution-Life-Cycle.txt

038 Sqoop Import - Managing Directories.mp4

038 Sqoop-Import-Managing-Directories.txt

039 Sqoop Import - Using split by.mp4

039 Sqoop-Import-Using-split-by.txt

040 Sqoop Import - auto reset to one mapper.mp4

040 Sqoop-Import-auto-reset-to-one-mapper.txt

041 Sqoop Import - Different file formats.mp4

041 Sqoop-Import-Different-file-formats.txt

042 Sqoop Import - Using compression.mp4

042 Sqoop-Import-Using-compression.txt

043 Sqoop Import - Using Boundary Query.mp4

043 Sqoop-Import-Using-Boundary-Query.txt

044 Sqoop Import - columns and query.mp4

044 Sqoop-Import-columns-and-query.txt

045 Sqoop Import - Delimiters and handling nulls.mp4

045 Sqoop-Import-Delimiters-and-handling-nulls.txt

046 Sqoop Import - Incremental Loads.mp4

046 Sqoop-Import-Incremental-Loads.txt

047 Sqoop Import - Hive - Create Hive Database.mp4

047 Sqoop-Import-Hive-Create-Hive-Database.txt

048 Sqoop Import - Hive - Simple Hive Import.mp4

048 Sqoop-Import-Hive-Simple-Hive-Import.txt

049 Sqoop Import - Hive - Managing Hive tables.mp4

049 Sqoop-Import-Hive-Managing-Hive-tables.txt

050 Sqoop Import - Import all tables.mp4

050 Sqoop-Import-Import-all-tables.txt

051 Role of Sqoop in typical data processing life cycle.mp4

051 Role-of-Sqoop-in-typical-data-processing-life-cycle.txt

052 Sqoop Export - Simple export with delimiters.mp4

052 Sqoop-Export-Simple-export-with-delimiters.txt

053 Sqoop Export - Understanding export behaviour.mp4

053 Sqoop-Export-Understanding-export-behaviour.txt

054 Sqoop Export - Column Mapping.mp4

054 Sqoop-Export-Column-Mapping.txt

055 Sqoop Export - Update and Upsert.mp4

055 Sqoop-Export-Update-and-Upsert.txt

056 Sqoop Export - Stage Tables.mp4

056 Sqoop-Export-Stage-Tables.txt

/05 Transform Stage and Store - Spark/

057 Introduction.mp4

057 Introduction.txt

058 Introduction to Spark.mp4

058 Introduction-to-Spark.txt

059 Setup Spark on Windows.mp4

059 Setup-Spark-on-Windows.txt

060 Quick overview about Spark documentation.mp4

060 Quick-overview-about-Spark-documentation.txt

061 Initializing Spark job using spark-shell.mp4

061 Initializing-Spark-job-using-spark-shell.txt

062 Create Resilient Distributed Data Sets (RDD).mp4

062 Create-Resilient-Distributed-Data-Sets-RDD-.txt

063 Previewing data from RDD.mp4

063 Previewing-data-from-RDD.txt

064 Reading different file formats - Brief overview using JSON.mp4

064 Reading-different-file-formats-overview.txt

065 Transformations Overview.mp4

065 Transformations-Overview.txt

066 Manipulating Strings as part of transformations using Scala.mp4

066 Manipulating-Strings-as-part-of-transformations-using-scala.txt

067 Row level transformations using map.mp4

067 Row-level-transformations-using-map.txt

068 Row level transformations using flatMap.mp4

068 Row-level-transformations-using-flatMap.txt

069 Filtering the data.mp4

069 Filtering-the-data.txt

070 Joining data sets - inner join.mp4

070 Joining-data-sets-inner-join.txt

071 Joining data sets - outer join.mp4

071 Joining-data-sets-outer-join.txt

072 Aggregations - Getting Started.mp4

072 Aggregations-Getting-Started.txt

073 Aggregations - using actions (reduce and countByKey).mp4

073 Aggregations-using-actions-reduce-and-countByKey-.txt

074 Aggregations - understanding combiner.mp4

074 Aggregations-understanding-combiner.txt

075 Aggregations using groupByKey - least preferred API for aggregations.mp4

075 Aggregations-using-groupByKey-least-preferred-API-for-aggregations.txt

076 Aggregations using reduceByKey.mp4

076 Aggregations-using-reduceByKey.txt

077 Aggregations using aggregateByKey.mp4

077 Aggregations-using-aggregateByKey.txt

078 Sorting data using sortByKey.mp4

078 Sorting-data-using-sortByKey.txt

079 Global Ranking - using sortByKey with take and takeOrdered.mp4

079 Global-Ranking-using-sortByKey-with-take-and-takeOrdered.txt

080 By Key Ranking - Converting (K V) pairs into (K IterableV) using groupByKey.mp4

080 By-Key-Ranking-Converting-K-V-pairs-into-K-Iterable-V-using-groupByKey.txt

081 Get topNPrices using Scala Collections API.mp4

081 Get-topNPrices-using-Scala-Collections-API.txt

082 Get topNPricedProducts using Scala Collections API.mp4

082 Get-topNPricedProducts-using-Scala-Collections-API.txt

083 Get top n products by category using groupByKey flatMap and Scala function.mp4

083 Get-top-n-products-by-category-using-groupByKey-flatMap-and-Scala-function.txt

084 Set Operations - union intersect distinct as well as minus.mp4

084 Set-Operations-union-intersect-distinct-as-well-as-minus.txt

085 Save data in Text Input Format.mp4

085 Save-data-in-Text-Input-Format.txt

086 Save data in Text Input Format using Compression.mp4

086 Save-data-in-Text-Input-Format-using-Compression.txt

087 Saving data in standard file formats - Overview.mp4

087 Saving-data-in-standard-file-formats-Overview.txt

088 Revision of Problem Statement and Design the solution.mp4

088 Revision-of-Problem-Statement-and-Design-the-solution.txt

089 Launching-Spark-Shell.txt

089 Solution - Get Daily Revenue per Product - Launching Spark Shell.mp4

090 Read-and-join-orders-and-order-items.txt

090 Solution - Get Daily Revenue per Product - Read and join orders and order_items.mp4

091 Compute-daily-revenue-per-product-id.txt

091 Solution - Get Daily Revenue per Product - Compute daily revenue per product id.mp4

092 Read-products-data-and-create-RDD.txt

092 Solution - Get Daily Revenue per Product - Read products data and create RDD.mp4

093 Solution - Get Daily Revenue per Product - Sort and save to HDFS.mp4

093 Sort-and-save-to-HDFS.txt

094 Solution - Add spark dependencies to sbt.mp4

094 Solution-Add-spark-dependencies-to-sbt.txt

095 Develop-as-Scala-based-application.txt

095 Solution - Develop as Scala based application.mp4

096 Run-locally-using-spark-submit.txt

096 Solution - Run locally using spark-submit.mp4

097 Solution-Ship-and-run-it-on-big-data-cluster.txt

/06 Data Analysis - Spark SQL or HiveQL/

098 Different interfaces to run Hive queries.mp4

098 Different-interfaces-to-run-Hive-queries.txt

099 Create Hive tables and load data in text file format.mp4

099 Create-Hive-tables-and-load-data-in-text-file-format.txt

100 Create Hive tables and load data in ORC file format.mp4

100 Create-Hive-tables-and-load-data-in-ORC-file-format.txt

101 Using spark-shell to run Hive queries or commands.mp4

101 Using-spark-shell-to-run-Hive-queries-or-commands.txt

102 Functions - Getting Started.mp4

102 Functions-Getting-Started.txt

103 Functions - Manipulating Strings.mp4

103 Functions-Manipulating-Strings.txt

104 Functions - Manipulating Dates.mp4

104 Functions-Manipulating-Dates.txt

105 Functions - Aggregations.mp4

105 Functions-Aggregations.txt

106 Functions - CASE.mp4

106 Functions-CASE.txt

107 Row level transformations.mp4

107 Row-level-transformations.txt

108 Joins.mp4

108 Joins.txt

109 Aggregations.mp4

109 Aggregations.txt

110 Sorting.mp4

110 Sorting.txt

111 Set Operations.mp4

111 Set-Operations.txt

112 Analytics Functions - Aggregations.mp4

112 Analytics-Functions-Aggregations.txt

113 Analytics Functions - Ranking.mp4

113 Analytics-Functions-Ranking.txt

114 Windowing Functions.mp4

114 Windowing-Functions.txt

115 Create Data Frame and Register as Temp table.mp4

115 Create-Data-Frame-and-Register-as-Temp-table.txt

116 Writing Spark SQL Applications - process data.mp4

116 Writing-Spark-SQL-Applications-process-data.txt

117 Writing Spark SQL Applications - Save data into Hive tables.mp4

117 Writing-Spark-SQL-Applications-Save-data-into-Hive-tables.txt

118 Data Frame Operations.mp4

118 Data-Frame-Operations.txt

/07 Data Ingest - real time near real time and streaming analytics/

119 Introduction.mp4

119 Introduction.txt

120 Flume - Getting Started.mp4

120 Flume-Getting-Started.txt

121 Flume - Web Server Logs to HDFS - Introduction.mp4

121 Flume-Web-Server-Logs-to-HDFS-Introduction.txt

122 Flume - Web Server Logs to HDFS - Setup Data.mp4

122 Flume-Web-Server-Logs-to-HDFS-Setup-Data.txt

123 Flume - Web Server Logs to HDFS - Source exec.mp4

123 Flume-Web-Server-Logs-to-HDFS-Source-exec.txt

124 Flume - Web Server Logs to HDFS - Sink HDFS - Getting Started.mp4

124 Flume-Web-Server-Logs-to-HDFS-Sink-HDFS-Getting-Started.txt

125 Flume - Web Server Logs to HDFS - Sink HDFS - Customize properties.mp4

125 Flume-Web-Server-Logs-to-HDFS-Sink-HDFS-Customize-properties.txt

126 Flume - Web Server Logs to HDFS - Deep dive to memory channel.mp4

126 Flume-Web-Server-Logs-to-HDFS-Deep-dive-to-memory-channel.txt

127 Kafka - Getting Started - High Level Architecture.mp4

127 Kafka-Getting-Started-High-Level-Architecture.txt

128 Kafka - Getting Started - Produce and consume messages using commands.mp4

128 Kafka-Getting-Started-Produce-and-consume-messages-using-commands.txt

129 Kafka - Anatomy of a topic.mp4

129 Kafka-Anatomy-of-a-topic.txt

130 Flume and Kafka in Streaming analytics.mp4

130 Flume-and-Kafka-in-Streaming-analytics.txt

131 Spark Streaming - Getting Started.mp4

131 Spark-Streaming-Getting-Started.txt

132 Spark Streaming - Setting up netcat.mp4

132 Spark-Streaming-Setting-up-netcat.txt

133 Spark Streaming - Develop Word Count program.mp4

133 Spark-Streaming-Develop-Word-Count-program.txt

134 Spark Streaming - Ship and run word count program on the cluster.mp4

134 Spark-Streaming-Ship-and-run-word-count-program-on-the-cluster.txt

135 Spark Streaming - Data Structure (DStream) and APIs overview.mp4

135 Spark-Streaming-Data-Structure-DStream-and-APIs-overview.txt

136 Spark Streaming - Get department wise traffic - Problem Statement.mp4

136 Spark-Streaming-Get-department-wise-traffic-Problem-Statement.txt

137 Spark Streaming - Get department wise traffic - Development.mp4

137 Spark-Streaming-Get-department-wise-traffic-Development.txt

138 Spark Streaming - Get department wise traffic - Run on the cluster.mp4

138 Spark-Streaming-Get-department-wise-traffic-Run-on-the-cluster.txt

139 Flume and Spark Streaming - Department Wise Traffic - Setup Flume.mp4

139 Flume-and-Spark-Streaming-Department-Wise-Traffic-Setup-Flume.txt

140 Flume and Spark Streaming - Department Wise Traffic - Add sbt dependencies.mp4

140 Flume-and-Spark-Streaming-Department-Wise-Traffic-Add-sbt-dependencies.txt

141 Flume and Spark Streaming - Department Wise Traffic - Develop and build.mp4

141 Flume-and-Spark-Streaming-Department-Wise-Traffic-Develop-and-build.txt

142 Flume and Spark Streaming - Department Wise Traffic - Run and Validate.mp4

142 Flume-and-Spark-Streaming-Department-Wise-Traffic-Run-and-Validate.txt

143 Flume and Kafka integration - Develop configuration file.mp4

143 Flume-and-Kafka-integration-Develop-configuration-file.txt

144 Flume and Kafka integration - Run and validate.mp4

144 Flume-and-Kafka-integration-Run-and-validate.txt

145 Kafka and Spark Streaming - Add dependencies.mp4

145 Kafka-and-Spark-Streaming-Add-dependencies.txt

146 Kafka and Spark Streaming - Develop and build application.mp4

146 Kafka-and-Spark-Streaming-Develop-and-build-application.txt

147 Kafka and Spark Streaming - Run and Validate.mp4

147 Kafka-and-Spark-Streaming-Run-and-Validate.txt

/08 Sample scenarios with solutions/

148 All-exercises.txt

148 Introduction to Sample Scenarios and Solutions.mp4

149 Problem Statements - General Guidelines.mp4

150 Initializing the job - General Guidelines.mp4

151 Getting crime count per type per month - Understanding Data.mp4

152 Get-monthly-crime-count-by-type.txt

152 Getting crime count per type per month - Implementing the logic - Core API.mp4

153 Getting crime count per type per month - Implementing the logic - Data Frames.mp4

154 Getting crime count per type per month - Validating Output.mp4

155 Get inactive customers - using Core Spark API (leftOuterJoin).mp4

155 Get-inactive-customers.txt

156 Get inactive customers - using Data Frames and SQL.mp4

156 Get-inactive-customers.txt

157 Get top 3 crimes in RESIDENCE - using Core Spark API.mp4

157 Get-top-3-crimes-in-RESIDENCE.txt

158 Get top 3 crimes in RESIDENCE - using Data Frame and SQL.mp4

158 Get-top-3-crimes-in-RESIDENCE.txt

159 Convert NYSE data from text file format to parquet file format.mp4

159 Problem-Statement-and-Solution.Look-at-the-end-of-problem-statement-for-URL-for-solution..txt

160 Get word count - with custom control arguments num keys and file format.mp4

160 Problem-Statement-and-Solution.Look-at-the-end-of-problem-statement-for-URL-for-solution..txt

/

[CourseClub.NET].url

[FCS Forum].url

[FreeCourseSite.com].url

Total files 318