Overview

Notes

Rajanand

Home

Welcome!

About

About me

Certifications

Microsoft

Microsoft Certifications

Tableau

Tableau Certification

Contact

Contact Me

Spark: Overview

DataFrame

Spark: DataFrame

Dataset

Spark: Dataset

RDDs

Spark: Resilient Distributed Datasets (RDDs)

Shuffle Join

Spark: Shuffle Join

Datasets vs DataFrames

Spark: Datasets vs DataFrames

Transformations vs Actions

Spark: Transformations vs. Actions

Collect vs Take

Spark: Collect vs Take

Predicate Pushdown

Predicate Pushdown in Spark

SQL: Overview

Understand how SQL queries run internally

Order of Execution in SQL

SQL query order of execution

SQL Essential Concepts

SQL 101: Essential Concepts

Read data

Read data in SQL

Aggregation

Aggregation in SQL

Uniting Data: Understanding Joins in SQL Server

Joins

Understanding Joins in SQL

Subqueries

Subqueries in SQL

Working with Data

Create and Modify Tables

Creating and Modifying Tables

Establishing Relationships Between Tables in SQL

Relationships

Relationships Between Tables

Types of Data

Types of Data: Structured, Semi-Structured, and Unstructured Data

How an insert operation works in a Delta Lake table.

Insert in Delta Table

How an update operation works in a Delta Lake table.

Update in Delta Table

How delete operation works in a Delta Lake table.

Delete in Delta Table

Python: Overview

Python Guide

Python: Guide

Python List Examples

Python Tuple Examples

Python Function Examples

Glossary: Overview

ACID Properties

Availability

Consistency, Availability and Partition Tolerance

CAP Theorem

Consistency

Data Engineering

Data Integration

Data Lake

The Best of Both Worlds (data warehouse and data lake)

Data Lakehouse

Data Warehouse

Distributed System

Fault Tolerance

Lazy evaluation

Reliability

Scalability

Notes

Introduction to Data Engineering

Source Systems, Data Ingestion, and Pipelines

Data Storage and Queries

Data Modeling, Transformation, and Serving