Stephen David-Williams
Stephen's blog

Stephen's blog

Follow
SOLID principles for Spark applications

SOLID principles for Spark applications

Where PySpark meets SOLID principles💥

Stephen David-Williams
Stephen David-Williams

23 min read

Functional programming in data engineering with Python - Part 2

Functional programming in data engineering with Python - Part 2

Stephen David-Williams
Stephen David-Williams

16 min read

SOLID principles in data engineering - Part 3

SOLID principles in data engineering - Part 3

Stephen David-Williams
Stephen David-Williams

19 min read

Functional programming in data engineering with Python - Part 1

Functional programming in data engineering with Python - Part 1

Stephen David-Williams

29 min read

SOLID principles in data engineering - Part 2

SOLID principles in data engineering - Part 2

Stephen David-Williams

12 min read

SOLID principles in data engineering - Part 1

SOLID principles in data engineering - Part 1

Stephen David-Williams

15 min read

How to install Kafka on Windows machine

How to install Kafka on Windows machine

Stephen David-Williams

5 min read

Process JSON data using Spark in Databricks

Process JSON data using Spark in Databricks

Stephen David-Williams

3 min read

Orchestrate Databricks notebooks with Azure Data Factory

Orchestrate Databricks notebooks with Azure Data Factory

Stephen David-Williams

3 min read

Incremental ingestion with Databricks’ Autoloader via File notifications

Incremental ingestion with Databricks’ Autoloader via File notifications

Stephen David-Williams

6 min read

Writing Data Quality Tests in Databricks using Pytest

Writing Data Quality Tests in Databricks using Pytest

Stephen David-Williams

7 min read

Using Power Query to clean data in Power BI

Using Power Query to clean data in Power BI

Stephen David-Williams

4 min read