Data Engineering

Explore our Data Engineering content

June 1, 2025 7 min read

PySpark Data Patterns: From Pandas User to Spark Developer

PySpark Data Patterns: From Pandas User to Spark Developer Overview This guide is structured for someone already comfortable with basic PySpark syntax coming from a Pandas background. It covers Spark SQL with views, …
January 16, 2025 6 min read

Advanced Polars Expressions: String Operations & Complex Data Types

Advanced Polars Expressions: String Operations & Complex Data Types Welcome to the second installment of our Polars mastery series! Building on the foundational concepts from Part 1, we’ll dive deep into …
January 15, 2025 7 min read

From Pandas to Polars: A Paradigm Shift in DataFrame Processing

Welcome to the first installment of our Polars blog series! If you’ve spent years mastering Pandas and are curious about what makes Polars the talk of the data community, this post is your gateway. We’ll …
April 18, 2024 3 min read

Advanced Pandas GroupBy and Window Functions for Data Engineering and Analytics

Session Outline: Advanced GroupBy and Window Functions in Pandas 1. Introduction to GroupBy and Its Role in Data Engineering (5 minutes) Overview: Recap of GroupBy as a split-apply-combine paradigm, as defined by Wes …
January 5, 2019 7 min read

Subsetting a DataFrame in Pandas

Subsetting a DataFrame in Pandas Master the art of data filtering with practical examples using the Iris dataset. Learn different techniques to filter and subset pandas DataFrames efficiently for better data analysis …

About Data Engineering

This category contains all our posts about Data Engineering. Browse through to find what you’re looking for.