theNotebook

Shelf two · The toolkit

NumPy & pandas

Beginner · 1 min read · Three tellings

Kitchen table

Imagine a calculator that works on a whole spreadsheet at once. Instead of adding up one row at a time, you say 'double every number in this column' and it happens in a blink, even with a million rows. That is NumPy. pandas sits on top and gives the columns names, so you can say 'show me every sale from March' like you are talking about the data, not marching through it cell by cell.

Whiteboard

Vectorised arrays and dataframes: the discipline is thinking in whole-array operations instead of row loops, knowing where copies happen versus views, and learning groupby properly instead of writing the same join four ways. Chained indexing and silent dtype coercion are where the bugs hide. When the data outgrows one machine there are heirs – Polars, Arrow, DuckDB – but the mental model they inherit is this one, so it is still the one worth learning deeply.

Boardroom

This is the spreadsheet layer of AI work, where data gets cleaned, joined and reshaped before anything intelligent happens to it, and where your analysts actually spend their days. It is free, universal and battle-tested, which means the investment case is not about buying tools but about training: a team fluent here answers questions in minutes that a clumsy one answers in days. Faster successors exist for heavy workloads, but the skills transfer. Nothing learned here is wasted.

namesalesmonth× 2every row at oncea million rows, one blink
One instruction, the whole column at once – no marching through cells.

Keywords

  • NumPy
  • pandas
  • dataframe
  • array
  • vectorisation
  • data wrangling

Search the notebook