An opinionated list of Python frameworks, libraries, tools, and resources
Most cloud sustainability tools are built for sustainability officers. They pull three-month-old billing data, run it through a proprietary model, and produce a PDF that engineers never see. By the time you know your us-east-1 cluster emits twice as much as us-west-2 would have, it's been running for a quarter. The architecture is locked in. The carbon is already burnt. The only moment you can act
If you’ve been around data engineering long enough, you’ve probably heard these terms thrown around in meetings: “Just dump it in the data lake” “We’ll expose it through the warehouse” “That goes into the mart” “We’re moving to a lakehouse architecture” And honestly… it can sound like four different ways of saying the same thing. They’re not. Each one solves a slightly different problem in the dat