While setting up Apache Airflow using Docker on Windows 11 WSL, I needed to extend the image to install some python packages. I created a dockerfile and requirements.txt, but every time I ran "docker-compose up --build", I received the error: ERROR: Invalid requirement: '<package-name': Expected semicolon (after name with no version specifier) or end To fix the error, I needed to change the encod
I needed to coordinate background scripts running across different machines. The obvious answer was Redis. Everyone uses Redis for this. The tutorials all use Redis. The Stack Overflow answers all say "just use Redis." So I looked at what deploying Redis would actually cost me: A running Redis server I had to maintain A broker to connect workers to it Celery or RQ on top of that Memory-based stora