A monthly overview of things you need to know as an architect or aspiring architect. Unlock the full InfoQ experience by logging in! Stay updated with your favorite authors and topics, engage with ...

This request is to add the ability for airflow to refresh database Connection Strings by re-evaluating the _CMD at a specified refresh interval. We run Airflow on Kubernetes Clusters on Azure with ...

In our previous setup we were using S3 sinker to Sink data from Kafka. It allowed us to partition by landing time, and we had guarantee than we could always easily query daily/hourly data. Now with ...