An empirical analysis of Python packages on PyPI and biomedical journals in 2023, with a focus on the quality of dependency declarations.

FawltyDeps 0.13.0 introduces a brand new mapping strategy. In this post, we'll delve into the mechanics of how dependencies and imports are matched, as well as how you can leverage these new features to boost your Python dependency management workflow.

To allow innovation in medical imaging with AI, we need efficient and affordable ways to store and compute at scale.

A practical introduction to using Sparkle to write Haskell programs which interface with Delta Lake.

Introducing a library for writing data pipelines which compose well and fail early

Meet Lagoon, a new open source tool for centralizing and querying semi-structured datasets.

We're happy to announce the first release of Porcupine, an open source framework to express portable and customizable data pipelines.

Funflow is a system for building and running workflows. It’s a system we’ve been working on for the last few months with a small number of clients. In this blog post we’ll talk about what workflows are, why we built Funflow, and what we’d like to do with it in the future. What is…

Maintaining a compute cluster for batch or stream data processing is hard work. Connecting it up to storage facilities and time sharing resources across multiple demands even more so. Fortunately cloud service providers these days typically upscale their offering to not just…

Large scale distributed applications are complex: there are effects at scale that matter far more than when your application is basked in the warmth of a single machine. Messages between any two processes may or may not make it to their final destination. If reading from a memory…