Apache-Iceberg

Building Datashard: Solving Data Corruption in High-Concurrency ML Workflows

I've been working on Highway, a Strict Atomic Workflow Management System that handles massive amounts of log data from multiple concurrent processes.