Notes on software engineering

Archive / page 2

21–40 of 547 posts, newest first.

  1. 2025
  2. A complete workflow domain-specific language - Highway DSL

    rodmena-limited.github.io/highway dsl/ link to specs are here

    1 min read
  3. How to run processes in with limited resources in Linux (no Docker needed)

    It's super powerful and simple:

    1 min read
  4. Running fully isolated commands in Linux

    To use to run a Python command that cannot see or touch files outside its own folder, you must combine with .

    1 min read
  5. Thundering herd problem

    The thundering herd problem occurs in computing when a large number of processes, threads, or client requests, all waiting for a specific event or resource, are awakened or triggered simultaneously…

    2 min read
  6. TOCTOU (Time-of-Check to Time-of-Use) vulnerability

    I encountered a bug during development of my distributed workflow engine, and I learned that: A TOCTOU (Time-of-Check to Time-of-Use) vulnerability is a software security issue that occurs when an…

    2 min read
  7. Durable Workflow Engines - Ridiculously Jumper!

    Update: I have abandoned using Jumper. It's buggy and the maintainers are not very welcoming to contributions. I am building my own.

    5 min read
  8. Integrating `highway_dsl` and `Jumper` for a Durable Workflow Engine

    The Integration Model This document outlines a strategy for merging and . These two systems are not competitors; they are complementary components operating at different layers of abstraction.

    5 min read
  9. Highway-DSL: A Pydantic-Native DSL for Defining Complex Workflows

    As systems grow, so does the complexity of their processes. Simple then scripts quickly evolve into brittle, unmanageable tangles of statements, blocks, and implicit dependencies.

    4 min read
  10. reTunnel is Amazing

    There is not easier way to expose your local network, ai agent or test webhooks. install and expose your app with . retunnel.com

    1 min read
  11. what is derivative of A in respect to B?

    The Core Concept: It's a Rate of Change At its heart, the derivative of A with respect to B measures how much A changes when B changes by a very small amount.

    3 min read
  12. What is derivative of A with respect to B?

    The Core Concept: It's a Rate of Change At its heart, the derivative of A with respect to B measures how much A changes when B changes by a very small amount.

    3 min read
  13. Learn Neural Networks

    Flash Cards ========== Flash Cards (basics) Videos ========= Neural Network From Scratch In Python The spelled-out intro to neural networks and backpropagation: building micrograd

    1 min read
  14. PySpark Style Guide

    PySpark Style Guide PySpark is a wrapper language that allows users to interface with an Apache Spark backend to quickly process data.

    12 min read
  15. ySpark Style Guide

    PySpark Style Guide PySpark is a wrapper language that allows users to interface with an Apache Spark backend to quickly process data.

    12 min read
  16. Math cheatsheets

    1. General Math Cheat Sheet (iPaper and other formats) 2. Elementary Algebra Cheat Sheet (PDF) 3. Trigonometry Cheat Sheet (PDF) 4. Calculus Cheat Sheet (PDF) 5.

    1 min read
  17. The Bill of Materials

    Alright, let's talk about something that's rapidly becoming a non-negotiable for anyone building software: the Bill of Materials, or SBOM. I'll show you the way Lockheed Martin does it.

    6 min read
  18. Flattening nested JSON objects with jq

    I wanted to take a nested set of JSON objects and import them into a SQLite database using - but I wanted to "flatten" some of the nested rows.

    1 min read
  19. Clone, edit and push files that live in a Gist

    GitHub Gists are full Git repositories, and can be cloned and pushed to. You can clone them anonymously (read-only) just using their URL: git clone…

    1 min read
  20. Installing lxml for Python on an M1/M2 Mac

    I ran into this error while trying to run on an M2 Mac, inside a virtual environment I had intitially created using : I eventually realized that this was using the system Python - - which doesn't have…

    1 min read
  21. Recursively fetching metadata for all files in a Google Drive folder

    For google-drive-to-sqlite I wanted a mechanism to recursively return metadata on every file in a specified Goole Drive folder.

    2 min read