Notes on software engineering

Archive / page 19

361–380 of 547 posts, newest first.

  1. 2024
  2. Python packages with pyproject.toml and nothing else

    I've been using and for my Python packages for a long time: I like that it works without me having to think about installing and learning any additional tools such as Flit or pip-tools or Poetry or…

    5 min read
  3. Tailing Google Cloud Run request logs and importing them into SQLite

    The CLI tool has the alpha ability to tail log files - but it's a bit of a pain to setup. You have to install two extras for it.

    2 min read
  4. Trying out Python packages with ipython and uvx

    I figured out a really simple pattern for experimenting with new Python packages today: This command will work if you have uv installed and nothing else.

    1 min read
  5. os.remove() on Windows fails if the file is already open

    I puzzled over this one for quite a while this morning. I had this test that was failing with Windows on Python 3.11: The test checks that the option to my constructor deletes and re-creates the file.

    1 min read
  6. Verifying your GitHub profile on Mastodon

    Mastodon has a really neat way of implementing verification, using the rel=me microformat. You can edit your Mastodon profile and add up to four links to it.

    2 min read
  7. Deploying a redbean app to Fly

    redbean is a fascinating project - it provides a web server in a self-contained executable which you can add assets (or dynamic Lua code) to just by zipping them into the same binary package.

    1 min read
  8. Querying for items stored in UTC that were created on a Thursday in PST

    This came up as a question on Hacker News. How can you query a SQLite database for items that were created on a Thursday in PST, when the data is stored in UTC?

    1 min read
  9. Running Dolly 2.0 on Paperspace

    Dolly 2.0 looks to be a big deal. It calls itself "the first open source, instruction-following LLM, fine-tuned on a human-generated instruction dataset licensed for research and commercial use." I've…

    2 min read
  10. How to get Cloudflare to cache HTML

    To my surprise, if you setup a Cloudflare caching proxy in front of a website it won't cache HTML pages by default, even if they are served with headers.

    1 min read
  11. Trying out free-threaded Python on macOS

    Inspired by py-free-threading.github.io I decided to try out a beta of Python 3.13 with the new free-threaded mode enabled, which removes the GIL.

    2 min read
  12. Finding duplicate records by matching name and nearby distance

    I wanted to find potentially duplicate records in my data, based on having the exact same name and being geographically located within 500 meters of each other.

    1 min read
  13. WebAuthn browser support

    I started exploring WebAuthn today - a set of browser standards that adds support for both Yubikey 2FA hardware devices and "platform" authentication using things like Touch ID and Face ID.

    1 min read
  14. Editing an iPhone home screen using macOS

    My iPhone has a weird bug: I can no longer re-arrange the app icons on the home screen (or in the dock) by dragging them around on my phone.

    1 min read
  15. Export a Mastodon timeline to SQLite

    I've been playing around with the Mastodon timelines API. It's pretty fun! I'm running my own instance which means I don't feel limited by politeness in terms of rate limits - if I'm just using my own…

    1 min read
  16. Figuring out if a text value in SQLite is a valid integer or float

    Given a table with a column in SQLite I want to figure out if every value in that table is actually the text representation of an integer or floating point value, so I can decide if it's a good idea…

    1 min read
  17. Run pytest against a specific Python version using Docker

    For datasette issue 1802 I needed to run my test suite using a specific version of Python 3.7. I decided to do this using Docker, using the official python:3.7-buster image.

    1 min read
  18. Deploying Python web apps as AWS Lambda functions

    I've been wanting to figure out how to do this for years. Today I finally put all of the pieces together for it. AWS Lambda can host functions written in Python.

    6 min read
  19. Skipping a GitHub Actions step without failing

    I wanted to have a GitHub Action step run that might fail, but if it failed the rest of the steps should still execute and the overall run should be treated as a success.

    1 min read
  20. Transcribing MP3s with whisper-cpp on macOS

    I asked on Twitter for tips about running Whisper transcriptions in the CLI on my Mac. Werner Robitza pointed me to Homebrew's whisper-cpp formula, and when I complained that it didn't have quite…

    1 min read
  21. Using a Tailscale exit node with GitHub Actions

    For an (ethical) scraping project I found that my low-volume scraper was working from my laptop but was being blocked by Cloudflare when I attempted to run it in GitHub Actions, presumably because the…

    3 min read