Farshid/Ashouri

Notes on software engineering

Archive / page 22

421–440 of 546 posts, newest first.

  1. 2023

  2. Search across all loaded resources in Firefox

    You can search for a string in any resource loaded by a page (including across HTML, JavaScript and CSS) in the Debugger pane by hitting Command+Shift+F.

    TIL firefox
    1 min read

  3. Using Fabric with an SSH public key

    Inspired by this tweet by Mike Driscoll I decided to try using Fabric to run commands over SSH from a Python script, using a public key for authentication.

    TIL python
    1 min read

  4. Compiling the SQLite spellfix.c module on macOS

    I wanted to browse a backup copy of my Plex database, which is a SQLite file. I tried this: The module is an optional module for SQLite.

    sqlite compilation macos datasette extensions
    1 min read

  5. Enabling a gin index for faster LIKE queries

    I tried using a gin index to speed up queries against a column. PostgreSQL: More performance for LIKE and ILIKE statements provided useful background.

    django postgresql database performance indexing
    1 min read

  6. Scroll to text fragments

    I ran a Google search this morning for and when I clicked on the top result it jumped me to a highlighted snippet of text on the page, despite that page not having relevant anchor links.

    TIL html
    1 min read

  7. Planning parallel downloads with TopologicalSorter

    For complicated reasons I found myself wanting to write Python code to resolve a graph of dependencies and produce a plan for efficiently executing them, in parallel where possible.

    TIL python
    1 min read

  8. Finding uses of an API with the new GitHub Code Search

    The GitHub Code Search beta is really powerful - it allows advanced search - including regular expression matches - against every public repo on GitHub.

    github code-search api programming cli
    1 min read

  9. literalinclude with markers for showing code in documentation

    I wanted to include some example Python tests in the Datasette documentation - but since they were tests, I also wanted to execute them as part of my test suite to make sure they worked correctly.

    TIL sphinx
    1 min read

  10. Understanding Kristofer Joseph's Single File Web Component

    Via Brian LeRoux I found single-file-web-component.html by Kristofer Joseph. It's really clever! It demonstrates how to build a custom Web Component in a single HTML file, using some neat tricks.

    TIL web-components
    1 min read

  11. Searching for repositories by topic using the GitHub GraphQL API

    I wanted to use the GitHub GraphQL API to return all of the repositories on the https://github.com/topics/git-scraping page.

    TIL github
    1 min read

  12. Annotated explanation of David Beazley's dataklasses

    David Beazley on Twitter: So, I just published this deliciously evil spin on dataclasses. It's tiny and the resulting classes import about 15-20 faster than dataclasses.

    python dataclasses code-generation performance metaprogramming
    1 min read

  13. Basic strace to see what a process is doing

    I had a long-running process and I wanted to check that it was at least doing something . I know its PID (32425 in this case) - here's how to use to see what it's doing right now.

    linux debugging cli strace system-calls
    1 min read

  14. List all columns in a SQLite database

    Here's a devious trick for listing ALL columns in a SQLite database, using a SQL query that generates another SQL query.

    TIL sqlite
    4 min read

  15. Null case comparisons in SQLite

    I wanted to say "output this transformed value if it's not null, otherwise nothing". The recipe I figured out was: Full query example: This uses datasette-rure for the function.

    TIL sqlite
    1 min read

  16. Storing files in an S3 bucket between GitHub Actions runs

    For my git-history live demos I needed to store quite large files ( 200MB SQLite databases) in between GitHub Actions runs, to avoid having to recreate the entire file from scratch every time.

    TIL github-actions
    1 min read

  17. Copy tables between SQLite databases

    I figured out a pattern for doing this today using the CLI tool - given two SQLite databases in the current folder, called and : I'm using that in this GitHub Actions workflow.

    sqlite database cli bash data-transfer
    1 min read

  18. Check spelling using codespell

    Today I discovered codespell via this Rich commit. is a really simple spell checker that can be run locally or incorporated into a CI flow. codespell is designed to run against source code.

    spelling codespell python ci/cd documentation
    1 min read

  19. Free API Gateway to expose localhost (ngrok alternative)

    I needed to build and use many inhouse tools (like controlling my lights, checking doors cameras remotely, checking my server's temperature, etc).

    api-gateway ngrok raspberry-pi cli networking
    1 min read

  20. GPT-4 for API design research

    I came up with a really useful prompt for GPT-4 today. I was considering options for refactoring how Datasette's core view functions work, and was contemplating alternative ways to dispatch to…

    gpt-4 ai api-design web-frameworks programming
    1 min read

  21. Downloading partial YouTube videos with ffmpeg

    I spoke at WordCamp US 2023, and wanted to grab a copy of the video of my talk. I always try to keep my own copies of these because I've seen some conferences eventually take these offline in the…

    youtube video downloading ffmpeg yt-dlp
    2 min read