Farshid/Ashouri

Notes on software engineering

Archive / page 13

241–260 of 546 posts, newest first.

  1. 2024

  2. Saving an in-memory SQLite database to a file in Python

    I was messing around in Python with an in-memory SQLite database, when I decided I actually wanted to save my experimental database to a file so I could explore it using Datasette.

    TIL sqlite
    1 min read

  3. Handling CSV files with wide columns in Python

    Users were reporting the following error using to import some CSV files: csv.Error: field larger than field limit (131072) It turns out the Python standard library CSV module enforces a default field…

    python csv file-io error-handling data-processing
    1 min read

  4. Using awk to add a prefix

    I wanted to dynamically run the following command against all files in a directory: I can't use here because I need each file to be processed using the option. I found a solution using .

    TIL bash
    1 min read

  5. hexdump and hexdump -C

    While exploring null bytes in this issue I learned that the command on macOS (and presumably other Unix systems) has a confusing default output.

    hexdump cli bash debugging binary
    1 min read

  6. HTML video that loads when the user clicks play

    Today I figured out how to use the tag to show a static thumbnail that gets replaced by the loaded video only when the user clicks play.

    html video web-development performance ux
    1 min read

  7. How to read Hacker News threads with most recent comments first

    Hacker News displays comments in a tree. This can be frustrating if you want to keep track of a particular conversation, as you constantly have to seek through the tree to find the latest comment.

    hacker-news api json datasette sqlite
    3 min read

  8. Attaching a generated file to a GitHub release using Actions

    For Datasette Desktop I wanted to run an action which, when I created a release, would build an asset for that release and then upload and attach it.

    github-actions github releases ci/cd javascript
    1 min read

  9. Skipping CSV rows with odd numbers of quotes using ripgrep

    I'm working with several huge CSV files - over 5 million rows total - and I ran into a problem: it turned out there were a few lines in those files that imported incorrectly because they were not…

    TIL bash
    1 min read

  10. Start, test, then stop a localhost web server in a Bash script

    I wanted to write a bash script that would start a Datasette server running, run a request against it using , then stop the server again.

    TIL bash
    2 min read

  11. Comparing database rows before and after with SQLite JSON functions

    Here's a trick I've been using to compare the rows in a table before and after I perform an operation against it. It works well for a few hundred (and maybe a few thousand) rows.

    sqlite sql json database data-analysis
    1 min read

  12. Loading radio.garden into SQLite using jq

    http://radio.garden/ is an amazing website which displays a 3D globe covered in radio stations and lets you listen to any of them. I wanted to have a play around with their data.

    TIL jq
    1 min read

  13. Get Skitch working on Catalina

    I really like Skitch for taking screeshots, mainly because I like to snap a quick shot and then drag the icon onto a Google Doc or similar without saving the file anywhere.

    macos skitch screenshots productivity troubleshooting
    1 min read

  14. Getting Python MD5 to work with FIPS systems

    This issue by Parand Darugar pointed out that Datasette doesn't currently run on Linux systems with FIPS enabled, due to the way it uses MD5 hashes. I hadn't heard of FIPS before.

    python fips md5 security compatibility
    2 min read

  15. Switching between gcloud accounts

    I have two different Google Cloud accounts active at the moment. Here's how to list them with : And to switch between them with :

    TIL cloudrun
    1 min read

  16. Writing Fly logs to S3

    Fly offers fly-log-shipper as a container you can run in a Fly application to send all of the logs from your other applications to a logging provider. Several providers are supported.

    TIL fly
    1 min read

  17. Fixes for datetime UTC warnings in Python

    I was getting the following warning for one of my Python test suites: I also saw a deprecation warning elsewhere for my usage of .

    python datetime utc deprecation compatibility
    1 min read

  18. __init_subclass__

    David Beazley on Twitter said: I think 95% of the problems once solved by a metaclass can be solved by instead This inspired me to finally learn how to use it!

    TIL python
    1 min read

  19. Social media cards generated with shot-scraper

    My TIL website has social media card images to make links shared from it look slightly more interesting when shared on sites like Mastodon and Twitter.

    TIL shot-scraper
    3 min read

  20. The simplest recursive CTE

    I found this really simple recursive CTE useful for ensuring I understood how to write recursive CTEs. This query returns five rows from a single column - from 0 to 4.

    TIL sqlite
    1 min read

  21. Calculating embeddings with gtr-t5-large in Python

    I've long wanted to run some kind of large language model on my own computer. Now that I have a M2 MacBook Pro I'm even more keen to find interesting ways to keep all of those CPU cores busy.

    python embeddings llm ai nlp
    4 min read