encoding

4 posts tagged “encoding”.

  1. 2025
  2. Finding CSV files that start with a BOM using ripgrep

    For sqlite-utils issue 250 I needed to locate some test CSV files that start with a UTF-8 BOM. Here's how I did that using ripgrep: The option means the search spans multiple lines - I only want to…

    1 min read
  3. 2024
  4. hexdump and hexdump -C

    While exploring null bytes in this issue I learned that the command on macOS (and presumably other Unix systems) has a confusing default output.

    1 min read
  5. 2023
  6. Fixing broken text encodings with sqlite-transform and ftfy

    I was working with a database table that included values that were clearly in the wrong character encoding - values like this: Rue Léopold I I used my sqlite-transform tool with the ftfy Python…

    1 min read
  7. Explicit file encodings using click.File

    I wanted to add a option to which could be used to change the file encoding used to read the incoming CSV or TSV file - see sqlite-utils 182.

    1 min read