Flattening nested JSON objects with jq
I wanted to take a nested set of JSON objects and import them into a SQLite database using - but I wanted to "flatten" some of the nested rows.
sqlite-utils
7 posts tagged “sqlite-utils”.
- 2025
-
1 min read
-
axe-core and shot-scraper for accessibility audits
I just watched a talk by Pamela Fox at North Bay Python on Automated accessibility audits. The video should be up within 24 hours.
1 min read -
Extracting web page content using Readability.js and shot-scraper
Readability.js is "A standalone version of the readability library used for Firefox Reader View". I figured out how to use the two of these together to extract the core content from a web page using…
1 min read - 2024
-
Exporting Amplitude events to SQLite
Amplitude offers an "Export Data" button in the project settings page. This can export up to 365 days of events (up to 4GB per export), where the export is a zip file containing gzipped…
1 min read -
Export a Mastodon timeline to SQLite
I've been playing around with the Mastodon timelines API. It's pretty fun! I'm running my own instance which means I don't feel limited by politeness in terms of rate limits - if I'm just using my own…
1 min read - 2023
-
Converting Airtable JSON for use with sqlite-utils using jq
The Airtable API outputs JSON that looks like this: The items in the array each have an , a nested dictionary and a .
1 min read -
Comparing two training datasets using sqlite-utils
WizardLM is "an Instruction-following LLM Using Evol-Instruct". It's a fine-tuned model on top of Meta's LLaMA.
3 min read