Farshid/Ashouri

duckdb

2 posts tagged “duckdb”.

  1. 2025

  2. Using DuckDB in Python to access Parquet data

    Did a quick experiment with DuckDB today, inspired by the bmschmidt/hathi-binary repo. That repo includes 3GB of data in 68 parquet files. Those files are 45MB each.

    TIL duckdb
    1 min read
  3. 2024

  4. Summing columns in remote Parquet files using DuckDB

    vivym/midjourney-messages on Hugging Face is a large ( 8GB) dataset consisting of 55,082,563 Midjourney images - each one with the prompt and a URL to the image hosted on Discord.

    TIL duckdb
    4 min read