Projects
/ project/Personal Automation

X Bookmark Intelligence Pipeline

Personal pipeline that turns saved X bookmarks into a weekly brief with classifications, actions, and reflection prompts.

Status
Selected project
Type
Personal Automation

Why I built it

Saving useful posts had turned into passive accumulation. I wanted a system that would help me revisit ideas while they were still relevant to the things I was building and thinking about.

How it works

  1. A Playwright scraper saves bookmarks into SQLite.
  2. An enrichment step adds deterministic metadata and optional LLM intent classification.
  3. A weekly digest groups the useful items into a briefing, clustered sections, a chronological appendix, and a reflection prompt.
  4. A small orchestration wrapper makes the pipeline repeatable enough to schedule.

Different model stages are chosen for different jobs: inexpensive classification for volume, stronger synthesis for the weekly brief, and a smaller creative step for the reflection question.

Reliability details

  • SQLite stores the original bookmark alongside enrichment status, fallbacks, and digest history.
  • A file lock prevents overlapping scheduled runs from racing each other.
  • Digest history makes it possible to resurface older posts without repeatedly recycling the same items.
  • Media previews are restricted to expected X image hosts.
  • A dry-run mode renders the digest locally before sending it.

What matters to me

This is less about scraping than building a better information diet. The pipeline is useful when it turns a saved link into an action, a connection, or a question worth following.