● opendata-buffer / live demo

opendata-buffer is a rust library that turns an object store (s3, gcs, azure blob…) into a durable queue using a simple manifest driven protocol that producers append to and a consumer drains in batches.

this page is a single shared global queue. everyone on the internet visiting it is appending to the same manifest you are. submit a tweet on the left and watch it land in the manifest on the right, then drain onto the ticker below.

the consumer is throttled into a 8s accumulate ↔ 15s drain rhythm so you can watch depth swing. a seeder pulls posts from bluesky to keep things moving when nobody's submitting. hover any underlined label for more.

0
0
0
— —

produce

submits to the active producer
producer
?

tweet ticker

in-memory ring · last 50
  1. waiting for tweets…

queue manifest

appended drained 
{
  "epoch": 0,
  "next_sequence": 0,
  "entries": []
}

run opendata-buffer manifest dump <path> against your own queue to get the same shape. → quick start