What is the SQLite value binary format for workerd Durable Objects?

Zino · May 3, 2023, 9:57pm

I am running a durable object locally like this:
wrangler dev src/index.ts --experimental-local --port 8701 --persist

I want to be able to read all of the storage for a durable object.

Workerd stores this in a SQLite file:

github.com/cloudflare/workerd

Allow Durable Objects to be stored persistently on local disk using SQLite

cloudflare:main ← cloudflare:kenton/sqlite

opened 04:04AM - 21 Jan 23 UTC

kentonv

+2172 -87

Each DO gets its own separate SQLite database. There is no change to the stor…age API (for now). We simply use SQLite to store keys and values behind the traditional DO storage API. This was a weird project where the first 10% of the project (creating the SQLite/KJ bindings) took 90% of the time, and the remaining 90% (implementing Durable Objects in terms of it) took 10% of the time. I think the plan is for @TrevorSundberg to review this. /cc @xortive @bcaimano @a-robinson @bretthoerner who are probably interested.

.wrangler/state/do/x.sqlite

The keys are strings, but the values are an unknown binary type.

What is the binary type so I can read the values whilst developing?

ckoeninger · May 8, 2023, 9:31pm

Question was answered here https://github.com/cloudflare/workerd/pull/302#issuecomment-1537177829 but as the answer says, that format is not guaranteed to stay the same.

system · May 11, 2023, 9:31pm

This topic was automatically closed 3 days after the last reply. New replies are no longer allowed.