fix: resolve #72 - #280
Conversation
…ternal source with
RudraMalvankar
left a comment
There was a problem hiding this comment.
Nice work on the replication plugin! One question: how does this handle updates or deletes in the source database after a row has already been replicated? Since replication appears to be append-only, it seems those changes wouldn't propagate. Would it be worth mentioning this limitation more explicitly in the README so users know it's intended behavior?
|
You're right that replication is append-only and pull-based, so in-place updates and deletes to already-replicated rows won't propagate — only new rows past the tracked |
Resolves #72.
Added a new
ReplicationPlugin(plugins/replication/) that pulls data from the configured external data source (Postgres/MySQL/SQLite/Hyperdrive) into the internal Durable Object SQLite database, so a StarbaseDB instance can serve as a close-to-edge replica. Replication is pull-based and append-only: per table the user defines a tracking column (e.g.idorcreated_at), and each pull fetches only rows newer than the last checkpoint, which is persisted in atmp_replication_checkpointstable./claim #72