HeadlinesBriefing favicon HeadlinesBriefing.com

BriskDB: Sharded SQLite with Parallel Writes & Cross-Language Support

Hacker News •
×

GitHub-hosted BriskDB transforms ordinary SQLite files into a single sharded database, enabling parallel writes, PostgreSQL compatibility, HTTP access, and Rust/Python APIs. It retains SQLite's storage engine while adding routing, shard-safe IDs, and operational safeguards.

The system uses independent WAL files for each shard, allowing parallel writes without a central lock. Shard-safe IDs prevent collisions via native range allocation or block leasing. Cross-shard indexes and global uniqueness are maintained through verification and bloom filters. BriskDB is an alpha, prioritizing transparency with published metrics on latency and contention.

Developers benefit from no SQLite fork—each shard remains an inspectable file. The Rust engine powers Python wheels and binaries, with HTTP and PostgreSQL protocols sharing the same routing logic. A responsive data browser at `/admin` aggregates sharded views. The alpha includes offline SQLite import, mono Python/Rust support, and planned MongoDB/MySQL drivers.

Current features include working HTTP/PG APIs, local shard management, and experimental cross-shard operations. BriskDB suits use cases needing write contention reduction in SQLite-based systems, contrasting with alternatives focused on replication or managed services.