readcon-db

mmap CON corpus

LMDB via Heed. Indexes, xxHash3 exact match, and bindings for Rust, C, C++, Python, and Fortran.

ConCorpus::open("/tmp/corpus")
Select::new().require_symbol("Cu")

readcon-db#

Rare-event codes already checkpoint on CON. This crate keeps thousands of those frames in one mmap tree: ingest CON text, filter without loading every atom, decode a hit with readcon-core.

Getting started · Tutorial — first corpus · How-to — corpus I/O by language · Architecture · FAQ

cargo add readcon-db
pip install readcon-db

Important

New here? Getting started then Tutorial — first corpus

Many writers / HPC shards? Campaign ops runbook

Language API? How-to — corpus I/O by language · Rust API

Tutorial: first corpus

Open a directory, ingest a fixture, select copper, print the hash.

Tutorial — first corpus

How-to by language

The same open / ingest / select path in Rust, Python, C, and Fortran.

How-to — corpus I/O by language

Architecture

mmap, SWMR, secondary indexes, xxHash3, hourglass ABI.

Architecture

Campaign ops

Shards, drain, join, compact. One writer per LMDB env.

Campaign ops runbook

Site map#

Tutorials

How-to guides

Explanation

Reference

Project meta