at protocol indexer with flexible filtering, xrpc queries, and a cursor-backed event stream, built on fjall
at-protocol atproto indexer rust fjall

[config] remove db env vars from readme, tune default memtable sizes to 32mb

ptr.pet 5bd8b4aa 0030fa59

verified
+1 -8
-7
README.md
··· 48 48 | `ENABLE_FIREHOSE` | `true` | whether to ingest relay subscriptions. | 49 49 | `ENABLE_BACKFILL` | `true` | whether to backfill from PDS instances. | 50 50 | `ENABLE_CRAWLER` | `false` (if Filter), `true` (if Full) | whether to actively query the network for unknown repositories. | 51 - | `DB_WORKER_THREADS` | `4` (`8` if full network) | database worker threads. | 52 - | `DB_MAX_JOURNALING_SIZE_MB` | `512` (`1024` if full network) | max database journaling size in MB. | 53 - | `DB_PENDING_MEMTABLE_SIZE_MB` | `64` (`192` if full network) | pending memtable size in MB. | 54 - | `DB_BLOCKS_MEMTABLE_SIZE_MB` | `64` (`192` if full network) | blocks memtable size in MB. | 55 - | `DB_REPOS_MEMTABLE_SIZE_MB` | `64` (`192` if full network) | repos memtable size in MB. | 56 - | `DB_EVENTS_MEMTABLE_SIZE_MB` | `64` (`192` if full network) | events memtable size in MB. | 57 - | `DB_RECORDS_MEMTABLE_SIZE_MB` | `64` (`192` if full network) | records memtable size in MB. | 58 51 | `CRAWLER_MAX_PENDING_REPOS` | `2000` | max pending repos for crawler. | 59 52 | `CRAWLER_RESUME_PENDING_REPOS` | `1000` | resume threshold for crawler pending repos. | 60 53
+1 -1
src/config.rs
··· 138 138 default_db_memtable_size_mb, 139 139 ): (usize, u64, u64) = full_network 140 140 .then_some((8usize, 1024u64, 192u64)) 141 - .unwrap_or((4usize, 512u64, 64u64)); 141 + .unwrap_or((4usize, 400u64, 32u64)); 142 142 143 143 let db_worker_threads = cfg!("DB_WORKER_THREADS", default_db_worker_threads); 144 144 let db_max_journaling_size_mb = cfg!(