tyiu/damus
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
4,246 Commits 139 Branches 0 Tags
04d4ff4e99e7d619fe898a2765bca06daefcef78
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
William CasarinandDaniel D’Aquino 04d4ff4e99 nostrdb: refactor: a few small formatting changes 
No functional changes, just formatting cleanups

Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:40:01 -07:00
William CasarinandDaniel D’Aquino 2d02766461 nostrdb: filter: add ndb_filter_find_search helper 
This can be used to quicky pull the search string
from a filter

Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:40:01 -07:00
William CasarinandDaniel D’Aquino 1e6873c879 nostrdb: nip50: add support for search field in filters 
We will be using this for our nip50 search support

Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:40:01 -07:00
William CasarinandDaniel D’Aquino d3496af5cc nostrdb: filter: fix ndb_filter_init_with and make public 
This fixes an allocation issue with ndb_filter_init_with for small
page sizes. instead of allocating the buffer around pages, we allocate
based on total buffer size.

Fixes: f7aac3215575 ("filter: introduce ndb_filter_init_with")
Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:40:01 -07:00
William CasarinandDaniel D’Aquino ec798bdeb2 nostrdb: debug: fix debug logs 
We forgot to move one DEBUG instance to NDB_LOG

Fixes: b4c2ff3d270a ("Only log to stdout if NDB_LOG is defined")
Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:40:01 -07:00
William CasarinandDaniel D’Aquino fa9b952295 nostrdb: add is_replaceable_kind helper 
we will be using this to detect replaceable kinds

Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:40:01 -07:00
William CasarinandDaniel D’Aquino 27f55bc09f nostrdb: refactor: use kind variable for clarity 
almost no reason to do this, but whatever

Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:40:01 -07:00
William CasarinandDaniel D’Aquino 52845a52bb nostrdb: remove ndb_writer_queue_note (dead code) 
This doesn't seem to be used at all

Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:40:01 -07:00
William CasarinandDaniel D’Aquino 4e27cca12b nostrdb: filter: introduce ndb_filter_init_with 
Just a static function for now for creating smaller filter sizes. We
will use this for filters that we know are small so that we don't have
to allocate so many pages at once. It's likely the OS will only allocate
a single page anyways, but its nice to be explicit.

Changelog-Added: Add ndb_filter_init_with
Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:40:01 -07:00
William CasarinandDaniel D’Aquino af5961ce26 nostrdb: query: add missing since check to kind query 
Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:40:00 -07:00
William CasarinandDaniel D’Aquino 58de0025aa nostrdb: monitor: lock monitor when we're freeing subscriptions 
Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:40:00 -07:00
William CasarinandDaniel D’Aquino c931108741 nostrdb: subs: fix memory leak in ndb_subscribe 
Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:40:00 -07:00
William CasarinandDaniel D’Aquino 20255198fd nostrdb: bug: add missing break statement 
probably harmless but it writes the note twice...

Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:40:00 -07:00
William CasarinandDaniel D’Aquino 289a8e262a nostrdb: migrations: make migrations asyncronous 
This also seems to fix some issues with older migrations.

Fixes: https://github.com/damus-io/nostrdb/issues/58
Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:40:00 -07:00
William CasarinandDaniel D’Aquino 05baba9c03 nostrdb: flags: make some indexes optional 
Make fulltext indices and note blocks optional. This will be useful for
quickly building databases when testing, since more stuff in the write
queue when writing can slow things down.

Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:40:00 -07:00
William CasarinandDaniel D’Aquino e0461d3458 nostrdb: writer: rename any_note to needs_commit 
This is a bit more clear as to what this variable actually means

Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:40:00 -07:00
William CasarinandDaniel D’Aquino 62aa72c215 nostrdb: leak: fix memory leak when failing to write like stats 
Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:40:00 -07:00
William CasarinandDaniel D’Aquino 287b35a8fb nostrdb: migration: dont fail v3 -> v4 on 0 migrations 
Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:40:00 -07:00
William CasarinandDaniel D’Aquino 478d7b4060 nostrdb: add authors query plan 
This fixes author queries

Fixes: https://github.com/damus-io/nostrdb/issues/52
Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:40:00 -07:00
William CasarinandDaniel D’Aquino 2c4728508b nostrdb: earlier since check in ndb_query_plan_execute_created_at 
this avoids a lookup if we dont need it

Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:40:00 -07:00
William CasarinandDaniel D’Aquino d24a3f0ce5 nostrdb: simplify ndb_query_plan_execute_ids 
Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:40:00 -07:00
William CasarinandDaniel D’Aquino efba599779 nostrdb: ids: fix typo in ndb_query_plan_execute_ids 
We should be specifying that we've matched the id here, not authors. Not
that this would have any effect.. but still.

Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:40:00 -07:00
William CasarinandDaniel D’Aquino 19243d49e1 nostrdb: always show migration text 
Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:40:00 -07:00
William CasarinandDaniel D’Aquino 6845d0df47 nostrdb: migrate notes to have pubkey indices 
Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:40:00 -07:00
William CasarinandDaniel D’Aquino 8e79ad582a nostrdb: add note pubkey and pubkey_kind indices 
We need these for profile queries

Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:40:00 -07:00
William CasarinandDaniel D’Aquino 282c02eed4 nostrdb: add ndb_db_is_index 
This function can be used to check if a db is an index or not. We
will use this in future functions that rebuild indices.

Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:40:00 -07:00
William CasarinandDaniel D’Aquino 155ac27bb5 nostrdb: introduce ndb_id_u64_ts 
This will be the key used by our note_profile_kind indee

Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:40:00 -07:00
William CasarinandDaniel D’Aquino be1d149f4b nostrdb: misc: move some functions around 
because this will make the changes nicer

Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:40:00 -07:00
William CasarinandDaniel D’Aquino 9e0dc47e98 nostrdb: rename: ndb_u64_tsid to ndb_u64_ts 
technically more accurate. we are about to introduce a new type called:

	ndb_ts_u64_id

which would be confusing if we didn't do this

Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:40:00 -07:00
William CasarinandDaniel D’Aquino 0916b14b32 nostrdb: make the subscription monitor threadsafe 
This was the only thing that wasn't threadsafe. Add a simple mutex
instead of a queue so that polling is quick.

This also means we can't really return the internal subscriptions
anymore, so we remove that for now until we have a safer
interface.

Fixes: https://github.com/damus-io/nostrdb/issues/55
Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:40:00 -07:00
William CasarinandDaniel D’Aquino 6818d001f2 nostrdb: mem: reduce default queue size 
This was overkill and was using lots of memory

Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:40:00 -07:00
William CasarinandDaniel D’Aquino 4bf9160502 nostrdb: fix heap corruption on windows 
windows thinks this is heap corruption... so I
guess we have to trust it.

Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:40:00 -07:00
William CasarinandDaniel D’Aquino 02df1e209b nostrdb: windows: fix threading bugs 
Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:40:00 -07:00
William CasarinandDaniel D’Aquino 3186b0e1d3 nostrdb: fix windows build 
Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:40:00 -07:00
William CasarinandDaniel D’Aquino de0935582c nostrdb: ndb_filter_{eq,is_subset_of}: make interfaces const 
this makes rust happier

Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:40:00 -07:00
William CasarinandDaniel D’Aquino 573de6b881 nostrdb: ndb_filter_is_subset_of 
subset testing for filters. Can be used to see if one subset is
redundant in the presence of a another in the local relay model

Changelog-Added: Add ndb_filter_is_subset_of
Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:40:00 -07:00
William CasarinandDaniel D’Aquino 44ab702792 nostrdb: add ndb_filter_eq 
filter equality testing. this works because field elements are sorted

Changelog-Added: Add ndb_filter_eq for filter equality testing
Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:40:00 -07:00
William CasarinandDaniel D’Aquino 1fdf234c46 nostrdb: rename get_elems to find_elements 
This is more accurate

Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:40:00 -07:00
William CasarinandDaniel D’Aquino 3018200e95 nostrdb: add ndb_subscription_filters 
Expose a way to get the set of filters for a subscription. On the rust
side, we should likely ndb_filter_clone each filter asap, because the
result of this function will only be valid up until the subscription
ends.

Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:40:00 -07:00
William CasarinandDaniel D’Aquino 47b79fc02e nostrdb: ingest: support kind 6 reposts 
This also enables processing raw json via ndb import

Fixes: https://github.com/damus-io/nostrdb/issues/46
Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:40:00 -07:00
William CasarinandDaniel D’Aquino 0c483bb55a nostrdb: print search keys to stdout 
otherwise it's way too annoying to grep

Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:40:00 -07:00
William CasarinandDaniel D’Aquino 8c446f804c nostrdb: filter: retain const variant of get_int_elemnet 
otherwise rust gets bitchy at as

Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:40:00 -07:00
William CasarinandDaniel D’Aquino e92018aee5 nostrdb: filter: allow mutable int elements 
Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:40:00 -07:00
William CasarinandDaniel D’Aquino b4b84e6895 nostrdb: resync with repo 
Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:40:00 -07:00
William CasarinandDaniel D’Aquino 6c53bc75f2 nostrdb: content_parser: fix blocks_size 
we are crossing cursors

Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:40:00 -07:00
William CasarinandDaniel D’Aquino 827731b9cb nostrdb: filter: retain const variant of get_int_elemnet 
otherwise rust gets bitchy at as

Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:40:00 -07:00
William CasarinandDaniel D’Aquino 56d44d0004 nostrdb: filter: allow mutable int elements 
Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:40:00 -07:00
William CasarinandDaniel D’Aquino bbed448ccb nostrdb: ndb_filter_from_json 
Changelog-Added: Add method for parsing filter json
Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:40:00 -07:00
William CasarinandDaniel D’Aquino b326f007f2 nostrdb: expose filter introspection methods 
Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:40:00 -07:00
William CasarinandDaniel D’Aquino a86d8416fc nostrdb: expose ndb_filter_get_elements 
This can be used to iterate though filter elements

Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:40:00 -07:00
William CasarinandDaniel D’Aquino b5c57dc935 nostrdb: make more things const 
rust is happier this way

Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:40:00 -07:00
William CasarinandDaniel D’Aquino 7d6814a481 nostrdb: add ndb_filter_json method 
Changelog-Added: Add ndb_filter_json method for creating json filters
Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:40:00 -07:00
William CasarinandDaniel D’Aquino 8dd048681b nostrdb: Fix issue where id tag filters are pushed as strings 
When creating filters, sometimes IDs are pushed as strings, so if there
is ever a 0 byte, the id prematurely ends, causing the filter to not
match

Fixes: https://github.com/rust-nostr/nostr/issues/454
Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:40:00 -07:00
William CasarinandDaniel D’Aquino 2d02a17af6 nostrdb: fix bech32 parsing and add test 
was off by one

Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:40:00 -07:00
William CasarinandDaniel D’Aquino 3171959d85 nostrdb: debug: improve tag index display 
Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:40:00 -07:00
William CasarinandDaniel D’Aquino bca3716e33 nostrdb: fix note content parsing bug with damus.io urls 
Changelog-Fixed: Fixed bug where non-bech32 damus io urls would cause corruption
Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:40:00 -07:00
William CasarinandDaniel D’Aquino 57db252783 nostrdb: ndb_note_json: return length 
Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:40:00 -07:00
William CasarinandDaniel D’Aquino 319579f912 nostrdb: ndb: dump json in filters and fulltext queries 
This is much more useful

Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:40:00 -07:00
William CasarinandDaniel D’Aquino 92e1e4b08f nostrdb: api: add ndb_note_json 
add a way to write an ndb note as json to a buffer

Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:40:00 -07:00
William CasarinandDaniel D’Aquino ffc50bb2c1 nostrdb: fix realloc corruption 
can't figure out why this is happening, but let's disable it for now
while we test. we shouldn't hit this code path anyways once we switch
over to local notes in damus ios

Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:40:00 -07:00
William CasarinandDaniel D’Aquino a562be009d nostrdb: add ability to register a subscription callback 
Since Damus iOS is not an immediate-mode UI like android, we would
rather not poll for results. Instead we need a way to register a
callback function that is called when we get new subscription results.

This is also useful on the android side, allowing us to request a new
frame to draw when we have new results, instead of drawing every second.

Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:40:00 -07:00
William CasarinandDaniel D’Aquino 30c9bc7db7 nostrdb: add ndb_unsubscribe 
We didn't have a way to unsubscribe from subscriptions. Now we do!

Apps like notecrumbs may open up many local subscriptions based on
incoming requests. We may need to make the MAX_SUBSCRIPTIONS size much
larger, but this should be okish for now.

Changelog-Added: Add ndb_unsubscribe to unsubscribe from subscriptions
Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:40:00 -07:00
William CasarinandDaniel D’Aquino 0ac03df841 nostrdb: build: fix compile warning 
A small size_t/uint64 conversion issue

Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:40:00 -07:00
William CasarinandDaniel D’Aquino db99b4f4d4 nostrdb: fix dubious looking parens logic 
Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:40:00 -07:00
William CasarinandDaniel D’Aquino cc9585b6e3 nostrdb: plan: use a less efficient plan for author query plans 
This is less efficient for now but we don't have a small-author-list
query plan yet.

Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:40:00 -07:00
William CasarinandDaniel D’Aquino bd17dcfac6 nostrdb: plan: add created_at query plan 
This introduces the basic created_at query plan. We scan the created_at
+ id index in descending order looking for items that match a filter.
This is a very general query plan, but might not be very efficient for
anything other than local timelines.

Changelog-Added: Add general created_at query plan for timelines
Closes: https://github.com/damus-io/nostrdb/issues/26
Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:40:00 -07:00
William CasarinandDaniel D’Aquino 25e91b386c nostrdb: cores: just set to 2 on unknown platforms 
Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:40:00 -07:00
William CasarinandDaniel D’Aquino 560e9e53cd nostrdb: fix a few note size compile issues 
Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:40:00 -07:00
William CasarinandDaniel D’Aquino 1c1e5fa2a0 nostrdb: random: add getrandom fallback for android 
Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:40:00 -07:00
William CasarinandDaniel D’Aquino 2d5f86b142 nostrdb: filter: make sure clone copies metadata 
Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:40:00 -07:00
William CasarinandDaniel D’Aquino 89686d758a nostrdb: filter: make sure to return clone errors 
Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:40:00 -07:00
William CasarinandDaniel D’Aquino 6c26add1da nostrdb: filter: add ndb_filter_clone 
Clone filters when moving them into subscriptions. This will allow us to
fix the double free issue on the rust side.

Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:40:00 -07:00
William CasarinandDaniel D’Aquino 3c5a83392e nostrdb: filter: use relative data offsets for easy cloning 
Instead of storing exact pointers inside of our filter elements, just
store offsets. This will allow us to clone filters very easily without
having to mess around with fixing up the pointers afterwards.

Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:40:00 -07:00
William CasarinandDaniel D’Aquino 1c63c3b9bb nostrdb: filter: add ndb_filter_end 
This is a pretty scary looking function that realloc our large variable
filter buffer into a compact one. This saves up a bunch of memory when
we are done building the filter.

Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:40:00 -07:00
William CasarinandDaniel D’Aquino 0bd4717e01 nostrdb: query: include note size in query results 
Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:40:00 -07:00
William CasarinandDaniel D’Aquino bebd531b58 nostrdb: return number of items popped when polling 
Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:40:00 -07:00
William CasarinandDaniel D’Aquino 5788c077c4 nostrdb: silence annoying debug 
Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:40:00 -07:00
William CasarinandDaniel D’Aquino 1b77b4f0e0 nostrdb: filters: copy filter metadata into subscription 
This fixes a few ownership issues

Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:40:00 -07:00
William CasarinandDaniel D’Aquino 62625c6ff3 nostrdb: ndb: add ndb_poll_for_notes 
The polling variant of ndb_wait_for_notes. This makes more sense for
realtime apps like notedeck

Changelog-Added: Add ndb_poll_for_notes
Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:40:00 -07:00
William CasarinandDaniel D’Aquino c8d88058d4 nostrdb: queue: switch to prot_queue_try_pop_all 
This allows you to `try pop` multiple items instead of 1

Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:40:00 -07:00
William CasarinandDaniel D’Aquino b8bef86ea1 nostrdb: port kernelkind's to the new bech32 parser 
Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:40:00 -07:00
William CasarinandDaniel D’Aquino b128330b2a nostrdb: tce: fix build for previous TCE change 
Fixes: 34093cd1 ("tce: add AUTH to-client-event")
Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:40:00 -07:00
William CasarinandDaniel D’Aquino 934ea80f85 nostrdb: blocks: add word count interface 
Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:40:00 -07:00
William CasarinandDaniel D’Aquino 588cebd18d nostrdb: header: add ptr helpers for swift 
swift is kind of dumb when it comes to opaque pointers

Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:40:00 -07:00
William CasarinandDaniel D’Aquino ccca6e58ec nostrdb: strblock: add typedef 
I don't technically need this but it helps a lot on the swift side
of things since I already have code that uses this identifier of a
similar structure

Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:40:00 -07:00
William CasarinandDaniel D’Aquino 8b3c86c5de nostrdb/query: add tag index and tag queries 
Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:39:59 -07:00
William CasarinandDaniel D’Aquino 05c5a6dacb nostrdb/filter: don't end field if we don't have one active 
Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:39:59 -07:00
William CasarinandDaniel D’Aquino 1a6568deca nostrdb/perf: add some flamegraph helpers to makefile 
Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:39:59 -07:00
William CasarinandDaniel D’Aquino 1b2f4c41df nostrdb/fix macos build 
Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:39:59 -07:00
William CasarinandDaniel D’Aquino 25bcf9c243 nostrdb/ndb: measure query performance 
Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:39:59 -07:00
William CasarinandDaniel D’Aquino 3993679cc0 nostrdb/query: support until for kind query plans 
Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:39:59 -07:00
William CasarinandDaniel D’Aquino e302bf37fa nostrdb/ndb: add inital query command 
still very early, but works for kinds!

Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:39:59 -07:00
William CasarinandDaniel D’Aquino a45f4d3087 nostrdb/Query Plans 
Instead of running queries off filters directly, we do some simple
heuristics and determine a reasonable query plan for the given filter.

To test this, also add a kind index query plan and add a test for it.

We still need tag, author, and created_at index scans. This is up next!

Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:39:59 -07:00
William CasarinandDaniel D’Aquino d598e178c1 nostrdb/index: make sure kind index is DUPSORT + INTEGERDUP 
We will probably need a migration for this?

Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:39:59 -07:00
William CasarinandDaniel D’Aquino 77601e77ee nostrdb/filter: rename FILTER_GENERIC to FILTER_TAG 
it's a bit more intuitive

Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:39:59 -07:00
William CasarinandDaniel D’Aquino 206efba58a nostrdb/cleanup: remove old dbscan stuff 
Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:39:59 -07:00
William CasarinandDaniel D’Aquino a84749cd07 nostrdb/debug: add print_kind_keys helper 
I needed this for debugging kind queries

Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:39:59 -07:00
William CasarinandDaniel D’Aquino 75c7adddb8 nostrdb/query: implement kind queries 
Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:39:59 -07:00
William CasarinandDaniel D’Aquino 9f1b9ab945 nostrdb/Initial nostrdb queries 
Still a lot more work to do, but this is at least a proof of concept for
querying nostrdb using filters.

Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:39:59 -07:00
William CasarinandDaniel D’Aquino b2080a946e nostrdb/cursor: fix bug when pushing last element 
Signed-off-by: William Casarin <jb55@jb55.com>
 2025-08-11 16:39:59 -07:00