Commit graph

65 commits

Author SHA1 Message Date
Mikkel Denker
5ab900eea5 fixed a bunch of problems with pattern_query implementation and wrote some tests to make sure it works correctly 2023-04-29 18:26:23 +02:00
Mikkel Denker
f74fe6934c Rename to stract 2023-03-06 09:43:54 +01:00
Mikkel Denker
2151fcfca8 chitchat dynamic cluster membership 2023-03-01 10:24:25 +01:00
Mikkel Denker
38fa0762a9 summarization button and stream summary to frontend 2023-02-14 11:06:26 +01:00
Mikkel Denker
2a1fa6109a abstractive summarization model with beam search 2023-02-07 15:11:23 +01:00
Mikkel Denker
8a6751cf24 Split centrality building into separate processes. This is a hotfix to reduce the memory for each step 2023-01-30 10:29:47 +01:00
Mikkel Denker
8c6a6a1a48 Qa model 2023-01-25 11:13:48 +01:00
Mikkel Denker
28186fb526 Simple calculator widget 2023-01-24 10:52:47 +01:00
Mikkel Denker
72fa54a945 Quantize crossencoder 2023-01-23 12:33:01 +01:00
Mikkel Denker
f1ad006799 Fixed bug where liked sites would show up in discardall optics, even though they matched none of the rules 2023-01-16 16:16:50 +01:00
Mikkel Denker
d3cb5d3215 collapsible for discussion snippets and more discussions 2023-01-15 18:42:38 +01:00
Mikkel Denker
d9e84c311f Fixed bug where crossencoder scores didn't make sense. For some reason, the ouput of the model needs to be f32 and can then later be cast to f64. No idea why 2023-01-15 14:23:04 +01:00
Mikkel Denker
0a46504402 crossencoder ranking (finally!) 2023-01-03 16:51:17 +01:00
Mikkel Denker
e4a27f27a0 Huge refactor of webgraph to split graph into multiple segments. This allows for more parallelism 2022-12-28 15:13:34 +01:00
Mikkel Denker
3cc7c84a32
Ftr/distributed search (#59)
* refactor network communication into separate module and made mapreduce async again

* sonic module is simple enough as is

* rename Searcher -> LocalSearcher

* [WIP] distributed searcher structure outlined

* split index search into initial and retrieval steps

* distributed searcher searching shards

* make bucket in collector generic

* no more todo!s. Waiting for indexing to finish to test implementation

* distributed searcher seems to work. Needs an enourmous refactor - the code is really ugly

* cleanup search-server on exit in justfile
2022-09-28 15:50:45 +02:00