DB scalability #111

Open
opened 2026-05-17 12:24:49 +00:00 by aniram · 1 comment
Owner

TODO

  • Bulk insert tables on sync
  • Use a dedicated index for frequently used filters
  • Keyset pagination(Cursor pagination)
  • Full-Text-Search(FTS) on 'keywords' and 'descricao...' which allows to find for e.g. propositions related to "trabalho" when user inserts "trab". Make it case-insensitive and Latin accents insensitive so that searching for "educacao" matches "educação".
TODO - [ ] Bulk insert tables on sync - [ ] Use a dedicated index for frequently used filters - [ ] Keyset pagination(Cursor pagination) - [ ] Full-Text-Search(FTS) on 'keywords' and 'descricao...' which allows to find for e.g. propositions related to "trabalho" when user inserts "trab". Make it case-insensitive and Latin accents insensitive so that searching for "educacao" matches "educação".
Author
Owner

Next level would be to use a dedicated search engine like Elasticsearch, Meilisearch, Typesense or Postgres FTS.
Elasticsearch -> High complexity, type tolerance
Meilisearch -> Low complexity, type tolerance
Typesense -> Low complexity, type tolerance
Postgres FTS -> NO complexity, NO type tolerance

Next level would be to use a dedicated search engine like Elasticsearch, Meilisearch, Typesense or Postgres FTS. Elasticsearch -> High complexity, type tolerance Meilisearch -> Low complexity, type tolerance Typesense -> Low complexity, type tolerance Postgres FTS -> NO complexity, NO type tolerance
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
overdrives/chambersbr#111
No description provided.