Code

scylla relay store#882

Code

Open

brianolson wants to merge 48 commits intomainbluesky-social/indigo:mainfrom bolson/new-relay-storebluesky-social/indigo:bolson/new-relay-storeCopy head branch name to clipboard

+2,151-379

Commits

Commits on Oct 18, 2024

• wip

  brianolson

  committed
  40afdd5

  Copy full SHA for 40afdd5

Commits on Oct 25, 2024

• wip: new storage skeleton

  brianolson

  committed
  450b771

  Copy full SHA for 450b771

Commits on Oct 31, 2024

• Merge remote-tracking branch 'origin/main' into bolson/new-relay-store

  brianolson

  committed
  5ada956

  Copy full SHA for 5ada956

Commits on Nov 1, 2024

• wip: starting to fail at unit testing new carstore

  brianolson

  committed
  2e408c1

  Copy full SHA for 2e408c1

• passes unit tests

  brianolson

  committed
  79252d7

  Copy full SHA for 79252d7

• Merge remote-tracking branch 'origin/main' into bolson/new-relay-store

  brianolson

  committed
  4ad3bea

  Copy full SHA for 4ad3bea

• more sqlite txn

  brianolson

  committed
  29cb514

  Copy full SHA for 29cb514

Commits on Nov 2, 2024

• index (uid,rev DESC); add readme

  brianolson

  committed
  0b6612a

  Copy full SHA for 0b6612a

Commits on Nov 3, 2024

• add some trace spans

  brianolson

  committed
  9bc8bf7

  Copy full SHA for 9bc8bf7

• flag to enable experimental sqlite carstore

  brianolson

  committed
  8bf9dcd

  Copy full SHA for 8bf9dcd

• mkdirs

  brianolson

  committed
  e5f8403

  Copy full SHA for e5f8403

• nil fix

  brianolson

  committed
  a631350

  Copy full SHA for a631350

• nil fix

  brianolson

  committed
  e8a57d8

  Copy full SHA for e8a57d8

• nil fix

  brianolson

  committed
  da9022a

  Copy full SHA for da9022a

Commits on Nov 7, 2024

• note blocks written in otel span

  brianolson

  committed
  06e76d5

  Copy full SHA for 06e76d5

Commits on Nov 8, 2024

• wip: scylla backend compiles

  brianolson

  committed
  1e283b7

  Copy full SHA for 1e283b7

• connect scylla to main

  brianolson

  committed
  c5e9107

  Copy full SHA for c5e9107

• allow posting pds crawl with limits

  brianolson

  committed
  d0e0a27

  Copy full SHA for d0e0a27

• scylla appeasment, index -> materialized view

  brianolson

  committed
  190b304

  Copy full SHA for 190b304

Commits on Nov 11, 2024

• not found is nil return, not err

  brianolson

  committed
  367255d

  Copy full SHA for 367255d

• cql marshal

  brianolson

  committed
  2967953

  Copy full SHA for 2967953

• explicit Cid <-> []byte for scylla

  brianolson

  committed
  43a68b2

  Copy full SHA for 43a68b2

• use secondary index to delet blocks by uid

  brianolson

  committed
  27741bc

  Copy full SHA for 27741bc

• add time histograms on major scylla queries

  brianolson

  committed
  e48e72f

  Copy full SHA for e48e72f

Commits on Nov 13, 2024

• fix

  brianolson

  committed
  b20aac6

  Copy full SHA for b20aac6

• Merge remote-tracking branch 'origin/main' into bolson/new-relay-store

  brianolson

  committed
  bac8361

  Copy full SHA for bac8361

• more info on bad repo compare

  brianolson

  committed
  2fe848e

  Copy full SHA for 2fe848e

• cleanup

  brianolson

  committed
  6afe8e4

  Copy full SHA for 6afe8e4

Commits on Nov 15, 2024

• Merge remote-tracking branch 'origin/main' into bolson/new-relay-store

  brianolson

  committed
  8072318

  Copy full SHA for 8072318

• fix arg name

  brianolson

  committed
  2bb6244

  Copy full SHA for 2bb6244

Commits on Nov 18, 2024

• Merge remote-tracking branch 'origin/main' into bolson/new-relay-store

  brianolson

  committed
  a8a5b7b

  Copy full SHA for a8a5b7b

Commits on Nov 22, 2024

• Merge remote-tracking branch 'origin/main' into bolson/new-relay-store

  brianolson

  committed
  198c156

  Copy full SHA for 198c156

Commits on Dec 6, 2024

• Merge remote-tracking branch 'origin/main' into bolson/new-relay-store

  brianolson

  committed
  8743ff0

  Copy full SHA for 8743ff0

Commits on Dec 11, 2024

• env RELAY_SCYLLA_NODES

  Show description for 6026f75
  brianolson

  committed
  6026f75

  Copy full SHA for 6026f75

Commits on Dec 17, 2024

• Merge remote-tracking branch 'origin/main' into bolson/new-relay-store

  brianolson

  committed
  377c10a

  Copy full SHA for 377c10a

Commits on Dec 18, 2024

• fix usage of ImportNewRepo

  brianolson

  committed
  805ae5b

  Copy full SHA for 805ae5b

• func ptr -> interface

  brianolson

  committed
  d709ae9

  Copy full SHA for d709ae9

• comment

  brianolson

  committed
  16c36b8

  Copy full SHA for 16c36b8

Commits on Dec 19, 2024

• CrawlDispatcher experiment

  brianolson

  committed
  4e13454

  Copy full SHA for 4e13454

Commits on Dec 20, 2024

• CrawlDispatcher noisy logging

  brianolson

  committed
  6a637f3

  Copy full SHA for 6a637f3

• CrawlDispatcher more log

  brianolson

  committed
  3eff0c5

  Copy full SHA for 3eff0c5

• CrawlDispatcher per-pds queue

  brianolson

  committed
  aa744ef

  Copy full SHA for aa744ef

• CrawlDispatcher fix

  brianolson

  committed
  7e374aa

  Copy full SHA for 7e374aa

• CrawlDispatcher fix

  brianolson

  committed
  8e778a7

  Copy full SHA for 8e778a7

• CrawlDispatcher fetchWorker logging

  brianolson

  committed
  6538e72

  Copy full SHA for 6538e72

• CrawlDispatcher bring back multiple workers per PDS, consciously

  brianolson

  committed
  d91feca

  Copy full SHA for d91feca

• FetchAndIndexRepo log times

  brianolson

  committed
  ee779c3

  Copy full SHA for ee779c3

Commits on Dec 21, 2024

• scylla 4 threaded write if >20 blocks

  brianolson

  committed
  c1c3c7e

  Copy full SHA for c1c3c7e