Indexer Processing over Large Transaction History #432
l-monninger
started this conversation in
Ideas
Replies: 1 comment 6 replies
-
Per concerns about establishing new connections:
The HTTP/2 connection should be kept alive regardless of Nginx, I believe. But, I believe gRPC processing a new stream connection is a bit heavier... |
Beta Was this translation helpful? Give feedback.
6 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Summary
We may have discovered that an exposed full node cannot handle live operations and provide the stream needed to synchronize over a lengthy history. For example, running the indexer from the start on the testnet which has 50 million transactions has proved problematic.
The medium-term solution here is horizontal scaling. However, we have also discussed stream metering.
Beta Was this translation helpful? Give feedback.
All reactions