Kubo users can more directly control which data is advertised — IPFS/2025

[cewood]

Description

Kubo users can more directly control which data is advertised without making the providing costs much higher (e.g. only pinned data, only files and directories for imported UnixFS data, etc.)

Tasks:

• improved diagnostics: wire up kubo stats provide to be separate from kubo stats reprovide (+ estimate % of completion based on previous reprovide runs?)
• Provide newly received blocks according to reprovide strategy ipfs/kubo#10837
• provider: duplicated CIDs sent to provide queue ipfs/boxo#901
• Command to clean reprovider queue ipfs/kubo#10829
• (tbd) Reprovider.Strategy=roots+mfs which walks MFS and only announces roots of dirs and files
• (tbd) wire up opt-in configuration for feat: DHT Reprovide Sweep ipfs/kubo#10834

ETA

Q2-Q3

Progress reporting

Q2

• Kubo 0.35 shipped with new Reprovider.Strategy=mfs|pinned+mfs and ability to disable BitswapServer when opportunistic providing to connected peers is not desired
• go-libp2p-kad-dht (Amino DHT) research and analysis and initial prototype
  • Reprovide Sweep libp2p/go-libp2p-kad-dht#824
  • feat: Reprovide Sweep libp2p/go-libp2p-kad-dht#1082

Q3

• Kubo integration: Integrate Modernized Provider System from go-libp2p-kad-dht ipfs/kubo#10881