Node Public Interfaces Team Weekly Update - 2021-10-15

[frol]

The previous update is #4975. See more engineering updates posted on gov.near.org

Brief Summary

• Apps that depend on aggregated data from the blockchain can now efficiently and effortlessly get and contribute their own aggregated metrics via near-analytics. Learn more about the solved pains and how to extend the existing metrics here: https://drive.google.com/file/d/17ONZ1Gg4HloADDoMm4cJDpvDlx1XLGio/view?usp=sharing

• Indexer Framework was confirmed working with the latest nearcore codebase in the preparation to nearcore release on testnet on Monday, October 18th (we successfully migrated near-indexer-for-explorer to the latest version of nearcore, cut 0.10.2-rc.1 release, and deployed it in production)

• Explorer received Russian translation (PR), so Explorer UI is now available in 4 languages: English, Chinese, Vietnamese, and Russian! Kudos to @nebezgreshniy, @SergZen, and @shelegdmitriy for all the work on the Russian translation!

Blockers

• Someone published Rust crates from nearcore ahead of us and blocks us from publishing the new version of near-jsonrpc-client-rs.
  • We reached out to them through github: Invitation to try out the new client + publishing to Crates.io bicarus-labs/near-api-rs#1 as well as email and other more direct mediums.

Result

(Acronyms: O - Objective, KR - Key Result)

• O1: Support success of DevConsole

  • KR2: Developer tools should support RPC-as-a-Service authorization mechanism

    • Pushed initial design for supporting basic authentication on the client side (@miraclx)
      feat: add support for basic authentication tokens near-jsonrpc-client-rs#18

• O3: Remove friction from building dApps

  • KR1: FT / NFT information is easily available for the developers

    • We are so close to merge NFT NEP feat: add NFT mint/transfer/burn event standard NEPs#256 (Thanks @evergreen-trading-systems and @mikedotexe for pushing it forward! @telezhnaya @frol reviewed the latest changes)

  • KR3: Release near-jsonrpc-client-rs

    • Synced and implemented a working CI pipeline for auto-publishing nearcore crates once merged on master (@miraclx + @chefsale)
      • Publishing failed because we lack authoritative access to those crates (someone else pushed them, blocking us).
    • Added tests for the generic constructor. Testing expected behaviour in typed or untyped Ok contexts as well as typed or untyped Err contexts (@miraclx)
      near/near-jsonrpc-client-rs@a6c2af3
    • Revised nearcore's publishablility (@miraclx)
      • Dropped paperclip git dependency from near-account-id to make it publishable
        refactor: drop paperclip dependency from near-account-id #4962
      • Fixed --all-features build in;
        • fix(rosetta-rpc): should build with features enabled #4963
        • fix(jsonrpc): build with all features enabled #5006

  • KR4: Indexer Framework projects fully support nearcore sharding

    • Cut indexer-for-explorer release candidate 0.10.2-rc.1 based on the latest nearcore master branch in preparation to the release on Monday, October 18th (@khorolets)
      https://github.com/near/near-indexer-for-explorer/releases/tag/0.10.2-rc.1
    • Confirmed indexer-for-explorer release candidate on testnet (@khorolets)

  • (:heavy_check_mark: COMPLETED) KR6: Stabilize automation of Analytics for Explorer

    • @telezhnaya presented near-analytics "framework" for incremental data aggregation. The recording is available: https://drive.google.com/file/d/17ONZ1Gg4HloADDoMm4cJDpvDlx1XLGio/view?usp=sharing 😎
    • Stabilized the process of collecting the stats (@telezhnaya)
      feat: add retry logic, handle broken DB connections near-analytics#11
    • Added new metric: tokens spent of fees. The numbers are ready to use (Thanks @rbval for contributing to near-analytics!)
      Initialize daily_transaction_fees aggregation near-analytics#18

• O5: Give users better insights about the current and historical status of the network

  • KR2: Explorer enables efficient exploration of NEAR history
    • Fixed XSS vulnerability caused by misconfiguration of i18n module (@shelegdmitriy)
      Fix html translations near-explorer#760
    • Exposed 'First produced block' instead of 'Genesis Start' (@shelegdmitriy)
      Expose 'First produced block' instead of 'Genesis Start' near-explorer#761
    • Add telemetry validation (@frol @shelegdmitriy)
      refactor(backend): Refactored telemetry handler near-explorer#759

Action Items

• O3: Remove friction from building dApps

  • KR1: FT / NFT information is easily available for the developers

    • Implement NFT events support into indexer-for-explorer (@telezhnaya)

  • KR3: Release near-jsonrpc-client-rs

    • Drop the old near-jsonrpc-client from nearcore (@miraclx)
      • Incremental developments here, but still inconclusive. Working with the new near-jsonrpc-client-rs in the context of which the old client was used is slightly tricky due to being properly typed but it's coming along good.
    • Migrate near-cli-rs to the new near-jsonrpc-client to take advantage of better strict typing as well as the new authorization support (@miraclx)
    • Fuzz testing RPC (@miraclx)
      Fuzz testing RPC #2422

  • KR5: Maintain 99.(9)% uptime for Indexer for Explorer

    • Finalize refactor of retry logic (@khorolets)
      refactor: Retry or panic macros to replace code duplication and add panic after N attempts near-indexer-for-explorer#168