[ZK Stack] - Fail with error 'TimeNotReached' - Is it a bug?

[moneta]

Team or Project

No response

Module Affected

• System contracts (era-system-contracts)
• Smart contracts (era-contracts)
• zkEVM (era-zk_evm)
• Server (zksync-era)
• Prover (era-boojum)
• Fee withdrawer (era-fee-withdrawer)
• Block Explorer (clock-explorer)
• Portal - Wallet + Bridge (dapp-portal)
• Other (please specify below)

Rust Version

1.85.0

Operating System

• Ubuntu
• MacOS
• Windows
• Other (Please specify below)

Issue Description

I deployed the ecosystem from the branch core-v27.3.0 (I used this branch because of the other later branch thrown different errors wen deploy)

repo: https://github.com/matter-labs/zksync-era/tree/core-v27.3.0

When I run the server, looks like it successfully processed the first l1 batch then it commit the batch to L1, but failed. Here is the transaction: https://sepolia.etherscan.io/tx/0xdd20ce2555a5f46da849f9273aff2b6d44efaf51aac212807afe858de4f17842

The error message reads:

Fail with error 'TimeNotReached (expectedTimestamp= 1748031355, actualTimestamp= 1748107080)'

However, this looks like a zkSync Era bug. The actual timestamp 1748107080 already passed the expected timestamp 1748031355.

This is the full logs:

2025-05-27T17:17:48.368331Z  INFO EthTxManager::loop_iteration: zksync_eth_sender::eth_tx_manager: Sending 1 Blob new transactions                                                                                                                                            
2025-05-27T17:17:48.368989Z  INFO EthTxManager::loop_iteration: zksync_eth_sender::eth_tx_manager: Sending Blob tx 1 (nonce 0) at block 8419016 with base_fee_per_gas 25018151530, priority_fee_per_gas 2000000000, blob_fee_per_gas Some(2)                                  
2025-05-27T17:17:48.470535Z  WARN EthTxManager::loop_iteration: zksync_eth_sender::eth_tx_manager: Error Sending Blob tx 1 (nonce 0) at block 8419016 with base_fee_per_gas 25018151530, priority_fee_per_gas 2000000000, blob_fee_per_gas Some(2),error Ethereum gateway erro
r: JSON-RPC request send_raw_transaction() failed: ErrorObject { code: ServerError(-32000), message: "insufficient funds for gas * price + value: balance 0, tx cost 405272272950262144, overshot 405272272950262144", data: Some(RawValue({"trace_id":"78510ce66fe5d4c603e0b8
a34e00dd00"})) }                                                                                                                                                                                                                                                              
2025-05-27T17:17:48.993832Z  WARN zksync_base_token_adjuster::base_token_ratio_provider: No latest price found in the database. Using default ratio.                                                                                                                          
2025-05-27T17:17:49.539281Z  INFO EthTxManager::loop_iteration: zksync_eth_sender::eth_tx_manager: Sending 1 Blob new transactions                                                                                                                                            
2025-05-27T17:17:49.539795Z  INFO EthTxManager::loop_iteration: zksync_eth_sender::eth_tx_manager: Sending Blob tx 1 (nonce 0) at block 8419017 with base_fee_per_gas 25492335510, priority_fee_per_gas 2000000000, blob_fee_per_gas Some(2)                                  
2025-05-27T17:17:49.625304Z  INFO EthTxManager::loop_iteration: zksync_eth_sender::eth_tx_manager: Checking tx id: 1, operator_nonce: OperatorNonce { finalized: Nonce(0), latest: Nonce(0) }, tx nonce: 0                                                                    
2025-05-27T17:17:50.693835Z  INFO EthTxManager::loop_iteration: zksync_eth_sender::eth_tx_manager: Checking tx id: 1, operator_nonce: OperatorNonce { finalized: Nonce(0), latest: Nonce(0) }, tx nonce: 0                                                                    
2025-05-27T17:17:50.994997Z  WARN zksync_base_token_adjuster::base_token_ratio_provider: No latest price found in the database. Using default ratio.                                                                                                                          
2025-05-27T17:17:51.813390Z  INFO EthTxManager::loop_iteration: zksync_eth_sender::eth_tx_manager: Checking tx id: 1, operator_nonce: OperatorNonce { finalized: Nonce(0), latest: Nonce(0) }, tx nonce: 0                                                                    
2025-05-27T17:17:52.901630Z  INFO EthTxManager::loop_iteration: zksync_eth_sender::eth_tx_manager: Checking tx id: 1, operator_nonce: OperatorNonce { finalized: Nonce(0), latest: Nonce(0) }, tx nonce: 0                                                                    
2025-05-27T17:17:52.994375Z  WARN zksync_base_token_adjuster::base_token_ratio_provider: No latest price found in the database. Using default ratio.                                                                                                                          
2025-05-27T17:17:53.957205Z  INFO EthTxManager::loop_iteration: zksync_eth_sender::eth_tx_manager: Checking tx id: 1, operator_nonce: OperatorNonce { finalized: Nonce(0), latest: Nonce(0) }, tx nonce: 0                                                                    
2025-05-27T17:17:54.994015Z  WARN zksync_base_token_adjuster::base_token_ratio_provider: No latest price found in the database. Using default ratio.                                                                                                                          
2025-05-27T17:17:55.060930Z  INFO EthTxManager::loop_iteration: zksync_eth_sender::eth_tx_manager: Checking tx id: 1, operator_nonce: OperatorNonce { finalized: Nonce(0), latest: Nonce(0) }, tx nonce: 0                                                                    
2025-05-27T17:17:56.116180Z  INFO EthTxManager::loop_iteration: zksync_eth_sender::eth_tx_manager: Checking tx id: 1, operator_nonce: OperatorNonce { finalized: Nonce(0), latest: Nonce(0) }, tx nonce: 0                                                                    
2025-05-27T17:17:56.993893Z  WARN zksync_base_token_adjuster::base_token_ratio_provider: No latest price found in the database. Using default ratio.                                                                                                                          
2025-05-27T17:17:57.177207Z  INFO EthTxManager::loop_iteration: zksync_eth_sender::eth_tx_manager: Checking tx id: 1, operator_nonce: OperatorNonce { finalized: Nonce(0), latest: Nonce(0) }, tx nonce: 0                                                                    
2025-05-27T17:17:58.241336Z  INFO EthTxManager::loop_iteration: zksync_eth_sender::eth_tx_manager: Checking tx id: 1, operator_nonce: OperatorNonce { finalized: Nonce(0), latest: Nonce(0) }, tx nonce: 0                                                                    
2025-05-27T17:17:58.993843Z  WARN zksync_base_token_adjuster::base_token_ratio_provider: No latest price found in the database. Using default ratio.                                                                                                                          
2025-05-27T17:17:59.365872Z  INFO EthTxManager::loop_iteration: zksync_eth_sender::eth_tx_manager: Checking tx id: 1, operator_nonce: OperatorNonce { finalized: Nonce(0), latest: Nonce(0) }, tx nonce: 0                                                                    
2025-05-27T17:18:00.429060Z  INFO EthTxManager::loop_iteration: zksync_eth_sender::eth_tx_manager: Checking tx id: 1, operator_nonce: OperatorNonce { finalized: Nonce(0), latest: Nonce(0) }, tx nonce: 0                                                                    
2025-05-27T17:18:00.993727Z  WARN zksync_base_token_adjuster::base_token_ratio_provider: No latest price found in the database. Using default ratio.                                                                                                                          
2025-05-27T17:18:01.496726Z  INFO EthTxManager::loop_iteration: zksync_eth_sender::eth_tx_manager: Checking tx id: 1, operator_nonce: OperatorNonce { finalized: Nonce(0), latest: Nonce(0) }, tx nonce: 0                                                                    
2025-05-27T17:18:02.575320Z  INFO EthTxManager::loop_iteration: zksync_eth_sender::eth_tx_manager: Checking tx id: 1, operator_nonce: OperatorNonce { finalized: Nonce(0), latest: Nonce(1) }, tx nonce: 0                                                                    
2025-05-27T17:18:02.994572Z  WARN zksync_base_token_adjuster::base_token_ratio_provider: No latest price found in the database. Using default ratio.                                                                                                                          
2025-05-27T17:18:03.645453Z  INFO EthTxManager::loop_iteration: zksync_eth_sender::eth_tx_manager: Checking tx id: 1, operator_nonce: OperatorNonce { finalized: Nonce(0), latest: Nonce(1) }, tx nonce: 0                                                                    
2025-05-27T17:18:04.743921Z  INFO EthTxManager::loop_iteration: zksync_eth_sender::eth_tx_manager: Checking tx id: 1, operator_nonce: OperatorNonce { finalized: Nonce(0), latest: Nonce(1) }, tx nonce: 0                                                                    
2025-05-27T17:18:04.994762Z  WARN zksync_base_token_adjuster::base_token_ratio_provider: No latest price found in the database. Using default ratio.                                                                                                                          
2025-05-27T17:18:05.904645Z  INFO EthTxManager::loop_iteration: zksync_eth_sender::eth_tx_manager: Checking tx id: 1, operator_nonce: OperatorNonce { finalized: Nonce(0), latest: Nonce(1) }, tx nonce: 0                                                                    
2025-05-27T17:18:06.993954Z  WARN zksync_base_token_adjuster::base_token_ratio_provider: No latest price found in the database. Using default ratio.                                                                                                                          
2025-05-27T17:18:07.010861Z  INFO EthTxManager::loop_iteration: zksync_eth_sender::eth_tx_manager: Checking tx id: 1, operator_nonce: OperatorNonce { finalized: Nonce(0), latest: Nonce(1) }, tx nonce: 0                                                                    
2025-05-27T17:18:08.222233Z  INFO EthTxManager::loop_iteration: zksync_eth_sender::eth_tx_manager: Checking tx id: 1, operator_nonce: OperatorNonce { finalized: Nonce(0), latest: Nonce(1) }, tx nonce: 0                                                                    
2025-05-27T17:18:08.993839Z  WARN zksync_base_token_adjuster::base_token_ratio_provider: No latest price found in the database. Using default ratio.                                                                                                                          
2025-05-27T17:18:09.284024Z  INFO EthTxManager::loop_iteration: zksync_eth_sender::eth_tx_manager: Checking tx id: 1, operator_nonce: OperatorNonce { finalized: Nonce(0), latest: Nonce(1) }, tx nonce: 0                                                                    
2025-05-27T17:18:10.994653Z  WARN zksync_base_token_adjuster::base_token_ratio_provider: No latest price found in the database. Using default ratio.                                                                                                                          
2025-05-27T17:18:12.994169Z  WARN zksync_base_token_adjuster::base_token_ratio_provider: No latest price found in the database. Using default ratio.                                                                                                                          
2025-05-27T17:18:13.090208Z  INFO EthTxManager::loop_iteration: zksync_eth_sender::eth_tx_manager: Checking tx id: 1, operator_nonce: OperatorNonce { finalized: Nonce(1), latest: Nonce(1) }, tx nonce: 0                                                                    
2025-05-27T17:18:13.090230Z  INFO EthTxManager::loop_iteration: zksync_eth_sender::eth_tx_manager: Updating status of tx 1 of type CommitBlocks with nonce 0                                                                                                                  
2025-05-27T17:18:13.111473Z DEBUG EthTxManager::loop_iteration: zksync_health_check: Changed health of `eth_tx_manager` from {"status":"ready"} to {"status":"ready","details":{"finalized_block":8419018,"last_mined_tx":{"created_at_timestamp":1748031373,"nonce":0,"predic
ted_gas_cost":null,"status":{"receipt":{"blockHash":"0xa03c7475673c24d817716e0b4d606628d46c6c3588b9173a1ba53b7d3024b2cc","blockNumber":"0x8076ca","contractAddress":null,"cumulativeGasUsed":"0x54d0df","effectiveGasPrice":"0x363002ad0","from":"0x28d9c35a1b11d08ff3ecbe0227
5ae2619181052b","gasUsed":"0x3d578","logs":[],"logsBloom":"0x00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
000000000000000000000000000000000","root":null,"status":"0x0","to":"0x3e9db006039b07b1df17dec4bf7ce3748c3fda44","transactionHash":"0xdd20ce2555a5f46da849f9273aff2b6d44efaf51aac212807afe858de4f17842","transactionIndex":"0x42","type":"0x3"},"success":false,"tx_hash":"0xdd
20ce2555a5f46da849f9273aff2b6d44efaf51aac212807afe858de4f17842"},"tx_type":"Commit"}}}                                                                                                                                                                                        
2025-05-27T17:18:13.185455Z  WARN EthTxManager::loop_iteration:observe_error{network="ethereum_11155111" component="eth_tx_manager"}: zksync_web3_decl::client::metrics: Request `eth_call` failed with RPC error: ErrorObject { code: ServerError(3), message: "execution rev
erted", data: Some(RawValue("0xfc7ab1d30000000000000000000000000000000000000000000000000000000000000000")) } method="eth_call" code=3                                                                                                                                         
2025-05-27T17:18:13.185514Z ERROR EthTxManager::loop_iteration: zksync_eth_sender::eth_tx_manager: Eth tx failed EthTx { id: 1, nonce: Nonce(0), contract_address: 0x3e9db006039b07b1df17dec4bf7ce3748c3fda44, tx_type: Commit, created_at_timestamp: 1748031373, predicted_ga
s_cost: None, chain_id: Some(SLChainId(11155111)) }, TransactionReceipt { transaction_hash: 0xdd20ce2555a5f46da849f9273aff2b6d44efaf51aac212807afe858de4f17842, transaction_index: 66, block_hash: Some(0xa03c7475673c24d817716e0b4d606628d46c6c3588b9173a1ba53b7d3024b2cc), b
lock_number: Some(8419018), from: 0x28d9c35a1b11d08ff3ecbe02275ae2619181052b, to: Some(0x3e9db006039b07b1df17dec4bf7ce3748c3fda44), cumulative_gas_used: 5558495, gas_used: Some(251256), contract_address: None, logs: [], status: Some(0), root: None, logs_bloom: 0x0000000
000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
0000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000, transaction_type: Some(3), effect
ive_gas_price: Some(14545857232) }, failure reason Some(FailureInfo { revert_code: 3, revert_reason: "", gas_used: Some(251256), gas_limit: 15000000 })                                                                                                                       
thread 'tokio-runtime-worker' panicked at /usr/src/zksync/core/node/eth_sender/src/eth_tx_manager.rs:486:9:                                                                                                                                                                   
We can't operate after tx fail                                                                                                                                                                                                                                                
note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace                                                                                                                                                                                                 
2025-05-27T17:18:13.197838Z DEBUG zksync_health_check: Changed health of `eth_tx_manager` from {"status":"ready","details":{"finalized_block":8419018,"last_mined_tx":{"created_at_timestamp":1748031373,"nonce":0,"predicted_gas_cost":null,"status":{"receipt":{"blockHash":
"0xa03c7475673c24d817716e0b4d606628d46c6c3588b9173a1ba53b7d3024b2cc","blockNumber":"0x8076ca","contractAddress":null,"cumulativeGasUsed":"0x54d0df","effectiveGasPrice":"0x363002ad0","from":"0x28d9c35a1b11d08ff3ecbe02275ae2619181052b","gasUsed":"0x3d578","logs":[],"logsB
loom":"0x000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000","root":null,"stat
us":"0x0","to":"0x3e9db006039b07b1df17dec4bf7ce3748c3fda44","transactionHash":"0xdd20ce2555a5f46da849f9273aff2b6d44efaf51aac212807afe858de4f17842","transactionIndex":"0x42","type":"0x3"},"success":false,"tx_hash":"0xdd20ce2555a5f46da849f9273aff2b6d44efaf51aac212807afe85
8de4f17842"},"tx_type":"Commit"}}} to {"status":"panicked"}                                                                                                                                                                                                                   
2025-05-27T17:18:13.198382Z ERROR zksync_node_framework::service: Task eth_tx_manager panicked: We can't operate after tx fail                                                                                                                                                
2025-05-27T17:18:13.199027Z  INFO zksync_node_framework::service: One of the task has exited, shutting down the node          

Please can you help? Thank you.

Expected Behavior

The transaction should be executed successfully

Current Behavior

The transaction failed.

Repository Link (if applicable)

No response

Additional Details

No response

Prior Research

• Yes, I searched for similar issues and did not find any matching ones.

[bxpana]

@moneta have you run this before on another branch? What other errors are you getting from different branches?

[moneta]

I tried with many branches but there are different bugs with each branch on deployment:

• The currently latest main branch: error with contract size. I reported it here [ZK Stack] - Zkstack ecosystem deployment - contract size limit error #1022
• I also got deployment errors with branch v28, then I downgrade to the lower versions. After a few deployments the version core-v27.3.0 passed the deployment

[moneta]

Is it possible because of the constant COMMIT_TIMESTAMP_NOT_OLDER is set to 3 days and the batch commit is later than that?

uint256 constant COMMIT_TIMESTAMP_NOT_OLDER = 3 days;

[moneta]

I re-deployed the ecosystem and start the sequencer node right after genesis then it works. So most probably the issue is with the verification of block timestamp not to be older than 3 days. However the error message is misleading. It would be a better to have different error, for example: "Block timestamp is too old".

[bxpana]

I re-deployed the ecosystem and start the sequencer node right after genesis then it works.

Before were you waiting 3+ days before starting the sequencer? Will bring up changing the error message and see if we can make it more clear.

For #1022 do you still need assistance with that, or now that you have things working you're good? IIUC you're now running on v27?

[moneta]

I actually ran the sequencer right after installation. However, I forgot to top up the Blob operator account with ETH so the first tx (commit block) never got sent successfully. Then it was memorial public holiday. So when I came back and topped up the blob account, it was from last Friday to Tuesday, which is more than 3 days.

Yes, I still need help with the ticket #1022

Thank you very much.

[dutterbutter]

Closing this issue as it seems resolved. Please re-open and add an update if issue is still relevant / continues.