feat(l1): add --input_dir and --output_dir options to archive sync (#3962)

**Motivation**
Allow writing dump state to files while archive syncing and using them
for archive syncing without the need of an active archive node .
This PR adds the following flags:
* `--ipc_path`: replaces the previously required `archive_node_ipc`
required unnamed arg
* `--output_dir`: outputs the state data received during the sync to the
given directory
* `--input_dir`: allows fetching state data from a previous archive sync
execution instead of an archive node
* `--no_sync`: skips state rebuild, only usable with `--output_dir` to
speed up state data writing when syncing the current node is not needed
<!-- Why does this pull request exist? What are its goals? -->

**Description**
* Adds new CLI flags `--ipc_path`, `--input_dir`, `--output_dir`,
`--no_sync`
* Abstracts archive sync main behaviour into structs to accommodate new
features:
* DumpReader: Allows reading state data from either an ipc connection or
a directory
* DumpProcessor: Processes state data by either using it to rebuild the
state and/or writing it to a file
<!-- A clear and concise general description of the changes this PR
introduces -->

<!-- Link to issues: Resolves #111, Resolves #222 -->

Closes #issue_number

Author: fmoletta

crates/common/serde_utils.rs

@@ -7,6 +7,24 @@ pub mod u256 {
     use ethereum_types::U256;
     use serde_json::Number;
 
+    pub mod dec_str {
+        use super::*;
+        pub fn deserialize<'de, D>(d: D) -> Result<U256, D::Error>
+        where
+            D: Deserializer<'de>,
+        {
+            let value = String::deserialize(d)?;
+            U256::from_dec_str(&value).map_err(|e| D::Error::custom(e.to_string()))
+        }
+
+        pub fn serialize<S>(value: &U256, serializer: S) -> Result<S::Ok, S::Error>
+        where
+            S: Serializer,
+        {
+            serializer.serialize_str(&value.to_string())
+        }
+    }
+
     pub fn deser_number<'de, D>(d: D) -> Result<U256, D::Error>
     where
         D: Deserializer<'de>,
@@ -33,14 +51,6 @@ pub mod u256 {
         }
     }
 
-    pub fn deser_dec_str<'de, D>(d: D) -> Result<U256, D::Error>
-    where
-        D: Deserializer<'de>,
-    {
-        let value = String::deserialize(d)?;
-        U256::from_dec_str(&value).map_err(|e| D::Error::custom(e.to_string()))
-    }
-
     pub fn deser_hex_str<'de, D>(d: D) -> Result<U256, D::Error>
     where
         D: Deserializer<'de>,

crates/networking/rpc/clients/beacon/types.rs

@@ -15,7 +15,7 @@ pub struct GetBlockResponseData {
 // Actual response has many more fields, but we only care about `slot` for now
 #[derive(Deserialize, Debug)]
 pub struct GetBlockResponseMessage {
-    #[serde(deserialize_with = "ethrex_common::serde_utils::u256::deser_dec_str")]
+    #[serde(with = "ethrex_common::serde_utils::u256::dec_str")]
     pub slot: U256,
 }
 

tooling/archive_sync/README.md

@@ -54,9 +54,27 @@ This executable takes 3 arguments:
 With these arguments you can run the following command from this directory:
 
 ```bash
- cargo run --release IPC_PATH BLOCK_NUMBER
+ cargo run --release  BLOCK_NUMBER --ipc_path IPC_PATH
 ```
 
 And adding `--datadir DATADIR` if you want to use a custom directory
 
 While archive sync is faster than the alternatives (snap, full) it can still take a long time on later blocks of large chains
+
+## Usage without an active archive node connection
+
+We can avoid relying on an active archive node connection once we have already performed the first sync by writing the state dump to a directory. Note that this will still require an active archive node for the first step.
+
+### Step 1: Run the `archive_sync` executable as usual with `--output_dir` flag
+
+```bash
+ cargo run --release BLOCK_NUMBER --ipc_path IPC_PATH --output_dir STATE_DUMP_DIR
+```
+
+If we don't need the node to be synced (for example if we plan to move the state dump to another server after the sync) we can also add the flag `--no_sync` to skip the state sync and only write the state data to files.
+
+### Step 2: Run the `archive_sync` executable with `--input_dir` instead of `--ipc-path`
+
+```bash
+ cargo run --release BLOCK_NUMBER --input_dir STATE_DUMP_DIR
+```