Replace MD5 with SHA-256 for manifest content hashing

Author: sahilsunny

.agents/skills/scrapingbee-cli/reference/batch/export.md

@@ -27,7 +27,7 @@ scrapingbee export --output-file results.csv --input-dir products/ --format csv
 
 **csv output:** Flattens JSON files into tabular rows. For API responses that contain a list (e.g. `organic_results`, `products`, `results`), each list item becomes a row. For single-object responses (e.g. a product page), the object itself is one row. Use `--flatten` to expand nested dicts into dot-notation columns. Use `--columns` to select specific fields and drop incomplete rows. `_url` column is added when `manifest.json` is present.
 
-**manifest.json (batch and crawl):** Both `scrape` batch runs and `crawl` write `manifest.json` to the output directory. Format: `{"<input>": {"file": "N.ext", "fetched_at": "<ISO-8601 UTC>", "http_status": 200, "credits_used": 5, "latency_ms": 1234, "content_md5": "<md5>"}}`. Useful for audit trails and monitoring workflows. The `export` command reads both old (plain string values) and new (dict values) manifest formats.
+**manifest.json (batch and crawl):** Both `scrape` batch runs and `crawl` write `manifest.json` to the output directory. Format: `{"<input>": {"file": "N.ext", "fetched_at": "<ISO-8601 UTC>", "http_status": 200, "credits_used": 5, "latency_ms": 1234, "content_sha256": "<sha256>"}}`. Useful for audit trails and monitoring workflows. The `export` command reads both old (plain string values) and new (dict values) manifest formats.
 
 ## Resume an interrupted batch
 

.agents/skills/scrapingbee-cli/reference/batch/output.md

@@ -42,15 +42,15 @@ Every batch run writes a `manifest.json` to the output folder:
     "http_status": 200,
     "credits_used": 5,
     "latency_ms": 1234,
-    "content_md5": "d41d8cd98f00b204e9800998ecf8427e"
+    "content_sha256": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855"
   },
   "https://example2.com": {
     "file": "2.html",
     "fetched_at": "2025-01-15T10:30:02",
     "http_status": 200,
     "credits_used": 5,
     "latency_ms": 876,
-    "content_md5": "7215ee9c7d9dc229d2921a40e899ec5f"
+    "content_sha256": "a591a6d40bf420404a011733cfb7b190d62c65bf0bcda32b57b277d9ad9f146e"
   }
 }
 ```
@@ -62,6 +62,6 @@ Every batch run writes a `manifest.json` to the output folder:
 | `http_status` | HTTP status code returned by the target site |
 | `credits_used` | Credits consumed (from `Spb-Cost` response header) |
 | `latency_ms` | Round-trip latency in milliseconds |
-| `content_md5` | MD5 hash of the raw response body — use to detect duplicate content or page changes across runs |
+| `content_sha256` | SHA-256 hash of the raw response body — use to detect duplicate content or page changes across runs |
 
 The manifest is used by `--resume` to skip already-completed items.

.github/skills/scrapingbee-cli/reference/batch/export.md

@@ -27,7 +27,7 @@ scrapingbee export --output-file results.csv --input-dir products/ --format csv
 
 **csv output:** Flattens JSON files into tabular rows. For API responses that contain a list (e.g. `organic_results`, `products`, `results`), each list item becomes a row. For single-object responses (e.g. a product page), the object itself is one row. Use `--flatten` to expand nested dicts into dot-notation columns. Use `--columns` to select specific fields and drop incomplete rows. `_url` column is added when `manifest.json` is present.
 
-**manifest.json (batch and crawl):** Both `scrape` batch runs and `crawl` write `manifest.json` to the output directory. Format: `{"<input>": {"file": "N.ext", "fetched_at": "<ISO-8601 UTC>", "http_status": 200, "credits_used": 5, "latency_ms": 1234, "content_md5": "<md5>"}}`. Useful for audit trails and monitoring workflows. The `export` command reads both old (plain string values) and new (dict values) manifest formats.
+**manifest.json (batch and crawl):** Both `scrape` batch runs and `crawl` write `manifest.json` to the output directory. Format: `{"<input>": {"file": "N.ext", "fetched_at": "<ISO-8601 UTC>", "http_status": 200, "credits_used": 5, "latency_ms": 1234, "content_sha256": "<sha256>"}}`. Useful for audit trails and monitoring workflows. The `export` command reads both old (plain string values) and new (dict values) manifest formats.
 
 ## Resume an interrupted batch
 

.github/skills/scrapingbee-cli/reference/batch/output.md

@@ -42,15 +42,15 @@ Every batch run writes a `manifest.json` to the output folder:
     "http_status": 200,
     "credits_used": 5,
     "latency_ms": 1234,
-    "content_md5": "d41d8cd98f00b204e9800998ecf8427e"
+    "content_sha256": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855"
   },
   "https://example2.com": {
     "file": "2.html",
     "fetched_at": "2025-01-15T10:30:02",
     "http_status": 200,
     "credits_used": 5,
     "latency_ms": 876,
-    "content_md5": "7215ee9c7d9dc229d2921a40e899ec5f"
+    "content_sha256": "a591a6d40bf420404a011733cfb7b190d62c65bf0bcda32b57b277d9ad9f146e"
   }
 }
 ```
@@ -62,6 +62,6 @@ Every batch run writes a `manifest.json` to the output folder:
 | `http_status` | HTTP status code returned by the target site |
 | `credits_used` | Credits consumed (from `Spb-Cost` response header) |
 | `latency_ms` | Round-trip latency in milliseconds |
-| `content_md5` | MD5 hash of the raw response body — use to detect duplicate content or page changes across runs |
+| `content_sha256` | SHA-256 hash of the raw response body — use to detect duplicate content or page changes across runs |
 
 The manifest is used by `--resume` to skip already-completed items.

.kiro/skills/scrapingbee-cli/reference/batch/export.md

@@ -27,7 +27,7 @@ scrapingbee export --output-file results.csv --input-dir products/ --format csv
 
 **csv output:** Flattens JSON files into tabular rows. For API responses that contain a list (e.g. `organic_results`, `products`, `results`), each list item becomes a row. For single-object responses (e.g. a product page), the object itself is one row. Use `--flatten` to expand nested dicts into dot-notation columns. Use `--columns` to select specific fields and drop incomplete rows. `_url` column is added when `manifest.json` is present.
 
-**manifest.json (batch and crawl):** Both `scrape` batch runs and `crawl` write `manifest.json` to the output directory. Format: `{"<input>": {"file": "N.ext", "fetched_at": "<ISO-8601 UTC>", "http_status": 200, "credits_used": 5, "latency_ms": 1234, "content_md5": "<md5>"}}`. Useful for audit trails and monitoring workflows. The `export` command reads both old (plain string values) and new (dict values) manifest formats.
+**manifest.json (batch and crawl):** Both `scrape` batch runs and `crawl` write `manifest.json` to the output directory. Format: `{"<input>": {"file": "N.ext", "fetched_at": "<ISO-8601 UTC>", "http_status": 200, "credits_used": 5, "latency_ms": 1234, "content_sha256": "<sha256>"}}`. Useful for audit trails and monitoring workflows. The `export` command reads both old (plain string values) and new (dict values) manifest formats.
 
 ## Resume an interrupted batch
 

.kiro/skills/scrapingbee-cli/reference/batch/output.md

@@ -42,15 +42,15 @@ Every batch run writes a `manifest.json` to the output folder:
     "http_status": 200,
     "credits_used": 5,
     "latency_ms": 1234,
-    "content_md5": "d41d8cd98f00b204e9800998ecf8427e"
+    "content_sha256": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855"
   },
   "https://example2.com": {
     "file": "2.html",
     "fetched_at": "2025-01-15T10:30:02",
     "http_status": 200,
     "credits_used": 5,
     "latency_ms": 876,
-    "content_md5": "7215ee9c7d9dc229d2921a40e899ec5f"
+    "content_sha256": "a591a6d40bf420404a011733cfb7b190d62c65bf0bcda32b57b277d9ad9f146e"
   }
 }
 ```
@@ -62,6 +62,6 @@ Every batch run writes a `manifest.json` to the output folder:
 | `http_status` | HTTP status code returned by the target site |
 | `credits_used` | Credits consumed (from `Spb-Cost` response header) |
 | `latency_ms` | Round-trip latency in milliseconds |
-| `content_md5` | MD5 hash of the raw response body — use to detect duplicate content or page changes across runs |
+| `content_sha256` | SHA-256 hash of the raw response body — use to detect duplicate content or page changes across runs |
 
 The manifest is used by `--resume` to skip already-completed items.

.opencode/skills/scrapingbee-cli/reference/batch/export.md

@@ -27,7 +27,7 @@ scrapingbee export --output-file results.csv --input-dir products/ --format csv
 
 **csv output:** Flattens JSON files into tabular rows. For API responses that contain a list (e.g. `organic_results`, `products`, `results`), each list item becomes a row. For single-object responses (e.g. a product page), the object itself is one row. Use `--flatten` to expand nested dicts into dot-notation columns. Use `--columns` to select specific fields and drop incomplete rows. `_url` column is added when `manifest.json` is present.
 
-**manifest.json (batch and crawl):** Both `scrape` batch runs and `crawl` write `manifest.json` to the output directory. Format: `{"<input>": {"file": "N.ext", "fetched_at": "<ISO-8601 UTC>", "http_status": 200, "credits_used": 5, "latency_ms": 1234, "content_md5": "<md5>"}}`. Useful for audit trails and monitoring workflows. The `export` command reads both old (plain string values) and new (dict values) manifest formats.
+**manifest.json (batch and crawl):** Both `scrape` batch runs and `crawl` write `manifest.json` to the output directory. Format: `{"<input>": {"file": "N.ext", "fetched_at": "<ISO-8601 UTC>", "http_status": 200, "credits_used": 5, "latency_ms": 1234, "content_sha256": "<sha256>"}}`. Useful for audit trails and monitoring workflows. The `export` command reads both old (plain string values) and new (dict values) manifest formats.
 
 ## Resume an interrupted batch
 

.opencode/skills/scrapingbee-cli/reference/batch/output.md

@@ -42,15 +42,15 @@ Every batch run writes a `manifest.json` to the output folder:
     "http_status": 200,
     "credits_used": 5,
     "latency_ms": 1234,
-    "content_md5": "d41d8cd98f00b204e9800998ecf8427e"
+    "content_sha256": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855"
   },
   "https://example2.com": {
     "file": "2.html",
     "fetched_at": "2025-01-15T10:30:02",
     "http_status": 200,
     "credits_used": 5,
     "latency_ms": 876,
-    "content_md5": "7215ee9c7d9dc229d2921a40e899ec5f"
+    "content_sha256": "a591a6d40bf420404a011733cfb7b190d62c65bf0bcda32b57b277d9ad9f146e"
   }
 }
 ```
@@ -62,6 +62,6 @@ Every batch run writes a `manifest.json` to the output folder:
 | `http_status` | HTTP status code returned by the target site |
 | `credits_used` | Credits consumed (from `Spb-Cost` response header) |
 | `latency_ms` | Round-trip latency in milliseconds |
-| `content_md5` | MD5 hash of the raw response body — use to detect duplicate content or page changes across runs |
+| `content_sha256` | SHA-256 hash of the raw response body — use to detect duplicate content or page changes across runs |
 
 The manifest is used by `--resume` to skip already-completed items.

plugins/scrapingbee-cli/skills/scrapingbee-cli/reference/batch/export.md

@@ -27,7 +27,7 @@ scrapingbee export --output-file results.csv --input-dir products/ --format csv
 
 **csv output:** Flattens JSON files into tabular rows. For API responses that contain a list (e.g. `organic_results`, `products`, `results`), each list item becomes a row. For single-object responses (e.g. a product page), the object itself is one row. Use `--flatten` to expand nested dicts into dot-notation columns. Use `--columns` to select specific fields and drop incomplete rows. `_url` column is added when `manifest.json` is present.
 
-**manifest.json (batch and crawl):** Both `scrape` batch runs and `crawl` write `manifest.json` to the output directory. Format: `{"<input>": {"file": "N.ext", "fetched_at": "<ISO-8601 UTC>", "http_status": 200, "credits_used": 5, "latency_ms": 1234, "content_md5": "<md5>"}}`. Useful for audit trails and monitoring workflows. The `export` command reads both old (plain string values) and new (dict values) manifest formats.
+**manifest.json (batch and crawl):** Both `scrape` batch runs and `crawl` write `manifest.json` to the output directory. Format: `{"<input>": {"file": "N.ext", "fetched_at": "<ISO-8601 UTC>", "http_status": 200, "credits_used": 5, "latency_ms": 1234, "content_sha256": "<sha256>"}}`. Useful for audit trails and monitoring workflows. The `export` command reads both old (plain string values) and new (dict values) manifest formats.
 
 ## Resume an interrupted batch
 

plugins/scrapingbee-cli/skills/scrapingbee-cli/reference/batch/output.md

@@ -42,15 +42,15 @@ Every batch run writes a `manifest.json` to the output folder:
     "http_status": 200,
     "credits_used": 5,
     "latency_ms": 1234,
-    "content_md5": "d41d8cd98f00b204e9800998ecf8427e"
+    "content_sha256": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855"
   },
   "https://example2.com": {
     "file": "2.html",
     "fetched_at": "2025-01-15T10:30:02",
     "http_status": 200,
     "credits_used": 5,
     "latency_ms": 876,
-    "content_md5": "7215ee9c7d9dc229d2921a40e899ec5f"
+    "content_sha256": "a591a6d40bf420404a011733cfb7b190d62c65bf0bcda32b57b277d9ad9f146e"
   }
 }
 ```
@@ -62,6 +62,6 @@ Every batch run writes a `manifest.json` to the output folder:
 | `http_status` | HTTP status code returned by the target site |
 | `credits_used` | Credits consumed (from `Spb-Cost` response header) |
 | `latency_ms` | Round-trip latency in milliseconds |
-| `content_md5` | MD5 hash of the raw response body — use to detect duplicate content or page changes across runs |
+| `content_sha256` | SHA-256 hash of the raw response body — use to detect duplicate content or page changes across runs |
 
 The manifest is used by `--resume` to skip already-completed items.