You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: README.md
+2-2Lines changed: 2 additions & 2 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1,6 +1,6 @@
1
1
# CC-Downloader
2
2
3
-
This is an experimental polite downloader for Common Crawl data writter in `rust`. This tool is intended for use outside of AWS.
3
+
This is an experimental polite downloader for Common Crawl data written in `rust`. This tool is intended for use outside of AWS.
4
4
5
5
## Todo
6
6
@@ -71,4 +71,4 @@ Options:
71
71
72
72
## Number of threads
73
73
74
-
The number of threads can be set using the `-t` flag. The default value is 10. It is advised to use the default value to avoid being blocked by the server. If you make too many requests in a short period of time, you will satrt receiving `403` errors which are unrecoverable and cannot be retried by the downloader.
74
+
The number of threads can be set using the `-t` flag. The default value is 10. It is advised to use the default value to avoid being blocked by the server. If you make too many requests in a short period of time, you will start receiving `403` errors which are unrecoverable and cannot be retried by the downloader.
0 commit comments