r00t2/optools
1
0
Fork 0
Code Issues Pull Requests Projects Releases Activity

check-in for mirror checker

Browse Source
This commit is contained in:
brent s
2017-10-08 20:05:50 -04:00
parent 54751f9753
commit f47f2f8640
3 changed files with 169 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

15
net/mirroring/urls.csv.spec Normal file
View File

@@ -0,0 +1,15 @@
"UUID","URL","SHA512_of_CONTENT","LAST_FETCHED_IN_UNIX_EPOCH"
UUID can be any non-whitespace, non-slashed string suitable for filenames you want, but I recommend a UUID4.
You can generate one at either https://www.uuidgenerator.net/ or via python:
>>> import uuid
>>> str(uuid.uuid4())
'16728c9e-5fde-4f63-8a36-4a3db612be8d'
It should be unique for every page.
You can generate an UNIX Epoch timestamp via:
date '+%s'