Changes between Version 2 and Version 3 of doc/DataExtractionForComparison


Ignore:
Timestamp:
Jun 7, 2012, 12:43:42 PM (7 years ago)
Author:
bastik
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • doc/DataExtractionForComparison

    v2 v3  
    11'''[wiki:DataExtractionForComparison Data extraction for Comparison]'''
    22
     3Here is the the modified batch to even more some steps
     4
     5{{{
     6@ECHO OFF
     7
     8REM Download the tarballs manually and unpack them
     9
     10REM Put the relay data in X:\consensuses-2012-03
     11
     12REM Put the bridge data in X:\bridge-descriptors-2012-03
     13 
     14ECHO Extracting nickname lines using grep
     15
     16"C:\Program Files (x86)\GnuWin32\bin\grep.exe" -r -h 2012 X:\consensuses-2012-03 > X:\dump.txt
     17
     18"C:\Program Files (x86)\GnuWin32\bin\grep.exe" -r -h 2012 X:\bridge-descriptors-2012-03\statuses > X:\dump2.txt
     19
     20ECHO Printing the second column of relays to file
     21
     22"C:\Program Files (x86)\GnuWin32\bin\awk.exe" {print$2} X:\dump.txt > X:\print.txt
     23
     24ECHO Printing the second column of bridges to file
     25
     26"C:\Program Files (x86)\GnuWin32\bin\awk.exe" {print$2} X:\dump2.txt > X:\print2.txt
     27
     28REM Sorting first to use uniq without arguments
     29
     30ECHO Please wait while the lines get sorted
     31
     32"C:\Program Files (x86)\GnuWin32\bin\sort.exe" X:\print.txt > X:\sorted.txt
     33
     34"C:\Program Files (x86)\GnuWin32\bin\sort.exe" X:\print2.txt > X:\sorted2.txt
     35
     36REM Then using uniq
     37
     38ECHO Keeping only unique names
     39
     40"C:\Program Files (x86)\GnuWin32\bin\uniq.exe" X:\sorted.txt > X:\unique.txt
     41
     42"C:\Program Files (x86)\GnuWin32\bin\uniq.exe" X:\sorted2.txt > X:\unique2.txt
     43
     44REM Turned out that I need the dump sorted
     45
     46ECHO Please wait while the dump gets sorted
     47
     48"C:\Program Files (x86)\GnuWin32\bin\sort.exe" X:\dump.txt > X:\dump_sorted.txt
     49
     50"C:\Program Files (x86)\GnuWin32\bin\sort.exe" X:\dump2.txt > X:\dump2_sorted.txt
     51
     52REM now you need to remove the dates manually from both unique.txt files
     53
     54ECHO Please press any file to close this
     55
     56PAUSE
     57
     58EXIT
     59}}}
     60----
    361The improved way of May 2012 for comparing March 2012 nicknames :
    462