wiki:doc/TorBOX/Dev/BuildDocumentation/0.3.0

Version 4 (modified by proper, 7 years ago) (diff)

--

aos Homepage

NOT FINISHED!

# Copyright:
# adrelanos (aka proper)
# adrelanos (at) riseup (dot) net
#
# License:
# GPL v3 or any later
#
# Any changes you pull into this source will be also licensed
# under GPL v3 or any later. Additionally you grant adrelanos the right to
# re-license your work under a different license. If that is not acceptable,
# you can either fork this source under GPL v3 or any later or contact
# adrelanos. Contact adrelanos, if you require this source code under
# different license.
#
# Authors:
# adrelanos (aka proper)
# Big contributions from anonymous.
# Leaktest and other stuff contributed by smarm.

This page documents how the binary distribution images are built. If you have any questions or need help let us know on /aos/Dev#Question.

Following these instructions will build version aos 0.3.0 based on Tor 0.2.3 and Ubuntu Precise.

Knowledge assumed: Virtualization and networking basic principles; operation of your platform; Linux knowledge: how to install Ubuntu and basic command line knowledge.

Only one prerequisites: you need a working internet connection.

For discussion related to the development and build process of aos images go aos/Dev/.

Build Anonymity

While downloading the required tools for building aos your internet service provider could if he want notice that you want to build aos. This is esspecially interesting, if you want to redistribute aos, but still want to stay anonymous. The full story can be read in the chapter Build Anonymity.

Build Security

  • Build on a dedicated build system, install security updates...
  • All install media and all downloaded/used code must be verified (including all software on the host).
  • Hashes or fingerprints listed on the wiki are not to be trusted, same goes for the scripts, verify them (and make use of the history feature).
  • Read aos/Trust

Host preparation

Read and apply if necessary Network Time Syncing!

We recommend you use a dedicated OS installation just for hosting the aos VMs (See aos/SecurityAndHardening)

You need to use Ubuntu. The build scripts could be adapted to run on other *NIX systems as well but currently they assume apt-get to be available. You need about 15 GB of free space.

Install the latest security updates, install VirtualBox (and qemu-kvm which is required to mount the Virtual Box .vdi images). Reboot to apply kernel updates.

sudo apt-get update && sudo apt-get dist-upgrade
sudo apt-get install virtualbox qemu genisoimage
sudo reboot

If you are going to use Virtual Box inside Virtual Box, be sure to change your host key. Virtual Box -> Preferences -> Input -> Host Key. The "outside" and the "inside" Host Key must differ, otherwise you can not leave the VM "inside" anymore. The "outside" Virtual Box hostkey may NOT be ctrl.1
1 Because the one is used by VBoxSDL "inside".

Building on Windows is no longer supported. Redistributed aos builds should be build on Linux. If you want to port the aos build scripts to Windows, please contact us. Running aos on a Windows host with Virtual Box installed should still be possible.

Using an apt cacher to speed up downloading

OPTIONAL

Does only work with aos-Gateway. Does not work for aos-Workstation because it never gets direct access to the host by design. We could think about installing apt-cacher-ng on aos-Gateway, if there are any security implications.

Go to aos_Gateway script and comment in the line Acquire::http { Proxy "http://192.168.0.2:3142"; };, i.e. remove the # (hash) in front of it.

If you want to build multiple times (for debugging etc.), it might make sense to install a local apt proxy on your build machine. That safes download time and traffic. Thanks to source.

sudo apt-get install apt-cacher-ng
sudo nano /etc/apt/apt.conf
Acquire::http { Proxy "http://127.0.0.1:3142"; };
sudo apt-get update

Source Code Intro

If you prefer to read and understand the source code just by reading scripts you may skip this optional chapter. This chapter is dedicated to give an introduction into the aos source code. It can be quite difficult to get started with hacking existing big complex projects.

aos_Build is a script, which simply runs all other scripts. Actually it's "optional". It has very little functionality beside running all other scripts. You are free to run all scripts one by one. That is useful for learning and for debugging purposes. In case you want to fix a bug or in case you want to upgrade the distribution or in case you want to switch the operating system or whatever you are better off running the steps manually. You can use the Build script as a reference for which steps have to be run in which order.

Ironically currently most scripts are used to create a virtual machine image, which contains the operating system and the either the aos_Gateway or the aos_Workstation script. Scripts needed for creation the virtual machine image are aos_GetISO, aos_ModifyISO, aos_CreateVM and aos_Image. GetISO downloads and verifies the operating system iso image.

ModifyISO mounts the downloaded iso image as read only, copies it, modifies the copied iso image by adding preseeding (unattended installation), unmounts the iso and finally creates preseed.iso, which contains the operating system installer disc modified not to require any user interaction while installing. This process already sets up lots of important privacy settings and other stuff, such as UTC timezone, hostname ubuntu, US language, username user and so on. (See aos/SecurityAndHardening and the ModifyISO script itself for a list of all changes and why.) Preseed.iso is configured to power off itself when it's done installing so the aos_Build script can continue.

aos_CreateVM creates VirtualBox machines with all settings required for secure networking, devices, security settings. Which those settings are in details can be again read in Security And Hardening or the script itself. CreateVM is also responsible for starting virtual machines while building. That happens two times, the first time the operating system will be installed and the second time either the aos_Gateway or the aos_Workstation script will be installed.

aos_Image allow to mount the virtual hdd images. This is required because we have to somehow get the aos_Gateway or the aos_Workstation script into the virtual hdds, so we can install them. With aos 0.1.3 we used ssh, but that was suboptimal. 1 Image also allows to copy the aos_Gateway or the aos_Workstation script to /usr/local/bin/ inside the virtual hdd images. It also adds autostarting them only once as soon as the virtual machine gets started next time. This is done by adding the script to /etc/rc.local. rc.local will look if the installer log exists and if that is so, the script will not be run again. rc.local will also power off the VM if the aos_Gateway or aos_Workstation script finished. 2

1 It required manually installing an ssh server just for getting the script into the virtual hdds. Ok, that could also be done with preseed. But it involves weakening the isolation of the VM from the host. The MAC address of the host could be seen my the VM.
2 /etc/rc.local will be reverted by the aos_Gateway or the aos_Workstation script.

aos_Gateway or the aos_Workstation will transform the installed operating system into the aos-Gateway or into the aos-Workstation. They update the system, install security relevant software, install useful applications for an anonymous general purpose operating system, set up all relevant privacy and anonymity required settings, desktop manager etc.

Thus, given the nature of the build step orientated scripts, you can easily work on the the different aspects of aos. For example, once you have created a clean virtual machine with the operating system only, you can make a clone or snapshot, run either the aos_Gateway or the aos_Workstation script as often as you need to test your changes and if something goes wrong, go back to the clone or snapshot. You don't have to build everything from scratch again. 3

3 For example, we could add the aos_Gateway or aos_Workstation script to the preseed.iso and let it run after installing. If something would go wrong, you would have to reinstall the whole operating system every time again. That's why we use separate steps.

The torcheck script will only be copied into aos-Workstation and is supposed to be run in aos-Workstation only. Checks network connection, Tor Browser version, SocksPort and TransPort IP and stream isolation.

Get the aos source code

Get all our scripts (currently 8) and save them in one folder, it's best to create a new folder called aos_src in your home directory. It is important that they are all named correctly!

Check the source code for error or malicious edits. Make use of the history feature of torproject.org's wiki.

"aos_Build" script
https://trac.torproject.org/projects/tor/wiki/doc/TorBOX/Dev/Build

"aos_GetISO" script
https://trac.torproject.org/projects/tor/wiki/doc/TorBOX/Dev/GetISO

"aos_ModifyISO" script
https://trac.torproject.org/projects/tor/wiki/doc/TorBOX/Dev/ModifyISO

"aos_CreateVM" script
https://trac.torproject.org/projects/tor/wiki/doc/TorBOX/Dev/CreateVM

"aos_Image" script
https://trac.torproject.org/projects/tor/wiki/doc/TorBOX/Dev/Image

"aos-Gateway" script
https://trac.torproject.org/projects/tor/wiki/doc/TorBOX/Dev/TGScript

"aos-Workstation" script
https://trac.torproject.org/projects/tor/wiki/doc/TorBOX/Dev/TWScript

"torcheck" script
https://trac.torproject.org/projects/tor/wiki/doc/TorBOX/Dev/torcheck

Create the Images

Preparations

Make the build script executable:

chmod +x ~/aos_source/aos_*

Make sure there aren't any VMs in VirtualBox already called "aos-Gateway" or "aos-Workstation" (TODO: automate that)

VM Creation

-all not supported yet.

  1. Open a shell and type:
    sudo ~/aos_source/aos_Build -tg
    
  1. Check if all went ok.
  1. Power on aos_Gateway
  1. Open a shell and type:
    sudo ~/aos_source/aos_Build -tw
    

The scripts can fail for many reasons, please report back any issues!

How to use the ova images

Reboot both VMs. Please read the Readme!

Final Steps (Only Required For Redistribution)

  • Leak Testing!
  • Test the images before release! TODO: Needs big revision with all aos features.
  • Update the Changelog.
  • Create hash sums for verification.
    sha512sum aos-Gateway.ova
    sha512sum aos-Workstation.ova
    
  • Upload the images.
  • Post hash sums to build documentation.
  • Post download links to build documentation.
  • At least a few testers should test before posting a news. Testers may be found by posting a news.
  • Finally announce: Post a news.