Torrent Distribution with WPKG

From WPKG | Open Source Software Deployment and Distribution
Jump to: navigation, search

Generating a torrent

I used python3 and py3createtorrent [1].

The following line generates a Matlab torrent seed file, with 8MiB chunks, one level up from the R2013a directory, so that the torrent creates "R2013a" when unpacked. It excludes all the win64 folders from the torrent so this particular example is for x86 only.

cd /mnt/REDACT/Matlab/
python3 /usr/local/bin/py3createtorrent/ -p 8192 -f -v R2013a localhost --exclude-pattern=win64$ -o /mnt/REDACT/torrents/Matlab#R2013a.x86.torrent

The Batch File

This batch file is placed at a path on your software repository.

TRACKER should be set to your bittorrent tracker, unless you use LPD (local peer discovery), which is enabled in the aria2c command.

ARIA should be set to the path to your aria2c binary.

Call script with PATH\TO\torrent.cmd PATH\TO\file.torrent PATH\TO\localsavepath.

@echo off

set DEST=%~2


:: subroutine handling
if "%3"=="seed" goto seed

:: allow aria2c free rein
netsh advfirewall firewall add rule name="aria-in" program="%ARIA%" dir=in action=allow enable=yes >NUL
netsh advfirewall firewall add rule name="aria-out" program="%ARIA%" dir=out action=allow enable=yes >NUL
goto fetch

cd "%DEST%\.."
%ARIA% "%TORRENTFILE%" --seed-ratio=0 --enable-dht=false --bt-enable-lpd=true --bt-seed-unverified=true --seed-time=10 --bt-exclude-tracker=* --bt-tracker=%TRACKER%/announce 

if not exist "%DEST%" mkdir "%DEST%"
cd %DEST%\..
%ARIA% "%TORRENTFILE%" -V --bt-stop-timeout=180 --bt-enable-lpd=true --allow-overwrite=true --enable-dht=false --seed-time=0 --file-allocation=none --bt-exclude-tracker=* --bt-tracker=%TRACKER%/announce

:: be a good neighbour - seed for 10 minutes to provide help to peers, particularly to nearby peers
if %RETURN%==0 (
	start /min %0 "%TORRENTFILE%" "%DEST%" seed
	:: future use - setup mode nexgen fix seeding for imaging; spin up startup seeds
	echo "%TORRENTFILE%","%DEST%" >> c:\nexgen\local-cache\completed-torrents.cmd

:: if RETURN=1, the most likely error is some problem with the DEST; get it on the next run
if %RETURN%==1 rmdir /s /q "%DEST%"

netsh advfirewall firewall delete rule name="aria-in" >NUL
netsh advfirewall firewall delete rule name="aria-out" >NUL
exit /B %RETURN%

Setting up the server

You need a server somewhere set up with some kind of tracker (unless you use LPD); I used opentracker, which is trivially easy to set up and runs on port 6969. [2], and aria2c, available as a package from your local vendor.

On the server, you need access to a seed copy of the software. I did this by mounting it via CIFS from our central server (as I need to support robocopy still for other departments), but a local copy somewhere on the machine is also perfectly good; better, even.

We decided to put the torrent files on a separate folder in our repository.

Then, start the torrent. For example:

aria2c -T /mnt/REDACT/torrents/Matlab#R2012a.x64.torrent -d /mnt/REDACT/Matlab --bt-seed-unverified --seed-ratio=0 --bt-enable-lpd --bt-exclude-tracker=\* --bt-tracker=http://REDACT:6969/announce

I have a startup script for this but I have to sanitize it.


A simple batch file for testing.

@echo off
set ARIA=c:\REDACT\aria2\amd64\aria2c.exe
set REPO=\\REDACT\sdp$

set TORRENT=%REPO%\torrents\Matlab#R2013a.x64.torrent

set DEST=c:\REDACT\local-cache\%PKG_PATH%

if "%1"=="seed" (
	start /min %~dp0torrent.cmd "%TORRENT%" "%DEST%" seed
) else (
	rmdir /s /q %DEST%
	%~dp0torrent.cmd "%TORRENT%" "%DEST%"

Example WPKG

<?xml version="1.0" encoding="UTF-8"?>

  name="Torrent download tester"
    <variable name="PKG_PATH" value="Adobe_Creative_Suite\CS5.5\CS5_5_DP_64" />
    <variable name="LOG_PREFIX" value="%LOGPATH%\%LOGPREFIX%-torrent" />
    <variable name="LOG_TORRENT" value="%LOG_PREFIX%-dl.log" /> 
    <check type="file" condition="exists" path="%LOCALCACHE%\%PKG_PATH%" />
    <install cmd='cmd /c rmdir /s /q %LOCALCACHE%\%PKG_PATH%' />
    <install cmd='%TORRENTCMD% "%SDP%\torrents\Adobe_Creative_Suite#CS5.5#CS5_5_DP_64.torrent" "%LOCALCACHE%\%PKG_PATH%" > %LOG_TORRENT%' />
    <upgrade include='install' />