Added milestone 9 for L2O and milestone 1 for ProbNat

2 files changed, 211 insertions, 22 deletions

diff --git a/template/l2o/mile9.html.j2 b/template/l2o/mile9.html.j2
index dbe36b59..1e5c9220 100644
--- a/template/l2o/mile9.html.j2
+++ b/template/l2o/mile9.html.j2
@@ -24,7 +24,7 @@
           {% trans %}
           This functionality was formerly implemented in the peerinfo service.</br></br> 
           
-          See branch l20integration revision 0f8b712.
+          See revision 0f8b712.
           {% endtrans %}
         </p>
       </section>
@@ -34,7 +34,7 @@
           {% trans %}
           This functionality was formerly implemented in the peerinfo service. After storing hellos with the peerstore service this was needed there.</br></br>
           
-          See branch l20integration revision 0f8b712.
+          See revision 55a25ef.
           {% endtrans %}
         </p>
       </section>
@@ -44,7 +44,7 @@
           {% trans %}
           This change was necessary to create the bootstrap hello which must be valid indefinitely.</br></br>
           
-          See branch l20integration revision 39bcd0f.
+          See revision 39bcd0f.
           {% endtrans %}
         </p>
       </section>
@@ -54,7 +54,7 @@
           {% trans %}
           The new api needed to be exchange in all GNUnet packages.</br></br> 
           
-          See branch l20integration revision 23a2640.
+          See revision 23a2640.
           {% endtrans %}
         </p>
       </section>
@@ -64,7 +64,7 @@
           {% trans %}
           The watch api of the peerstore service was changed to return all values for a given key, before notifying the caller about ne values being stored.</br></br> 
           
-          See branch l20integration revision 86ae84f.
+          See revision 86ae84f.
           {% endtrans %}
         </p>
       </section>
@@ -74,7 +74,7 @@
           {% trans %}
           The new hello design was exchanged in all GNUnet packages.</br></br> 
           
-          See branch l20integration revision a362cd5.
+          See revision a362cd5.
           {% endtrans %}
         </p>
       </section>
@@ -84,7 +84,7 @@
           {% trans %}
           A cli tool for changing the bootstrap hello file in the contrib/hello directory was changed to rewritethe hello bootstrap file from old to new format. </br></br> 
           
-          See branch l20integration revision 8ea9223.
+          See revision 8ea9223.
           {% endtrans %}
         </p>
       </section>
@@ -94,7 +94,7 @@
           {% trans %}
           The peerinfo service service was scanning a hostlist file and the data was used by the hostlist server. This code was moved to the peerstore service.</br></br> 
           
-          See branch l20integration revision 20d6f3.
+          See revision 20d6f3.
           {% endtrans %}
         </p>
       </section>
@@ -104,7 +104,7 @@
           {% trans %}
           The new testing framework was transport specific Now it can be used in other packages too.</br></br> 
           
-          See branch l20integration revision 02a1fda.
+          See revision 02a1fda.
           {% endtrans %}
         </p>
       </section>
@@ -114,7 +114,7 @@
           {% trans %}
           After changes to be able to use the testing framework more generic the dependencies needed to be fixed..</br></br> 
           
-          See branch l20integration revision 1016d6d.
+          See revision 1016d6d.
           {% endtrans %}
         </p>
       </section>
@@ -124,7 +124,7 @@
           {% trans %}
           A small function syntax fix.</br></br> 
           
-          See branch l20integration revision 84913b.
+          See revision 84913b.
           {% endtrans %}
         </p>
       </section>
@@ -134,7 +134,7 @@
           {% trans %}
           The watch functionality first returns all values for a given key, before notifying the caller about new values for that key.</br></br> 
           
-          See branch l20integration revision e1341d1.
+          See revision e1341d1.
           {% endtrans %}
         </p>
       </section>
@@ -144,7 +144,7 @@
           {% trans %}
           All occurencies in GNUnet packages were changed from old to new hello format.</br></br> 
           
-          See branch l20integration revision 66ecfe2.
+          See revision 66ecfe2.
           {% endtrans %}
         </p>
       </section>
@@ -154,7 +154,7 @@
           {% trans %}
           Unnecessary check removed. Fixed small coding error.</br></br> 
           
-          See branch l20integration revision 3bd35e8.
+          See revision 3bd35e8.
           {% endtrans %}
         </p>
       </section>
@@ -164,7 +164,7 @@
           {% trans %}
           The validation of other peers in the transport package was not working in some cases, because validation did not use monotonic time, and first_challenge_use wasn't reset.</br></br> 
           
-          See branch l20integration revision 88cb4be.
+          See revision 88cb4be.
           {% endtrans %}
         </p>
       </section>
@@ -174,7 +174,7 @@
           {% trans %}
           A wrong group name was used for a DHT block entry.</br></br> 
           
-          See branch l20integration revision 8127d51.
+          See revision 8127d51.
           {% endtrans %}
         </p>
       </section>
@@ -184,7 +184,7 @@
           {% trans %}
           Reading hostlist entries and compiling the hostlist response to a hostlist request was started too early, even though the peer did not created its own hello.</br></br> 
           
-          See branch l20integration revision 7761b42.
+          See revision 7761b42.
           {% endtrans %}
         </p>
       </section>
@@ -194,7 +194,7 @@
           {% trans %}
           The configuration of the test case had to be changed to let one peer run a hostlist server.</br></br> 
           
-          See branch l20integration revision 3c761cd.
+          See revision 3c761cd.
           {% endtrans %}
         </p>
       </section>
@@ -204,17 +204,122 @@
           {% trans %}
           The host list server needed a cache for the entries, because with storing entries in the peerstore, only the new hellos were notified to the hostlist server.</br></br> 
           
-          See branch l20integration revision e4b146e.
+          See revision e4b146e.
           {% endtrans %}
         </p>
       </section>
       <section>
-        <h4>{{ _("Changed hostlist server to use a hello cache.") }}</h4><br/>
+        <h4>{{ _("Bootstrap: Fixed bug to not replace hellos for a peer.") }}</h4><br/>
         <p>
           {% trans %}
-          The host list server needed a cache for the entries, because with storing entries in the peerstore, only the new hellos were notified to the hostlist server.</br></br> 
+          Hellos are store with a specific key GNUNET_PEERSTORE_HELLO_KEY and option GNUNET_PEERSTORE_STOREOPTION_MULTIPLE instead of GNUNET_PEERSTORE_STOREOPTION_REPLACE.</br></br> 
           
-          See branch l20integration revision e4b146e.
+          See revision 0516538.
+          {% endtrans %}
+        </p>
+      </section>
+      <section>
+        <h4>{{ _("Hello: Fix another bug in cli tool to generate contrib hello file.") }}</h4><br/>
+        <p>
+          {% trans %}
+          Use the actuall private key of the installed peer, not the peer id from file.</br></br> 
+          
+          See revision e0d28ef.
+          {% endtrans %}
+        </p>
+      </section>
+      <section>
+        <h4>{{ _("Cadet: Fixed issue #7542") }}</h4><br/>
+        <p>
+          {% trans %}
+          Cadet still used the legacy DHT hello block format, changed to the new URL-based block format.</br></br> 
+          
+          See revision 9376034.
+          {% endtrans %}
+        </p>
+      </section>
+      <section>
+        <h4>{{ _("Added DDLs for handling GNUNET_PEERSTORE_StoreHelloContext.") }}</h4><br/>
+        <p>
+          {% trans %}
+          Changed code to store hellos in new format in peerstore in transport and topology subsystem.</br></br> 
+          
+          See revision 233a6be.
+          {% endtrans %}
+        </p>
+      </section>
+      <section>
+        <h4>{{ _("A long list of Bugs which where fixed.") }}</h4><br/>
+        <p>
+          {% trans %}
+          <ul>
+                <li>c1783c1: TNG: Adding missing manual test case topology file.</li>
+                <li>8093c8e: Changed relative path to no force test config</li>
+                <li>aa9bebd: TNG: Fixed bug in handling hello to start validation.</li>
+                <li>21be887: Introduced closure to hold store context when caling function to add hello in peerstore.</li>
+                <li>0ecf00f: Hello: Fixed usage of GNUNET_HELLO_builder_iterate.</li>
+                <li>8ebef9f: Cadet: Changes to use DhtHelloMessage instead of HelloUriMessage, and to hand over not a HelloMessage, but a block to the dht.</li>
+                <li>2b87bab: Peerstore: Fixed memory related bugs.</li>
+                <li>a71b245: Testing: Exchange binary name for transport in test case configuration.</li>
+                <li>7da7937: Transport: Fixed null pointer in address iteration code to start validation.</li>
+                <li>060b681: Transport: Fixed bug while setting up key material for backchannel.</li>
+                <li>53ad5e4: Transport: Fixed bug while setting up key material for backchannel.</li>
+                <li>57d31ec: Transport: Fixed bug in free pending messages and queue entries.</li>
+                <li>20f5e2a: Transport: Fixed bug in ring buffer for core messages.</li>
+                <li>2c71a76: Topology: Fixed small bug.</li>
+                <li>d46e0b7: Hello: Changed bootstrap peer hello file to new bootstrap peer.</li>
+                <li>29e2e51: Peerstore: Make peerstore start immediately. Added option to use included hello.</li>
+                <li>1848ece: Hello: Change error handling of GNUNET_HELLO_builder_add_address usage.</li>
+                <li>4e77b10: Peerstore: We replace existing hellos. Only the origin peer merges hellos.</li>
+                <li>8e8c3f1: Transport: Added missing dekrement when removing QueueEntry from DLL.</li>
+                <li>a919091: Transport: Added missing dekrement of global communicator queue counter.</li>
+                <li>1513057: Transport: Using the correct TransportClient for dekrementing the global communicator queue counter.</li>
+                <li>23246e1: Transport: Fixed check when to stop FC retransmission.</li>
+                <li>015cef0: Transport: Removed logging that lead to an assertion.</li>
+                <li>ea2420b: Transport: Fixed check of value gotten from peerstore.</li>
+                <li>5934318: Transport: Destroy closed ProtoQueue.</li>
+                <li>f5fa8ef: Transport: Added logging in case of UDP errors, and destroy queue in case of errors.</li>
+                <li>e2a4d6c: Transport: Fixed bug in handling of AckPending.</li>
+                <li>c9b0b25: Transport: Removed misplaced removal of QueueEntry.</li>
+                <li>7f7571b: Transport: Fixed bugs in core message cache.</li>
+                <li>bc81b0a: Transport: We need to check if a message was cached when resuming communicators.</li>
+                <li>433c13c: Transport: Fixed bug handling queue length and QueueEntry when queue has no capacity.</li>
+                <li>3becc2d: Transport: Fixed bug to check each queue for validity separately.</li>
+                <li>2d955b1: Transport: More useful debug logging für service.</li>
+                <li>f1510f7: Transport: Fixed using wrong function to calculate mean time when to send next fragment.</li>
+                <li>ec57587: Peerstore: Fixed wrong assert when checking DLL with watches.</li>
+                <li>4274265: Transport: Added logging in case of UDP errors, and destroy queue in case of errors.</li>
+                <li>8d3c8c3: Transport: Fixed bug in handling of AckPending.</li>
+                <li>edd8e08: Transport: Removed misplaced removal of QueueEntry.</li>
+                <li>3b906ef: Transport: Fixed bugs in core message cache.</li>
+                <li>ca73eed: Transport: We need to check if a message was cached when resuming communicators.</li>
+                <li>e39ed50: Transport: Fixed bug handling queue length and QueueEntry when queue has no capacity.</li>
+                <li>f08eae1: Transport: Fixed bug to check each queue for validity separately.</li>
+                <li>6a27b67: Transport: Fixed using wrong function to calculate mean time when to send next fragment.</li>
+                <li>da2f9f7: Peerstore: Fixed wrong assert when checking DLL with watches.</li>
+                <li>6565677: Transport: Fixed counting of fragments of a message</li>
+                <li>26b05be: Transport: Introduced variable to count the round of fragments of a message being (re)send.</li>
+                <li>e22e637: Transport: Fixed ring buffer.</li>
+                <li>f387a7b: Util: Introduced GNUNET_TIME_relative_multiply_double.</li>
+                <li>36a9952: Transport: Added cleanup task to remove QueueEntry we got no ACK for.</li>
+                <li>164badb: Transport: Changed logic to first create a queue before starting validation.</li>
+                <li>894754f: Core: Added missing GNUNET_TRANSPORT_core_receive_continue.</li>
+                <li>b9cd040: Transport: Fixed bug in logic getting root parent of fragment which is a DV box.</li>
+                <li>84b76e3: Transport: Resuming communicators in case of core restarting.</li>
+                <li>78b0a9a: Transport. Fixed bug in logic freeing timedout QueueEntry.</li>
+                <li>0d9df1c: Fixed bug calculating next resend of fragments.</li>
+                <li>c69a0e9: Transport: first_challenge_use has to be reset in case of revalidation.</li>
+                <li>01b7a5d: Transport: When to resend a validation challenge and when to start revalidation needs to be seperate logic.</li>
+                <li>5f56628: Transport: Fixed bug in logic releasing resources and notifying communicators after caching messages to core.</li>
+                <li>94caa7d: Transport: Fixed bug in resend logic for fragments, especially for DV boxes.</li>
+                <li>67c90f8: Core: Fixed bug to stop keepalive after handling ping.</li>
+                <li>a3b9d98: Transport: Fixed fragmentation logic.</li>
+                <li>4254ee1: Core: Removed unnecessary client continue.</li>
+                <li>1d88d65: Transport: Added check for DV box, when checking for last applicable fragment during freeing some fragment.</li>
+                <li>4402b56: Transport: Added logging to debug freeing of fragments.</li>
+                <li>25ffc82: Transport: Inform Core about all VirtualLinks not only neighbours.</li>
+                <li>aaf07c7: Core: Added logic to decrease restart delay of connection to Transport depending on how long the connection to Transport lasted.</li>
+          </ul></br></br>
           {% endtrans %}
         </p>
       </section>
diff --git a/template/probnat/mile1.html.j2 b/template/probnat/mile1.html.j2
new file mode 100644
index 00000000..8499fec3
--- /dev/null
+++ b/template/probnat/mile1.html.j2
@@ -0,0 +1,84 @@
+{% extends "common/base.j2" %}
+{% block body_content %}
+<main id="maincontent">
+<article class="container">
+
+  <header>
+    <h1>{{ _("NGI Assure project: Probabilistic NAT Traversal") }}</h1>
+  </header>
+
+  <div class="row">
+    <div class="col-2 d-none d-lg-block"><!-- for large viewports show menu for better orientation -->
+      <nav class="nav subnav position-fixed flex-column border-right" style="position:fixed">
+      <a class="nav-link" href="index.html#idea">{{ _("Project main page") }}</a>
+      </nav>
+    </div>
+    <div class="col">
+
+      <h2>Implementation details milestone 1</h2>
+
+      <section>
+        <h4><a name="netjail" class="subnav-anchor"></a>{{ _("See revision 4b2303a on branch dev/t3ss/probnat") }}</h4>
+        <p>
+          {% trans %}
+          <table width="100%">
+                <tr>
+                        <td width="40%" style="vertical-align: top;">src/service/transport/nat_router.sh</td><td width="60%" style="vertical-align: top;">Test framework router component to fake kernel behavior to keep a port of an outgoing connection open.</td>
+                <tr>
+                        <td></td><td> </td>
+                </tr>
+                <tr>
+                        <td width="40%" style="vertical-align: top;">scripts/netjail/nat_node_test.sh</td><td width="60%" style="vertical-align: top;">Test script to just send test messages to another node to open up a port.</td>
+                </tr>
+                <tr>
+                        <td width="40%" style="vertical-align: top;">scripts/netjail/getmsg.sh</td><td width="60%" style="vertical-align: top;">Test script to receive test messages from nat_node_test.sh.</td>
+                <tr>
+                        <td></td><td> </td>
+                </tr>
+                <tr>
+                        <td width="40%" style="vertical-align: top;">est_transport_plugin_cmd_nat_mapping.c</td><td width="60%" style="vertical-align: top;">Testcase to start the script which sends test messages to open up ports.</td>
+                <tr>
+                        <td></td><td> </td>
+                </tr>
+                <tr>
+                        <td width="40%" style="vertical-align: top;">test_transport_nat_mapping_topo.conf</td><td width="60%" style="vertical-align: top;">Configuration for the test case.</td>
+                <tr>
+                        <td></td><td> </td>
+                </tr>
+                <tr>
+                        <td width="40%" style="vertical-align: top;">test_transport_nat_mapping.sh</td><td width="60%" style="vertical-align: top;">Script to start the test case.</td>
+                <tr>
+                        <td></td><td> </td>
+                </tr>
+                <tr>
+                        <td width="40%" style="vertical-align: top;">scripts/Makefile.am</td><td width="60%" style="vertical-align: top;">Added nat_node_test.sh and getmsg.sh.</td>
+                <tr>
+                        <td></td><td> </td>
+                </tr>
+                <tr>
+                        <td width="40%" style="vertical-align: top;">scripts/netjail/netjail_start.sh</td><td width="60%" style="vertical-align: top;">Added node nummber parameter to node start script, and make the script run in background.</td>
+                <tr>
+                        <td></td><td> </td>
+                </tr>
+                <tr>
+                        <td width="40%" style="vertical-align: top;">scripts/netjail/netjail_stop.sh</td><td width="60%" style="vertical-align: top;">Added node nummber parameter to node stop script.</td>
+                <tr>
+                        <td></td><td> </td>
+                </tr>
+                <tr>
+                        <td width="40%" style="vertical-align: top;">src/service/testing/testing_api_cmd_exec_bash_script.c</td><td width="60%" style="vertical-align: top;">Bugfixing the script that was initially implemented to do explorative testing of transport integrsation, and which is now also used to start the script which sends test messages.</td>
+                </tr>
+                <tr>
+                        <td width="40%" style="vertical-align: top;">src/service/transport/Makefile.am</td><td width="60%" style="vertical-align: top;">Added test_transport_plugin_cmd_nat_mapping.c</td>
+                </tr>
+          </table>
+          {% endtrans %}
+        </p>
+      </section>
+
+      
+    </div>
+  </div>
+
+</article>
+{% endblock body_content %}