Current Demo Setup for SES and MF

Networks

• Satelite link
  • Each machine connected directly to a sat modem has a /30 public ip, with the modem as gateway. Some L2 packets appear to pass, but not reliably? To compensate, L2TP tunnels are used.
  • SES_SAT is the tunnel interface, between each site and landing1.orbit-lab.org.
  • This tunnel is bridged to vlan 31, outdoor data, on landing1.
• Terrestrial link
  • This link operates over the public internet. In order to pass L2 traffic, an L2TP tunnel to landing1.orbit-lab.org is used.
  • This tunnel is bridged to vlan 3701, GENI MF, on landing1.

Topology

SES1 in princeton has one satelite and one ground link. There is an l2 tunnel over each of these to landing1, at winlab.

Node4-3 and mf1 at winlab, each have one interface on each bridged vlan.

Traffic for satellite will thus travel over the public internet to the ground station, then over the sat link to SES1.

KEYS

SSH key based authentication is set up for SES1 and SES2 machines. The keys are in /home/native/.ssh on machine mf1, and in /root/SES_KEYS on remote-l.

Machines

• node4-3.outdoor.orbit-lab.org
  • Eth0: Outdoor data, 10.41.4.3/16
  • Eth0.3701: MF vlan, bridged to geni sites, 10.100.200.53/16
  • Eth1: Outdoor Control, 10.40.4.3/16
  • Eth2: Direct connection to satelite modem port 1, 216.226.242.246/30
• mf1.outdoor.orbit-lab.org
  • em1: was direct connection to sat modem, currently disconnected.
  • em2: outdoor control, 10.40.0.53/16
  • p2p1: Geni MF vlan, 3701. Terrestrial tunnel Link, 10.100.200.54/16
  • p2p2: Outdoor data, vlan 31, sat tunnel link, 10.41.200.54/16
• ses1: Princeton remote machine
  • em1: sat link
    • ip: 216.226.242.242/30
  • em2: public internet link
    • ip: 23.24.73.161
  • ses_ground: tunnel for ground link, over em2
    • ip: 10.100.200.55/16
  • ses_sat: tunnel for sat link, over em1
    • 10.41.200.55/16
  • Scripts:
    • Routing tables have been changed to allow two tunnels. There is an additonal table, sat. This table has one rule, that for traffic from 216.226.242.242 to landing1, it should go via the sat modem. It is added to the ip rules just before the main table.
    • To view routes, type ip r show

    • native@ses1:~$ ip r show
      default via 23.24.73.166 dev em2 
      10.41.0.0/16 dev ses_sat  proto kernel  scope link  src 10.41.200.55 
      10.100.0.0/16 dev ses_ground  proto kernel  scope link  src 10.100.200.55 
      23.24.73.160/29 dev em2  proto kernel  scope link  src 23.24.73.161 
      128.6.192.147 via 23.24.73.166 dev em2  src 23.24.73.161 
      192.168.14.0/24 dev veth1  proto kernel  scope link  src 192.168.14.4 
      192.168.14.0/24 dev veth2  proto kernel  scope link  src 192.168.14.101 
      216.226.242.240/30 dev em1  proto kernel  scope link  src 216.226.242.242 
      

    • To view extra table, type ip r show table sat

    • native@ses1:~$ ip r show table sat
      128.6.192.147 via 216.226.242.241 dev em1 
      

    • To show rules, type ip rule show

    • native@ses1:~$ ip rule show
      0:	from all lookup local 
      32765:	from 216.226.242.242 lookup sat 
      32766:	from all lookup main 
      32767:	from all lookup default 
      

  • Tunnel setup
    • In native's home directory, there is a file tunnel.sh
    • This runs on boot, and sets up both L2TP tunnels to landing1, as well as routes.
    • This script is symlinked to from /etc/init.d and was set to run on boot with update-rc.d tunnel defaults
    • Contents of script:

      #!/bin/bash
      
      #sets up tunnel via terrestrial link
      #remote ip for landing 1 is 128.6.192.147
      #local IP for ses1 is ???.???.???.???
      #ip address for tunnel to MF at Winlab is 
      #mf1.outdoor.orbit-lab.org 10.41.0.54
      #ses1 10.41.0.55
      #ses2 10.41.0.56
      
      modprobe l2tp_eth
      #ground
      ip l2tp del tunnel tunnel_id 1
      ip l2tp add tunnel remote 128.6.192.147 local 23.24.73.161 \
      	tunnel_id 1 peer_tunnel_id 5 udp_sport 3004 udp_dport 3004 encap udp
      ip l2tp add session name ses_ground \
      	tunnel_id 1 session_id 1 peer_session_id 1
      ip link set ses_ground up mtu 1500
      ip r add 128.6.192.147 via 23.24.73.166
      ip addr add 10.100.200.55/16 dev ses_ground
      ping 10.100.200.53 -c 10
      
      #satelite
      ip l2tp del tunnel tunnel_id 2
      ip l2tp add tunnel remote 128.6.192.147 local 216.226.242.242 \
      	tunnel_id 2 peer_tunnel_id 6 udp_sport 3005 udp_dport 3005 encap udp
      ip l2tp add session name ses_sat \
      	tunnel_id 2 session_id 1 peer_session_id 1
      ip link set ses_sat up mtu 1500
      ip route add 128.6.192.147 via 216.226.242.241 table sat
      ip rule add from 216.226.242.242/32 table sat
      
      #ip r add 128.6.192.147 via 216.226.242.241
      
      #ip addr add 10.100.200.55/16 dev ses_ground
      #ping 10.100.200.54 -c 10
      

Desired Final Configuration

Sites

There will be 4 sites.

Location	Sat IP	Ground IP	Description
Woodbine	10.10.0.9/29	216.226.210.34/30	Uplink and core router
Princeton	216.226.242.241/30	23.24.73.161/29	Remote 1
WINLAB	216.226.242.245/30	Private IP on tunnel.	Remote 2
iDirect Herndon	216.226.242.249/30	??	Remote 3

All sites will have a l2tp tunnel over public internet to WINLAB, to be connected to GENI MF vlan. Ideally, all 3 sites will pass L2 broadcast/multicast traffic to each other. While that is in progress, all sites will terminate a L2TP tunnel at Woodbine, over their satellite links.

Idrac: SESwinlab2009