An attempt at Floodlight Development.

This page documents the (attempted) process of developing a version of Floodlight with FlowVisor-like slicing capabilities.

This is an on-going process - therefore this page will be updated frequently.

Quick links

Overview
Setup
Background
Approach - a diary-style log of the implementation.

• Floodlight Module System
• Flowvisor FlowMap Overview

jump to bottom.

Overview.

Slicing is the SDN (in our case referring to OpenFlow) term for network virtualization. Specifically, A slice is a SDN controller and the network resources allocated to it by a hypervisor-like entity such as FlowVisor. With proper resource isolation and allocation, multiple controllers can coexist on a single physical network.

In the usual case, FlowVisor behaves as a proxy, intercepting and modifying the OpenFlow control messages between the switches and the multiple controllers so that each slice only sees a subset of the network.

Floodlight is a modularized OpenFlow controller, in that its functional components can be split into two major parts:

1. The core event dispatcher, and
2. The various event handlers.

The event handlers (Floodlight modules) are what define the behavior of swicthes (hub, learning switch, router, etc.). A more in-depth discussion of these components can be found ​here.

The key point here is that Floodlight's modular structure allows for multiple different handlers to coexist, with various (groups of) modules imposing different capabilities on the switches. If these modules controlled different groups of switches e.g. had their own bit of resource, each <module:resource> set can be viewed as a slice. Floodlight does not currently have this capability, so the objective of the process described here is to try to realize this feature.

Setup

Development is done on two VMs, one for Flowvisor and Floodlight source, and the other, Mininet for testing our code.

• VM1(10.50.250.2): 3-switch, 3-host Mininet topology pointed to external controller in VM2:

Topology:

h4   h5   h6
 |    |    | 
s1---s2---s3 

Mininet config:

# mn --topo=linear,3 --controller=remote --ip=10.50.250.17 --port=6633

• VM2(10.50.250.17): Flowvisor on port 6633, with a slice to point two switches to Floodlight instance on 6634

FlowVisor configuration:

# fvctl createSlice fl-1 tcp:localhost:6634 foo@sampledomain.org
# fvctl addFlowSpace 00:00:00:00:00:00:00:02 1000 any "Slice:fl-1=7"
# fvctl addFlowSpace 00:00:00:00:00:00:00:01 1000 any "Slice:fl-1=7"

Floodlight config alteration (in src/main/resources/config.properties):

net.floodlightcontroller.restserver.RestApiServer.port = 8088
net.floodlightcontroller.core.FloodlightProvider.openflowport = 6634

The REST API port is changed from 8080 to prevent conflict with Flowvisor's services.

Background.

The general flow of operation with respect to Flowvisor (in terms of components) is the following:

1. The Acceptor (OFSwitchAcceptor) listens for all OpenFlow message types (OFTypes) and all switch join/leave events.
2. When a new switch joins, the Acceptor hands the switch's connection to a Classifier (FVClassifier).
3. The Classifier fetches all slices associated with the switch and launches a Slicer (FVSlicer) per module.
   • mappings of DPID to slices are found through configurations (the Flowmap)
   • modules associated with the control module (the primary module defining the behavior of a switch for that slice) may be grouped together in a slice.
4. Each Slicer sets up event dispatching for the modules associated with a slice.

Where the messages go once Flowvisor receives a message are determined by the FlowMap. the origin of a message can be determined several ways, one being checking the OFType (as some messages are sent by switches but never controllers, and vice versa).

Flowvisor implements all of the needed controller functions, so a good chunk of it is life-support (event handling mechanism, timers, OpenFlow signaling, etc.). Therefore, we need to be aware of what Floodlight already provides, and what can/needs-to be pulled in from Flowvisor.

A Floodlight module, in general:

• can subscribe to switch join/leave events. They are notified of joins after the switch sends a features reply.
• can subscribe to all OFTypes, and once processed, can choose to pass it down the processing chain to other modules or drop it.
• the modules themselves cannot control which modules receive the messages if it choses to pass them downstream.

Approach (and implementation).

(6/12):

We generally believe that the following parts will need to be implemented:

1. A broker module to register with the core module for all events - the core module can notify this module of OpenFlow messages and new switches.
2. A component that provides the IFloodlightProviderService interface to the rest of the modules. To the rest of the modules, the broker module will appear to be the core controller module.
3. Flow-mapping mechanism - it is possible that the components needed for a working FlowMap can be taken directly from Flowvisor, since it is relatively independent from the rest of the code base (according to Ali).

Therefore, the module is both a module in Floodlight's usual sense as a subscriber to the controller core, but also a controller that services the rest of the modules. The rough parallels are:

• the main broker module's behavior as a listener roughly corresponds to the OFSwitchAcceptor
• the new IFloodlightProviderService interface (call it "FVController"?) and receive() functions correspond to the FVSlicers and FVClassifiers
• the modules correspond to the multiple controllers

The FVController interface should be responsible for keeping track of which modules are associated with which slice, and which messages reach what (with help from the FlowMap). This means that the modules must register with it, as opposed to the core controller defined in Controller.java.

So, for the meanwhile, the next steps include:

• isolating out the FlowMap code in Flowvisor
• mapping out the module registration mechanisms in Floodlight
• finding a "nice" way to make the modules register with FVController.

(6/13):[Floodlight Module System]

A (not-so) quick revisit of the module loading system in Floodlight was done to figure out how exactly a module learns to subscribe to the main controller module.

Starting at the top, in the init() function of each module is almost always this line:

floodlightProvider = context.getServiceImpl(IFloodlightProviderService.class);

Where context is an instance of FloodlightModuleContext, which contains a mapping between the interfaces and the services providing them. getServiceImpl(), in the case above, returns the service providing the IFloodlightProviderService interface, which is the core controller.

FloodlightModuleLoader is the actual class responsible for populating FloodlightModuleContext's mapping; Recalling, from Main.java:

FloodlightModuleLoader fml = new FloodlightModuleLoader();
IFloodlightModuleContext moduleContext = fml.loadModulesFromConfig(settings.getModuleFile());

Internally, for each module exporting a service, in initModules() FloodlightModuleLoader calls getServiceImpls(), an IFloodlightModule function that lets modules define the services that they export. It then uses FloodlightModuleContext's addService() in order to fill its mapping.

Returning to the controller mapped to IFloodlightProviderService.class, we see that it is a service exported by the module FloodlightProvider. It is the first module to be loaded by the module loading system, and therefore the mapping to the controller is there for the rest of the modules to register with.

This leads us to a potential way to place a module between the controller and the rest of the modules:

• Re-name the real IFloodlightProviderService to something else
• Implement a module that subscribes to the re-named controller service
• Implement a FVController from IFloodlightProviderService
• export this as a service with key IFloodlightProviderService.class

This shouldn't require any change on the other modules (except Controller.java).

(6/14):

A preliminary attempt at trying the above (do not follow if you ever come across this, it is an experiment):

create copies of core files:

• FVController, proxy version of Controller - for now a blank IFloodlightProxy implementation
• IFloodlightProxy, a copy of IFloodlightProviderService to be used by FVController

re-wired files:

• FVController implements IFloodlightProxy, with FVAcceptor as its version of FloodlightProvider

For the following files, 'rewiring' refers to swapping out IFloodlightProviderService with IFloodlightProxy.

• ForwardingBase, Forwarding (the generic forwarding components loaded by default)

additional changes:

• Add FVAcceptor to /floodlight/src/main/resources/META-INF/services/net.floodlightcontroller.core.module.IFloodlightModule
• Have FVAcceptor subscribe to IFloodlightProviderService as its floodlightprovider
• Incorporate FloodlightProvider's functions into FVAcceptor (for now, brutely drop in, just exporting IFloodlightProxy service)

This process forces the forwarding component to register with FVController, as opposed to the core module. The core module still takes care of OpenFlow signaling e.g. echo keepalives and the initial handshake, so any switches will still connect properly and keep the connection alive.

(6/18):

After much tweaking and code-tracing with log.debug outputs, a (seemingly) working proxy was implemented.

• FVController: implements its own bare-bones versions of:
  • updateSwitch: track list of active switches
  • add/removeOFMessageListener
  • add/removeOFSwitchListener
  • getSwitches: return immutable list of active switches
  • handleOutgoingMessage
  • injectOfMessage
  • handleMessage
  • init: initialize class variables

• OFSwitchImpl:
  • a setFloodlightProxy setter function
  • modified write() functions that call either FVController or Controller's handleOutgoingMessage() depending on OFType:

    switch (m.getType()) {
        case PACKET_OUT:
        case FLOW_MOD:
        case PORT_MOD:	
            this.floodlightProxy.handleOutgoingMessage(this, m, bc);
            break;
        default: 	
            this.floodlightProvider.handleOutgoingMessage(this, m, bc);
    }
    

• Controller: add functions to set the floodlightProxy in OFSwitchImpl
• FloodlightProvider: fetch and set Controller's FVProxy in init()

  controller.setFVProxy(
      context.getServiceImpl(IFloodlightProxy.class));
  

(6/20):[Flowvisor FlowMap Overview]

The FlowMap is one of Flowvisor's central components that must be ported. The first step, as always, is to understand how its components fit together. Hopefully there will be time for a clear re-write of the banter to follow…

A FlowMap provides a uniform interface for the FlowSpace. It can be thought of as a structure to hold the FlowSpace, and to map it to proper slices. The two kinds of FlowMaps supported by Flowvisor as of now (v.0.8.3) are the Linear and Federated FlowMaps, both implementations of the Java interface, FlowMap.java. A FlowSpace, is represented by flow rules, which map actions to OpenFlow pattern matches. The enum MatchType defines how each header field of a (Flowvisor-defined) rule pattern and the received rule patterns relate. FlowEntry.java implements the FlowSpace.

Intersections take two FlowEntries and describe how they relate (via a MatchType), and, if they overlap, a representation of the intersection in the form of a FlowEntry built by choosing the more heavily constrained pattern for each header field and DPID(s). FlowIntersect.java implements the representation of the intersection, and FlowEntry defines matches(), which compares two FlowEntries to produce the intersection. Comparisons are implemented in FlowTestOp.java.

The "traditional" OFMatch construct doesn't so matching on DPID, so it is extended by FVMatch to do so.

.