The key aim of this thesis is the design and prototypical implementation of a storage platform for IP flow records based on peer-to-peer mechanisms. The storage platform presented here combines the storage space of multiple network devices and provides an interface for storing flow records and for querying stored data. Different flow aggregation levels are considered when storing flow data in order to reduce the amount of storage space required.

Measuring traffic in a network is the first step in several key network management operations. Its applications include differentiated usage-based charging, long-term traffic analysis for capacity planning, and troubleshooting tasks like the detection of routing anomalies and/or denial-of-service attacks. Traditional centralised approaches cannot scale with the huge amount of network traffic data that accumulates in today’s high-speed Internet. Thus, the key idea is to benefit from the shared use of bandwidth, combined storage space and pooled computing power, which are only some of the advantages of decentralised systems. A notable disadvantage is the increased complexity of maintaining data integrity and consistency and of ensuring reliable and continuous access to the stored data.

This thesis presents a proposal of such a decentralised storage system that is capable of aggregating flow data at many different, fine-grained levels in order to reduce the data volume as far as desired, depending on the granularity required. Furthermore, an optimised routing variant is proposed that reduces network overhead traffic for the purpose of improving the system’s scalability. The prototype implementation shows that the underlying overlay network implementation used does not meet the desired performance requirements. The existing bottlenecks are therefore pinpointed at the end of the work.

Netflow Database

Image 1 of 7