The Auckland-IV data set is a continuous 45 days GPS-syncronized IP header trace captured with a DAG3 system at the University of Auckland Internet uplink by the WAND research group between February and April 2000.

When downloading the traces, please read the disclaimers. When using these traces for research and publications, please give appropriate credits for the Auckland-IV data set towards NLANR MOAT and the WAND research group. The WAND group wishes to thank Nevil Brownlee and the ITSS operators group for their continuing support of the measurement point.

The traces are in DAG format, which currently is a fixed 64 bytes record format with 40 bytes of IP header (usually covering most, if not all, of the TCP/IP and UDP/IP headers). To start off, a simple ASCII converter is in d3h2asc.pl, although the timestamp output is inaccurate. This is just in case you need something to get started.

For more sophisticated analysis we recommend using the dagtools package available from the DAG software website. The tool dagdump is a simple converter into ASCII and serves as a good starting point when you wish to import DAG traces into a toolset of your own. Also, CAIDA's CoralReef package should have support for native DAG traces shortly.

The University of Auckland ITSS department is operating an OC3c ATM link via Clear Communications (a major New Zealand ISP and competitor to Telecom NZ), which is carrying a variety of services off the main campus.

This is a continuous 6 1/2 week GPS-syncronized IP header trace taken with a pair of DAG3 cards at the University of Auckland Internet access link. The timekeeping precision of the DAG timestamping engine, called the DUCK, has been monitored during the entire duration of the trace and is guaranteed to be less than 1 microsecond to UTC at all times.

The tap is installed at an OC3 link carrying a number of Classical-IP-over-ATM, LANE and POTS services. The trace contains all Classical-IP headers of a pair of redundant VPI/VCI's (10/102 and 10/103), which connects the university to their local service provider.

For the last week in February the system was configured to only monitor VPI/VCI=10/103 until the redundancy was discovered and both ATM channels included into the trace. This explains the unavailability of trace data for the last two days of February. A cap for a few MBits/sec peak packet rate is set in each direction.

For publication the traces have been sanitized. All non-IP traffic is discarded (one more time, just to be sure). Only ICMP, TCP and UDP is left in the trace. For UDP packets and IP fragments all user payload is zeroed. The IP addresses are mapped into network 10.X.X.X in a non-reversable way to preserve privacy. The same IP mapping database is used for all traces, so IP addresses identical in different traces are identical in the real world. A study of behaviour of a particular machine across all the traces is thus possible.

Jörg Micheel, Ian Graham, Nevil Brownlee: The Auckland data set: an access link observed, submitted paper to the 14th ITC Specialist Seminar on Access Networks and Systems, April 25th-27th, 2001, Barcelona, Spain. Email me for a copy.

H Stele Martin, Anthony J McGregor, John G Cleary: Analysis of Internet Delay Times, Proceedings of the First Passive and Active Measurement Workshop, PAM2000, April 3rd-4th 2000, Hamilton, New Zealand, p.141ff.

Sarah K Joyce: Traffic on the Internet - A Study of Internet Games Traffic, BCMS 420 Honours project report, University of Waikato, Hamilton, New Zealand, 2000.

Vinay Ribero, Mark Coates, Rudolf Riedi, Shriram Sarvotham, Brent Hendricks and Richard Baraniuk: Multifractal Cross-Traffic Estimation. Proceedings of the 13th ITC Specialist Seminar on IP Traffic Measurement, Modelling and Management, September 18th -20th , 2000, Monterey, California, USA. Pages 15-1ff. The reference to the Auckland data set is in the actual talk.

Darryl Veitch, Lidong Huang, EMUlab, University of Melbourne, and Patrice Abry, Ecole Normale Superieure de Lyon, Laboratoire de Physique: Studies of Long Range Dependencies and Self-Similiarity in Internet traffic patterns using Wavelet analysis. Darryl Veitch's home page.

Guoqiang Mao and Daryous Habibi: Loss Performance Analysis for Heterogeneous ON-OFF Sources with Application to Connection Admission Control, submitted for publication in IEEE/ACM Transaction on Networking, October 2000.

If you are about to write a paper using the above data set, please kindly let us know.

There is information on the WAND website. Graphs include packets, bandwidth and new connections per each trace. The pointers are:

	http://wand.cs.waikato.ac.nz/wand/wits/
	http://wand.cs.waikato.ac.nz/wand/wits/auck/4/

Another data set NZIX-II provides for a view of five days of traffic at a busy Internet Exchange. Public access to the traces is here.