This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision Next revision Both sides next revision | ||
multi-interface_device_design [2009/03/10 23:10] afbarnard added project log entry |
multi-interface_device_design [2009/03/17 20:42] perryk |
||
---|---|---|---|
Line 1: | Line 1: | ||
+ | ====== Multi-Interface Traffic Scheduling ====== | ||
+ | |||
Aubrey Barnard and Perry Kivolowitz | Aubrey Barnard and Perry Kivolowitz | ||
Our aim is 1) to write an extensible framework for measuring network performance over multiple adapters and 2) to develop techniques to analyze the captured data to suggest changes to how the adapters are being used. | Our aim is 1) to write an extensible framework for measuring network performance over multiple adapters and 2) to develop techniques to analyze the captured data to suggest changes to how the adapters are being used. | ||
+ | |||
+ | Full project proposal: [to be included once I get permissions to upload external files] | ||
+ | |||
+ | ===== Metrics ===== | ||
+ | |||
+ | These are my current notes on network metrics. These will be reformatted once I get a separate page for them. | ||
+ | |||
+ | <file> | ||
+ | From class and our brains: | ||
+ | jitter | ||
+ | heartbeat | ||
+ | DNS | ||
+ | DHCP | ||
+ | ping | ||
+ | simulate different traffic types, e.g. streaming multimedia | ||
+ | frequency of dropped packets | ||
+ | amount of unacked data | ||
+ | network saturation (achievable bandwidth) | ||
+ | |||
+ | |||
+ | ---------- | ||
+ | Google search | ||
+ | |||
+ | ---------- | ||
+ | Network Metric Report | ||
+ | http://www.geant2.net/upload/pdf/GN2-05-265v4-Deliverable_DJ1-2-3_Network_Metric_Report.pdf | ||
+ | |||
+ | Measurement dimensions: | ||
+ | Performance: | ||
+ | * Availability | ||
+ | * Loss and errors | ||
+ | * Delay | ||
+ | * Bandwidth | ||
+ | Miscellaneous: | ||
+ | * Device-specific | ||
+ | * Flow | ||
+ | * Routing | ||
+ | |||
+ | SNMP | ||
+ | |||
+ | measure bit errors with communicating synchronized PRNGs | ||
+ | |||
+ | measure bit errors at physical and data link layers | ||
+ | |||
+ | one-way delay, jitter, round trip time | ||
+ | |||
+ | bandwidth: capacity, utilization, available bandwidth, achievable bandwidth | ||
+ | |||
+ | capacity: use snmp (hardware endpoints should know capacity) | ||
+ | |||
+ | measure delay with synchronized clocks; problematic | ||
+ | |||
+ | |||
+ | ---------- | ||
+ | Non-metric coordinates for predicting network proximity | ||
+ | http://research.microsoft.com/pubs/73318/coords_infocom2008.pdf | ||
+ | |||
+ | Doesn't look very helpful as I'm not sure how min-plus applies to our situation. Also, overall it is an optimization procedure (iterative over time) which really doesn't help us. | ||
+ | |||
+ | |||
+ | ---------- | ||
+ | Loss Network Models and Multiple Metric Performance Sensitivity Analysis for Mobile Wireless Multi-hop Networks | ||
+ | http://www.isr.umd.edu/~vahidt/LossNetworkModel_WICON08.pdf | ||
+ | |||
+ | TODO | ||
+ | |||
+ | |||
+ | ---------- | ||
+ | Inference and Labeling of Metric-Induced Network Topologies | ||
+ | http://www.cs.bu.edu/fac/byers/pubs/tpds.pdf | ||
+ | |||
+ | hop-count | ||
+ | |||
+ | bottleneck bandwidth | ||
+ | |||
+ | packet loss rate | ||
+ | |||
+ | estimation of shared loss | ||
+ | |||
+ | TODO | ||
+ | |||
+ | |||
+ | ---------- | ||
+ | Controlling Multimedia QoS in the Future Home Network Using the PSQA Metric | ||
+ | http://comjnl.oxfordjournals.org/cgi/reprint/49/2/137 | ||
+ | |||
+ | TODO | ||
+ | |||
+ | |||
+ | ---------- | ||
+ | Improving network anomaly detection effectiveness via an integrated multi-metric-multi-link PCA-based approach | ||
+ | http://www3.interscience.wiley.com/cgi-bin/fulltext/121481651/PDFSTART | ||
+ | |||
+ | TODO | ||
+ | |||
+ | |||
+ | ---------- | ||
+ | IMC '08 | ||
+ | |||
+ | ---------- | ||
+ | A measurement study of a commercial-grade urban wifi mesh | ||
+ | http://portal.acm.org/citation.cfm?id=1452520.1452534&coll=portal&dl=ACM&type=series&idx=SERIES10693&part=series&WantType=Proceedings&title=IMC&CFID=26429339&CFTOKEN=74708467 | ||
+ | |||
+ | SNMP | ||
+ | |||
+ | number failed transmissions, wireless noise floor | ||
+ | |||
+ | iperf (TODO) | ||
+ | |||
+ | |||
+ | ---------- | ||
+ | IMC '07 | ||
+ | |||
+ | ---------- | ||
+ | Characterizing residential broadband networks | ||
+ | http://portal.acm.org/citation.cfm?id=1298306.1298313&coll=portal&dl=ACM&type=series&idx=SERIES10693&part=series&WantType=Proceedings&title=IMC&CFID=26429339&CFTOKEN=74708467 | ||
+ | |||
+ | queue lengths, seems residential ISPs have large traffic queues which delay packets by milliseconds | ||
+ | |||
+ | do we account for upstream vs. downstream differences? | ||
+ | |||
+ | 1488 byte TCP ACK packets | ||
+ | |||
+ | floods, trickles | ||
+ | |||
+ | |||
+ | ---------- | ||
+ | Studying wireless routing link metric dynamics | ||
+ | http://portal.acm.org/citation.cfm?id=1298306.1298352&coll=portal&dl=ACM&type=series&idx=SERIES10693&part=series&WantType=Proceedings&title=IMC&CFID=26429339&CFTOKEN=74708467 | ||
+ | |||
+ | expected transmission count: how many transmissions do you expect to need to successfully transmit a packet | ||
+ | 1/(P(packet success)*P(ack success)) | ||
+ | |||
+ | measure bandwidth via packet pair, back-to-back probe packets of increasing size | ||
+ | |||
+ | |||
+ | ---------- | ||
+ | IMC '04 | ||
+ | |||
+ | ---------- | ||
+ | Self-configuring network traffic generation | ||
+ | http://portal.acm.org/citation.cfm?id=1028788.1028798&coll=portal&dl=ACM&type=series&idx=SERIES10693&part=series&WantType=Proceedings&title=IMC&CFID=26429339&CFTOKEN=74708467 | ||
+ | |||
+ | Related work, nothing helpful on metrics | ||
+ | |||
+ | |||
+ | ---------- | ||
+ | Strategies for sound internet measurement | ||
+ | http://portal.acm.org/citation.cfm?id=1028788.1028824&coll=portal&dl=ACM&type=series&idx=SERIES10693&part=series&WantType=Proceedings&title=IMC&CFID=26429339&CFTOKEN=74708467 | ||
+ | |||
+ | precision: what data is kept/omitted; timing; | ||
+ | |||
+ | justify your measurement decisions | ||
+ | |||
+ | associate meta-data with measurements | ||
+ | |||
+ | accuracy: e.g. what can go wrong with packet filtering, several levels can drop; stable clock rate | ||
+ | |||
+ | misconception: are you measuring what you think you are measuring?; beware of proxies; large socket buffers and small transfer sizes; vantage point; representativeness (i.e. controlled experiments) | ||
+ | |||
+ | compute connection size by difference in TCP SYN/FIN/RST sequence numbers | ||
+ | |||
+ | calibration: outliers, spikes often suggest measurement problems; self-consistency checks; multiple ways of measuring same thing; test using synthetic data | ||
+ | |||
+ | |||
+ | ---------- | ||
+ | Ten fallacies and pitfalls on end-to-end available bandwidth estimation | ||
+ | http://portal.acm.org/citation.cfm?id=1028788.1028825&coll=portal&dl=ACM&type=series&idx=SERIES10693&part=series&WantType=Proceedings&title=IMC&CFID=26429339&CFTOKEN=74708467 | ||
+ | |||
+ | available bandwidth metric is link capacity above and beyond average utilization | ||
+ | |||
+ | mind the relation between probing stream duration and averaging time scale | ||
+ | |||
+ | packet trains are better than packet pairs | ||
+ | |||
+ | beware cross-traffic burstiness | ||
+ | |||
+ | beware multiple bottlenecks | ||
+ | |||
+ | beware iterative probing does not necessarily converge to a single number | ||
+ | |||
+ | available bandwidth should not be compared to bulk TCP throughput | ||
+ | |||
+ | |||
+ | ---------- | ||
+ | Single-hop probing asymptotics in available bandwidth estimation: sample-path analysis | ||
+ | http://portal.acm.org/citation.cfm?id=1028788.1028831&coll=portal&dl=ACM&type=series&idx=SERIES10693&part=series&WantType=Proceedings&title=IMC&CFID=26429339&CFTOKEN=74708467 | ||
+ | |||
+ | explains how to analyze packet trains | ||
+ | |||
+ | |||
+ | ---------- | ||
+ | Bandwidth estimation in broadband access networks | ||
+ | http://portal.acm.org/citation.cfm?id=1028788.1028832&coll=portal&dl=ACM&type=series&idx=SERIES10693&part=series&WantType=Proceedings&title=IMC&CFID=26429339&CFTOKEN=74708467 | ||
+ | |||
+ | nothing significant | ||
+ | |||
+ | |||
+ | ---------- | ||
+ | SIGCOMM '91 | ||
+ | |||
+ | ---------- | ||
+ | A control-theoretic approach to flow control | ||
+ | http://portal.acm.org/citation.cfm?id=115992.115995&coll=portal&dl=ACM&type=series&idx=SERIES419&part=series&WantType=Proceedings&title=COMM&CFID=26429339&CFTOKEN=74708467 | ||
+ | |||
+ | packet-pair technique: measure ack delay to estimate server's processing rate | ||
+ | </file> | ||
===== Project Log ===== | ===== Project Log ===== | ||
+ | |||
+ | ==== 02/26 ==== | ||
+ | |||
+ | Proposal submitted. | ||
==== 03/03 ==== | ==== 03/03 ==== | ||
Line 52: | Line 265: | ||
AB - Went through abstracts of last two years of SIGMETRICS IMC. | AB - Went through abstracts of last two years of SIGMETRICS IMC. | ||
+ | |||
+ | ==== 03/11 ==== | ||
+ | |||
+ | AB - Finished literature search of SIGMETRICS IMC. At this point I think I've collected about enough information from the literature. Read about SNMP. | ||
+ | |||
+ | ==== 03/12 ==== | ||
+ | |||
+ | AB - Creating new site organization. The new site should begin here: [[multi-interface_device_design:traffic_scheduling|Multi-Interface Traffic Scheduling]]. Added temporary version of metrics notes. | ||
+ | |||
+ | ==== 03/17 ==== | ||
+ | |||
+ | PK - After much coding, the traffic driver is fully running including 3 different types of traffic and real time capture at the hardware level. Next step is to add real time capture to the server. Not including experiments, about 2000 lines of code have been written so far. | ||