Early Experience with an Internet Broadcast System Based on Overlay Multicast http://esm.cs.cmu.edu Kay Sripanidkulchai Yang-hua Chu, Aditya Ganjam, Eugene Ng1, Sanjay Rao2, Jibin Zhan, and Hui Zhang Carnegie Mellon University, Rice1, Purdue2

Ubiquitous Internet Broadcasting •Anyone can publish •Anyone, anywhere, can tune in

7/1/2004

http://esm.cs.cmu.edu

2

End System Multicast Pittsburgh

NYC

Seattle-LAN

Seattle-Modem SF1

Pittsburgh

Overlay Tree SeattleLAN SeattleModem SF1 SF2

NYC

7/1/2004

SF2

http://esm.cs.cmu.edu

3

ESM: The Benefits • Easy to deploy – No change to network infrastructure

• Programmable end-hosts – Application-specific customizations Transcoding/ Priority forwarding Pittsburgh

SeattleLAN SeattleModem SF1 SF2

NYC

7/1/2004

http://esm.cs.cmu.edu

4

ESM Project Chronology • 2000: Architecture proposed • Next 3 years: “Protocol-design approach” – Examples: Narada, Yoid, Overcast, Scattercast, Nice, ALMI, Hypercast, CAN Multicast, Bayeux, CoopNet, SplitStream, Bullet, … – Demonstrated the potential using simulation and university-based Internet test-beds

• 2002 – present: “Application-centric approach” – Does end system multicast work in the real world? – First completely operational system with extensive usage and first report of experience

7/1/2004

http://esm.cs.cmu.edu

5

Outline • • • •

System overview Deployment status Deployment experience and system performance Lessons learned

7/1/2004

http://esm.cs.cmu.edu

6

A/V Signal

System Overview Encoder

Broadcast Source Monitor Logger Key Components: –Protocol to organize receivers into efficient overlays –Support for heterogeneous receivers –Support for hosts behind NATs and firewalls 7/1/2004

http://esm.cs.cmu.edu

7

Overlay Protocol Semantics • Connected overlay tree rooted at source – Data sent along the tree – Bound fanout at each node

• Optimize for end-to-end bandwidth – Secondary for delay

• Distributed, self-improving protocol – Periodically probe other hosts as “potential parents” – Switch parent if improve performance SeattleLAN

Pittsburgh

NYC

7/1/2004

http://esm.cs.cmu.edu

SeattleModem SF1 SF2

8

Support for heterogeneous receivers A/V Signal

Encoder

Each receiver: Receive as many layers as capacity allows. Unicast congestion control

Pittsburgh

NYC

SeattleLAN

Priority forwarding

SeattleModem SF1 SF2

7/1/2004

http://esm.cs.cmu.edu

9

Support for NATs and Firewalls

X Public IP

NAT

NAT

–Support NATs as children of public hosts –Support NATs as parents of public hosts

7/1/2004

http://esm.cs.cmu.edu

10

Outline • • • •

System overview Deployment status Deployment experience and system performance Lessons learned

7/1/2004

http://esm.cs.cmu.edu

11

User experience

Performance Stats

Overlay Tree

7/1/2004

http://esm.cs.cmu.edu

12

Deployment status Event

Duration (hours)

Unique Hosts

Peak Size

SIGCOMM ’02

25

338

83

SIGCOMM ’03

72

705

101

Slashdot

24

1609

160

DARPA Grand Challenge

4

800

280

220

4000

-

… Total

Many continents and many networks. 7/1/2004

http://esm.cs.cmu.edu

13

Snapshot from Sigcomm ’02 Broadcast U.S. East Coast U.S. Central U.S. West Coast Europe Asia Unknown

7/1/2004

Source (CMU)

http://esm.cs.cmu.edu

14

Outline • System overview • Deployment status • Deployment experience and system performance – New analysis methodology and tools

• Lessons learned

7/1/2004

http://esm.cs.cmu.edu

15

Performance: Sigcomm ‘02

Sigcomm02

Bandwidth constrained: wireless, poor access bandwidth

7/1/2004

http://esm.cs.cmu.edu

16

System Dynamics Keynote Rebroadcast Number of hosts

Keynote Session 1

9:00 7/1/2004

11:00

Session 2 Session 3

13:00 http://esm.cs.cmu.edu

15:00

17:00 17

System Dynamics Keynote Rebroadcast Number of hosts

Keynote Session 1

Session 2 Session 3 Departing host

Inet2 congestion Purdue congestion

France congestion 9:00 7/1/2004

11:00

13:00 http://esm.cs.cmu.edu

15:00

17:00 18

More conferences and lectures

Conference and lecture broadcasts have good overall performance.

7/1/2004

http://esm.cs.cmu.edu

19

Slashdot Broadcast

Slashdot

Performance is not as good as conference and lecture broadcasts.

7/1/2004

http://esm.cs.cmu.edu

20

Resource Index

Resource Index:

(3+5)/3 = 2.7

7/1/2004

• Ratio of supply of bandwidth to demand of bandwidth • Resource index == 1 means the system is saturated • Resource index == 2 means the system can support two times the current members in the system

http://esm.cs.cmu.edu

21

Resource Index

Resource Index

Abundant resources

Only considering bandwidth. 7/1/2004

http://esm.cs.cmu.edu

22

Resource Index with NATs Inefficient structure

Connectivity-optimal structure

NAT

NAT

X X

Resource Index: (3+5)/3 = 2.7

Resource Index: (3+3)/3 = 2.0 7/1/2004

http://esm.cs.cmu.edu

23

Resource Index

Considering connectivity constraints

More constrained.

The presence of NATs and firewalls places more constraints on the environment. 7/1/2004

http://esm.cs.cmu.edu

24

Outline • • • •

System overview Deployment status Deployment experience and system performance Lessons learned – Towards the next iteration….

7/1/2004

http://esm.cs.cmu.edu

25

Lessons learned: NATs/firewalls • Observation: There are a lot of NATs in the system (70%) • Problem: Fewer resources and poor performance • Solutions: – (1) Enabling NAT-NAT connections using UDP as the transport protocol – (2) Connectivity-aware structuring so hosts with public IP addresses use NATs as parents

7/1/2004

http://esm.cs.cmu.edu

26

Solutions Inefficient structure

Connectivity-optimal structure

NAT

NAT

XX

Resource Index: (3+5)/3 = 2.7

Resource Index: (3+3)/3 = 2.0

Increase Resource Index in Slashdot by 74%. 7/1/2004

http://esm.cs.cmu.edu

27

Lessons learned Automatic estimation of bandwidth • Observation: Some hosts lie about or misconfigure their bandwidth contributions • Problem: Poor performance • Solution: Measurement-based estimation of outgoing bandwidth can increase Resource Index by 20% Preferential treatment • Observation: Close to saturation • Problem: Cannot accept more hosts into the system • Solution: Preferential treatment of contributors avoids rejection of 78% of the hosts – Accept contributors at full streaming rate – Allow free-riders to join lower quality stream 7/1/2004

http://esm.cs.cmu.edu

28

Summary • First operational experience with a real broadcast application – 4000 viewers and 4 publishers

• Demonstrated the potential of end system multicast in a real application with real users – Can provide good performance for most of the broadcasts conducted to date

• Identified the importance of several issues that have not received attention in the research community – Resource constrained environment, NATs/firewalls

• Next big challenges – Wider and larger-scale deployment, security, interactivity, making the application friendly

7/1/2004

http://esm.cs.cmu.edu

29

Early Experience with an Internet Broadcast System ...

7/1/2004 http://esm.cs.cmu.edu. 2. Ubiquitous Internet Broadcasting. •Anyone can .... Sigcomm02. Bandwidth constrained: wireless, poor access bandwidth ...
Download PDF
1MB Sizes 2 Downloads 208 Views
Report

Recommend Documents

Early Experience with an Internet Broadcast ... - Semantic Scholar
lay parent changes over time, we direct the player to a fixed localhost:port URL which points to the overlay proxy run- ning at the same host. The overlay proxy handles all topol- ogy changes and sends data packets to the player as though it were a u
Early Research Experience With OpenAccess Gear: An ...
Apr 3, 2005 - Gear system, an open source software initiative intended to provide ... individual design database requires the development of parsers and.
Early Research Experience With OpenAccess Gear: An Open Source ...
Apr 3, 2005 - Keywords. EDA, database, open source, physical design, placement, timing. 1. ... an open source development environment with a library of tools and software ..... available for download from a separate web site [5]. Table 1.
An Experience With Oncology Nurses
and hyperactivity and accelerated behaviors .... Package for the Social Sciences (SPSS, ver- ... action effect existed between the degree of ..... Computer- and.
FREE Download Keith s Radio Station: Broadcast, Internet, and ...
produced, financed and delivered across a spectrum of technologies, including the newest technological trends such as streaming and podcasting, satellite, and HD. Radio, John Allen Hendricks and Bruce Mims argue that the future of radio remains brigh
Read PDF Keith s Radio Station: Broadcast, Internet ...
promotional usage of social media A revised examination of technologically advanced ... The new companion website features content for both students and ...
ePub Keith s Radio Station: Broadcast, Internet, and ...
Book Synopsis. Keith s Radio Station offers a concise and insightful guide to all aspects of radio operations, explaining the functions performed within.
Online PDF Keith s Radio Station: Broadcast, Internet ...
Major Currency Pairs Forex Quotes forex tradingcharts com forex tradingcharts .... promotional usage of social media A revised examination of technologically ...
Planning an event on cruise - Get the best experience with ...
Planning an event on cruise - Get the best experience with professionals.pdf. Planning an event on cruise - Get the best experience with professionals.pdf. Open.
Bubbles and Experience: An Experiment with a Steady ...
beginning of each market, two of the eight subjects in the waiting room were randomly selected to enter the market. They were replaced by another two inexperienced traders when a new market began. When those eight subjects were in the waiting room, t
(*PDF*) Click Millionaires: Work Less, Live More with an Internet ...
with an Internet Business You Love By #A# pdf ... audience communities to digital delivery, online services, affiliate marketing-even physical products; position.