US8649259B2 - Method and apparatus for implementing control of multiple physically dual homed devices - Google Patents

Method and apparatus for implementing control of multiple physically dual homed devices Download PDF

Info

Publication number
US8649259B2
US8649259B2 US13/471,712 US201213471712A US8649259B2 US 8649259 B2 US8649259 B2 US 8649259B2 US 201213471712 A US201213471712 A US 201213471712A US 8649259 B2 US8649259 B2 US 8649259B2
Authority
US
United States
Prior art keywords
ethernet switch
gateways
ethernet
switch unit
control plane
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
US13/471,712
Other versions
US20120230183A1 (en
Inventor
David Allan
Peter Ashwood-Smith
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
RPX Clearinghouse LLC
Original Assignee
Rockstar Consortium US LP
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Rockstar Consortium US LP filed Critical Rockstar Consortium US LP
Priority to US13/471,712 priority Critical patent/US8649259B2/en
Publication of US20120230183A1 publication Critical patent/US20120230183A1/en
Assigned to ROCKSTAR CONSORTIUM US LP reassignment ROCKSTAR CONSORTIUM US LP ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: Rockstar Bidco, LP
Priority to US14/176,223 priority patent/US20140153382A1/en
Application granted granted Critical
Publication of US8649259B2 publication Critical patent/US8649259B2/en
Assigned to RPX CLEARINGHOUSE LLC reassignment RPX CLEARINGHOUSE LLC ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: BOCKSTAR TECHNOLOGIES LLC, CONSTELLATION TECHNOLOGIES LLC, MOBILESTAR TECHNOLOGIES LLC, NETSTAR TECHNOLOGIES LLC, ROCKSTAR CONSORTIUM LLC, ROCKSTAR CONSORTIUM US LP
Assigned to JPMORGAN CHASE BANK, N.A., AS COLLATERAL AGENT reassignment JPMORGAN CHASE BANK, N.A., AS COLLATERAL AGENT SECURITY AGREEMENT Assignors: RPX CLEARINGHOUSE LLC, RPX CORPORATION
Assigned to RPX CORPORATION, RPX CLEARINGHOUSE LLC reassignment RPX CORPORATION RELEASE (REEL 038041 / FRAME 0001) Assignors: JPMORGAN CHASE BANK, N.A.
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00Data switching networks
    • H04L12/28Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
    • H04L12/42Loop networks
    • H04L12/437Ring fault isolation or reconfiguration
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L45/00Routing or path finding of packets in data switching networks
    • H04L45/66Layer 2 routing, e.g. in Ethernet based MAN's
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L41/00Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
    • H04L41/06Management of faults, events, alarms or notifications
    • H04L41/0654Management of faults, events, alarms or notifications using network fault recovery
    • H04L41/0659Management of faults, events, alarms or notifications using network fault recovery by isolating or reconfiguring faulty entities
    • H04L41/0661Management of faults, events, alarms or notifications using network fault recovery by isolating or reconfiguring faulty entities by reconfiguring faulty entities
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L41/00Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
    • H04L41/06Management of faults, events, alarms or notifications
    • H04L41/0654Management of faults, events, alarms or notifications using network fault recovery
    • H04L41/0668Management of faults, events, alarms or notifications using network fault recovery by dynamic selection of recovery network elements, e.g. replacement by the most appropriate element after failure
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L45/00Routing or path finding of packets in data switching networks
    • H04L45/28Routing or path finding of packets in data switching networks using route fault recovery
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L49/00Packet switching elements
    • H04L49/35Switches specially adapted for specific applications
    • H04L49/351Switches specially adapted for specific applications for local area network [LAN], e.g. Ethernet switches
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L49/00Packet switching elements
    • H04L49/70Virtual switches
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61KPREPARATIONS FOR MEDICAL, DENTAL OR TOILETRY PURPOSES
    • A61K31/00Medicinal preparations containing organic active ingredients
    • A61K31/33Heterocyclic compounds
    • A61K31/335Heterocyclic compounds having oxygen as the only ring hetero atom, e.g. fungichromin
    • A61K31/337Heterocyclic compounds having oxygen as the only ring hetero atom, e.g. fungichromin having four-membered rings, e.g. taxol
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61KPREPARATIONS FOR MEDICAL, DENTAL OR TOILETRY PURPOSES
    • A61K33/00Medicinal preparations containing inorganic active ingredients
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61KPREPARATIONS FOR MEDICAL, DENTAL OR TOILETRY PURPOSES
    • A61K47/00Medicinal preparations characterised by the non-active ingredients used, e.g. carriers or inert additives; Targeting or modifying agents chemically bound to the active ingredient
    • A61K47/06Organic compounds, e.g. natural or synthetic hydrocarbons, polyolefins, mineral oil, petrolatum or ozokerite
    • A61K47/08Organic compounds, e.g. natural or synthetic hydrocarbons, polyolefins, mineral oil, petrolatum or ozokerite containing oxygen, e.g. ethers, acetals, ketones, quinones, aldehydes, peroxides
    • A61K47/12Carboxylic acids; Salts or anhydrides thereof

Definitions

  • the present invention relates to communication networks and, more particularly, to a method and apparatus for implementing control of multiple physically dual homed devices.
  • Data communication networks may include various switches, routers, hubs, and other devices coupled to and configured to receive data and forward the data on the network. These devices will be referred to herein as “network elements.”
  • a network element is generally not a consumer of the data, but rather is used to receive and forward data so that the data may pass through the network.
  • Data is communicated through a network by enabling the network elements to pass protocol data units, such as frames, packets, cells or segments, between each other over communication links.
  • protocol data units such as frames, packets, cells or segments
  • the various network elements on the communication network communicate with each other using predefined sets of rules, referred to herein as protocols.
  • Different protocols are used to govern different aspects of the communication, such as how signals should be formed for transmission between the network elements, various aspects of what the protocol data units should look like, how protocol data units should be handled or routed through the network by the network elements, and how information such as routing information should be exchanged between the network elements.
  • a network service provider will generally implement one or more data centers to enable customers to connect to a communication network such as the Internet.
  • a data center may be used to house servers that enable users to connect to the corporate network or which provide other services on the network.
  • Example services include database services, email services, etc.
  • a large number of servers may be housed in a rack and connected to an Ethernet Switch Unit which connects the servers to a communication network.
  • the Ethernet Switch Unit will be co-located with the rack of servers.
  • the Ethernet switch unit will then connect to a large Gateway switch which will connect the Ethernet switch unit to higher bandwidth network such as a routed Ethernet network.
  • FIG. 1 shows an example data center in which servers 10 connect to one or more Ethernet switch units 12 , which in turn are connected to gateways 14 .
  • the gateways 14 provide connectivity to a routed Ethernet network 16 .
  • the Ethernet switch units will generally be dual-homed to a pair of gateway switches so that, if one of the gateway switches should fail, the other gateway can assume responsibility for forwarding traffic into the routed Ethernet network.
  • each of the Ethernet switch units 12 are connected to two different gateways (e.g. dual homed) to a pair of gateway switches 14 .
  • the gateway switches may individually assume responsibility to represent particular ESUs into the routed Ethernet network or, alternatively, may collaboratively represent the ESUs into the routed Ethernet network by treating the links from the ESUs to the gateways as a split multi-link trunk.
  • the gateway is required to advertise into the routed Ethernet network to represent the set of subtending servers.
  • the gateway will need to advertise the MAC address of the port via which the ESU is reached into the routed Ethernet network
  • the gateway will need to advertise the MAC address of the port via which the ESU is reached into the routed Ethernet network
  • the associated number of ports, and hence the number of MAC addresses being advertised into the routed Ethernet network e.g. an Ethernet network implemented using 802.1aq Shortest Path Backbone Bridging, although this may also apply to 802.1ah spanning tree controlled Ethernet networks
  • 802.1ah spanning tree controlled Ethernet networks may become excessive and expensive for the core to maintain. Accordingly, it would be advantageous to provide a way to reduce the number of MAC addresses that is required to be advertised into the routed Ethernet network.
  • One or more ring control protocol instances are run on the multiple physically dual homed devices in such a way that enables collections of dual homed devices to be represented by a single pair of addresses into the attached routed Ethernet network.
  • the gateway devices analyze the passing ring control packets to create direct mappings for data packets to the routed Ethernet network.
  • the dual homed devices are treated as a ring from a control perspective, the data path is implemented to be direct so that data packets continue to flow directly from the dual homed devices to each of the attached gateway devices.
  • Each of the gateway devices implements one or more virtual switches, which each serve to aggregate traffic from multiple attached ESUs into the routed Ethernet network.
  • Each virtual switch advertises its own MAC address into the routed Ethernet network rather than the MAC addresses of each of the attached Ethernet Switch Units so that fewer MAC addresses will be advertised by each of the gateways.
  • frames may be send to and received from the ESU directly or via the peer gateway (in failure scenarios).
  • Frames that are received from the Ethernet switch units are encapsulated at the virtual switch using a new Ethernet header identifying the virtual switch as the source of the data packets.
  • frames of data will be addressed to the virtual switch, which will demux packets using the C-MAC Ethernet header to pass the frames onto the correct output port to the correct Ethernet switch unit.
  • a set of Ethernet switch units is able to be represented into the routed Ethernet network using a pair of MAC addresses, while enabling data paths to continue to flow directly between the Ethernet switch units and the routed Ethernet network.
  • FIG. 1 is a functional diagram of a reference network showing a dual homed connection between Ethernet Switch Units and a pair of gateways;
  • FIG. 2 is a functional block diagram showing physical dual homed Ethernet switch units interconnecting with a pair of gateway switches;
  • FIG. 3 shows the flow of control information between the network devices arranged as shown in FIG. 2 according to one embodiment of the invention
  • FIG. 4 shows the logical flow of control information in the embodiment of FIG. 3 ;
  • FIGS. 5-6 show the flow of control information between the network devices arranged as shown in FIG. 2 according to another embodiment of the invention.
  • FIG. 7 shows the flow of data and the flow of control information through one of the gateways according to the embodiment of the invention shown in FIGS. 5-6 ;
  • FIG. 8 shows the flow of data and the flow of control information through one of the gateways according to the embodiment of the invention shown in FIGS. 3-4 .
  • FIG. 2 is a functional block diagram showing physical dual homed Ethernet switch units interconnecting with a pair of gateway switches.
  • each of the Ethernet switch units connects via one or more links to two or more Gateways 14 .
  • each of the gateways implements at least one virtual switch 18 that summarizes traffic from a plurality of Ethernet switch units into the routed Ethernet network 16 .
  • the virtual switch performs Mac-in-Mac encapsulation to add a B-MAC Ethernet header to the traffic as described in IEEE 802.1ah.
  • Each gateway may implement multiple virtual switches, each of which is responsible for handling traffic for a set of the attached Ethernet switch units.
  • sets of subtending ESUs that have a common peer gateway may be represented by a single MAC address into the routed Ethernet network rather than requiring each ESU to be individually represented into the routed Ethernet network.
  • the number of MAC addresses advertised into the core network may be reduced to increase scalability of the network.
  • one or more instances of a separate control plane is implemented between the virtual switches and attached set of physically dual homed devices (e.g. Ethernet switch units).
  • the control plane in one embodiment, is implemented using a ring control protocol so that control messages, e.g. link state advertisements, will follow the logical ring rather than following the data path on the network.
  • control messages e.g. link state advertisements
  • link state advertisements e.g. link state advertisements
  • control messages may be exchanged between the set of attached physical devices while enabling the set of attached physical devices to be represented into the attached routed Ethernet network using a pair of MAC addresses.
  • the control plane is implemented using a ring architecture, the data path from each physically dual homed device to the associated gateways remains point-to-point so that the selection of a ring-based control protocol does not affect the data traffic patterns on the network.
  • Ethernet Shared Protection Rings is a protocol designed to be used to control an Ethernet ring network having a group of serially interconnected nodes.
  • E-SPRING is defined as ITU-T SG15/Q9, G.8032, which specifies how the nodes on the ring should handle unicast, multicast, and broadcast frames. It also specifies multiple service classes, failure handling, and other aspects of how traffic should be forwarded by nodes on the Ethernet ring.
  • the manner in which an Ethernet ring operates is also described in greater detail in U.S. patent application Ser. No. 12/027,942, entitled Method And Apparatus For Controlling A Set Of Ethernet Nodes Interconnected To Form One Or More Closed Loops, filed Feb.
  • the control plane associated with the interconnection between the gateways and Ethernet switch units is implemented using a ring control protocol.
  • U.S. patent application Ser. No. 12/344,355, filed Dec. 26, 2008 describes a way of enabling a network implemented using a ring control protocol to be dual homed into an Ethernet network implementing a spanning tree control protocol
  • U.S. patent application Ser. No. 12/344,362, filed Dec. 26, 2008 describes a way of enabling a ring network implemented using a ring control protocol to be dual homed into an Ethernet network implementing traffic engineered trunks.
  • the content of each of these applications is hereby incorporated herein by reference.
  • FIG. 3 shows one example of how a ring control protocol may be used according to one embodiment of the invention.
  • each gateway has implemented a virtual switch that summarizes routes from the multiple Ethernet switch units into a single BMAC for advertisement on the network.
  • a separate ring protocol instance is used for each Ethernet Switch Unit.
  • a separate ring control instance may be used to create a logical control ring including one of the virtual switch instances in each of the gateways, as well as one of the Ethernet switch units.
  • a first ring control protocol instance is used to control Ethernet switch 1 and includes Ethernet Switch Unit 1 , virtual switch 1 , and virtual switch 2 .
  • a second ring control protocol instance is used to control Ethernet switch 2 .
  • the second ring control protocol instance includes Ethernet switch 2 , virtual switch 1 , and virtual switch 2 .
  • the ring control protocol enables traffic to be forwarded from the Ethernet switch unit to the correct gateway in a persistent manner so that link failures between the Ethernet switch units and the gateways is transparent to the routed network. For example, assume that traffic from Ethernet switch unit 1 was to be forwarded by the left gateway in FIG. 2 onto the routed Ethernet network.
  • the ring control protocol may implement a blocking port on the port leading to the right gateway, so that traffic flows from the Ethernet switch unit to the left gateway. If there is a failure on the link between Ethernet Switch Unit 1 and the left gateway, the ring control protocol will automatically remove the blocking port and move the blocking port to be adjacent the failure. This will cause the Ethernet switch unit to forward traffic out toward the gateway on the right.
  • the virtual switch in the right gateway will know that it is not responsible for forwarding traffic into the routed Ethernet network and will forward the traffic along the ring over the IST to the left gateway.
  • the virtual switch in the left gateway will thus receive the traffic from the Ethernet switch unit 1 via the IST and forward the traffic into the routed Ethernet network.
  • local failures between the Ethernet switch units and the gateway may be hidden from the routed Ethernet network, so that each end of the ring appears as an invariant B-MAC.
  • FIG. 8 shows an example of how the control traffic and data traffic would be handled by a virtual switch.
  • the virtual switch will forward data traffic onto the routed Ethernet network and will forward control traffic over the IST to enable the control traffic to pass over the ring to the other virtual switch.
  • the virtual switch will also forward data traffic over the IST. Accordingly, each virtual switch will only forward traffic for that set of ESUs that it is responsible to represent into the routed Ethernet network.
  • FIGS. 5-7 show another embodiment where groups of Ethernet switch units are logically formed into a single ring for control purposes by causing the gateway switches to u-turn control packets to enable multiple Ethernet switch units to exist on a common control ring.
  • FIG. 5 there are an even number of Ethernet switch units, which enables each of the gateway switches to directly interconnect each of the Ethernet switch units on the ring.
  • FIG. 6 shows another example in which there is an odd number of Ethernet switch units. In this instance one of the branches of the logical ring will need to extend over the Inter-switch trunk to complete the ring.
  • the example shown in FIG. 6 has the control traffic being passed over the IST, the invention is not limited in this regard as the control traffic could instead be passed by the virtual switch over the attached routed network.
  • FIG. 7 shows the difference between the data path and the control path in a gateway node.
  • interconnecting the Ethernet switch units in a logical ring for control purposes only affects the flow of control packets between the Ethernet switch units.
  • the control packets are looped back to enable a group of Ethernet switch units to be logically interconnected in a ring (e.g. as shown in FIG. 5 or 6 ) so that a ring control protocol may be used to manage these devices.
  • the data path associated with the Ethernet switch units is still point to point so that, when the gateway receives a data packet, it will forward the data packets directly onto the PLSB network in a normal manner.
  • implementing the control plane using a ring control protocol does not affect the manner in which the gateway switches handle data traffic on the network or how the gateway switches forward data onto the PLSB network.
  • the virtual switch 18 performs MAC learning to learn MAC addresses reachable via the attached ESU by watching the unique port the ESU is attached to.
  • the gateway When the gateway receives a data packet from an attached Ethernet switch unit, it will pass the packet to the virtual switch, which will perform BMAC encapsulation to enable the packet to be forwarded over the attached routed Ethernet network.
  • the virtual switch In the reverse direction, when the gateway receives a packet from the routed Ethernet network, the virtual switch will read the client MAC address and use the mapping to select an output port to forward the packet to the correct Ethernet switch unit.
  • each of the Ethernet Switch Units aggregates traffic from multiple clients. Traffic from that ESU may then be forwarded to a particular gateway or, alternatively, may be forwarded to virtual switches on two or more gateways. Likewise, traffic from a particular ESU may be forwarded to two or more virtual switches implemented on the same gateway. Traffic from a particular ESU may be transmitted in one or more VLANs to enable traffic to be directed to different virtual switches within the same ESU, so that each ESU can aggregate a portion of the traffic for the ESU into the attached routed Ethernet network.
  • ASIC Application Specific Integrated Circuit
  • FPGA Field Programmable Gate Array
  • Programmable logic can be fixed temporarily or permanently in a tangible medium such as a read-only memory chip, a computer memory, a disk, or other storage medium. All such embodiments are intended to fall within the scope of the present invention.

Abstract

A ring control protocol is used to establish a separate control plane for a plurality of physically dual homed devices to enable collections of dual homed devices to be represented by a single pair of addresses into the attached routed Ethernet network. The gateway devices analyze the passing ring control packets to create direct mappings for data packets to the routed Ethernet network. Thus, although the dual homed devices are treated as a ring from a control perspective, the data path is implemented to be direct so that data packets continue to flow directly from the dual homed devices to each of the attached gateway devices. In one embodiment, each of the gateway devices implements a virtual switch and advertises the MAC address of the virtual switch into the routed Ethernet network rather than the MAC addresses of each of the attached Ethernet Switch Units.

Description

RELATED APPLICATION
This application is a continuation of co-pending U.S. patent application Ser. No. 12/487,407, filed on Jun. 18, 2009, entitled METHOD AND APPARATUS FOR IMPLEMENTING CONTROL OF MULTIPLE PHYSICALLY DUAL HOMED DEVICES, which is hereby incorporated herein by reference in its entirety.
TECHNICAL FIELD
The present invention relates to communication networks and, more particularly, to a method and apparatus for implementing control of multiple physically dual homed devices.
BACKGROUND
Data communication networks may include various switches, routers, hubs, and other devices coupled to and configured to receive data and forward the data on the network. These devices will be referred to herein as “network elements.” A network element is generally not a consumer of the data, but rather is used to receive and forward data so that the data may pass through the network. Data is communicated through a network by enabling the network elements to pass protocol data units, such as frames, packets, cells or segments, between each other over communication links. A particular protocol data unit may be handled by multiple network elements and cross multiple communication links as it travels between its source and its destination over the network.
The various network elements on the communication network communicate with each other using predefined sets of rules, referred to herein as protocols. Different protocols are used to govern different aspects of the communication, such as how signals should be formed for transmission between the network elements, various aspects of what the protocol data units should look like, how protocol data units should be handled or routed through the network by the network elements, and how information such as routing information should be exchanged between the network elements.
A network service provider will generally implement one or more data centers to enable customers to connect to a communication network such as the Internet. Likewise, in an enterprise, a data center may be used to house servers that enable users to connect to the corporate network or which provide other services on the network. Example services include database services, email services, etc.
In a data center, a large number of servers (e.g. 24 servers) may be housed in a rack and connected to an Ethernet Switch Unit which connects the servers to a communication network. Typically, the Ethernet Switch Unit will be co-located with the rack of servers. The Ethernet switch unit will then connect to a large Gateway switch which will connect the Ethernet switch unit to higher bandwidth network such as a routed Ethernet network.
FIG. 1 shows an example data center in which servers 10 connect to one or more Ethernet switch units 12, which in turn are connected to gateways 14. The gateways 14 provide connectivity to a routed Ethernet network 16. The Ethernet switch units will generally be dual-homed to a pair of gateway switches so that, if one of the gateway switches should fail, the other gateway can assume responsibility for forwarding traffic into the routed Ethernet network. For example, in FIG. 1, each of the Ethernet switch units 12 are connected to two different gateways (e.g. dual homed) to a pair of gateway switches 14. The gateway switches may individually assume responsibility to represent particular ESUs into the routed Ethernet network or, alternatively, may collaboratively represent the ESUs into the routed Ethernet network by treating the links from the ESUs to the gateways as a split multi-link trunk.
Although it is possible to envision multiple ESUs in a chain connected to a pair of gateway nodes, such a configuration is vulnerable to multiple failures. Hence dual homing of individual switches directly to the gateways is desirable since the configuration is less susceptible to failure.
Large data centers may require layer two connectivity for communities of 10s to 100s of thousands of servers. To enable this configuration to be able to scale, one of the key metrics to consider is the number of MAC addresses the gateway is required to advertise into the routed Ethernet network to represent the set of subtending servers. Specifically, when the ESU is connected directly to the gateway, the gateway will need to advertise the MAC address of the port via which the ESU is reached into the routed Ethernet network Normally as the number of Ethernet switch units increases, the associated number of ports, and hence the number of MAC addresses being advertised into the routed Ethernet network (e.g. an Ethernet network implemented using 802.1aq Shortest Path Backbone Bridging, although this may also apply to 802.1ah spanning tree controlled Ethernet networks) may become excessive and expensive for the core to maintain. Accordingly, it would be advantageous to provide a way to reduce the number of MAC addresses that is required to be advertised into the routed Ethernet network.
SUMMARY OF THE INVENTION
One or more ring control protocol instances are run on the multiple physically dual homed devices in such a way that enables collections of dual homed devices to be represented by a single pair of addresses into the attached routed Ethernet network. The gateway devices analyze the passing ring control packets to create direct mappings for data packets to the routed Ethernet network. Thus, although the dual homed devices are treated as a ring from a control perspective, the data path is implemented to be direct so that data packets continue to flow directly from the dual homed devices to each of the attached gateway devices. Each of the gateway devices implements one or more virtual switches, which each serve to aggregate traffic from multiple attached ESUs into the routed Ethernet network. Each virtual switch advertises its own MAC address into the routed Ethernet network rather than the MAC addresses of each of the attached Ethernet Switch Units so that fewer MAC addresses will be advertised by each of the gateways. When resiliency is provided for by a peer gateway, frames may be send to and received from the ESU directly or via the peer gateway (in failure scenarios). Frames that are received from the Ethernet switch units are encapsulated at the virtual switch using a new Ethernet header identifying the virtual switch as the source of the data packets. In the reverse direction, frames of data will be addressed to the virtual switch, which will demux packets using the C-MAC Ethernet header to pass the frames onto the correct output port to the correct Ethernet switch unit. By running a separate control plane between the Ethernet switch units and the gateway, a set of Ethernet switch units is able to be represented into the routed Ethernet network using a pair of MAC addresses, while enabling data paths to continue to flow directly between the Ethernet switch units and the routed Ethernet network.
BRIEF DESCRIPTION OF THE DRAWINGS
Aspects of the present invention are pointed out with particularity in the appended claims. The present invention is illustrated by way of example in the following drawings in which like references indicate similar elements. The following drawings disclose various embodiments of the present invention for purposes of illustration only and are not intended to limit the scope of the invention. For purposes of clarity, not every component may be labeled in every figure. In the figures:
FIG. 1 is a functional diagram of a reference network showing a dual homed connection between Ethernet Switch Units and a pair of gateways;
FIG. 2 is a functional block diagram showing physical dual homed Ethernet switch units interconnecting with a pair of gateway switches;
FIG. 3 shows the flow of control information between the network devices arranged as shown in FIG. 2 according to one embodiment of the invention;
FIG. 4 shows the logical flow of control information in the embodiment of FIG. 3;
FIGS. 5-6 show the flow of control information between the network devices arranged as shown in FIG. 2 according to another embodiment of the invention;
FIG. 7 shows the flow of data and the flow of control information through one of the gateways according to the embodiment of the invention shown in FIGS. 5-6; and
FIG. 8 shows the flow of data and the flow of control information through one of the gateways according to the embodiment of the invention shown in FIGS. 3-4.
DETAILED DESCRIPTION
FIG. 2 is a functional block diagram showing physical dual homed Ethernet switch units interconnecting with a pair of gateway switches. As shown in FIG. 2, each of the Ethernet switch units connects via one or more links to two or more Gateways 14. According to an embodiment, each of the gateways implements at least one virtual switch 18 that summarizes traffic from a plurality of Ethernet switch units into the routed Ethernet network 16. In one embodiment, the virtual switch performs Mac-in-Mac encapsulation to add a B-MAC Ethernet header to the traffic as described in IEEE 802.1ah. Each gateway may implement multiple virtual switches, each of which is responsible for handling traffic for a set of the attached Ethernet switch units. By implementing a virtual switch, sets of subtending ESUs that have a common peer gateway may be represented by a single MAC address into the routed Ethernet network rather than requiring each ESU to be individually represented into the routed Ethernet network. Hence, the number of MAC addresses advertised into the core network may be reduced to increase scalability of the network.
According to an embodiment of the invention, one or more instances of a separate control plane is implemented between the virtual switches and attached set of physically dual homed devices (e.g. Ethernet switch units). The control plane, in one embodiment, is implemented using a ring control protocol so that control messages, e.g. link state advertisements, will follow the logical ring rather than following the data path on the network. By utilizing a ring control protocol, control messages may be exchanged between the set of attached physical devices while enabling the set of attached physical devices to be represented into the attached routed Ethernet network using a pair of MAC addresses. However, whereas the control plane is implemented using a ring architecture, the data path from each physically dual homed device to the associated gateways remains point-to-point so that the selection of a ring-based control protocol does not affect the data traffic patterns on the network.
It should be noted that simply having a common MAC address for all devices connected to the gateway node in many cases is not sufficient, this is because under failure of the node the recovery actions may not be aligned. There may be customers directly attached to the switch, or sets of switches for which there is a different peer gateway in the dual homed arrangement. Hence a MAC address is assigned for a set of subtending switches that have a common recovery behavior under failure.
Ethernet Shared Protection Rings (E-SPRING) is a protocol designed to be used to control an Ethernet ring network having a group of serially interconnected nodes. E-SPRING is defined as ITU-T SG15/Q9, G.8032, which specifies how the nodes on the ring should handle unicast, multicast, and broadcast frames. It also specifies multiple service classes, failure handling, and other aspects of how traffic should be forwarded by nodes on the Ethernet ring. The manner in which an Ethernet ring operates is also described in greater detail in U.S. patent application Ser. No. 12/027,942, entitled Method And Apparatus For Controlling A Set Of Ethernet Nodes Interconnected To Form One Or More Closed Loops, filed Feb. 7, 2008, the content of which is hereby incorporated herein by reference. In one embodiment, the control plane associated with the interconnection between the gateways and Ethernet switch units is implemented using a ring control protocol. U.S. patent application Ser. No. 12/344,355, filed Dec. 26, 2008, describes a way of enabling a network implemented using a ring control protocol to be dual homed into an Ethernet network implementing a spanning tree control protocol, and U.S. patent application Ser. No. 12/344,362, filed Dec. 26, 2008, describes a way of enabling a ring network implemented using a ring control protocol to be dual homed into an Ethernet network implementing traffic engineered trunks. The content of each of these applications is hereby incorporated herein by reference.
FIG. 3 shows one example of how a ring control protocol may be used according to one embodiment of the invention. In this embodiment, each gateway has implemented a virtual switch that summarizes routes from the multiple Ethernet switch units into a single BMAC for advertisement on the network. In this example, a separate ring protocol instance is used for each Ethernet Switch Unit. For example, as shown in FIG. 4, a separate ring control instance may be used to create a logical control ring including one of the virtual switch instances in each of the gateways, as well as one of the Ethernet switch units. Thus, in FIG. 4, a first ring control protocol instance is used to control Ethernet switch 1 and includes Ethernet Switch Unit 1, virtual switch 1, and virtual switch 2. Likewise, a second ring control protocol instance is used to control Ethernet switch 2. In this embodiment, the second ring control protocol instance includes Ethernet switch 2, virtual switch 1, and virtual switch 2.
The ring control protocol enables traffic to be forwarded from the Ethernet switch unit to the correct gateway in a persistent manner so that link failures between the Ethernet switch units and the gateways is transparent to the routed network. For example, assume that traffic from Ethernet switch unit 1 was to be forwarded by the left gateway in FIG. 2 onto the routed Ethernet network. The ring control protocol may implement a blocking port on the port leading to the right gateway, so that traffic flows from the Ethernet switch unit to the left gateway. If there is a failure on the link between Ethernet Switch Unit 1 and the left gateway, the ring control protocol will automatically remove the blocking port and move the blocking port to be adjacent the failure. This will cause the Ethernet switch unit to forward traffic out toward the gateway on the right. The virtual switch in the right gateway will know that it is not responsible for forwarding traffic into the routed Ethernet network and will forward the traffic along the ring over the IST to the left gateway. The virtual switch in the left gateway will thus receive the traffic from the Ethernet switch unit 1 via the IST and forward the traffic into the routed Ethernet network. By implementing a ring control protocol, local failures between the Ethernet switch units and the gateway may be hidden from the routed Ethernet network, so that each end of the ring appears as an invariant B-MAC.
Although the control traffic flows as shown in FIG. 3, the data traffic from each of the switch units is passed to the selected virtual switch and is passed from the virtual switch onto the attached routed Ethernet network. FIG. 8 shows an example of how the control traffic and data traffic would be handled by a virtual switch. As shown in FIG. 8, the virtual switch will forward data traffic onto the routed Ethernet network and will forward control traffic over the IST to enable the control traffic to pass over the ring to the other virtual switch. Of course, as described above, under failure conditions there may be instances where the virtual switch will also forward data traffic over the IST. Accordingly, each virtual switch will only forward traffic for that set of ESUs that it is responsible to represent into the routed Ethernet network.
FIGS. 5-7 show another embodiment where groups of Ethernet switch units are logically formed into a single ring for control purposes by causing the gateway switches to u-turn control packets to enable multiple Ethernet switch units to exist on a common control ring. In the embodiment shown in FIG. 5, there are an even number of Ethernet switch units, which enables each of the gateway switches to directly interconnect each of the Ethernet switch units on the ring. FIG. 6 shows another example in which there is an odd number of Ethernet switch units. In this instance one of the branches of the logical ring will need to extend over the Inter-switch trunk to complete the ring. Although the example shown in FIG. 6 has the control traffic being passed over the IST, the invention is not limited in this regard as the control traffic could instead be passed by the virtual switch over the attached routed network.
FIG. 7 shows the difference between the data path and the control path in a gateway node. As shown in FIG. 7, interconnecting the Ethernet switch units in a logical ring for control purposes only affects the flow of control packets between the Ethernet switch units. Specifically, in the embodiment shown in FIG. 7 the control packets are looped back to enable a group of Ethernet switch units to be logically interconnected in a ring (e.g. as shown in FIG. 5 or 6) so that a ring control protocol may be used to manage these devices. However, the data path associated with the Ethernet switch units is still point to point so that, when the gateway receives a data packet, it will forward the data packets directly onto the PLSB network in a normal manner. Thus, implementing the control plane using a ring control protocol does not affect the manner in which the gateway switches handle data traffic on the network or how the gateway switches forward data onto the PLSB network.
The virtual switch 18 performs MAC learning to learn MAC addresses reachable via the attached ESU by watching the unique port the ESU is attached to. When the gateway receives a data packet from an attached Ethernet switch unit, it will pass the packet to the virtual switch, which will perform BMAC encapsulation to enable the packet to be forwarded over the attached routed Ethernet network. In the reverse direction, when the gateway receives a packet from the routed Ethernet network, the virtual switch will read the client MAC address and use the mapping to select an output port to forward the packet to the correct Ethernet switch unit.
As discussed above, each of the Ethernet Switch Units aggregates traffic from multiple clients. Traffic from that ESU may then be forwarded to a particular gateway or, alternatively, may be forwarded to virtual switches on two or more gateways. Likewise, traffic from a particular ESU may be forwarded to two or more virtual switches implemented on the same gateway. Traffic from a particular ESU may be transmitted in one or more VLANs to enable traffic to be directed to different virtual switches within the same ESU, so that each ESU can aggregate a portion of the traffic for the ESU into the attached routed Ethernet network.
The functions described above may be implemented as a set of program instructions that are stored in a computer readable memory and executed on one or more processors on the computer platform. However, it will be apparent to a skilled artisan that all logic described herein can be embodied using discrete components, integrated circuitry such as an Application Specific Integrated Circuit (ASIC), programmable logic used in conjunction with a programmable logic device such as a Field Programmable Gate Array (FPGA) or microprocessor, a state machine, or any other device including any combination thereof. Programmable logic can be fixed temporarily or permanently in a tangible medium such as a read-only memory chip, a computer memory, a disk, or other storage medium. All such embodiments are intended to fall within the scope of the present invention.
It should be understood that various changes and modifications of the embodiments shown in the drawings and described in the specification may be made within the spirit and scope of the present invention. Accordingly, it is intended that all matter contained in the above description and shown in the accompanying drawings be interpreted in an illustrative and not in a limiting sense.

Claims (18)

What is claimed is:
1. A method of coupling at least one Ethernet switch unit comprising an Ethernet switch unit Media Access Control (MAC) address to a routing-protocol-controlled Ethernet network, the method comprising:
dual homing the at least one Ethernet switch unit on a pair of gateways connected to the routing-protocol-controlled Ethernet network, the pair of gateways being connected by an inter-gateway trunk;
configuring the at least one Ethernet switch unit and the pair of gateways to implement a control plane logical ring linking the at least one Ethernet switch unit to the pair of gateways;
associating a common Media Access Control (MAC) address of the routing-protocol-controlled Ethernet network with each Ethernet switch unit linked to the pair of gateways via the control plane logical ring; and
representing, into the routing-protocol-controlled Ethernet network at one of the gateways using the common MAC address in lieu of the Ethernet switch unit MAC address, packets received from each Ethernet switch unit linked to the pair of gateways via the control plane logical ring.
2. The method of claim 1, comprising coupling a plurality of Ethernet switch units to the routing-protocol-controlled Ethernet network by:
dual homing each Ethernet switch unit on the pair of gateways;
configuring the plurality of Ethernet switch units and the pair of gateways to implement a separate control plane logical ring for each Ethernet switch unit;
associating a respective MAC address of the routing-protocol-controlled Ethernet network with each Ethernet switch unit; and
representing, into the routing-protocol-controlled Ethernet network at one of the gateways using the respective MAC address of the routing-protocol-controlled Ethernet network, each Ethernet switch unit linked to the pair of gateways via the separate control plane logical ring.
3. The method of claim 2, wherein representing, into the routing-protocol-controlled Ethernet network at one of the gateways using the respective MAC address, each Ethernet switch unit linked to the pair of gateways via the separate control plane logical ring comprises representing some of the Ethernet switch units at one gateway and representing others of the Ethernet switch units at the other gateway.
4. The method of claim 1, comprising coupling a plurality of Ethernet switch units to the routing-protocol-controlled Ethernet network by:
dual homing each Ethernet switch unit of the plurality of Ethernet switch units on the pair of gateways, each Ethernet switch unit have a different Ethernet switch unit MAC address associated therewith;
configuring the plurality of Ethernet switch units and the pair of gateways to implement a common control plane logical ring for the plurality of Ethernet switch units;
associating the common MAC address of the routing-protocol-controlled Ethernet network with each Ethernet switch unit of the plurality of Ethernet switch units; and
representing, into the routing-protocol-controlled Ethernet network at one of the gateways using the common MAC address in lieu of the Ethernet switch unit MAC address associated with each Ethernet switch unit, packets received from each Ethernet switch unit linked to the pair of gateways via the common control plane logical ring.
5. The method of claim 4, wherein representing, into the routing-protocol-controlled Ethernet network at one of the gateways using the common MAC address, each Ethernet switch unit linked to the pair of gateways via the common control plane logical ring comprises representing some of the Ethernet switch units at one gateway and representing others of the Ethernet switch units at the other gateway.
6. The method of claim 1, comprising coupling a plurality of Ethernet switch units to the routing-protocol-controlled Ethernet network by:
dual homing each Ethernet switch unit on the pair of gateways;
configuring the plurality of Ethernet switch units and the pair of gateways to implement plural control plane logical rings, each control plane logical ring linking at least one Ethernet switch unit to the pair of gateways;
associating a respective common MAC address of the routing-protocol-controlled Ethernet network with the Ethernet switch units of each control plane logical ring; and
representing, into the routing-protocol-controlled Ethernet network at one of the gateways using the respective common MAC address, each Ethernet switch unit linked to the pair of gateways via the control plane logical ring.
7. The method of claim 6, comprising grouping together, into each separate control plane logical ring, Ethernet switch units requiring common recovery behavior under failure.
8. The method of claim 6, wherein representing, into the routing-protocol-controlled Ethernet network at one of the gateways using the respective common MAC address, each Ethernet switch unit linked to the pair of gateways via the control plane logical ring comprises representing some of the Ethernet switch units at one gateway and representing others of the Ethernet switch units at the other gateway.
9. The method of claim 1, wherein representing, into the routing-protocol-controlled Ethernet network at one of the gateways using the common MAC address, each Ethernet switch unit linked to the pair of gateways via the control plane logical ring comprises advertising the common MAC address into the routing-protocol-controlled Ethernet network such that data traffic can be directed over the routing-protocol-controlled Ethernet network to each Ethernet switch unit linked to the pair of gateways via the control plane logical ring using the common MAC address.
10. The method of claim 1, comprising configuring each Ethernet switch unit with a direct data path to the pair of gateways such that data traffic does not follow the control plane logical ring.
11. The method of claim 1, comprising operating the control plane logical ring according to the Ethernet shared protection rings (E-SPRING) protocol.
12. The method of claim 1, comprising configuring at least one virtual switch at each gateway to summarize routes from Ethernet switch units homed on the each gateway.
13. The method of claim 12, comprising configuring the at least one virtual switch to encapsulate data traffic passing into the routing-protocol-controlled Ethernet network from an Ethernet switch unit with the common MAC address of the routing-protocol-controlled Ethernet network which is associated with the Ethernet switch unit.
14. The method of claim 12, comprising configuring the at least one virtual switch to decapsulate data traffic passing from the routing-protocol-controller Ethernet network to an Ethernet switch unit to remove a routing-protocol-controlled Ethernet network MAC address.
15. The method of claim 1, wherein for each control plane logical ring linking an odd number of Ethernet switch units to the pair of gateways, the gateways use the inter-gateway trunk to complete the control plane logical ring.
16. The method of claim 1, comprising:
forwarding control plane traffic from a first Ethernet switch unit in the control plane logical ring to a first gateway of the pair of gateways;
forwarding the control plane traffic from the first gateway to a second Ethernet switch unit in the control plane logical ring; and
forwarding the control plane traffic from the second Ethernet switch unit to a second gateway of the pair of gateways.
17. The method of claim 16, further comprising forwarding the control plane traffic from the second gateway to the first gateway via the inter-gateway trunk.
18. The method of claim 16, further comprising forwarding the control plane traffic from the second gateway to a third Ethernet switch unit in the control plane logical ring.
US13/471,712 2009-06-18 2012-05-15 Method and apparatus for implementing control of multiple physically dual homed devices Expired - Fee Related US8649259B2 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
US13/471,712 US8649259B2 (en) 2009-06-18 2012-05-15 Method and apparatus for implementing control of multiple physically dual homed devices
US14/176,223 US20140153382A1 (en) 2009-06-18 2014-02-10 Method and apparatus for implementing control of multiple physically dual homed devices

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US12/487,407 US8184648B2 (en) 2009-06-18 2009-06-18 Method and apparatus for implementing control of multiple physically dual homed devices
US13/471,712 US8649259B2 (en) 2009-06-18 2012-05-15 Method and apparatus for implementing control of multiple physically dual homed devices

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US12/487,407 Continuation US8184648B2 (en) 2009-06-18 2009-06-18 Method and apparatus for implementing control of multiple physically dual homed devices

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US14/176,223 Continuation US20140153382A1 (en) 2009-06-18 2014-02-10 Method and apparatus for implementing control of multiple physically dual homed devices

Publications (2)

Publication Number Publication Date
US20120230183A1 US20120230183A1 (en) 2012-09-13
US8649259B2 true US8649259B2 (en) 2014-02-11

Family

ID=43354336

Family Applications (3)

Application Number Title Priority Date Filing Date
US12/487,407 Expired - Fee Related US8184648B2 (en) 2009-06-18 2009-06-18 Method and apparatus for implementing control of multiple physically dual homed devices
US13/471,712 Expired - Fee Related US8649259B2 (en) 2009-06-18 2012-05-15 Method and apparatus for implementing control of multiple physically dual homed devices
US14/176,223 Abandoned US20140153382A1 (en) 2009-06-18 2014-02-10 Method and apparatus for implementing control of multiple physically dual homed devices

Family Applications Before (1)

Application Number Title Priority Date Filing Date
US12/487,407 Expired - Fee Related US8184648B2 (en) 2009-06-18 2009-06-18 Method and apparatus for implementing control of multiple physically dual homed devices

Family Applications After (1)

Application Number Title Priority Date Filing Date
US14/176,223 Abandoned US20140153382A1 (en) 2009-06-18 2014-02-10 Method and apparatus for implementing control of multiple physically dual homed devices

Country Status (4)

Country Link
US (3) US8184648B2 (en)
EP (1) EP2443808A4 (en)
CN (1) CN102461120A (en)
WO (1) WO2010145025A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150271010A1 (en) * 2014-03-20 2015-09-24 Sudhir V. Shetty Systems And Methods For Automatic Access Layer Configuration

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8625410B2 (en) * 2009-05-11 2014-01-07 Ciena Corporation Dual homed E-spring protection for network domain interworking
US8446818B2 (en) * 2010-11-01 2013-05-21 Avaya Inc. Routed split multi-link trunking resiliency for wireless local area network split-plane environments
US8861339B2 (en) * 2010-11-01 2014-10-14 Avaya Inc. Packet forwarding function of a mobility switch deployed as routed SMLT (RSMLT) node
US8817593B2 (en) * 2010-11-01 2014-08-26 Avaya Inc. Method and apparatus providing failover for a point to point tunnel for wireless local area network split-plane environments
US8923296B2 (en) * 2012-02-23 2014-12-30 Big Switch Networks, Inc. System and methods for managing network packet forwarding with a controller
US9264254B2 (en) 2012-03-30 2016-02-16 Ciena Corporation Generalized service protection systems and methods
US20140156906A1 (en) * 2012-11-30 2014-06-05 Broadcom Corporation Virtual Trunking Over Physical Links
US9160678B2 (en) * 2013-04-15 2015-10-13 International Business Machines Corporation Flow control credits for priority in lossless ethernet
CN104717081B (en) * 2013-12-13 2018-01-23 杭州华为数字技术有限公司 The implementation method and device of a kind of gateway function

Citations (47)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5299312A (en) 1990-11-15 1994-03-29 Massachusetts Institute Of Technology Network fault recovery by controllable switching of subnetworks
US5489896A (en) * 1992-10-18 1996-02-06 Lannet Data Communications Ltd. Network with a security capability
US5953314A (en) 1997-08-28 1999-09-14 Ascend Communications, Inc. Control processor switchover for a telecommunications switch
US6188689B1 (en) * 1996-10-04 2001-02-13 Kabushiki Kaisha Toshiba Network node and method of frame transfer
US6195351B1 (en) * 1998-01-28 2001-02-27 3Com Corporation Logical switch set
US6246692B1 (en) 1998-02-03 2001-06-12 Broadcom Corporation Packet switching fabric using the segmented ring with resource reservation control
US20020010869A1 (en) * 2000-06-07 2002-01-24 Young-Il Kim MAC address-based communication restricting method
US20020019958A1 (en) 2000-08-07 2002-02-14 Cantwell Larry J. Method and apparatus for imparting fault tolerance in a switch or the like
US20020023170A1 (en) 2000-03-02 2002-02-21 Seaman Michael J. Use of active topology protocols, including the spanning tree, for resilient redundant connection of an edge device
US20020191250A1 (en) 2001-06-01 2002-12-19 Graves Alan F. Communications network for a metropolitan area
US6594776B1 (en) * 2000-06-28 2003-07-15 Advanced Micro Devices, Inc. Mechanism to clear MAC address from Ethernet switch address table to enable network link fail-over across two network segments
US20030185149A1 (en) 2002-03-29 2003-10-02 Daniell Piers John Expansion of telecommunications networks with automatic protection switching
US20030189898A1 (en) * 2002-04-04 2003-10-09 Frick John Kevin Methods and systems for providing redundant connectivity across a network using a tunneling protocol
US20040100970A1 (en) * 2002-11-27 2004-05-27 Gerdisch Mitchell R. Methods for providing a reliable server architecture using a multicast topology in a communications network
US20050066216A1 (en) * 2003-09-18 2005-03-24 Cisco Technology, Inc. High availability virtual switch
US20050190752A1 (en) * 2004-02-27 2005-09-01 Cheng-Mau Chiou Method and system for locating the incoming port of a MAC address in an Ethernet switch network
US20050276215A1 (en) 2004-06-10 2005-12-15 Makoto Kitani Network relay system and control method thereof
US7093027B1 (en) * 2002-07-23 2006-08-15 Atrica Israel Ltd. Fast connection protection in a virtual local area network based stack environment
US20070047436A1 (en) * 2005-08-24 2007-03-01 Masaya Arai Network relay device and control method
US20070076719A1 (en) 2005-10-05 2007-04-05 Nortel Networks Limited Provider backbone bridging - provider backbone transport internetworking
US7246168B1 (en) * 1998-11-19 2007-07-17 Cisco Technology, Inc. Technique for improving the interaction between data link switch backup peer devices and ethernet switches
US20070165648A1 (en) * 2006-01-16 2007-07-19 Min-Kyu Joo Packet processing apparatus and method
US7345991B1 (en) * 2003-05-28 2008-03-18 Atrica Israel Ltd. Connection protection mechanism for dual homed access, aggregation and customer edge devices
US20080159124A1 (en) * 2006-12-28 2008-07-03 Fujitsu Limited Method for redundant linking lines and wide area network node device
US7403523B2 (en) * 2004-04-28 2008-07-22 Tekelec Methods and systems for tunneling packets of a ring-topology-based link level communications protocol over a network having a star topology using a star-topology-based link level communications protocol
US20080183854A1 (en) * 2003-12-10 2008-07-31 Hopen Chris A Network Appliance
US7411963B2 (en) 2005-01-19 2008-08-12 Cisco Technology, Inc. Method for dissemination of non-routing information using the IS-IS protocol
US20080225695A1 (en) 2007-03-13 2008-09-18 Florin Balus Failure protection in a provider backbone bridge network using forced mac flushing
US20080239946A1 (en) 2007-03-28 2008-10-02 Fujitsu Limited Communication system, switch
US20080279096A1 (en) * 2007-05-11 2008-11-13 Sullivan Michael J Lightweight node based network redundancy solution leveraging rapid spanning tree protocol (rstp)
US20080304477A1 (en) * 2004-09-30 2008-12-11 Ingvar Froroth Carrier Class Resilience Solution For Switched Ethernet Local Area Networks (Lans)
US20090168671A1 (en) * 2007-12-31 2009-07-02 Nortel Networks Limited Interworking an Ethernet Ring Network with a Spanning Tree Controlled Ethernet Network
US20090168647A1 (en) * 2007-12-31 2009-07-02 Nortel Networks Limited Interworking an Ethernet Ring Network and an Ethernet Network with Traffic Engineered Trunks
US20090276842A1 (en) * 2008-02-28 2009-11-05 Level 3 Communications, Llc Load-Balancing Cluster
US7639605B2 (en) 2006-02-08 2009-12-29 Cisco Technology, Inc. System and method for detecting and recovering from virtual switch link failures
US7643468B1 (en) * 2004-10-28 2010-01-05 Cisco Technology, Inc. Data-center network architecture
US20100020680A1 (en) * 2008-07-28 2010-01-28 Salam Samer M Multi-chassis ethernet link aggregation
US20100142544A1 (en) 2007-03-14 2010-06-10 Zonit Structured Solutions, Llc Data center network distribution system
US7751416B2 (en) * 2003-09-18 2010-07-06 Cisco Technology, Inc. Virtual network device
US20100189117A1 (en) * 2009-01-28 2010-07-29 Cisco Technology, Inc. Distributed IP Gateway Based on Sharing a MAC Address and IP Address Concurrently Between a First Network Switching Device and a Second Network Switching Device
US20100284413A1 (en) * 2009-05-11 2010-11-11 Nortel Networks Limited Dual homed e-spring protection for network domain interworking
US7925817B2 (en) 2008-04-16 2011-04-12 Hitachi, Ltd. Computer system and method for monitoring an access path
US7974388B2 (en) * 2004-03-05 2011-07-05 Avaya Inc. Advanced port-based E911 strategy for IP telephony
US8077709B2 (en) * 2007-09-19 2011-12-13 Cisco Technology, Inc. Redundancy at a virtual provider edge node that faces a tunneling protocol core network for virtual private local area network (LAN) service (VPLS)
US8125928B2 (en) * 2009-07-24 2012-02-28 Juniper Networks, Inc. Routing frames in a shortest path computer network for a multi-homed legacy bridge node
US8284656B2 (en) * 2006-04-28 2012-10-09 Alcatel Lucent System and method for resilient VPLS over multi-nodal APS protected provider edge nodes
US8467316B1 (en) * 2010-12-29 2013-06-18 Juniper Networks, Inc. Enhanced address learning in layer two computer networks

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050190757A1 (en) * 2004-02-27 2005-09-01 Cisco Technology Inc. Interworking between Ethernet and non-Ethernet customer sites for VPLS
US7296092B2 (en) * 2004-06-30 2007-11-13 Nokia, Inc. Apparatus for inter-domain communications including a virtual switch for routing data packets between virtual interfaces of the virtual switch
CN1812300B (en) * 2005-01-28 2010-07-07 武汉烽火网络有限责任公司 Loop network connection control method, route exchanging equipment and loop network system
CN101371525A (en) * 2005-10-05 2009-02-18 北方电讯网络有限公司 Provider backbone bridging - provider backbone transport internetworking
US8724449B2 (en) * 2009-06-10 2014-05-13 Cisco Technology, Inc. Failure protection for access ring topology

Patent Citations (50)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5299312A (en) 1990-11-15 1994-03-29 Massachusetts Institute Of Technology Network fault recovery by controllable switching of subnetworks
US5489896A (en) * 1992-10-18 1996-02-06 Lannet Data Communications Ltd. Network with a security capability
US6188689B1 (en) * 1996-10-04 2001-02-13 Kabushiki Kaisha Toshiba Network node and method of frame transfer
US5953314A (en) 1997-08-28 1999-09-14 Ascend Communications, Inc. Control processor switchover for a telecommunications switch
US6195351B1 (en) * 1998-01-28 2001-02-27 3Com Corporation Logical switch set
US6246692B1 (en) 1998-02-03 2001-06-12 Broadcom Corporation Packet switching fabric using the segmented ring with resource reservation control
US7246168B1 (en) * 1998-11-19 2007-07-17 Cisco Technology, Inc. Technique for improving the interaction between data link switch backup peer devices and ethernet switches
US20020023170A1 (en) 2000-03-02 2002-02-21 Seaman Michael J. Use of active topology protocols, including the spanning tree, for resilient redundant connection of an edge device
US20020010869A1 (en) * 2000-06-07 2002-01-24 Young-Il Kim MAC address-based communication restricting method
US6594776B1 (en) * 2000-06-28 2003-07-15 Advanced Micro Devices, Inc. Mechanism to clear MAC address from Ethernet switch address table to enable network link fail-over across two network segments
US7386876B2 (en) * 2000-07-06 2008-06-10 Samsung Electronics Co., Ltd. MAC address-based communication restricting method
US20020019958A1 (en) 2000-08-07 2002-02-14 Cantwell Larry J. Method and apparatus for imparting fault tolerance in a switch or the like
US20020191250A1 (en) 2001-06-01 2002-12-19 Graves Alan F. Communications network for a metropolitan area
US20030185149A1 (en) 2002-03-29 2003-10-02 Daniell Piers John Expansion of telecommunications networks with automatic protection switching
US20030189898A1 (en) * 2002-04-04 2003-10-09 Frick John Kevin Methods and systems for providing redundant connectivity across a network using a tunneling protocol
US7093027B1 (en) * 2002-07-23 2006-08-15 Atrica Israel Ltd. Fast connection protection in a virtual local area network based stack environment
US20040100970A1 (en) * 2002-11-27 2004-05-27 Gerdisch Mitchell R. Methods for providing a reliable server architecture using a multicast topology in a communications network
US7345991B1 (en) * 2003-05-28 2008-03-18 Atrica Israel Ltd. Connection protection mechanism for dual homed access, aggregation and customer edge devices
US20050066216A1 (en) * 2003-09-18 2005-03-24 Cisco Technology, Inc. High availability virtual switch
US7751416B2 (en) * 2003-09-18 2010-07-06 Cisco Technology, Inc. Virtual network device
US20080183854A1 (en) * 2003-12-10 2008-07-31 Hopen Chris A Network Appliance
US20050190752A1 (en) * 2004-02-27 2005-09-01 Cheng-Mau Chiou Method and system for locating the incoming port of a MAC address in an Ethernet switch network
US7974388B2 (en) * 2004-03-05 2011-07-05 Avaya Inc. Advanced port-based E911 strategy for IP telephony
US7403523B2 (en) * 2004-04-28 2008-07-22 Tekelec Methods and systems for tunneling packets of a ring-topology-based link level communications protocol over a network having a star topology using a star-topology-based link level communications protocol
US20050276215A1 (en) 2004-06-10 2005-12-15 Makoto Kitani Network relay system and control method thereof
US20080304477A1 (en) * 2004-09-30 2008-12-11 Ingvar Froroth Carrier Class Resilience Solution For Switched Ethernet Local Area Networks (Lans)
US7643468B1 (en) * 2004-10-28 2010-01-05 Cisco Technology, Inc. Data-center network architecture
US7411963B2 (en) 2005-01-19 2008-08-12 Cisco Technology, Inc. Method for dissemination of non-routing information using the IS-IS protocol
US20070047436A1 (en) * 2005-08-24 2007-03-01 Masaya Arai Network relay device and control method
US20070076719A1 (en) 2005-10-05 2007-04-05 Nortel Networks Limited Provider backbone bridging - provider backbone transport internetworking
US20070165648A1 (en) * 2006-01-16 2007-07-19 Min-Kyu Joo Packet processing apparatus and method
US7639605B2 (en) 2006-02-08 2009-12-29 Cisco Technology, Inc. System and method for detecting and recovering from virtual switch link failures
US8284656B2 (en) * 2006-04-28 2012-10-09 Alcatel Lucent System and method for resilient VPLS over multi-nodal APS protected provider edge nodes
US20080159124A1 (en) * 2006-12-28 2008-07-03 Fujitsu Limited Method for redundant linking lines and wide area network node device
US20080225695A1 (en) 2007-03-13 2008-09-18 Florin Balus Failure protection in a provider backbone bridge network using forced mac flushing
US7782763B2 (en) * 2007-03-13 2010-08-24 Alcatel Lucent Failure protection in a provider backbone bridge network using forced MAC flushing
US20100142544A1 (en) 2007-03-14 2010-06-10 Zonit Structured Solutions, Llc Data center network distribution system
US20080239946A1 (en) 2007-03-28 2008-10-02 Fujitsu Limited Communication system, switch
US20080279096A1 (en) * 2007-05-11 2008-11-13 Sullivan Michael J Lightweight node based network redundancy solution leveraging rapid spanning tree protocol (rstp)
US8077709B2 (en) * 2007-09-19 2011-12-13 Cisco Technology, Inc. Redundancy at a virtual provider edge node that faces a tunneling protocol core network for virtual private local area network (LAN) service (VPLS)
US20090168647A1 (en) * 2007-12-31 2009-07-02 Nortel Networks Limited Interworking an Ethernet Ring Network and an Ethernet Network with Traffic Engineered Trunks
US8018841B2 (en) 2007-12-31 2011-09-13 Ciena Corporation Interworking an ethernet ring network and an ethernet network with traffic engineered trunks
US20090168671A1 (en) * 2007-12-31 2009-07-02 Nortel Networks Limited Interworking an Ethernet Ring Network with a Spanning Tree Controlled Ethernet Network
US20090276842A1 (en) * 2008-02-28 2009-11-05 Level 3 Communications, Llc Load-Balancing Cluster
US7925817B2 (en) 2008-04-16 2011-04-12 Hitachi, Ltd. Computer system and method for monitoring an access path
US20100020680A1 (en) * 2008-07-28 2010-01-28 Salam Samer M Multi-chassis ethernet link aggregation
US20100189117A1 (en) * 2009-01-28 2010-07-29 Cisco Technology, Inc. Distributed IP Gateway Based on Sharing a MAC Address and IP Address Concurrently Between a First Network Switching Device and a Second Network Switching Device
US20100284413A1 (en) * 2009-05-11 2010-11-11 Nortel Networks Limited Dual homed e-spring protection for network domain interworking
US8125928B2 (en) * 2009-07-24 2012-02-28 Juniper Networks, Inc. Routing frames in a shortest path computer network for a multi-homed legacy bridge node
US8467316B1 (en) * 2010-12-29 2013-06-18 Juniper Networks, Inc. Enhanced address learning in layer two computer networks

Non-Patent Citations (5)

* Cited by examiner, † Cited by third party
Title
Final Office Action for U.S. Appl. No. 12/487,407 mailed Oct. 25, 2011, 16 pages.
International Search Report for PCT/CA2010/00935 mailed Oct. 12, 2010, 10 pages.
Non-final Office Action for U.S. Appl. No. 12/487,407 mailed Apr. 26, 2011, 10 pages.
Notice of Allowance for U.S. Appl. No. 12/487,407 mailed Jan. 25, 2012, 9 pages.
Preliminary Report on Patentability for PCT/CA2010/00935 mailed Jun. 18, 2009, 5 pages.

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150271010A1 (en) * 2014-03-20 2015-09-24 Sudhir V. Shetty Systems And Methods For Automatic Access Layer Configuration
US9294347B2 (en) * 2014-03-20 2016-03-22 Dell Products Lp Systems and methods for automatic access layer configuration

Also Published As

Publication number Publication date
US20100322263A1 (en) 2010-12-23
US20120230183A1 (en) 2012-09-13
EP2443808A4 (en) 2015-03-11
US20140153382A1 (en) 2014-06-05
CN102461120A (en) 2012-05-16
WO2010145025A1 (en) 2010-12-23
EP2443808A1 (en) 2012-04-25
US8184648B2 (en) 2012-05-22

Similar Documents

Publication Publication Date Title
US8649259B2 (en) Method and apparatus for implementing control of multiple physically dual homed devices
CA2709467C (en) Interworking an ethernet ring network with a spanning tree controlled ethernet network
US7746892B2 (en) Method and apparatus for transporting ethernet services
EP2092692B1 (en) Method for exchanging routing information and the establishment of connectivity across multiple network areas
US9338052B2 (en) Method and apparatus for managing the interconnection between network domains
US9001647B2 (en) Distributed failure recovery in a routed ethernet network
US9882838B2 (en) Forwarding inter-switch connection (ISC) frames in a network-to-network interconnect topology
US9432213B2 (en) IP forwarding across a link state protocol controlled ethernet network
US8018841B2 (en) Interworking an ethernet ring network and an ethernet network with traffic engineered trunks
CN1938997B (en) Method, connection controller and system for differential forwarding in address-based carrier networks
CN1708963B (en) Multi-bridge LAN aggregation
WO2010115260A1 (en) Enabling an ethernet ring network to scalably support a hub-and-spoke connectivity model
US20120300774A1 (en) Method and apparatus for exchanging routing information and establishing connectivity across multiple network areas
Allan et al. Provider link state bridging
CN103152283A (en) Method and device for sharing load of aggregation link

Legal Events

Date Code Title Description
AS Assignment

Owner name: ROCKSTAR CONSORTIUM US LP, TEXAS

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:ROCKSTAR BIDCO, LP;REEL/FRAME:031594/0955

Effective date: 20120509

FEPP Fee payment procedure

Free format text: PAYOR NUMBER ASSIGNED (ORIGINAL EVENT CODE: ASPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

AS Assignment

Owner name: RPX CLEARINGHOUSE LLC, CALIFORNIA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:ROCKSTAR CONSORTIUM US LP;ROCKSTAR CONSORTIUM LLC;BOCKSTAR TECHNOLOGIES LLC;AND OTHERS;REEL/FRAME:034924/0779

Effective date: 20150128

AS Assignment

Owner name: JPMORGAN CHASE BANK, N.A., AS COLLATERAL AGENT, IL

Free format text: SECURITY AGREEMENT;ASSIGNORS:RPX CORPORATION;RPX CLEARINGHOUSE LLC;REEL/FRAME:038041/0001

Effective date: 20160226

FEPP Fee payment procedure

Free format text: MAINTENANCE FEE REMINDER MAILED (ORIGINAL EVENT CODE: REM.)

AS Assignment

Owner name: RPX CORPORATION, CALIFORNIA

Free format text: RELEASE (REEL 038041 / FRAME 0001);ASSIGNOR:JPMORGAN CHASE BANK, N.A.;REEL/FRAME:044970/0030

Effective date: 20171222

Owner name: RPX CLEARINGHOUSE LLC, CALIFORNIA

Free format text: RELEASE (REEL 038041 / FRAME 0001);ASSIGNOR:JPMORGAN CHASE BANK, N.A.;REEL/FRAME:044970/0030

Effective date: 20171222

LAPS Lapse for failure to pay maintenance fees

Free format text: PATENT EXPIRED FOR FAILURE TO PAY MAINTENANCE FEES (ORIGINAL EVENT CODE: EXP.)

STCH Information on status: patent discontinuation

Free format text: PATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362

FP Lapsed due to failure to pay maintenance fee

Effective date: 20180211