WO2010088369A2 - Methods and apparatus to collect broadband market data - Google Patents

Methods and apparatus to collect broadband market data Download PDF

Info

Publication number
WO2010088369A2
WO2010088369A2 PCT/US2010/022384 US2010022384W WO2010088369A2 WO 2010088369 A2 WO2010088369 A2 WO 2010088369A2 US 2010022384 W US2010022384 W US 2010022384W WO 2010088369 A2 WO2010088369 A2 WO 2010088369A2
Authority
WO
WIPO (PCT)
Prior art keywords
address
addresses
machine
identify
organization
Prior art date
Application number
PCT/US2010/022384
Other languages
French (fr)
Other versions
WO2010088369A3 (en
Inventor
Shi LU
Ranney Fry
Jerome Baccelli
Original Assignee
The Nielsen Company (Us), Llc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by The Nielsen Company (Us), Llc filed Critical The Nielsen Company (Us), Llc
Priority to EP10702966.2A priority Critical patent/EP2382776A4/en
Priority to AU2010208224A priority patent/AU2010208224A1/en
Priority to JP2011548288A priority patent/JP2012516513A/en
Priority to GB1113767A priority patent/GB2480029A/en
Publication of WO2010088369A2 publication Critical patent/WO2010088369A2/en
Publication of WO2010088369A3 publication Critical patent/WO2010088369A3/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/02Marketing; Price estimation or determination; Fundraising
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/02Marketing; Price estimation or determination; Fundraising
    • G06Q30/0201Market modelling; Market analysis; Collecting market data
    • G06Q30/0203Market surveys; Market polls
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00Systems or methods specially adapted for specific business sectors, e.g. utilities or tourism
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/50Network services
    • H04L67/51Discovery or management thereof, e.g. service location protocol [SLP] or web services
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/10Adaptations for transmission by electrical cable

Definitions

  • This disclosure relates generally to market research and, more particularly, to methods and apparatus to collect broadband market data.
  • ISPs Internet service providers
  • Competitive information allows the ISP to employ strategic and/or tactical decisions related to opportunities that may increase a subscriber base and/or identify which market areas may be particularly receptive to the services provided by the ISP. Additionally, information about the ISP and its competitors permits a comparison to reveal market presence and/or market dominance.
  • Obtaining information related to the presence of competitive ISPs and/or the market share in any particular geographic market may entail conducting surveys. Surveys, whether oral or written, typically yield low sample rates when compared to the total number of existing subscribers. Additionally, answers to the surveys are usually provided by a human respondent, who is prone to inaccuracy regarding details of their existing ISP. For example, a human respondent may state the name of their browser application or computer manufacturer instead of the name of their ISP. [0005] Additionally, because oral and written surveys are perceived as a burden to subscribers, ISPs are not likely to enjoy opportunities to determine whether the subscriber's status has changed. For example, a subscriber to an ISP is not typically bound by contracts that restrict and/or discourage competitive shopping with alternate ISPs.
  • FIG. 1 is a block diagram of an example system to collect broadband market data.
  • FIG. 2 is a block diagram of an example market share evaluator shown in FIG. 1.
  • FIGS. 3-8 are flowcharts representative of examples processes that may be performed to implement one or more entities of the example systems and apparatus of FIGS. 1 and 2, and/or the example data charts of FIGS. 9A and 9B.
  • FIGS. 9A and 9B are example data charts generated by the example systems and apparatus of FIGS. 1 and 2, and/or the example processes of FIGS. 3-8.
  • FIG. 10 is a block diagram of an example processor system that may be used to execute the example processes of FIGS. 3-8 to implement the example systems, apparatus, and/or methods described herein.
  • Example methods and apparatus to collect broadband market data are disclosed.
  • a disclosed example method includes selecting a panelist household, the panelist household subscribing to at least one broadband service delivered via a modem, and identifying an Internet protocol (IP) address assigned to the modem by an Internet service provider (ISP).
  • IP Internet protocol
  • the example method also includes retrieving a range of IP addresses associated with the ISP, selecting a random subset of IP addresses from the range of IP addresses, and testing each of the IP addresses from the random subset to determine an activity status of each IP address.
  • a disclosed example apparatus includes a test manager to select a panelist household and identify an IP address assigned to a household modem, a registry manager to retrieve a range of IP addresses registered by an ISP, the identified IP address within the retrieved range of IP addresses, and an activity determiner to identify whether each IP address in the range of IP addresses is active or inactive.
  • an internet service provider ISP
  • the ISP is particularly interested in learning whether competitors experience a similar gain or loss. For example, if the ISP and one or more competitors experience similar gains in subscribers, then the general market area may be experiencing growth. Such an indication may prompt the ISP to increase advertising and/or promotional resources to attempt to capture such growth (e.g., market share) opportunities before one or more competitors capture a greater portion of the available subscribers.
  • the general market area may be stagnant and/or shrinking, which may indicate advertising and/or promotional efforts should focus on one or more alternate markets.
  • the ISP may gain insight to the effectiveness of an advertising campaign and/or a promotion.
  • the methods and apparatus described herein identify, in part, candidate internet protocol (IP) addresses that may be associated with subscribers, whether the IP addresses are active or inactive, the ISP associated with each IP address, and/or the location of the IP address.
  • IP internet protocol
  • the methods and apparatus described herein allow a user to collect broadband market data for one or more market(s) of interest. As such, the user is better able to calculate market share for one or more broadband ISPs because, in part, market statistic calculation confidence increases when a statistically significant amount of data is available.
  • An example market share database is updated on a scheduled basis, a manual basis, periodically, or aperiodically to store known ISPs, name servers, and/or router nomenclature (e.g., ge-0-1 -ubr01.warren.ma.boston.comcast.net) associated with ISPs and/or IP addresses.
  • router nomenclature e.g., ge-0-1 -ubr01.warren.ma.boston.comcast.net
  • the example methods and apparatus described herein identify one or more key words, letters, numbers, labels, and/or combinations thereof that may be indicative of geography (e.g., "ma,” "boston,” etc.) and/or one or more markets of interest.
  • FIG. 1 is an illustration of an example system 100 to collect broadband market data.
  • the system 100 includes a market share evaluator 102 communicatively connected to a registry database 104 and a market information database 106.
  • the example registry database 104 may include one or more databases that identify which registrant is associated with one or more registered IP addresses and/or domain names.
  • Such registry databases 104 include, but are not limited to, information from the American Registry for Internet Numbers (ARTN), the Internet Corporation for Assigned Names and Number (ICANN), IP Geolocation by Maxmind ® , etc.
  • the example market information database 106 includes resolution keywords in an example resolution keyword table 107 to, in part, allow resolution of one or more hostname labels that may be cryptic and/or otherwise unfamiliar to a user of the methods and apparatus described herein.
  • resolution keywords 107 may be used to decipher such labels.
  • the example market share evaluator 102 is also communicatively connected to one or more networks 108, such as the Internet.
  • networks 108 such as the Internet.
  • ISPs such as example ISP "A” 110, ISP "B” 112, and ISP “C” are communicatively connected to the network 108, in which each ISP provides one or more services to household communication devices 116a-d.
  • Household communication devices 116a- d may include, but are not limited to routers, modems and/or other equipment communicatively connected to an ISP.
  • Each example ISP may be responsible for providing services (e.g., such as household Internet access, telephony, and/or media services) in an identified geographic market area. In the illustrated example of FIG.
  • ISP "A” 110 provides services to one or more household communication devices 116a
  • ISP "B” 112 provides services to one or more household communication devices 116b, both of which are located in an example first market area 118
  • example ISP "C” 114 provides services to one or more household communication devices 116c in an example second market area 120.
  • ISP "A" 110 provides services to one or more household communication devices in both the first market area 118 and the second market area 120.
  • each household communication device is assigned an IP address (e.g., a static IP address or a dynamic IP address) by the ISP that is registered for use and/or management by that ISP.
  • IP address e.g., a static IP address or a dynamic IP address
  • the methods and apparatus described herein perform one or more techniques to ascertain the most likely geographic indicator (e.g., a state, a city, etc.) for the IP address assigned to the household communication device(s).
  • the methods and apparatus described herein associate each IP address with a corresponding ISP router that provides geographic location cues.
  • the methods and apparatus described herein may identify that the last router hop in the communicative path to IP address to 208.180.36.166 is associated with hostname s208-180-36-166.snjs.ca.sta.suddenlink.net," which includes one or more geographic location cues (e.g., "snjs" refers to San Jose).
  • an ISP registers one or more blocks of IP addresses that may be assigned to subscribers.
  • ARIN is one of five Regional Internet Registries (RIRs) that manage IP address resources.
  • RIRs include the Asia Pacific Network Information Centre (APNIC) and the Latin American and Caribbean IP Address Regional Registry (LACNIC).
  • APNIC Asia Pacific Network Information Centre
  • LACNIC Latin American and Caribbean IP Address Regional Registry
  • ARTN facilitates one or more processes that allow a user (e.g., an ISP) to register (usually for a fee) one or more IP addresses for exclusive use and to associate the registered IP address with a hostname.
  • ARTN also facilitates a database lookup facility to allow queries (e.g., Whois queries) of an IP address to return a corresponding hostname, organization information, and/or whether the organization has other registered IP addresses (e.g., a block of IP addresses).
  • queries e.g., Whois queries
  • the organization information may include a corresponding contact name and/or address, such organization information may not be indicative of where the registered IP address(es) are being used (located).
  • the IP address 68.87.148.146 is associated with, at the time of this writing, Comcast Cable Communications, Inc. having an organization address in Mt. Laurel, NJ.
  • the ARIN database also indicates that this organization has registered a block of IP addresses ranging from 68.80.0.0 to 68.87.255.255.
  • UDP User Datagram Protocol
  • ICMP Internet Control Message Protocol
  • the labels within the example hostname provide at least two geographic cues (i.e., "ma,” and "boston") of where the IP address of interest is likely being used. In this example, the most likely geographic location associated with the IP address 68.87.148.146 is Boston, Massachusetts.
  • a hostname While the concept of a hostname is to, in part, facilitate a human- readable association with a specific IP address, the hostname and/or one or more labels of the hostname concatenated with dots may still appear cryptic to a human attempting to read it. For example, labels within the example hostname "snjs.ca.sta.suddenlink.net" may not readily appear to reveal useful information to persons unfamiliar with the San Jose area. Alternatively, users may confuse the label "ca” with nomenclature associated with Canada rather than California. To better resolve hostname labels and determine geographic and/or organizational association(s), the methods and apparatus described herein parse the hostname labels and search the example market information database 106 for matching (e.g., logical ANDed) combinations.
  • matching e.g., logical ANDed
  • a candidate geographic location and/or associated organization associated with the IP address may be determined.
  • hostname "snjs.ca.sta.suddenlink.net”
  • the methods and apparatus described herein search for a combination of labels “snjs,” “ca,” and “suddenlink” before concluding that the router hostname is properly associated with the organization Suddenlink Communications, Inc. located in San Jose, California.
  • one or more household communication devices may be associated with one or more panelists, such as panelist router "A" 122a, panelist router "B” 122b, and panelist router “C” 122c.
  • One or more panelist households may be selected by, for example, a marketing entity to obtain a statistically significant sample size of behavior so that projections to a larger universe may be made with an acceptable degree of confidence.
  • Panelists are typically selected in sufficient numbers to achieve statistical significance, and represent one or more particular geographic and/or demographic aspects of a larger universe of participants (e.g., subscribers of Internet services, viewers of media devices, Hispanic consumers, Japanese consumers, etc.).
  • One or more households typically become a representative panelist based on, in part, an agreement with the monitoring entity (e.g., the marketing entity) to have one or more household behaviors monitored.
  • Household behaviors of interest to the monitoring entity include, but are not limited to, television programs watched, dates/times at which programs are watched, shopping behaviors, web sites visited, and/or household services purchased (e.g., Internet services, telephony services, etc.).
  • the agreement with the household panelists also includes explicit information related to the household address, thereby revealing their location.
  • the panelists 122a-c also provide information related to the IP address assigned to their router(s) and the ISP with which the household subscribes.
  • the example market share evaluator 102 periodically, aperiodically, manually, or on a scheduled basis retrieves updates from the panelist households 122a-c to obtain the most recent IP address and ISP used by that household.
  • each panelist household may have one or more personal computers running one or more applications that determine the assigned router IP address and e-mail such IP address information back to the marketing entity.
  • the example market share evaluator 102 updates the example market information database 106 with information related to the new and/or alternate ISP. In this manner, the system 100 may stay appraised of additional ISPs that enter the first market area 118 and/or the second market area 120.
  • the example market share evaluator 102 identifies one or more new and/or alternate hostname labels indicative of the new and/or alternate ISP.
  • hostname resolution related to IP address location and its associated organization e.g., its associated ISP
  • FIG. 2 is a detailed schematic illustration of the example market share evaluator 102 shown in FIG. 1.
  • the example market share evaluator 102 includes a test manager 202, an IP address aggregator 204, and an activity determiner 205 that includes an example ping manager 206, and a port scan manager 208.
  • the example market share evaluator 102 also includes a registry manager 210 that is communicatively connected to the example registry database 104.
  • the example market share evaluator 102 includes a hostname resolver 212, a network interface 214 communicatively connected to the example network 108 (e.g., the Internet), and a panelist updater 216.
  • the example test manager 202 is communicatively connected to the market information database 106 the IP address aggregator 204, the ping manager 206, the port scan manager 208, the registry manager 210, the hostname resolver 212, the network interface 214, and the panelist updater 216 to invoke one or more services thereof.
  • the example test manager 202 on a periodic, scheduled, aperiodic, and/or manual basis invokes a test of one or more IP addresses to determine whether it is active or inactive. Additionally, the example test manager 202 determines a corresponding organization and location associated with the IP address. Once information related to an IP address active/inactive status, an organization, and a location is obtained, the example test manager 202 calculates market share statistics for each organization that provides Internet services to subscribers.
  • the example test manager 202 invokes the example IP address aggregator 204 to obtain one or more IP addresses of interest when performing a test.
  • the IP address aggregator 204 may provide one or more IP addresses of interest from the market information database 106, which may store IP addresses identified from one or more previous tests to determine an active/inactive state. As such, the data within the example market information database 106 may be kept current.
  • the example IP address aggregator 204 selects one or more IP addresses of one or more panelist households 122a-c. Additionally, the IP address aggregator 204 may select one or more neighboring IP addresses that could be part of a block of IP addresses registered by the ISP associated with the panelist.
  • the IP address aggregator 204 may also invoke the registry manager 210 to obtain one or more IP addresses associated with a specific organization/ISP. For example, the IP address aggregator 204 may specify an organization name "WOW MEDIA" to determine which IP addresses and/or blocks of IP addresses are registered by the organization/ISP of interest.
  • the example registry manager 210 contacts at least one registry database, such as ARIN, and provides organizational name keywords as input to the registry database.
  • the example registry manager 210 receives corresponding IP addresses, a seed starting IP address, and/or blocks of IP addresses associated with the keyword input(s).
  • the example test manager 202 may randomly select a predetermined number of IP addresses from the block (e.g., a subset of the block) to test. As such, a representative random sample of IP addresses may provide a reasonable indication of market presence of the organization. Additionally or alternatively, the example test manager 202 may employ the seed starting IP address as a randomly selected IP address within the range associated with the organization. The randomly selected seed starting IP address may service as a starting IP address, an ending IP address, and/or a midpoint IP address within a range of IP addresses to test.
  • the example ping manager 206 performs an ICMP Ping operation via the example network interface 214 using the IP address of interest.
  • a ping is a computer network tool employed to determine whether a host is reachable across a network and sends ICMP echo request packets to the target IP address of interest. After sending each echo request packet, the example ping manager 206 listens via the network interface 214 for ICMP echo response reply messages. If such reply messages are received, then the IP address of interest is deemed active.
  • an ISP and/or one or more routers in the path may block a ping request (e.g., for security concerns), at which point the example port scan manager 208 attempts to scan one or more ports (e.g., TCP port 80 http service, TCP port 443 https service, etc.) of the machine associated with IP address of interest.
  • a successful port scan results in the IP address of interest being deemed active.
  • some ISPs may block either or both of a port scan or ping. If neither the ping nor the port scan are successful, the IP address of interest is deemed inactive and the market information database 106 is updated accordingly.
  • IP addresses of interest having a successful ping or port scan are further associated with information obtained from one or more registry databases 104, such as the ARIN database that stores registry information for IP addresses in North America, Canada, the Caribbean, and the North Atlantic Islands.
  • a query to the ARIN database is also referred to as a Whois query, which accepts the IP address or hostname as input and returns information including, but not limited to, an associated organization, a contact person(s), contact telephone number(s), a contact address, and/or contact e-mail address.
  • the organizational information returned from the ARIN query is compared to the market information database 106 for a match that indicates whether the organization is a corporation, a university, or an ISP. If the IP address of interest is associated with an ISP, then it is also deemed to be used for residential purposes.
  • the methods and apparatus described herein further determine a corresponding location and more detailed ownership information.
  • the ARTN query described above identifies the organization that registered the IP address of interest, such organization may be a reseller of IP addresses rather than the ultimate user.
  • the example hostname resolver 212 of FIG. 2 performs a reverse domain name server (DNS) lookup (sometimes referred to as NSLookup (name-server lookup)) on the IP address to identify one or more cues indicative of true ownership.
  • DNS reverse domain name server
  • NSLookup name-server lookup
  • an ARTN database query on the IP address 64.236.16.20 identifies "AOL Transit Data Network" as the organization that has registered IP addresses ranging from 64.236.0.0 to 64.236.255.255.
  • the ultimate party and/or end-user for the IP address 64.236.16.20 is more accurately determined based on a reverse DNS lookup (also referred to as a reverse resolve) performed by the example hostname resolver 212, which reveals a hostname of "www2.cnn.com.” Accordingly, the example hostname resolver 212 parses the hostname, extracts "cnn" and confirms the true end-user as CNN if a label-match is found in the example market information database 106. [0028] To determine a location associated with the IP address of interest, the example hostname resolver 212 performs a multi-location trace-route.
  • a trace-route is a computer network application to identify the routers traversed by packets in an IP network.
  • the trace-route application identifies multiple hops of routers, starting with the router closest to the requestor and ending with the last router closest to the target IP address.
  • Router identification during each hop includes, in part, a name for each router.
  • Router hops may be influenced by, in part, one or more firewalls that cause alternate hop destinations.
  • the last router listed is a series of router hops geographically closest to the device associated with the IP address of interest.
  • one or more router hops may be different when compared to a requestor in a separate location.
  • the last router hop is usually the same, but in some instances the last router hop may identify a different router.
  • Such alternate paths may occur in the example event where one or more router path(s) are down due to, for example, hardware failure(s), power failure(s), and/or localized weather interruptions.
  • the example hostname resolver 212 performs a multi-location trace-route, in which the originating trace-route test uses the same IP address of interest, but at separate originating locations. For example, a first trace-route for IP address 24.32.38.55 may originate in San Francisco, California, a second trace-route for the same IP address may originate in Dallas, Texas, and a third trace-route for the same IP address may originate in Lindbergh, Virginia. While all three of these originating locations will include one or more initial unique router hops, the ultimate path of test packets is expected to reach the same last hop router.
  • the example hostname resolver 212 parses the labels of the hostname for cues indicative of location. Such cues (e.g., labels “snjs,” “ca,” and “suddenlink”) are compared against those labels stored in the example market information database 106 to resolve, or otherwise translate cryptic abbreviations and/or codes that refer to an organization (e.g., an ISP), a city (e.g., "snjs"), a state (e.g., "ca,” “ma,” etc.), or any other geographic identifier.
  • an organization e.g., an ISP
  • city e.g., "snjs”
  • a state e.g., "ca,” "ma,” etc.
  • the example hostname resolver 212 may employ a threshold test before parsing labels from the hostname for location cues. In other words, a lower degree of confidence that the last hop router is the actual IP address location occurs when fewer than all separate originating locations yield the same last hop router name.
  • the methods and apparatus described herein save such information to the example market information database 106 (e.g., as tabular information).
  • the example market information database 106 e.g., as tabular information.
  • one or more entities interested in measuring broadband market statistics prefer to obtain a sufficient amount of sample measurements before any calculated results will be deemed statistically significant.
  • the methods and apparatus described herein may test any number of IP addresses of interest before calculating a corresponding market share of active IP addresses for any given time period (e.g., calculated market share per day, per week, per bi-week, per month, etc.). For example, if the example market share evaluator 102 tests five-hundred IP addresses associated with a first ISP and five-hundred IP addresses associated with a second ISP, then the example test manager 202 calculates a corresponding percentage of active IP addresses for each of the first and second ISP. Such calculated percentages may occur, for example, on a weekly basis to determine a projected broadband market presence per geographic area and/or identify one or more trends of market share penetration for competing ISPs.
  • time period e.g., calculated market share per day, per week, per bi-week, per month, etc.
  • IP addresses previously identified as active and/or associated with an organization are saved to the example market information database 106 for subsequent testing at a later date/time. For example, subscribers to ISP services may leave the ISP for a competitor's ISP, thereby causing the previously active IP address to become inactive/dormant. Subsequent testing of that same IP address may reveal that the IP address remains dormant/inactive for a period of time, or is reallocated to another subscriber. Additionally, performing one or more subsequent tests on the previously identified IP address(es) may prevent and/or minimize the need for additional queries to the registry database(s), in which each query may be associated with an access fee.
  • FIGS. 1 and 2 While an example system 100 to collect broadband market data and an example market share evaluator 102 has been illustrated in FIGS. 1 and 2, one or more of the interfaces, data structures, elements, processes and/or devices illustrated in FIGS. 1 and 2 may be combined, divided, re-arranged, omitted, eliminated and/or implemented in any other way. Further, the example market share evaluator 102, the example test manager 202, the example IP address aggregator 204, the example ping manager 206, the example port scan manager 208, the example registry manager 210, the example hostname resolver 212, the example network interface 214, and/or the example panelist updater 216 of FIGS. 1 and 2 may be implemented by hardware, software, and/or firmware.
  • any of the example market share evaluator 102, the example test manager 202, the example IP address aggregator 204, the example ping manager 206, the example port scan manager 208, the example registry manager 210, the example hostname resolver 212, the example network interface 214, and/or the example panelist updater 216 may be implemented by one or more circuit(s) (ASIC(s)), programmable logic device(s) (PLD(s)), and/or field programmable logic device(s) (FPLD(s)), etc.
  • ASIC application-programmable logic device
  • FPLD field programmable logic device
  • At least one of the example market share evaluator 102, the example test manager 202, the example IP address aggregator 204, the example ping manager 206, the example port scan manager 208, the example registry manager 210, the example hostname resolver 212, the example network interface 214, and/or the example panelist updater 216 are hereby expressly defined to include a tangible medium, such as a memory, a digital versatile disc (DVD), a compact disc (CD), etc. storing the firmware and/or software.
  • a communication system may include interfaces, data structures, elements, processes, and/or devices instead of, or in addition to, those illustrated in FIGS. 1 and 2 and/or may include more than one of any or all of the illustrated interfaces, data structures, elements, processes and/or devices.
  • FIGS. 3-8 illustrate example processes that may be performed to implement the example market share evaluator 102 of FIGS. 1 and 2.
  • the example processes of FIGS. 3-8 may be carried out by a processor, a controller, and/or any other suitable processing device. For instance, the example processes of FIGS.
  • 3-8 may be embodied in coded instructions stored on any tangible computer-readable medium such as a flash memory, a CD, a DVD, a floppy disk, a read-only memory (ROM), a random-access memory (RAM), a programmable ROM (PROM), an electronically-programmable ROM (EPROM), and/or an electronically-erasable PROM (EEPROM), an optical storage disk, an optical storage device, magnetic storage disk, a magnetic storage device, and/or any other medium that can be used to carry or store program code and/or instructions in the form of machine-readable instructions or data structures, and that can be accessed by a processor, a general- purpose or special-purpose computer, or other machine with a processor (e.g., the example processor platform PlOO discussed below in connection with FIG.
  • a processor e.g., the example processor platform PlOO discussed below in connection with FIG.
  • Machine-readable instructions comprise, for example, instructions and/or data that cause a processor, a general-purpose computer, a special-purpose computer, or a special-purpose processing machine to implement one or more particular processes.
  • some or all of the example processes of FIGS. 3-8 may be implemented using any combination(s) of ASIC(s), PLD(s), FPLD(s), discrete logic, hardware, firmware, etc.
  • one or more operations of the example processes of FIGS. 3-8 may instead be implemented manually or as any combination of any of the foregoing techniques, for example, any combination of firmware, software, discrete logic, and/or hardware. Further, many other methods of implementing the example operations of FIGS.
  • FIGS. 3-8 may be employed.
  • the order of execution of the blocks may be changed, and/or one or more of the blocks described may be changed, eliminated, sub-divided, or combined.
  • any or all of the example processes of FIGS. 3-8 may be carried out sequentially and/or carried out in parallel by, for example, separate processing threads, processors, devices, discrete logic, circuits, etc.
  • the example process 300 of FIG. 3 begins with the example test manager 202 selecting a candidate IP address to test (block 302).
  • Candidate IP addresses may be retrieved from the example market information database 106 based on the IP address(es) associated with known panelists, and/or candidate IP address(es) may be acquired from the example registry database 104 in response to a query associated with an ISP of interest.
  • the example test manager 202 may query the registry database 104 (e.g., the ARIN database) using an organization name (e.g., Verizon) to determine whether the organization has registered one or more IP addresses and/or blocks of IP addresses (block 302).
  • an organization name e.g., Verizon
  • the example test manager 202 may invoke the example panelist updater 216 to obtain panelist IP addresses to test and/or re-test.
  • the one or more panelists may agree to disclose their current IP address, and/or otherwise allow home monitoring equipment to operate within the panelist household that periodically, manually, aperiodically, and/or on a scheduled basis report the current IP address.
  • the home monitoring equipment may invoke an application (e.g., ipconfig) and/or script on one or more household personal computers to determine which IP address has been assigned to the panelist household.
  • the example panelist updater 216 selects a panelist from the market information database 106 (block 402) and obtains the current IP address associated with that panelist (block 404). Additionally, the example panelist updater 216 may obtain, via survey and/or household monitoring device(s) (e.g., Nielsen ® People Meter) other panelist ISP information (block 406). Panelist ISP information may include, but is not limited to, the ISP business name, the type of ISP services provided to the panelist household (e.g., DSL Internet services, cable Internet services, fiber optic services (FiOS), etc.).
  • the example panelist updater 216 may obtain panelist demographic information from the example market information database 106, surveys, and/or the household monitoring device(s) (block 408). In the event that new and/or additional information is obtained via one or more surveys and/or via the household monitoring device(s) associated with, for example, Nielsen ® online audience measurement services, such information is saved to the market information database 106 for future use (block 410). For example, one or more iterations through the illustrated example process 400 of FIG. 4 gathers additional candidate IP addresses for testing, as described in further detail below. IP addresses obtained through the one or more iterations may be saved to a memory and/or database for individual testing, which determines, in part, an active or inactive status of each candidate IP address.
  • the example panelist updater 216 and/or the IP address aggregator 204 determines whether there are additional panelists to check (block 412) so that, in part, the example test manager 202 has a sufficient and/or statistically significant number of candidate IP addresses to make one or more market statistic conclusions having a requisite degree of confidence.
  • the illustrated example process 400 of FIG. 4 obtains one or more candidate IP addresses for testing from panelists
  • the illustrated example process 500 of FIG. 5 also obtains candidate IP addresses for testing by determining whether the IP address registrant also manages one or more blocks of neighboring IP addresses.
  • the example panelist updater 216 obtains a seed IP address from a panelist by querying the list of panelists stored in the example market information database 106 (block 502). Using the seed IP address as input for a query to the registry database 104, such as the ARIN database, the example registry manager 210 obtains information to indicate whether the seed IP address has one or more neighboring IP addresses also managed and/or registered by the same organizational entity (block 504).
  • a query to the ARIN database using a panelist seed IP address of 69.47.21.141 reveals, in part, an organization name "WideOpenWest Finance LLC," which has registered IP addresses ranging from 69.47.0.0 through 69.47.255.255.
  • the example test manager 202 selects a random number of IP addresses to test (block 506).
  • the selected random IP addresses may be temporarily saved by the test manager 202 in a queue or memory, and the information related to the known range of registered IP addresses for the organization are saved in the example market information database 106 (block 508) for future use.
  • the test manager 202 may, instead, select another group of random IP addresses to test from the market information database 106. If another seed IP address is to be selected (block 510) to, for example, acquire a greater number of IP addresses to satisfy a statistically significant threshold, control returns to block 502. Additionally, after saving the results to the example market information database 106 (block 508), a subsequent attempt to obtain an IP address to test by the market share evaluator 102 may not require any further queries to one or more registry databases 104. Instead, the example test manager 202 may acquire candidate IP addresses directly from the market information database 106, which are identified as being associated with a specific ISP.
  • the example ping manager 206 performs a ping operation using one of the selected candidate IP addresses (block 304) to determine whether echo response messages are received and, if so (block 306) the selected candidate IP address is deemed active (block 308). In other words, the example ping manager 206 determines an activity status of the candidate IP address of interest.
  • the example test manager 202 directs the port scan manager 208 to initiate a port scan (block 310) and, if successful (block 312), the selected IP address is deemed active (block 308). However, if the port scan is not successful (block 312), the selected IP address is deemed inactive (block 314) and control returns to block 304 to select another candidate IP address to test.
  • IP addresses that are deemed active (block 308) by either a ping or port scan are further used as input for a query to one or more registry databases 104 (block 316), such as the ARIN database.
  • Information retrieved from the registry databases 104 may include, but is not limited to, the name and/or address of the organization that registered the selected IP address, whether the named organization has also registered other IP addresses and/or one or more blocks of IP addresses, and/or a contact name, telephone number, and/or e-mail address of a contact responsible for the IP address.
  • IP addresses that are associated with corporations, hospitals, schools, universities, and/or similar businesses and/or organizations are distinguished from IP addresses associated with residential use by the example market share evaluator 102 (block 318).
  • the example registry manager 210 compares the returned organization name with identified organization names stored in the market information database 106.
  • the example market information database 106 includes at least one parameter associated with organization names to identify whether the organization is residential, meaning it provides IP addresses for residential purposes, or whether the organization is non-residential, meaning that it provides and/or otherwise manages IP addresses for corporate, scholastic, and/or any other non- residential purpose (block 318). If the IP address is not residential (block 320), then the example test manager 202 determines whether there are additional IP addresses of interest to test (block 322) and, if so, control returns to block 302. Otherwise, if the example test manager 202 determines that there are no additional IP addresses of interest to test, market share statistics are calculated based on the acquired test results (block 324), as described in further detail below.
  • the example market share evaluator 102 determines a corresponding location of the IP address and performs a secondary test to identify a true end user (block 326) as compared to the registrant identified by one or more registry databases (e.g., the organization associated with OrgName by the ARIN database). As described above, the organization identified as responsible for a registered IP address may not be the ultimate end-user, but rather a reseller of IP addresses.
  • FIG. 6 illustrates the example process 326 to determine a corresponding location of the IP address and perform the secondary test to identify the true end user.
  • the example test manager 202 determines if the IP address of interest is stored in the example market information database 106 (block 602). If so, then the example market share evaluator 102 may not need to expend additional processing resources and/or time to determine true ownership and location information in the event that the stored information is relatively recent. As such, the example test manager 202 determines whether the information associated with the IP address of interest exceeds a date and/or time threshold, which serves as an indication of how recent or current the stored information is.
  • the example hostname resolver 212 performs a reverse DNS lookup (also referred to as a reverse-resolve) using the IP address of interest to retrieve an associated hostname (block 608).
  • An example response to a reverse DNS lookup using the IP address of interest 68.87.148.146 is "ge-0-1- ubr01.warren.ma.boston.comcast.net.” Also note that an example response to an ARIN database Whois query using this same IP address of interest to identify the organization name is "Comcast Cable Communications, Inc.” Accordingly, both the reverse DNS lookup and the registry database lookup identify the same end-user entity.
  • the example hostname resolver 212 compares reverse DNS labels with labels stored in the example market information database 106 (block 610), as described in further detail in connection with FIG. 7.
  • the example hostname resolver 212 parses and places received hostname, domain name, and/or router labels in separate fields (block 702) and identifies whether the labels satisfy a match of known residential ISPs stored as resolution keywords in the resolution keyword table 107 of the example market information database 106 (block 704).
  • the one or more keywords in the example resolution keyword table 107 may include, but are not limited to, letters, words, numbers and/or one or more alphanumeric representations that are indicative of an ISP, an organization, and/or a location.
  • the example hostname resolver 212 applies one or more rules to identify a valid ISP associated with a combination of labels parsed from a received hostname.
  • the hostname "ge-0-1 -ubr01.warren.ma.boston.comcast.net” may be analyzed by the hostname resolver 212 so that the labels “ma,” “boston,” and “comcast” are parsed-out for comparison purposes.
  • the hostname resolver 212 includes a rule in which these three labels, when all identified within a single received hostname, result in identification of Comcast ® as the ultimate end-user ISP.
  • the example hostname resolver 212 determines if any label matches are found in the market information database 106 (block 706) and, if so, whether the required number of threshold label matches have been detected (block 708). If the required number of threshold label matches have been met (block 708), then the IP address of interest is associated with the ISP identified in the market information database 106 and/or a candidate result (block 710).
  • the received hostname from the reverse DNS is flagged for manual follow-up (block 614).
  • the manual follow-up may include, but is not limited to one or more users investigating new, alternate, and/or otherwise unrecognized label keywords to determine an associated ISP organization name and/or corresponding location. Such newly discovered information may further be appended to the example market information database 106 and/or resolution keywords 107 so that future/subsequent circumstances allow immediate resolution when those label keywords are encountered. This circumstance may arise in the event a new ISP enters the market having hostname labels not previously identified during one or more tests of IP addresses.
  • the market information database 106 described herein continues to become more complete the longer it is used with the methods and apparatus described herein to measure broadband market statistics.
  • the example hostname resolver 212 initiates a multi-location trace-route (block 616) to confirm a common last hop router hostname (block 618).
  • the example hostname resolver 212 compares each returned hostname for a match in the example market information database 106 and resolves a corresponding location if a match is found (block 622), otherwise the IP address of interest is flagged for follow-up (block 624).
  • the test manager 202 calculates one or more broadband market statistics (block 324) such as, for example, market share.
  • the example test manager 202 selects an ISP of interest for which broadband market statistics are desired (block 802).
  • Data returned from the one or more iterative tests of IP addresses is stored in the market information database 106, and for each ISP of interest the number of detected active IP addresses is divided by the total number of IP addresses tested to yield a percentage of active IP addresses for the given time period (block 804).
  • the example test manager 202 calculates one or more projection estimates for the ISP of interest in the given market area (e.g., the first market area 118, the second market area 120, etc.) (block 806). For example, if a number of assigned IP addresses is found to be 325 out of 500 IP addresses tested, then a factor of 0.65 is calculated as factor indicative of active IP addresses.
  • a total number of active IP addresses may be calculated/projected as 6,500 (e.g., 325 ⁇ 0.05, or 0.65 X 10,000).
  • control returns to block 802, otherwise one or more output tables may be generated for the user (block 810), such as the example output tables 900 and/or 950 shown in FIGS. 9A and 9B.
  • the example data output table 900 of FIG. 9A includes an IP address column 902, a reverse DNS lookup column 904 to identify a hostname corresponding to the IP address, a Whois column 906 to identify a corresponding registrant name associated with the IP address, a ping column 908 to identify whether or not a ping operation was successful, and a port column 910 to identify whether or not one or more port scanning operations were successful. Additionally, the example table 900 of FIG. 9A includes a geography column 912 to identify the location of the IP address, and an active column 914 to identify whether the IP address of column 902 is active or inactive.
  • the example data output table 950 of FIG. 9B includes an ISP column 952, an IP address range column 954 to identify which groups of IP addresses (e.g., one or more grouped ranges of IP addresses) the ISP is responsible for, a number of IP addresses tested column 956 to identify the total number of IP addresses tested from the pool of IP addresses in column 954, and a number of active IP addresses column 958.
  • the example data output table 950 also includes a number of inactive IP addresses column 960 and a corresponding percentage of active IP addresses based on the total number of IP addresses tested column 962. While FIGS.
  • 9A and 9B illustrate two example data output tables that may be generated and/or calculated by the example market share evaluator 102, the methods and apparatus described herein are not limited thereto. Any other data output arrangement may be generated by the market share evaluator 102 to accommodate for varying needs of the user(s) such as, but not limited to, ranked data tables to illustrate ISPs having the largest or smallest market share for a city, a state, a region, and/or data tables to illustrate a rate of change in subscribers from one time period to another time period.
  • the example data tables 900 and 950 calculated by the example market share evaluator 102 may also identify one or more trends related to subscriber increases, subscriber decreases, and/or one or more effects in response to advertising and/or promotional efforts.
  • the ISP using the methods and apparatus described herein may establish a baseline broadband subscriber share and/or a rate of new subscribers for the ISP and/or competitors of the ISP prior to initiating one or more advertising and/or promotional campaigns. During such advertising and/or promotional campaigns, the ISP may continue to employ the methods and apparatus described herein to determine the effect of such advertising efforts (e.g., a threshold gain in the percentage of subscribers, an increase in the rate of new subscribers, etc.).
  • FIG. 10 is a schematic diagram of an example processor platform PlOO that may be used and/or programmed to implement any or all of the example market share evaluator 102, the example test manager 202, the example IP address aggregator 204, the example ping manager 206, the example port scan manager 208, the example registry manager 210, the example hostname resolver 212, the example network interface 214, and/or the example panelist updater 216 of FIGS. 1 and 2.
  • the processor platform PlOO can be implemented by one or more general- purpose processors, processor cores, microcontrollers, etc.
  • the processor platform PlOO of the example of FIG. 10 includes at least one general-purpose programmable processor P105.
  • the processor P105 executes coded instructions PI lO and/or Pl 12 present in main memory of the processor P105 (e.g., within a RAM Pl 15 and/or a ROM P120).
  • the processor P105 may be any type of processing unit, such as a processor core, a processor and/or a microcontroller.
  • the processor P 105 may execute, among other things, the example processes of FIGS. 3-8 to implement the example methods and apparatus described herein.
  • the processor P 105 is in communication with the main memory (including a ROM P120 and/or the RAM Pl 15) via a bus P125.
  • the RAM Pl 15 may be implemented by dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), and/or any other type of RAM device, and ROM may be implemented by flash memory and/or any other desired type of memory device. Access to the memory Pl 15 and the memory P120 may be controlled by a memory controller (not shown).
  • the example memory Pl 15 may be used to implement the example market information database 106 of FIG. 1.
  • the processor platform PlOO also includes an interface circuit P 130.
  • the interface circuit P 130 may be implemented by any type of interface standard, such as an external memory interface, serial port, general-purpose input/output, etc.
  • One or more input devices P 135 and one or more output devices P 140 are connected to the interface circuit P 130.

Abstract

Example methods and apparatus to collect broadband market data are disclosed. A disclosed example method includes selecting a panelist household, the panelist household subscribing to at least one broadband service delivered via a modem, and identifying an Internet protocol (IP) address assigned to the modem by an Internet service provider (ISP). The example method also includes retrieving a range of IP addresses associated with the ISP, selecting a random subset of IP addresses from the range of IP addresses, and testing each of the IP addresses from the random subset to determine an activity status of each IP address.

Description

METHODS AND APPARATUS TO COLLECT BROADBAND MARKET DATA
RELATED APPLICATION
[0001] This patent claims the benefit of U.S. Provisional application serial no. 61/148,263, filed on January 29, 2009, entitled "Methods and Apparatus to Measure Broadband Market Statistics," and U.S. non-provisional application serial no. 12/576,805, filed on October 9, 2009, entitled "Methods and Apparatus to Collect Broadband Market Data," which are hereby incorporated by reference herein in their entireties.
FIELD OF THE DISCLOSURE
[0002] This disclosure relates generally to market research and, more particularly, to methods and apparatus to collect broadband market data.
BACKGROUND
[0003] Internet service providers (ISPs) that choose to participate in a market typically need to acquire information about their competitors. Competitive information allows the ISP to employ strategic and/or tactical decisions related to opportunities that may increase a subscriber base and/or identify which market areas may be particularly receptive to the services provided by the ISP. Additionally, information about the ISP and its competitors permits a comparison to reveal market presence and/or market dominance.
[0004] Obtaining information related to the presence of competitive ISPs and/or the market share in any particular geographic market may entail conducting surveys. Surveys, whether oral or written, typically yield low sample rates when compared to the total number of existing subscribers. Additionally, answers to the surveys are usually provided by a human respondent, who is prone to inaccuracy regarding details of their existing ISP. For example, a human respondent may state the name of their browser application or computer manufacturer instead of the name of their ISP. [0005] Additionally, because oral and written surveys are perceived as a burden to subscribers, ISPs are not likely to enjoy opportunities to determine whether the subscriber's status has changed. For example, a subscriber to an ISP is not typically bound by contracts that restrict and/or discourage competitive shopping with alternate ISPs. Thus, if the subscriber agrees to answer survey questions at a first time, such subscriber is not likely to also agree to another survey question at a second time (e.g., two-months after the first survey). Instead, the subscriber is likely to view the additional survey questions as a burden not worthy of their time.
BRIEF DESCRIPTION OF THE DRAWINGS
[0006] FIG. 1 is a block diagram of an example system to collect broadband market data.
[0007] FIG. 2 is a block diagram of an example market share evaluator shown in FIG. 1.
[0008] FIGS. 3-8 are flowcharts representative of examples processes that may be performed to implement one or more entities of the example systems and apparatus of FIGS. 1 and 2, and/or the example data charts of FIGS. 9A and 9B.
[0009] FIGS. 9A and 9B are example data charts generated by the example systems and apparatus of FIGS. 1 and 2, and/or the example processes of FIGS. 3-8.
[0010] FIG. 10 is a block diagram of an example processor system that may be used to execute the example processes of FIGS. 3-8 to implement the example systems, apparatus, and/or methods described herein.
DETAILED DESCRIPTION
[0011] Although the following discloses example methods and apparatus including, among other components, software executed on hardware, such methods and apparatus are merely illustrative and should not be considered as limiting. For example, any or all of these hardware and software components could be embodied exclusively in hardware, exclusively in software, or in any combination of hardware and software. Accordingly, while the following describes example methods, systems, and apparatus, the examples provided are not the only way to implement such methods, systems, and apparatus.
[0012] Example methods and apparatus to collect broadband market data are disclosed. A disclosed example method includes selecting a panelist household, the panelist household subscribing to at least one broadband service delivered via a modem, and identifying an Internet protocol (IP) address assigned to the modem by an Internet service provider (ISP). The example method also includes retrieving a range of IP addresses associated with the ISP, selecting a random subset of IP addresses from the range of IP addresses, and testing each of the IP addresses from the random subset to determine an activity status of each IP address. [0013] A disclosed example apparatus includes a test manager to select a panelist household and identify an IP address assigned to a household modem, a registry manager to retrieve a range of IP addresses registered by an ISP, the identified IP address within the retrieved range of IP addresses, and an activity determiner to identify whether each IP address in the range of IP addresses is active or inactive.
[0014] In the event that an internet service provider (ISP) gains or loses subscribers, the ISP is particularly interested in learning whether competitors experience a similar gain or loss. For example, if the ISP and one or more competitors experience similar gains in subscribers, then the general market area may be experiencing growth. Such an indication may prompt the ISP to increase advertising and/or promotional resources to attempt to capture such growth (e.g., market share) opportunities before one or more competitors capture a greater portion of the available subscribers. Alternatively, if the ISP and one or more competitors experience subscriber losses, then the general market area may be stagnant and/or shrinking, which may indicate advertising and/or promotional efforts should focus on one or more alternate markets. On the other hand, in the event that the ISP market share is higher than one or more competitors and/or rate of new subscribers is increasing as compared to one or more competitors, then the ISP may gain insight to the effectiveness of an advertising campaign and/or a promotion.
[0015] The methods and apparatus described herein identify, in part, candidate internet protocol (IP) addresses that may be associated with subscribers, whether the IP addresses are active or inactive, the ISP associated with each IP address, and/or the location of the IP address. As described in further detail below, the methods and apparatus described herein allow a user to collect broadband market data for one or more market(s) of interest. As such, the user is better able to calculate market share for one or more broadband ISPs because, in part, market statistic calculation confidence increases when a statistically significant amount of data is available. An example market share database is updated on a scheduled basis, a manual basis, periodically, or aperiodically to store known ISPs, name servers, and/or router nomenclature (e.g., ge-0-1 -ubr01.warren.ma.boston.comcast.net) associated with ISPs and/or IP addresses. In particular, the example methods and apparatus described herein identify one or more key words, letters, numbers, labels, and/or combinations thereof that may be indicative of geography (e.g., "ma," "boston," etc.) and/or one or more markets of interest.
[0016] FIG. 1 is an illustration of an example system 100 to collect broadband market data. In the illustrated example of FIG. 1, the system 100 includes a market share evaluator 102 communicatively connected to a registry database 104 and a market information database 106. The example registry database 104 may include one or more databases that identify which registrant is associated with one or more registered IP addresses and/or domain names. Such registry databases 104 include, but are not limited to, information from the American Registry for Internet Numbers (ARTN), the Internet Corporation for Assigned Names and Number (ICANN), IP Geolocation by Maxmind®, etc. Additionally, the example market information database 106 includes resolution keywords in an example resolution keyword table 107 to, in part, allow resolution of one or more hostname labels that may be cryptic and/or otherwise unfamiliar to a user of the methods and apparatus described herein. For example, in response to an example Whois query to ARIN, one or more labels may be returned having no apparent relationship to a state, a city, and/or a known ISP name. Accordingly, the example resolution keywords 107 may be used to decipher such labels.
[0017] The example market share evaluator 102 is also communicatively connected to one or more networks 108, such as the Internet. Any number of ISPs, such as example ISP "A" 110, ISP "B" 112, and ISP "C" are communicatively connected to the network 108, in which each ISP provides one or more services to household communication devices 116a-d. Household communication devices 116a- d may include, but are not limited to routers, modems and/or other equipment communicatively connected to an ISP. Each example ISP may be responsible for providing services (e.g., such as household Internet access, telephony, and/or media services) in an identified geographic market area. In the illustrated example of FIG. 1, ISP "A" 110 provides services to one or more household communication devices 116a, and ISP "B" 112 provides services to one or more household communication devices 116b, both of which are located in an example first market area 118. On the other hand, example ISP "C" 114 provides services to one or more household communication devices 116c in an example second market area 120.
[0018] In the illustrated example of FIG. 1, ISP "A" 110 provides services to one or more household communication devices in both the first market area 118 and the second market area 120. As described in further detail below, each household communication device is assigned an IP address (e.g., a static IP address or a dynamic IP address) by the ISP that is registered for use and/or management by that ISP. In the event that the ISP of interest has a presence in more than one market area (e.g., only the first market area 118, only the second market area 120, etc.), then the methods and apparatus described herein perform one or more techniques to ascertain the most likely geographic indicator (e.g., a state, a city, etc.) for the IP address assigned to the household communication device(s). For example, if one of the example household communication devices 116a has an IP address of 208.180.36.166, and one of the example household communication devices 116d has an IP address of 208.180.250.75, both of which are registered by ISP "A" 110, then the methods and apparatus described herein associate each IP address with a corresponding ISP router that provides geographic location cues. In particular, the methods and apparatus described herein may identify that the last router hop in the communicative path to IP address to 208.180.36.166 is associated with hostname s208-180-36-166.snjs.ca.sta.suddenlink.net," which includes one or more geographic location cues (e.g., "snjs" refers to San Jose).
[0019] Without limitation, the methods and apparatus described herein test one or more IP addresses to determine whether the IP address of interest is active or inactive. Generally speaking, an ISP registers one or more blocks of IP addresses that may be assigned to subscribers. ARIN is one of five Regional Internet Registries (RIRs) that manage IP address resources. Other RIRs include the Asia Pacific Network Information Centre (APNIC) and the Latin American and Caribbean IP Address Regional Registry (LACNIC). ARTN facilitates one or more processes that allow a user (e.g., an ISP) to register (usually for a fee) one or more IP addresses for exclusive use and to associate the registered IP address with a hostname. ARTN also facilitates a database lookup facility to allow queries (e.g., Whois queries) of an IP address to return a corresponding hostname, organization information, and/or whether the organization has other registered IP addresses (e.g., a block of IP addresses). However, while the organization information may include a corresponding contact name and/or address, such organization information may not be indicative of where the registered IP address(es) are being used (located). To illustrate, the IP address 68.87.148.146 is associated with, at the time of this writing, Comcast Cable Communications, Inc. having an organization address in Mt. Laurel, NJ. The ARIN database also indicates that this organization has registered a block of IP addresses ranging from 68.80.0.0 to 68.87.255.255. However, a User Datagram Protocol (UDP) and/or an Internet Control Message Protocol (ICMP) trace-route of the IP address 68.87.148.146 reveals that the last router hostname is "ge-0-1- ubr01.warren.ma.boston.comcast.net." As described above, the labels within the example hostname provide at least two geographic cues (i.e., "ma," and "boston") of where the IP address of interest is likely being used. In this example, the most likely geographic location associated with the IP address 68.87.148.146 is Boston, Massachusetts.
[0020] While the concept of a hostname is to, in part, facilitate a human- readable association with a specific IP address, the hostname and/or one or more labels of the hostname concatenated with dots may still appear cryptic to a human attempting to read it. For example, labels within the example hostname "snjs.ca.sta.suddenlink.net" may not readily appear to reveal useful information to persons unfamiliar with the San Jose area. Alternatively, users may confuse the label "ca" with nomenclature associated with Canada rather than California. To better resolve hostname labels and determine geographic and/or organizational association(s), the methods and apparatus described herein parse the hostname labels and search the example market information database 106 for matching (e.g., logical ANDed) combinations. In the event that a match of two or more labels is found after a logical AND, a candidate geographic location and/or associated organization associated with the IP address may be determined. To illustrate with the above- identified example hostname "snjs.ca.sta.suddenlink.net," the methods and apparatus described herein search for a combination of labels "snjs," "ca," and "suddenlink" before concluding that the router hostname is properly associated with the organization Suddenlink Communications, Inc. located in San Jose, California. [0021] Returning to the illustrated example of FIG. 1, one or more household communication devices may be associated with one or more panelists, such as panelist router "A" 122a, panelist router "B" 122b, and panelist router "C" 122c. One or more panelist households may be selected by, for example, a marketing entity to obtain a statistically significant sample size of behavior so that projections to a larger universe may be made with an acceptable degree of confidence. Panelists are typically selected in sufficient numbers to achieve statistical significance, and represent one or more particular geographic and/or demographic aspects of a larger universe of participants (e.g., subscribers of Internet services, viewers of media devices, Hispanic consumers, Japanese consumers, etc.). One or more households typically become a representative panelist based on, in part, an agreement with the monitoring entity (e.g., the marketing entity) to have one or more household behaviors monitored. Household behaviors of interest to the monitoring entity include, but are not limited to, television programs watched, dates/times at which programs are watched, shopping behaviors, web sites visited, and/or household services purchased (e.g., Internet services, telephony services, etc.). The agreement with the household panelists also includes explicit information related to the household address, thereby revealing their location. In the illustrated example of FIG. 1, the panelists 122a-c also provide information related to the IP address assigned to their router(s) and the ISP with which the household subscribes.
[0022] As described in further detail below, the example market share evaluator 102 periodically, aperiodically, manually, or on a scheduled basis retrieves updates from the panelist households 122a-c to obtain the most recent IP address and ISP used by that household. For example, each panelist household may have one or more personal computers running one or more applications that determine the assigned router IP address and e-mail such IP address information back to the marketing entity. In the event that a household decides to change which ISP supplies Internet services, the example market share evaluator 102 updates the example market information database 106 with information related to the new and/or alternate ISP. In this manner, the system 100 may stay appraised of additional ISPs that enter the first market area 118 and/or the second market area 120. Additionally, the example market share evaluator 102 identifies one or more new and/or alternate hostname labels indicative of the new and/or alternate ISP. As a result, hostname resolution related to IP address location and its associated organization (e.g., its associated ISP) can be performed using the proper label(s).
[0023] FIG. 2 is a detailed schematic illustration of the example market share evaluator 102 shown in FIG. 1. The example market share evaluator 102 includes a test manager 202, an IP address aggregator 204, and an activity determiner 205 that includes an example ping manager 206, and a port scan manager 208. The example market share evaluator 102 also includes a registry manager 210 that is communicatively connected to the example registry database 104. Further, the example market share evaluator 102 includes a hostname resolver 212, a network interface 214 communicatively connected to the example network 108 (e.g., the Internet), and a panelist updater 216. The example test manager 202 is communicatively connected to the market information database 106 the IP address aggregator 204, the ping manager 206, the port scan manager 208, the registry manager 210, the hostname resolver 212, the network interface 214, and the panelist updater 216 to invoke one or more services thereof. The example test manager 202, on a periodic, scheduled, aperiodic, and/or manual basis invokes a test of one or more IP addresses to determine whether it is active or inactive. Additionally, the example test manager 202 determines a corresponding organization and location associated with the IP address. Once information related to an IP address active/inactive status, an organization, and a location is obtained, the example test manager 202 calculates market share statistics for each organization that provides Internet services to subscribers.
[0024] In operation, the example test manager 202 invokes the example IP address aggregator 204 to obtain one or more IP addresses of interest when performing a test. For example, the IP address aggregator 204 may provide one or more IP addresses of interest from the market information database 106, which may store IP addresses identified from one or more previous tests to determine an active/inactive state. As such, the data within the example market information database 106 may be kept current. Without limitation, the example IP address aggregator 204 selects one or more IP addresses of one or more panelist households 122a-c. Additionally, the IP address aggregator 204 may select one or more neighboring IP addresses that could be part of a block of IP addresses registered by the ISP associated with the panelist. The IP address aggregator 204 may also invoke the registry manager 210 to obtain one or more IP addresses associated with a specific organization/ISP. For example, the IP address aggregator 204 may specify an organization name "WOW MEDIA" to determine which IP addresses and/or blocks of IP addresses are registered by the organization/ISP of interest. In operation, the example registry manager 210 contacts at least one registry database, such as ARIN, and provides organizational name keywords as input to the registry database. In response to the query, the example registry manager 210 receives corresponding IP addresses, a seed starting IP address, and/or blocks of IP addresses associated with the keyword input(s). Rather than test all of the returned IP addresses identified from the registry database query, the example test manager 202 may randomly select a predetermined number of IP addresses from the block (e.g., a subset of the block) to test. As such, a representative random sample of IP addresses may provide a reasonable indication of market presence of the organization. Additionally or alternatively, the example test manager 202 may employ the seed starting IP address as a randomly selected IP address within the range associated with the organization. The randomly selected seed starting IP address may service as a starting IP address, an ending IP address, and/or a midpoint IP address within a range of IP addresses to test.
[0025] To determine whether an IP address of interest is active, the example ping manager 206 performs an ICMP Ping operation via the example network interface 214 using the IP address of interest. Generally speaking, a ping is a computer network tool employed to determine whether a host is reachable across a network and sends ICMP echo request packets to the target IP address of interest. After sending each echo request packet, the example ping manager 206 listens via the network interface 214 for ICMP echo response reply messages. If such reply messages are received, then the IP address of interest is deemed active. In some instances, an ISP and/or one or more routers in the path may block a ping request (e.g., for security concerns), at which point the example port scan manager 208 attempts to scan one or more ports (e.g., TCP port 80 http service, TCP port 443 https service, etc.) of the machine associated with IP address of interest. A successful port scan results in the IP address of interest being deemed active. Generally speaking, some ISPs may block either or both of a port scan or ping. If neither the ping nor the port scan are successful, the IP address of interest is deemed inactive and the market information database 106 is updated accordingly.
[0026] IP addresses of interest having a successful ping or port scan are further associated with information obtained from one or more registry databases 104, such as the ARIN database that stores registry information for IP addresses in North America, Canada, the Caribbean, and the North Atlantic Islands. A query to the ARIN database is also referred to as a Whois query, which accepts the IP address or hostname as input and returns information including, but not limited to, an associated organization, a contact person(s), contact telephone number(s), a contact address, and/or contact e-mail address. The organizational information returned from the ARIN query is compared to the market information database 106 for a match that indicates whether the organization is a corporation, a university, or an ISP. If the IP address of interest is associated with an ISP, then it is also deemed to be used for residential purposes.
[0027] The methods and apparatus described herein further determine a corresponding location and more detailed ownership information. In other words, while the ARTN query described above identifies the organization that registered the IP address of interest, such organization may be a reseller of IP addresses rather than the ultimate user. As such, the example hostname resolver 212 of FIG. 2 performs a reverse domain name server (DNS) lookup (sometimes referred to as NSLookup (name-server lookup)) on the IP address to identify one or more cues indicative of true ownership. For example, an ARTN database query on the IP address 64.236.16.20 identifies "AOL Transit Data Network" as the organization that has registered IP addresses ranging from 64.236.0.0 to 64.236.255.255. However, the ultimate party and/or end-user for the IP address 64.236.16.20 is more accurately determined based on a reverse DNS lookup (also referred to as a reverse resolve) performed by the example hostname resolver 212, which reveals a hostname of "www2.cnn.com." Accordingly, the example hostname resolver 212 parses the hostname, extracts "cnn" and confirms the true end-user as CNN if a label-match is found in the example market information database 106. [0028] To determine a location associated with the IP address of interest, the example hostname resolver 212 performs a multi-location trace-route. Generally speaking, a trace-route is a computer network application to identify the routers traversed by packets in an IP network. The trace-route application identifies multiple hops of routers, starting with the router closest to the requestor and ending with the last router closest to the target IP address. Router identification during each hop includes, in part, a name for each router. Router hops may be influenced by, in part, one or more firewalls that cause alternate hop destinations. Typically, the last router listed is a series of router hops geographically closest to the device associated with the IP address of interest. Depending on the location of the requestor that is performing a trace-route test, one or more router hops may be different when compared to a requestor in a separate location. In both cases, the last router hop is usually the same, but in some instances the last router hop may identify a different router. Such alternate paths may occur in the example event where one or more router path(s) are down due to, for example, hardware failure(s), power failure(s), and/or localized weather interruptions.
[0029] To improve the confidence level that the last router hop is correct during the trace-route, the example hostname resolver 212 performs a multi-location trace-route, in which the originating trace-route test uses the same IP address of interest, but at separate originating locations. For example, a first trace-route for IP address 24.32.38.55 may originate in San Francisco, California, a second trace-route for the same IP address may originate in Dallas, Texas, and a third trace-route for the same IP address may originate in Lindbergh, Virginia. While all three of these originating locations will include one or more initial unique router hops, the ultimate path of test packets is expected to reach the same last hop router. If all trace-route tests identify the same last hop router information (e.g., s208-l 80-36- 166.snjs.ca.sta.suddenlink.net), then the example hostname resolver 212 parses the labels of the hostname for cues indicative of location. Such cues (e.g., labels "snjs," "ca," and "suddenlink") are compared against those labels stored in the example market information database 106 to resolve, or otherwise translate cryptic abbreviations and/or codes that refer to an organization (e.g., an ISP), a city (e.g., "snjs"), a state (e.g., "ca," "ma," etc.), or any other geographic identifier. On the other hand, if not all of the separate originating locations ultimately yield the same last hop router, then the example hostname resolver 212 may employ a threshold test before parsing labels from the hostname for location cues. In other words, a lower degree of confidence that the last hop router is the actual IP address location occurs when fewer than all separate originating locations yield the same last hop router name.
[0030] After identifying whether the IP address of interest is active or inactive, and after identifying a corresponding IP address owner (e.g., a true end-user rather than just the organization named by the registry), and after identifying a corresponding location of the IP address of interest, the methods and apparatus described herein save such information to the example market information database 106 (e.g., as tabular information). Typically, one or more entities interested in measuring broadband market statistics prefer to obtain a sufficient amount of sample measurements before any calculated results will be deemed statistically significant. As such, the methods and apparatus described herein may test any number of IP addresses of interest before calculating a corresponding market share of active IP addresses for any given time period (e.g., calculated market share per day, per week, per bi-week, per month, etc.). For example, if the example market share evaluator 102 tests five-hundred IP addresses associated with a first ISP and five-hundred IP addresses associated with a second ISP, then the example test manager 202 calculates a corresponding percentage of active IP addresses for each of the first and second ISP. Such calculated percentages may occur, for example, on a weekly basis to determine a projected broadband market presence per geographic area and/or identify one or more trends of market share penetration for competing ISPs.
[0031] IP addresses previously identified as active and/or associated with an organization are saved to the example market information database 106 for subsequent testing at a later date/time. For example, subscribers to ISP services may leave the ISP for a competitor's ISP, thereby causing the previously active IP address to become inactive/dormant. Subsequent testing of that same IP address may reveal that the IP address remains dormant/inactive for a period of time, or is reallocated to another subscriber. Additionally, performing one or more subsequent tests on the previously identified IP address(es) may prevent and/or minimize the need for additional queries to the registry database(s), in which each query may be associated with an access fee.
[0032] While an example system 100 to collect broadband market data and an example market share evaluator 102 has been illustrated in FIGS. 1 and 2, one or more of the interfaces, data structures, elements, processes and/or devices illustrated in FIGS. 1 and 2 may be combined, divided, re-arranged, omitted, eliminated and/or implemented in any other way. Further, the example market share evaluator 102, the example test manager 202, the example IP address aggregator 204, the example ping manager 206, the example port scan manager 208, the example registry manager 210, the example hostname resolver 212, the example network interface 214, and/or the example panelist updater 216 of FIGS. 1 and 2 may be implemented by hardware, software, and/or firmware. Thus, for example, any of the example market share evaluator 102, the example test manager 202, the example IP address aggregator 204, the example ping manager 206, the example port scan manager 208, the example registry manager 210, the example hostname resolver 212, the example network interface 214, and/or the example panelist updater 216 may be implemented by one or more circuit(s) (ASIC(s)), programmable logic device(s) (PLD(s)), and/or field programmable logic device(s) (FPLD(s)), etc. When any of the appended claims are read to cover a purely software and/or firmware implementation, at least one of the example market share evaluator 102, the example test manager 202, the example IP address aggregator 204, the example ping manager 206, the example port scan manager 208, the example registry manager 210, the example hostname resolver 212, the example network interface 214, and/or the example panelist updater 216 are hereby expressly defined to include a tangible medium, such as a memory, a digital versatile disc (DVD), a compact disc (CD), etc. storing the firmware and/or software. Further still, a communication system may include interfaces, data structures, elements, processes, and/or devices instead of, or in addition to, those illustrated in FIGS. 1 and 2 and/or may include more than one of any or all of the illustrated interfaces, data structures, elements, processes and/or devices.
[0033] FIGS. 3-8 illustrate example processes that may be performed to implement the example market share evaluator 102 of FIGS. 1 and 2. The example processes of FIGS. 3-8 may be carried out by a processor, a controller, and/or any other suitable processing device. For instance, the example processes of FIGS. 3-8 may be embodied in coded instructions stored on any tangible computer-readable medium such as a flash memory, a CD, a DVD, a floppy disk, a read-only memory (ROM), a random-access memory (RAM), a programmable ROM (PROM), an electronically-programmable ROM (EPROM), and/or an electronically-erasable PROM (EEPROM), an optical storage disk, an optical storage device, magnetic storage disk, a magnetic storage device, and/or any other medium that can be used to carry or store program code and/or instructions in the form of machine-readable instructions or data structures, and that can be accessed by a processor, a general- purpose or special-purpose computer, or other machine with a processor (e.g., the example processor platform PlOO discussed below in connection with FIG. 10). Combinations of the above are also included within the scope of computer-readable media. Machine-readable instructions comprise, for example, instructions and/or data that cause a processor, a general-purpose computer, a special-purpose computer, or a special-purpose processing machine to implement one or more particular processes. Alternatively, some or all of the example processes of FIGS. 3-8 may be implemented using any combination(s) of ASIC(s), PLD(s), FPLD(s), discrete logic, hardware, firmware, etc. Also, one or more operations of the example processes of FIGS. 3-8 may instead be implemented manually or as any combination of any of the foregoing techniques, for example, any combination of firmware, software, discrete logic, and/or hardware. Further, many other methods of implementing the example operations of FIGS. 3-8 may be employed. For example, the order of execution of the blocks may be changed, and/or one or more of the blocks described may be changed, eliminated, sub-divided, or combined. Additionally, any or all of the example processes of FIGS. 3-8 may be carried out sequentially and/or carried out in parallel by, for example, separate processing threads, processors, devices, discrete logic, circuits, etc.
[0034] The example process 300 of FIG. 3 begins with the example test manager 202 selecting a candidate IP address to test (block 302). Candidate IP addresses may be retrieved from the example market information database 106 based on the IP address(es) associated with known panelists, and/or candidate IP address(es) may be acquired from the example registry database 104 in response to a query associated with an ISP of interest. For example, the example test manager 202 may query the registry database 104 (e.g., the ARIN database) using an organization name (e.g., Verizon) to determine whether the organization has registered one or more IP addresses and/or blocks of IP addresses (block 302).
[0035] Turning briefly to the illustrated example process 400 of FIG. 4, the example test manager 202 may invoke the example panelist updater 216 to obtain panelist IP addresses to test and/or re-test. Generally speaking, because many ISPs assign IP addresses to subscribers in a dynamic manner rather than statically, such assigned IP addresses are subject to periodic expiration and reassignment. Accordingly, the one or more panelists may agree to disclose their current IP address, and/or otherwise allow home monitoring equipment to operate within the panelist household that periodically, manually, aperiodically, and/or on a scheduled basis report the current IP address. Without limitation, the home monitoring equipment may invoke an application (e.g., ipconfig) and/or script on one or more household personal computers to determine which IP address has been assigned to the panelist household.
[0036] In the illustrated example of FIG. 4, the example panelist updater 216 selects a panelist from the market information database 106 (block 402) and obtains the current IP address associated with that panelist (block 404). Additionally, the example panelist updater 216 may obtain, via survey and/or household monitoring device(s) (e.g., Nielsen® People Meter) other panelist ISP information (block 406). Panelist ISP information may include, but is not limited to, the ISP business name, the type of ISP services provided to the panelist household (e.g., DSL Internet services, cable Internet services, fiber optic services (FiOS), etc.). Without limitation, the example panelist updater 216 may obtain panelist demographic information from the example market information database 106, surveys, and/or the household monitoring device(s) (block 408). In the event that new and/or additional information is obtained via one or more surveys and/or via the household monitoring device(s) associated with, for example, Nielsen® online audience measurement services, such information is saved to the market information database 106 for future use (block 410). For example, one or more iterations through the illustrated example process 400 of FIG. 4 gathers additional candidate IP addresses for testing, as described in further detail below. IP addresses obtained through the one or more iterations may be saved to a memory and/or database for individual testing, which determines, in part, an active or inactive status of each candidate IP address. Accordingly, the example panelist updater 216 and/or the IP address aggregator 204 determines whether there are additional panelists to check (block 412) so that, in part, the example test manager 202 has a sufficient and/or statistically significant number of candidate IP addresses to make one or more market statistic conclusions having a requisite degree of confidence.
[0037] While the illustrated example process 400 of FIG. 4 obtains one or more candidate IP addresses for testing from panelists, the illustrated example process 500 of FIG. 5 also obtains candidate IP addresses for testing by determining whether the IP address registrant also manages one or more blocks of neighboring IP addresses. The example panelist updater 216 obtains a seed IP address from a panelist by querying the list of panelists stored in the example market information database 106 (block 502). Using the seed IP address as input for a query to the registry database 104, such as the ARIN database, the example registry manager 210 obtains information to indicate whether the seed IP address has one or more neighboring IP addresses also managed and/or registered by the same organizational entity (block 504). For example, a query to the ARIN database using a panelist seed IP address of 69.47.21.141 reveals, in part, an organization name "WideOpenWest Finance LLC," which has registered IP addresses ranging from 69.47.0.0 through 69.47.255.255. Based on this discovered range of IP addresses registered by the same organization, the example test manager 202 selects a random number of IP addresses to test (block 506). The selected random IP addresses may be temporarily saved by the test manager 202 in a queue or memory, and the information related to the known range of registered IP addresses for the organization are saved in the example market information database 106 (block 508) for future use. In other words, rather than perform another query to one or more registry databases 104 to determine a range of IP addresses registered by "WideOpenWest Finance LLC," the test manager 202 may, instead, select another group of random IP addresses to test from the market information database 106. If another seed IP address is to be selected (block 510) to, for example, acquire a greater number of IP addresses to satisfy a statistically significant threshold, control returns to block 502. Additionally, after saving the results to the example market information database 106 (block 508), a subsequent attempt to obtain an IP address to test by the market share evaluator 102 may not require any further queries to one or more registry databases 104. Instead, the example test manager 202 may acquire candidate IP addresses directly from the market information database 106, which are identified as being associated with a specific ISP.
[0038] Returning to the illustrated example process 300 of FIG. 3, after any number of IP addresses are selected (block 302), the example ping manager 206 performs a ping operation using one of the selected candidate IP addresses (block 304) to determine whether echo response messages are received and, if so (block 306) the selected candidate IP address is deemed active (block 308). In other words, the example ping manager 206 determines an activity status of the candidate IP address of interest. On the other hand, if the ping operation does not successfully return one or more echo response messages (block 306), the example test manager 202 directs the port scan manager 208 to initiate a port scan (block 310) and, if successful (block 312), the selected IP address is deemed active (block 308). However, if the port scan is not successful (block 312), the selected IP address is deemed inactive (block 314) and control returns to block 304 to select another candidate IP address to test.
[0039] IP addresses that are deemed active (block 308) by either a ping or port scan are further used as input for a query to one or more registry databases 104 (block 316), such as the ARIN database. Information retrieved from the registry databases 104 may include, but is not limited to, the name and/or address of the organization that registered the selected IP address, whether the named organization has also registered other IP addresses and/or one or more blocks of IP addresses, and/or a contact name, telephone number, and/or e-mail address of a contact responsible for the IP address. IP addresses that are associated with corporations, hospitals, schools, universities, and/or similar businesses and/or organizations are distinguished from IP addresses associated with residential use by the example market share evaluator 102 (block 318).
[0040] In particular, the example registry manager 210 compares the returned organization name with identified organization names stored in the market information database 106. The example market information database 106 includes at least one parameter associated with organization names to identify whether the organization is residential, meaning it provides IP addresses for residential purposes, or whether the organization is non-residential, meaning that it provides and/or otherwise manages IP addresses for corporate, scholastic, and/or any other non- residential purpose (block 318). If the IP address is not residential (block 320), then the example test manager 202 determines whether there are additional IP addresses of interest to test (block 322) and, if so, control returns to block 302. Otherwise, if the example test manager 202 determines that there are no additional IP addresses of interest to test, market share statistics are calculated based on the acquired test results (block 324), as described in further detail below.
[0041] In the event that the IP address is deemed residential (block 320), the example market share evaluator 102 determines a corresponding location of the IP address and performs a secondary test to identify a true end user (block 326) as compared to the registrant identified by one or more registry databases (e.g., the organization associated with OrgName by the ARIN database). As described above, the organization identified as responsible for a registered IP address may not be the ultimate end-user, but rather a reseller of IP addresses.
[0042] FIG. 6 illustrates the example process 326 to determine a corresponding location of the IP address and perform the secondary test to identify the true end user. In the illustrated example of FIG. 6, the example test manager 202 determines if the IP address of interest is stored in the example market information database 106 (block 602). If so, then the example market share evaluator 102 may not need to expend additional processing resources and/or time to determine true ownership and location information in the event that the stored information is relatively recent. As such, the example test manager 202 determines whether the information associated with the IP address of interest exceeds a date and/or time threshold, which serves as an indication of how recent or current the stored information is. If the threshold is not exceeded (block 604), thereby indicating that the IP address information stored in the example market information database 106 is relatively recent or current, such stored information is relied upon to confirm the true owner and location of the IP address of interest (block 606). [0043] On the other hand, in the event that the IP address of interest is not stored in the example market information database 106 (block 602) or the time/date threshold is exceeded (block 604), then the example hostname resolver 212 performs a reverse DNS lookup (also referred to as a reverse-resolve) using the IP address of interest to retrieve an associated hostname (block 608). An example response to a reverse DNS lookup using the IP address of interest 68.87.148.146 is "ge-0-1- ubr01.warren.ma.boston.comcast.net." Also note that an example response to an ARIN database Whois query using this same IP address of interest to identify the organization name is "Comcast Cable Communications, Inc." Accordingly, both the reverse DNS lookup and the registry database lookup identify the same end-user entity.
[0044] However, in some circumstances the organization name from the ARIN query and the reverse DNS will not match, such as when the example IP address of interest is 64.236.16.20. In this example, the ARTN query identifies the organization responsible for registering the IP address as "AOL Transit Data Network." On the other hand, a reverse DNS using the same IP address of interest reveals "www2.cnn.com." To resolve such a disparity and determine the true end user associated with the IP address of interest, the example hostname resolver 212 compares reverse DNS labels with labels stored in the example market information database 106 (block 610), as described in further detail in connection with FIG. 7.
[0045] In the illustrated example of FIG. 7, the example hostname resolver 212 parses and places received hostname, domain name, and/or router labels in separate fields (block 702) and identifies whether the labels satisfy a match of known residential ISPs stored as resolution keywords in the resolution keyword table 107 of the example market information database 106 (block 704). The one or more keywords in the example resolution keyword table 107 may include, but are not limited to, letters, words, numbers and/or one or more alphanumeric representations that are indicative of an ISP, an organization, and/or a location. In other words, the example hostname resolver 212 applies one or more rules to identify a valid ISP associated with a combination of labels parsed from a received hostname. Continuing with the example above, the hostname "ge-0-1 -ubr01.warren.ma.boston.comcast.net" may be analyzed by the hostname resolver 212 so that the labels "ma," "boston," and "comcast" are parsed-out for comparison purposes. In this example, the hostname resolver 212 includes a rule in which these three labels, when all identified within a single received hostname, result in identification of Comcast® as the ultimate end-user ISP.
[0046] However, assuming that the returned hostname was, instead, "ge-0-1- ubr01.warren.ma.comcast.net," then the example rule that requires at least three specific labels for proper identification of Comcast® would not be satisfied. Despite the fact that one of the labels includes "comcast," the possibility exists that Comcast® redistributes (e.g., a reseller) the IP address to a separate ISP. Accordingly, Comcast® and/or its residential customers would not be the ultimate end-user in this example, thus the IP address of interest cannot be properly associated with a conclusive end- user. Continuing with the example process 610 of FIG. 7, the example hostname resolver 212 determines if any label matches are found in the market information database 106 (block 706) and, if so, whether the required number of threshold label matches have been detected (block 708). If the required number of threshold label matches have been met (block 708), then the IP address of interest is associated with the ISP identified in the market information database 106 and/or a candidate result (block 710).
[0047] Returning to FIG. 6, if the hostname ownership is not resolved after one or more queries to the market information database 106 as described in connection with FIG. 7 (block 612), then the received hostname from the reverse DNS is flagged for manual follow-up (block 614). The manual follow-up may include, but is not limited to one or more users investigating new, alternate, and/or otherwise unrecognized label keywords to determine an associated ISP organization name and/or corresponding location. Such newly discovered information may further be appended to the example market information database 106 and/or resolution keywords 107 so that future/subsequent circumstances allow immediate resolution when those label keywords are encountered. This circumstance may arise in the event a new ISP enters the market having hostname labels not previously identified during one or more tests of IP addresses. As a result, the market information database 106 described herein continues to become more complete the longer it is used with the methods and apparatus described herein to measure broadband market statistics. [0048] If, on the other hand, the received hostname is resolved (block 612), then the example hostname resolver 212 initiates a multi-location trace-route (block 616) to confirm a common last hop router hostname (block 618). For example, if a first trace-route for the IP address of interest 68.87.148.146 originates in San Francisco (e.g., initiating router hostname "bdrrtr-a.22.c4.sf2.telephia.com"), a second trace-route for the same IP address originates in Dallas (e.g., initiating router hostname "tbrl.dlstx.ip.att.net"), and a third trace-route for the same IP address of interest originates in Lindbergh (e.g., initiating router hostname "host-criterion-83- 225.customer.ntelos.net") all identify a last hop router hostname "ge-0-1- ubr01.warren.ma.boston.comcast.net," then the labels indicative of location are extracted to identify the corresponding city and/or state in which the IP address of interest is located (block 620). In this example, the label cues "boston" and "ma" identify the city of Boston in the state of Massachusetts. However, in the event that there is no indicator of location in the hostname, then any information in the example market information database 106 will be used.
[0049] If, instead, all three trace-routes do not identify a common last hop router hostname (block 618), then the example hostname resolver 212 compares each returned hostname for a match in the example market information database 106 and resolves a corresponding location if a match is found (block 622), otherwise the IP address of interest is flagged for follow-up (block 624).
[0050] Returning to the illustrated example process 300 of FIG. 3, if the test manager 202 does not have any additional IP addresses of interest to test (block 322), then the test manager 202 calculates one or more broadband market statistics (block 324) such as, for example, market share. Turning to FIG. 8, the example test manager 202 selects an ISP of interest for which broadband market statistics are desired (block 802). Data returned from the one or more iterative tests of IP addresses is stored in the market information database 106, and for each ISP of interest the number of detected active IP addresses is divided by the total number of IP addresses tested to yield a percentage of active IP addresses for the given time period (block 804). In the event that the total number of IP addresses tested satisfies a threshold value indicative of a statistically significant sample size, the example test manager 202 calculates one or more projection estimates for the ISP of interest in the given market area (e.g., the first market area 118, the second market area 120, etc.) (block 806). For example, if a number of assigned IP addresses is found to be 325 out of 500 IP addresses tested, then a factor of 0.65 is calculated as factor indicative of active IP addresses. Additionally, if the ISP of interest is believed to control a quantity of, for example, 10,000 IP addresses (e.g., as determined from one or more registry databases, such as the ARIN database), then a total number of active IP addresses may be calculated/projected as 6,500 (e.g., 325 ÷ 0.05, or 0.65 X 10,000). If the user desires to calculate one or more broadband market statistics for alternate ISPs (block 808), then control returns to block 802, otherwise one or more output tables may be generated for the user (block 810), such as the example output tables 900 and/or 950 shown in FIGS. 9A and 9B.
[0051] The example data output table 900 of FIG. 9A includes an IP address column 902, a reverse DNS lookup column 904 to identify a hostname corresponding to the IP address, a Whois column 906 to identify a corresponding registrant name associated with the IP address, a ping column 908 to identify whether or not a ping operation was successful, and a port column 910 to identify whether or not one or more port scanning operations were successful. Additionally, the example table 900 of FIG. 9A includes a geography column 912 to identify the location of the IP address, and an active column 914 to identify whether the IP address of column 902 is active or inactive.
[0052] The example data output table 950 of FIG. 9B includes an ISP column 952, an IP address range column 954 to identify which groups of IP addresses (e.g., one or more grouped ranges of IP addresses) the ISP is responsible for, a number of IP addresses tested column 956 to identify the total number of IP addresses tested from the pool of IP addresses in column 954, and a number of active IP addresses column 958. The example data output table 950 also includes a number of inactive IP addresses column 960 and a corresponding percentage of active IP addresses based on the total number of IP addresses tested column 962. While FIGS. 9A and 9B illustrate two example data output tables that may be generated and/or calculated by the example market share evaluator 102, the methods and apparatus described herein are not limited thereto. Any other data output arrangement may be generated by the market share evaluator 102 to accommodate for varying needs of the user(s) such as, but not limited to, ranked data tables to illustrate ISPs having the largest or smallest market share for a city, a state, a region, and/or data tables to illustrate a rate of change in subscribers from one time period to another time period. Additionally, the example data tables 900 and 950 calculated by the example market share evaluator 102 may also identify one or more trends related to subscriber increases, subscriber decreases, and/or one or more effects in response to advertising and/or promotional efforts. For example, the ISP using the methods and apparatus described herein may establish a baseline broadband subscriber share and/or a rate of new subscribers for the ISP and/or competitors of the ISP prior to initiating one or more advertising and/or promotional campaigns. During such advertising and/or promotional campaigns, the ISP may continue to employ the methods and apparatus described herein to determine the effect of such advertising efforts (e.g., a threshold gain in the percentage of subscribers, an increase in the rate of new subscribers, etc.).
[0053] FIG. 10 is a schematic diagram of an example processor platform PlOO that may be used and/or programmed to implement any or all of the example market share evaluator 102, the example test manager 202, the example IP address aggregator 204, the example ping manager 206, the example port scan manager 208, the example registry manager 210, the example hostname resolver 212, the example network interface 214, and/or the example panelist updater 216 of FIGS. 1 and 2. For example, the processor platform PlOO can be implemented by one or more general- purpose processors, processor cores, microcontrollers, etc.
[0054] The processor platform PlOO of the example of FIG. 10 includes at least one general-purpose programmable processor P105. The processor P105 executes coded instructions PI lO and/or Pl 12 present in main memory of the processor P105 (e.g., within a RAM Pl 15 and/or a ROM P120). The processor P105 may be any type of processing unit, such as a processor core, a processor and/or a microcontroller. The processor P 105 may execute, among other things, the example processes of FIGS. 3-8 to implement the example methods and apparatus described herein.
[0055] The processor P 105 is in communication with the main memory (including a ROM P120 and/or the RAM Pl 15) via a bus P125. The RAM Pl 15 may be implemented by dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), and/or any other type of RAM device, and ROM may be implemented by flash memory and/or any other desired type of memory device. Access to the memory Pl 15 and the memory P120 may be controlled by a memory controller (not shown). The example memory Pl 15 may be used to implement the example market information database 106 of FIG. 1.
[0056] The processor platform PlOO also includes an interface circuit P 130. The interface circuit P 130 may be implemented by any type of interface standard, such as an external memory interface, serial port, general-purpose input/output, etc. One or more input devices P 135 and one or more output devices P 140 are connected to the interface circuit P 130.
[0057] Although certain example methods, apparatus and articles of manufacture have been described herein, the scope of coverage of this patent is not limited thereto. On the contrary, this patent covers all methods, apparatus and articles of manufacture fairly falling within the scope of the appended claims either literally or under the doctrine of equivalents.

Claims

What Is Claimed Is:
1. A computer implemented method to identify an Internet protocol (IP) address activity status, comprising: selecting a panelist household, the panelist household subscribing to at least one broadband service delivered via a modem; identifying an IP address assigned to the modem by an Internet service provider (ISP); retrieving a range of IP addresses associated with the ISP; selecting a random subset of IP addresses from the range of IP addresses; and testing each of the IP addresses from the random subset to determine an activity status of each IP address.
2. A method as defined in claim 1, wherein retrieving the range of IP addresses comprises querying a registry database with the identified IP address associated with the modem.
3. A method as defined in claim 2, wherein the registry database comprises the American Registry for Internet Numbers.
4. A method as defined in claim 2, further comprising: providing the registry database with an organization keyword to retrieve a seed IP address associated with the organization; and selecting the range of IP addresses based on the seed IP address.
5. A method as defined in claim 1, further comprising saving the range of IP addresses to a market information database to allow iterative IP address testing without additional registry queries.
6. A method as defined in claim 1, wherein testing each of the IP addresses from the random subset further comprises performing a ping test to determine an active status.
7. A method as defined in claim 6, further comprising identifying at least one of the IP addresses from the random subset as active when the ping test succeeds.
8. A method as defined in claim 6, further comprising performing a port scan when the ping test fails.
9. A method as defined in claim 8, further comprising identifying at least one of the IP addresses from the random subset as active when the port scan succeeds.
10. A method as defined in claim 1, wherein testing each of the IP addresses further comprises querying a registry to identify an organization associated with the IP address.
11. A method as defined in claim 10, further comprising performing a reverse resolve to identify whether the identified organization is an end-user of the IP address.
12. A method as defined in claim 11, further comprising parsing results from the reverse resolve to match a plurality of labels with at least one resolution keyword, the at least one resolution keyword to identify the end-user.
13. A method as defined in claim 12, further comprising identifying a threshold number of label matches to confirm the identified end-user.
14. A method as defined in claim 10, further comprising calculating market share statistics associated with the identified organization.
15. A method as defined in claim 1, wherein testing each of the IP addresses further comprises performing a multi-hop trace-route to identify a plurality of multi- hop router names and derive a location associated with each of the identified IP address.
16. A method as defined in claim 15, further comprising comparing each of the plurality of multi-hop router names returned from the multi-hop trace-route to confirm a common last-hop router.
17. A method as defined in claim 16, further comprising extracting a label indicative of a geographic location from the router names.
18. A method as defined in claim 16, further comprising comparing the label indicative of the geographic location with a resolution keyword to confirm the geographic location of the identified IP address.
19. An apparatus to identify an activity status of an Internet protocol (IP) address, comprising: a test manager to select a panelist household and identify an IP address assigned to a household modem; a registry manager to retrieve a range of IP addresses registered by an Internet service provider (ISP), the identified IP address within the retrieved range of IP addresses; and an activity determiner to identify whether each IP address in the range of IP addresses is active or inactive.
20. An apparatus as defined in claim 19, wherein the activity determiner comprises a ping manager to send at least one echo request to the identified IP address and to receive at least one echo return from the identified IP address to confirm an activity status.
21. An apparatus as defined in claim 19, wherein the activity determiner comprises a port scan manager to initiate at least one port scan to the identified IP address to confirm an activity status.
22. An apparatus as defined in claim 19, wherein the registry manager queries a registry database with an organization name to retrieve the range of IP addresses associated with the organization name.
23. An apparatus as defined in claim 19, further comprising a hostname resolver to reverse resolve each IP address in the range of IP addresses, the reverse resolve generating a corresponding hostname for each IP address.
24. An apparatus as defined in claim 23, further comprising a resolution keyword table including a plurality of resolution keywords associated with a plurality of Internet service providers, the hostname resolver to compare the plurality of resolution keywords to the corresponding hostname for each IP address.
25. A method to calculate broadband market statistics, comprising: selecting an Internet protocol (IP) address; reverse resolving the selected IP address to obtain a domain name associated with the IP address; parsing the domain name to extract a plurality of domain labels; comparing the plurality of labels to a plurality of resolution keywords to identify an owner of the IP address; and calculating a broadband market statistic based on the identified owner of the IP address.
26. A method as defined in claim 25, wherein selecting the IP address further comprises retrieving a panelist household IP address.
27. A method as defined in claim 26, further comprising selecting a range of IP addresses within the panelist household IP address.
28. A method as defined in claim 25, wherein the plurality of domain labels comprise an alphanumeric representation indicative of at least one of a geographic location or an organization.
29. An article of manufacture storing machine accessible instructions that, when executed, cause a machine to: select a panelist household, the panelist household subscribing to at least one broadband service delivered via a modem; identify an IP address assigned to the modem by an Internet service provider (ISP); retrieve a range of IP addresses associated with the ISP; select a random subset of IP addresses from the range of IP addresses; and test each of the IP addresses from the random subset to determine an activity status of each IP address.
30. An article of manufacture as defined in claim 29, wherein the machine accessible instructions, when executed, cause the machine to query a registry database with the identified IP address associated with the modem.
31. An article of manufacture as defined in claim 30, wherein the machine accessible instructions, when executed, cause the machine to: provide the registry database with an organization keyword to retrieve a seed IP address associated with the organization; and select the range of IP addresses based on the seed IP address.
32. An article of manufacture as defined in claim 29, wherein the machine accessible instructions, when executed, cause the machine to save the range of IP addresses to a market information database to allow iterative IP address testing without additional registry queries.
33. An article of manufacture as defined in claim 22, wherein the machine accessible instructions, when executed, cause the machine to perform a ping test to determine an active status.
34. An article of manufacture as defined in claim 33, wherein the machine accessible instructions, when executed, cause the machine to identify at least one of the IP addresses from the random subset as active when the ping test succeeds.
35. An article of manufacture as defined in claim 33, wherein the machine accessible instructions, when executed, cause the machine to perform a port scan when the ping test fails.
36. An article of manufacture as defined in claim 35, wherein the machine accessible instructions, when executed, cause the machine to identify at least one of the IP addresses from the random subset as active when the port scan succeeds.
37. An article of manufacture as defined in claim 29, wherein the machine accessible instructions, when executed, cause the machine to query a registry to identify an organization associated with the IP address.
38. An article of manufacture as defined in claim 37, wherein the machine accessible instructions, when executed, cause the machine to perform a reverse resolve to identify whether the identified organization is an end-user of the IP address.
39. An article of manufacture as defined in claim 38, wherein the machine accessible instructions, when executed, cause the machine to parse results from the reverse resolve to match a plurality of labels with at least one resolution keyword, the at least one resolution keyword to identify the end-user.
40. An article of manufacture as defined in claim 39, wherein the machine accessible instructions, when executed, cause the machine to identify a threshold number of label matches to confirm the identified end-user.
41. An article of manufacture as defined in claim 37, wherein the machine accessible instructions, when executed, cause the machine to calculate market share statistics associated with the identified organization.
42. An article of manufacture as defined in claim 29, wherein the machine accessible instructions, when executed, cause the machine to perform a multi-hop trace-route to identify a location associated with each of the identified IP address.
43. An article of manufacture as defined in claim 42, wherein the machine accessible instructions, when executed, cause the machine to compare a plurality of multi-hop router names returned from the multi-hop trace-route to confirm a common last-hop router.
44. An article of manufacture as defined in claim 43, wherein the machine accessible instructions, when executed, cause the machine to extract at least one label indicative of a geographic location from the router names.
45. An article of manufacture as defined in claim 44, wherein the machine accessible instructions, when executed, cause the machine to compare the at least one label indicative of the geographic location with at least one resolution keyword to confirm a geographic location of the identified IP address.
PCT/US2010/022384 2009-01-29 2010-01-28 Methods and apparatus to collect broadband market data WO2010088369A2 (en)

Priority Applications (4)

Application Number Priority Date Filing Date Title
EP10702966.2A EP2382776A4 (en) 2009-01-29 2010-01-28 Methods and apparatus to collect broadband market data
AU2010208224A AU2010208224A1 (en) 2009-01-29 2010-01-28 Methods and apparatus to collect broadband market data
JP2011548288A JP2012516513A (en) 2009-01-29 2010-01-28 Method and apparatus for collecting broadband market data
GB1113767A GB2480029A (en) 2009-01-29 2010-01-28 Methods and apparatus to collect broadband market data

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US14826309P 2009-01-29 2009-01-29
US61/148,263 2009-01-29
US12/576,805 2009-10-09
US12/576,805 US8280996B2 (en) 2009-01-29 2009-10-09 Methods and apparatus to collect broadband market data

Publications (2)

Publication Number Publication Date
WO2010088369A2 true WO2010088369A2 (en) 2010-08-05
WO2010088369A3 WO2010088369A3 (en) 2010-09-23

Family

ID=42354898

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2010/022384 WO2010088369A2 (en) 2009-01-29 2010-01-28 Methods and apparatus to collect broadband market data

Country Status (6)

Country Link
US (2) US8280996B2 (en)
EP (1) EP2382776A4 (en)
JP (1) JP2012516513A (en)
AU (1) AU2010208224A1 (en)
GB (1) GB2480029A (en)
WO (1) WO2010088369A2 (en)

Families Citing this family (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8135685B2 (en) * 2006-09-18 2012-03-13 Emc Corporation Information classification
US9461890B1 (en) 2007-09-28 2016-10-04 Emc Corporation Delegation of data management policy in an information management system
US8280996B2 (en) 2009-01-29 2012-10-02 The Nielsen Company (Us), Llc Methods and apparatus to collect broadband market data
WO2010088372A1 (en) 2009-01-29 2010-08-05 The Nielsen Company (Us), Llc Methods and apparatus to measure market statistics
US8699378B2 (en) * 2009-09-30 2014-04-15 At&T Intellectual Property I, L.P. Methods and apparatus for discovering hosts on an IPv6 network
US8412847B2 (en) * 2009-11-02 2013-04-02 Demandbase, Inc. Mapping network addresses to organizations
US8972554B2 (en) * 2010-09-30 2015-03-03 The Nielsen Company (Us), Llc Methods and apparatus to measure mobile broadband market share
US10089592B2 (en) 2010-12-29 2018-10-02 Comcast Cable Communications, Llc Measuring video asset viewing
US10945011B2 (en) 2010-12-29 2021-03-09 Comcast Cable Communications, Llc Measuring video viewing
JP5857519B2 (en) * 2011-08-11 2016-02-10 富士通株式会社 Test program, test apparatus, and test method
US9331975B2 (en) * 2011-12-16 2016-05-03 The Nielsen Company (Us), Llc Systems, methods, and apparatus to identify media presentation devices
US10645433B1 (en) 2013-08-29 2020-05-05 Comcast Cable Communications, Llc Measuring video-content viewing
US10440428B2 (en) 2013-01-13 2019-10-08 Comcast Cable Communications, Llc Measuring video-program-viewing activity
US11627356B2 (en) 2012-01-28 2023-04-11 Comcast Cable Communications, Llc Data translation for video-viewing activity
US9331921B2 (en) 2012-05-17 2016-05-03 Vindico, Llc Internet connected household identification for online measurement and dynamic content delivery
US11463403B2 (en) 2012-05-17 2022-10-04 Viant Technology Llc Internet connected household identification for online measurement and dynamic content delivery
US10284439B2 (en) * 2013-12-02 2019-05-07 Google Llc Method for measuring end-to-end internet application performance
FR3042083B1 (en) * 2015-10-01 2017-12-08 Orbite METHOD FOR AUTOMATICALLY IDENTIFYING ORGANIZATION BASED ON INTERNET PROTOCOL IP IDENTIFICATION NUMBER
US10834449B2 (en) * 2016-12-31 2020-11-10 The Nielsen Company (Us), Llc Methods and apparatus to associate audience members with over-the-top device media impressions
US11328308B1 (en) * 2017-05-31 2022-05-10 Juniper Networks, Inc Systems and methods for matching and delivering account-level data from multiple customer-facing platforms based on contact-level touchpoints
US10805259B2 (en) * 2017-06-30 2020-10-13 Microsoft Technology Licensing, Llc Geolocation using reverse domain name server information
US11127073B2 (en) * 2019-10-03 2021-09-21 Capital One Services, Llc Systems and methods for obtaining user parameters of e-commerce users to auto complete checkout forms
US11936703B2 (en) 2021-12-09 2024-03-19 Viant Technology Llc Out-of-home internet connected household identification

Family Cites Families (42)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5845285A (en) 1997-01-07 1998-12-01 Klein; Laurence C. Computer system and method of data analysis
US6151631A (en) * 1998-10-15 2000-11-21 Liquid Audio Inc. Territorial determination of remote computer location in a wide area network for conditional delivery of digitized products
US6516189B1 (en) * 1999-03-17 2003-02-04 Telephia, Inc. System and method for gathering data from wireless communications networks
AUPQ206399A0 (en) 1999-08-06 1999-08-26 Imr Worldwide Pty Ltd. Network user measurement system and method
US7577725B1 (en) * 2000-02-25 2009-08-18 Cisco Technology, Inc. IP address allocation in a network environment
US7930285B2 (en) * 2000-03-22 2011-04-19 Comscore, Inc. Systems for and methods of user demographic reporting usable for identifying users and collecting usage data
US6684250B2 (en) * 2000-04-03 2004-01-27 Quova, Inc. Method and apparatus for estimating a geographic location of a networked entity
US7181519B2 (en) 2000-12-11 2007-02-20 Silverback Technologies, Inc. Distributed network monitoring and control system
US7720996B2 (en) * 2001-03-27 2010-05-18 Microsoft Corporation Internet protocol (IP) address proximity and application to peer provider location
WO2002097629A1 (en) * 2001-05-30 2002-12-05 Fox Paul D System and method for providing network security policy enforcement
US20030083924A1 (en) * 2001-10-31 2003-05-01 Yuchun Lee Multi-level audience processing
US20030093438A1 (en) * 2001-11-09 2003-05-15 David Miller System and method for performing reverse DNS resolution
US20080189408A1 (en) * 2002-10-09 2008-08-07 David Cancel Presenting web site analytics
US6751295B2 (en) * 2002-04-03 2004-06-15 Criterion Wireless Corp. Method and apparatus for measuring communication market statistics
US8639557B2 (en) * 2002-06-11 2014-01-28 The Nielsen Company (Us), Llc Method and system for collecting and analyzing market data in a mobile communications system
US6876979B2 (en) 2002-08-12 2005-04-05 Paybyclick Corporation Electronic commerce bridge system
WO2004034229A2 (en) * 2002-10-10 2004-04-22 Rocksteady Networks, Inc. System and method for providing access control
US7200658B2 (en) * 2002-11-12 2007-04-03 Movielink, Llc Network geo-location system
US20040193918A1 (en) * 2003-03-28 2004-09-30 Kenneth Green Apparatus and method for network vulnerability detection and compliance assessment
US20050108378A1 (en) 2003-10-25 2005-05-19 Macrovision Corporation Instrumentation system and methods for estimation of decentralized network characteristics
US20050096969A1 (en) * 2003-11-05 2005-05-05 Sevio Robert A. Market share forecasting for businesses selling products or services to other businesses (non-consumer markets)
GB2408114A (en) 2003-11-13 2005-05-18 Whereonearth Ltd Determining a geographical location from IP address information
US7797410B2 (en) * 2004-04-29 2010-09-14 Euro Convergence, Sarl Reverse IP method and system
TW200614783A (en) 2004-07-20 2006-05-01 Ibm Communication apparatus, communication system, communication method, communication service method, program, and recording medium
US7636785B2 (en) 2004-11-16 2009-12-22 Microsoft Corporation Heuristic determination of user origin
US20060130147A1 (en) * 2004-12-15 2006-06-15 Matthew Von-Maszewski Method and system for detecting and stopping illegitimate communication attempts on the internet
US20060178903A1 (en) * 2005-01-21 2006-08-10 Commoca, Inc. Method and system for converged communications directory search and advertising services
US20060184381A1 (en) * 2005-01-27 2006-08-17 Servicemagic, Inc. Computer-implemented method and system for matching a consumer to a home service provider
WO2006094275A2 (en) * 2005-03-02 2006-09-08 Markmonitor, Inc. Trust evaluation systems and methods
US7818201B2 (en) * 2006-03-31 2010-10-19 Vology, Inc. Lead referral system
US8090766B2 (en) * 2006-08-15 2012-01-03 Microsoft Corporation System and method to identify, rank, and audit network provided configurables
US8041596B2 (en) * 2006-09-08 2011-10-18 Eldis Inc. Methods for estimating search engine market share for websites
US20080281696A1 (en) * 2007-05-11 2008-11-13 Verizon Services Organization Inc. Systems and methods for using dns records to provide targeted marketing services
US20080313019A1 (en) 2007-06-14 2008-12-18 Jeffers Martin C System and method for extracting contact information from website traffic statistics
US8856360B2 (en) * 2007-06-22 2014-10-07 Microsoft Corporation Automatically identifying dynamic internet protocol addresses
US8170998B2 (en) 2007-09-12 2012-05-01 American Express Travel Related Services Company, Inc. Methods, systems, and computer program products for estimating accuracy of linking of customer relationships
US20090112918A1 (en) 2007-10-26 2009-04-30 Team Banzai Media Group Rich media content web site analytics system and method and network analytics infrastructure employing the same
US20090132365A1 (en) 2007-11-15 2009-05-21 Microsoft Corporation Search, advertising and social networking applications and services
US20090150166A1 (en) 2007-12-05 2009-06-11 International Business Machines Corporation Hiring process by using social networking techniques to verify job seeker information
US20090197582A1 (en) 2008-02-01 2009-08-06 Lewis Robert C Platform for mobile advertising and microtargeting of promotions
WO2010088372A1 (en) 2009-01-29 2010-08-05 The Nielsen Company (Us), Llc Methods and apparatus to measure market statistics
US8280996B2 (en) 2009-01-29 2012-10-02 The Nielsen Company (Us), Llc Methods and apparatus to collect broadband market data

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See references of EP2382776A4 *

Also Published As

Publication number Publication date
WO2010088369A3 (en) 2010-09-23
AU2010208224A1 (en) 2011-08-18
GB2480029A (en) 2011-11-02
GB201113767D0 (en) 2011-09-21
US20100191577A1 (en) 2010-07-29
JP2012516513A (en) 2012-07-19
US9189796B2 (en) 2015-11-17
EP2382776A2 (en) 2011-11-02
EP2382776A4 (en) 2014-04-02
US8280996B2 (en) 2012-10-02
US20130013770A1 (en) 2013-01-10

Similar Documents

Publication Publication Date Title
US9189796B2 (en) Methods and apparatus to collect broadband market data
US20200195554A1 (en) Methods and apparatus to measure market statistics
US20230396689A1 (en) Methods and apparatus to determine media impressions using distributed demographic information
US8521908B2 (en) Existent domain name DNS traffic capture and analysis
US11093955B2 (en) Methods and apparatus to measure mobile broadband market share
Benevenuto et al. Characterizing user behavior in online social networks
McDonald et al. A comparison of online and postal data collection methods in marketing research
Kneller et al. Barriers to exporting: What are they and who do they matter to?
Nicholas et al. Evaluating consumer website logs: a case study of The Times/The Sunday Times website
EP2216747A2 (en) Method and apparatus to associate demographic and geographic information with influential consumer relationships
US8499032B2 (en) System and method for compiling a set of domain names to recover
CN101729288B (en) Method and device for counting network access behaviours of internet users
US11282105B1 (en) Anonymized cross-application or cross-site attribution without use of central IDs
CN107330718B (en) Media anti-cheating method and device, storage medium and terminal
CN103268562A (en) Internet advertisement audience population ascribed characteristic monitoring method and system
Clinton et al. Reluctant Republicans, eager Democrats? Partisan nonresponse and the accuracy of 2020 presidential pre-election telephone polls
Gerber et al. Do subtle linguistic interventions priming a social identity as a voter have outsized effects on voter turnout? Evidence from a new replication experiment
AU2013203834B2 (en) Methods and apparatus to collect broadband market data
SARWAR et al. New Product development: Strategy & implementation mechanism for Copy testing
Pickard et al. Analysis of enterprise IPv6 readiness
Marciel Insights of YouTube View Check System

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 10702966

Country of ref document: EP

Kind code of ref document: A2

WWE Wipo information: entry into national phase

Ref document number: 2011548288

Country of ref document: JP

WWE Wipo information: entry into national phase

Ref document number: 2010702966

Country of ref document: EP

ENP Entry into the national phase

Ref document number: 1113767

Country of ref document: GB

Kind code of ref document: A

Free format text: PCT FILING DATE = 20100128

WWE Wipo information: entry into national phase

Ref document number: 1113767.6

Country of ref document: GB

ENP Entry into the national phase

Ref document number: 2010208224

Country of ref document: AU

Date of ref document: 20100128

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE