IPv6 Matrix presentation for World IPv6 Launch, June 2012

IPv6 Matrix Project - http://www.ipv6matrix.orgPage 1

IPv6 Matrix Project

Tracking IPv6 connectivity Worldwide

http://www.ipv6matrix.org

Dr. Olivier MJ Crépin-Leblond – [email protected] June 2012 Update for World IPv6 Launch on 6 June 2012


We are running out of IP addresses

When we reach this point, it will be too late since

there will be no more “free” IPv4 addresses!

Real time data collected September 2011

http://www.potaroo.net/tools/ipv4/index.html


World IPv6 Launch

� Major Internet service providers (ISPs), home networking

equipment manufacturers, and web companies around the world

are coming together to permanently enable IPv6 for their products and services.

� http://www.worldipv6launch.org


IPv6 Matrix Project

� ISOC England was awarded a Community Grants Programme award in November 2009

� Design and implementation of an “IPv6 Crawler,” software on a computer that crawls through the DNS at regular intervals in order to detect and test:� IPv6 DNS servers

� IPv6 compliant Web servers� IPv6 compliant SMTP mailers

� IPv6 compliant NTP servers.


Project Rationale

� Today, more than 95% of Internet traffic is generated by a small number of data sources – i.e. the world’s busiest Web Sites

� Without IPv6 accessible content, IPv6 has no chance of being used - ever.

� Take the 1 Million most popular Web site list from alexa.com as a starting point for the domains to be tested. Add more domains later.

� Test them for IPv6 connectivity

� This is equivalent to testing about 6.3 million hosts worldwide

� Use GeoIP database to estimate real host location


Project Teams

� London, UK:

� Project Management and support

� Hardware supply and installation

� Data Centre and IPv6 connectivity

� Nile University, Egypt:

� Software Programming


Crawler

CENTOS 5 Linux / updatedOperating

System

2 x hot-swappable redundant

535W.

PSU

146 Gb hardware SATA 2-disk

RAID (hot swappable)

HD Storage

4 Gb DDR2 SDRAMRAM

2 x Dual Core Intel(R)

Xeon(TM) CPU 3.60GHz

CPU

194.33.63.250 / 1 Gb/s (GIH

private address space)

IPv4 address

(eth1) /

speed

shell.ipv6matrix.orgName (eth1)

2a00:19e8:20:1::a2 / 100 Mb/sIPv6 address

(eth0) /

speed

212.124.204.162 / 100 Mb/sIPv4 address

(eth0) /

speed

turtle.ipv6matrix.org ;

crawler.ipv6matrix.org

turtle.ipv6matrix.com ;

crawler.ipv6matrix.com

turtle.ipv6matrix.net ;

crawler.ipv6matrix.net

Name (eth0)

HP DL360pModel

Crawler (back

end)


Web Server

Ubuntu 4.4 Linux / updatedOperating System

Single 500WPSU

2 x 1 Tb fast SATAHD Storage

4 Gb DDR2 SDRAMRAM

2 x Dual Core Intel(R) Xeon(TM)

CPU 3.40GHz

CPU

194.33.63.251 / 1 Gb/s (GIH

private address space)

IPv4 address

(eth1) /

speed

tusk.ipv6matrix.orgName (eth1)

2a00:19e8:20:1::aa / 100 Mb/sIPv6 address

(eth0) /

speed

212.124.204.170 / 100 Mb/sIPv4 address

(eth0) /

speed

elephant.ipv6matrix.org ;

www.ipv6matrix.org

elephant.ipv6matrix.com ;

www.ipv6matrix.com

elephant.ipv6matrix.net ;

www.ipv6matrix.net

Name (eth0)

HP DL140Model

Web Server

(front end)


Router

MN-16ESW 16 port / 100

Mb/s

Interface card /

speed

2 / 100 Mb/sEthernet Ports /

speed

64 MbDRAM

Advanced IP Services IOSOperating

System

CISCO 2811Model

Router


Local Network


Software flowchart


Web Site

Structure


www.ipv6matrix.org Web Site


What are we tracking?

� Host IPv6 penetration

� Using IPv4 Geo-location coordinates

� Includes generic TLD (gTLDs, .com, .net, .org) and country code ccTLDs

� Two types of information:

� Infrastructure: DNS + Web + E-mail + Time server (NTP)This tracks all of the infrastructure required to run IPv6 Web services

� Web sites only (actual content)This tracks the Web services themselves. Usually this percentage is lower than the figure for the infrastructure


What are we archiving?

� Everything that we are tracking on the previous page, plus:

� Testing of connectivity to the above services in case IPv6 addresses are advertised but no service runs on them

� Tracing of route from London Docklands to each one of these hosts both using IPv4 and IPv6 – and archiving all of this information in text format

� A lot more data, accessible from the Web site archive

� In June 2012, the size of this database in text format is approx 140Gb and continually increasing (the testing software runs 24/7)


Data Archives

Selecting Data Archives provides

a link to the detailed information

Table.

Click on “Search”, to go

directly to the Top Level Domain,

or scroll down to the desired

Top Level Domain.


Data Archives

� Example Data in Data Archives (stop

at date)

Click on the “+” to the left of the

Top Level Domain to gain

access the sub-menu containing

the dates of all the data runs,

and so on, to reveal results.

year-month-day__hour-min-sec


Data Archives - results

Click on the links to open a

new window containing

all of the detailed results

formatted in a table.


Data Archives - resultsBasic IPv4/IPv6 connectivity table

Domain penetration summary table

Geographical IP database

Type of IPv6 access (tunnels etc.)

Trace path, hop count, MTU IPv4 & IPv6

Ping count IPv4 and IPv6

Reverse IPv4 and IPv6

SOA for Nameserver

Service detection for SMTP, HTTP and HTTPs

TLS detection for SMTP


Detailed Data for .AEClicked on tcp80_WWW_ae: connection to http port


Using the filter

Use the filter to select by Top Level Domain, or by type of service tested.


Results

4 June 2012 – pre-IPv6 Launch


Europe Data snapshot

December 20119.82%

15.14%

2.71%

2.80% 4.06%

2.02%

9.34%6.44%

2.13%

2.77%

5.39%

13.70%

4.75%

7.91%

5.68%

0.64% 0.58%

11.83%

0.83%

4.04%

6.72%

16.66%6.14%

6.30% 2.67% 10.01%

11.09%

5.58%

2.66% 4.96% 7.07%11.87%

8.24%

13.52%

5.06% 6.96%

3.70%

5.20%

7.44%

15.81%

9.98%

12.20%

6.92%8.87%

16.73%

6.50%

4.04%

0.65% 0.93%

10.53%

0.16%

3.88%

4.34%

18.54%18.36%

3.51%

IPv6 Host Penetration

Infrastructure

- DNS

- Web

- E-mail

- NTP

16.26%

2.33%

12.19%

2.71%

4 June 2012

Low Sample

Low accuracy


Europe Data snapshot

4 June 2012

11.67%

1.00%

0.27%

0.71% 2.41%

0.47%

1.68%7.45%

1.17%

0.45%

0.94%

2.19%

0.99%

0.51%

2.60%

0.32% 0.29%

0.42%

0.95%

0.19%

0.86%

4.15%9.14%

0.85% 1.30% 4.00%

0.48%

2.85%

0.75% 2.82% 6.71%1.83%

0.51%

1.68%

1.11% 1.22%

0.35%

1.08%

0.93%

1.08%

11.85%

4.35%

10.35%0.73%

3.90%

1.07%

1.80%

0.34% 0.35%

0.36%

0.17%

0.16%

1.59%

26.70%23.86%

1.41%


Web only

12.29%

0.65%

12.43%

0.64%

December 2011

Low Sample

Low accuracy


Infrastructure

- DNS or

- Web or

- E-mail or

- NTP


(*) Low Sample

Low accuracy

Previous Country DNS+WEB+E-mail+NTP % change

Order Dec 2011 4 June 2012

1 Moldova (*) 18.54% 18.36% -0.18%

2 Switzerland 16.66% 16.73% 0.07%

4 France 15.14% 15.81% 0.67%

7 Slovenia 11.33% 13.69% 2.36%

5 Finland 13.70% 13.52% -0.18%

9 Czech Republic 10.01% 12.20% 2.19%

3 Slovakia 16.26% 12.19% -4.07%

11 Netherlands 9.34% 11.87% 2.53%

6 Ukraine 11.83% 10.53% -1.30%

10 Portugal 9.82% 9.98% 0.16%

8 Poland 11.09% 8.87% -2.22%

12 Denmark 7.91% 8.24% 0.33%

14 Latvia 6.72% 7.44% 0.72%

15 Germany 6.44% 7.07% 0.63%

32 Russia 2.13% 6.96% 4.83%

17 Spain 6.14% 6.92% 0.78%

18 Estonia 6.14% 6.92% 0.78%

13 Bosnia and Herzegovina (*) 7.51% 6.54% -0.97%

16 Austria 6.30% 6.50% 0.20%

19 Croatia 5.83% 6.28% 0.45%

20 Norway 5.68% 5.58% -0.10%

21 Sweden 4.75% 5.06% 0.31%

23 Belgium 4.06% 4.96% 0.90%

26 Luxembourg 3.21% 4.80% 1.59%

22 Greece 4.34% 4.04% -0.30%

24 Lithuania 4.04% 3.88% -0.16%

29 United Kingdom 2.71% 3.70% 0.99%

30 Italy 2.67% 3.51% 0.84%

25 Macedonia 3.33% 3.33% 0.00%

33 Iceland 2.02% 2.77% 0.75%

31 Hungary 2.33% 2.71% 0.38%

28 Ireland 2.80% 2.66% -0.14%

27 Serbia (*) 3.06% 2.53% -0.53%

35 Romania 0.58% 0.93% 0.35%

36 Bulgaria 0.50% 0.81% 0.31%

34 Belarus 0.83% 0.16% -0.67%



Web only

(*) Low Sample

Low accuracy

Previous Country WEB % change

Order Dec 2011 4 june 2012

1 Moldova (*) 23.70% 23.86% 0.16%

2 Slovakia 12.29% 12.43% 0.14%

3 Portugal 11.67% 11.85% 0.18%

5 Spain 9.14% 10.35% 1.21%

6 Germany 7.45% 6.71% -0.74%

9 Slovenia 4.77% 5.53% 0.76%

10 Czech Republic 4.00% 4.35% 0.35%

8 Switzerland 4.15% 3.90% -0.25%

7 Macedonia 4.23% 3.12% -1.11%

11 Norway 2.60% 2.85% 0.25%

14 Belgium 2.41% 2.82% 0.41%

16 Netherlands 1.68% 1.83% 0.15%

15 Greece 1.59% 1.80% 0.21%

13 Finland 2.19% 1.68% -0.51%

17 Croatia 1.63% 1.45% -0.18%

18 Italy 1.30% 1.41% 0.11%

20 Russia 1.17% 1.22% 0.05%

19 Sweden 0.99% 1.11% 0.12%

4 Estonia 0.94% 1.08% 0.14%

22 France 1.00% 1.08% 0.08%

23 Austria 0.85% 1.07% 0.22%

21 Latvia 0.86% 0.93% 0.07%

24 Ireland 0.71% 0.75% 0.04%

28 Poland 0.48% 0.73% 0.25%

25 Hungary 0.65% 0.64% -0.01%

35 Serbia (*) 0.00% 0.59% 0.59%

31 Denmark 0.51% 0.51% 0.00%

26 Iceland 0.47% 0.45% -0.02%

29 Bulgaria 0.16% 0.45% 0.29%

27 Ukraine 0.42% 0.36% -0.06%

30 United Kingdom 0.27% 0.35% 0.08%

32 Romania 0.29% 0.35% 0.06%

12 Belarus 0.95% 0.17% -0.78%

33 Lithuania 0.19% 0.16% -0.03%

34 Bosnia and Herzegovina (*) 0.00% 0.00% 0.00%


Europe Trends

� Many countries see a significant rise in infrastructure

� Likely to be caused by a main hosting provider, installing dual-stack Name-servers

� Russia with biggest growth in infrastructure

� Slovakia & Portugal still leading with dual-stack Web sites

� Spain catching up.

� Country with largest number of dual stack Web sites in Europe: Germany


Asia Data snapshot

2.13%

0.20%

3.47%4.16%

2.76%

0.50%

0.54%

0.64%

12.90%

11.94%

3.12%6.16%

0.00%

1.83%

0.25%

3.52%

4.22% 0.10%

1.84%

1.22%

2.21%

2.38%

7.74%

2.51%

0.90%

6.96%

0.22%

2.66%

0.22%

2.02%

3.81%

0.47% 3.84%4.32%

3.70%

0.00%

0.63%

3.12%

0.47%

0.27%

1.89%12.79%

4.57%

22.42%

22.73%26.32%

4 June 2012

December 2011

Infrastructure

- DNS or

- Web or

- E-mail or

- NTP


Low Sample

Low accuracy

SG: 25.52%SG: 24.52%

HK: 2.61%HK: 2.49%


Asia Data snapshot

1.17%

0.15%

0.91%0.97%

1.77%

0.38%

0.14%

0.65%

3.49%

11.21%

3.12%1.14%

0.00%

0.28%

0.13%

4.69%

1.24% 0.11%

3.57%

1.22%

0.38%

1.49%

1.40%

0.69%

0.40%

1.22%

0.18%

1.59%

0.08%

0.29%

4.56%

0.07% 0.98%0.89%

3.06%

0.00%

0.64%

3.12%

0.40%

0.27%

3.45%11.85%

1.55%

5.95%

50.00%50.00%

4 June 2012

December 2011


Web only

Low Sample

Low accuracy

SG: 0.65%SG: 0.90%

HK: 0.71%HK: 0.77%




1 Singapore 25.52% 24.52% -1.00%

2 Armenia (*) 12.90% 22.42% 9.52%

3 Sri Lanka (*) 11.94% 12.79% 0.85%

4 Indonesia 6.16% 7.74% 1.58%

12 Russia 2.13% 6.96% 4.83%

8 Malaysia 4.22% 4.57% 0.35%

6 New Zealand 4.16% 4.32% 0.16%

5 Australia 3.47% 3.84% 0.37%

7 Philippines (*) 3.52% 3.81% 0.29%

10 Saudi Arabia (*) 2.76% 3.70% 0.94%

9 Oman (*) 3.12% 3.12% 0.00%

11 Taiwan 2.38% 2.66% 0.28%

14 Thailand 2.21% 2.51% 0.30%

24 Hong Kong 2.61% 2.49% -0.12%

15 Japan 1.83% 2.02% 0.19%

13 Qatar (*) 1.84% 1.89% 0.05%

20 India 0.54% 0.90% 0.36%

17 United Arab Emirates (*) 0.64% 0.63% -0.01%

18 Iran 0.50% 0.47% -0.03%

22 Vietnam (*) 0.10% 0.47% 0.37%

16 Pakistan 1.22% 0.27% -0.95%

19 South Korea 0.25% 0.22% -0.03%

21 China 0.20% 0.22% 0.02%

23 Kuwait (*) 0.00% 0.00% 0.00%


Infrastructure

- DNS or

- Web or

- E-mail or

- NTP

(*) Low Sample

Low accuracy



Web only

(*) Low Sample

Low accuracy



1 Sri Lanka (*) 11.21% 11.85% 0.64%

3 Armenia (*) 3.49% 5.95% 2.46%

2 Philippines (*) 4.69% 4.56% -0.13%

4 Qatar (*) 3.57% 3.45% -0.12%

5 Oman (*) 3.12% 3.12% 0.00%

6 Saudi Arabia (*) 1.77% 3.06% 1.29%

7 Taiwan 1.49% 1.59% 0.10%

13 Malaysia 1.24% 1.55% 0.31%

9 Indonesia 1.14% 1.40% 0.26%

12 Russia 1.17% 1.22% 0.05%

10 Australia 0.91% 0.98% 0.07%

22 Singapore 0.65% 0.90% 0.25%

11 New Zealand 0.97% 0.89% -0.08%

24 Hong Kong 0.71% 0.77% 0.06%

15 Thailand 0.38% 0.69% 0.31%

14 United Arab Emirates (*) 0.65% 0.64% -0.01%

16 Iran 0.38% 0.40% 0.02%

20 India 0.14% 0.40% 0.26%

18 Japan 0.28% 0.29% 0.01%

8 Pakistan 1.22% 0.27% -0.95%

19 China 0.15% 0.18% 0.03%

17 South Korea 0.13% 0.08% -0.05%

21 Vietnam (*) 0.11% 0.07% -0.04%

23 Kuwait (*) 0.00% 0.00% 0.00%


Asia Trends

� Singapore still leading by far in infrastructure but trailing in dual-stack Web Site content

� Russia with biggest growth in infrastructure

� China results abnormally very low – content not dual stacked or IPv6 behind firewall?

� India also low both in infrastructure and most popular Web sites with dual stack

� Less reliability of results due to smaller sample size in many countries of the region


Africa Data snapshot

36.61%

9.52%

7.42%

10.20%

0.96%1.01%

9.43%

7.17%

43.01%

9.38%

4 June 2012

December 2011

Infrastructure

- DNS or

- Web or

- E-mail or

- NTP


Low Sample

Low accuracy


Africa Data snapshot

0.00%

10.00%

2.78%

14.29%

0.41%0.46%

14.29%

2.56%

0.00%

0.00%

4 June 2012

December 2011


Web only

Low Sample

Low accuracy



Infrastructure

- DNS or

- Web or

- E-mail or

- NTP

(*) Low Sample

Low accuracy

The small number of hosts tested make the results

for most of Africa appear higher than they really are

Country DNS+WEB+E-mail+NTP % change

Dec 2011 4 June 2012

Tunisia (*) 36.61% 43.01% 6.40%

Tanzania (*) 10.20% 9.43% -0.77%

Senegal (*) 9.52% 9.38% -0.14%

Kenya (*) 7.42% 7.17% -0.25%

South Africa 0.96% 1.01% 0.05%

Algeria 0.00% 0.96% 0.96%



Web only

(*) Low Sample

Low accuracy

The small number of hosts tested make the results

for most of Africa appear higher than they really are

Country WEB % change

Dec 2011 4 June 2012

Tanzania (*) 14.29% 14.29% 0.00%

Kenya (*) 2.78% 2.56% -0.22%

Algeria 0.00% 1.28% 1.28%

South Africa 0.41% 0.46% 0.05%

Senegal (*) 10.00% 0.00% -10.00%

Tunisia (*) 0.00% 0.00% 0.00%


Africa Trends

� Many countries now have IPv6

capability, some through tunnels

� Dual Stack Islands starting to appear

� Can be compared with the growth of

Internet connectivity in the nineties


Compare Historical data on

African Internet Connectivity

June 1994 May 1997

Source: Internetology - http://www.nsrc.org/codes/bymap/ntlgy/ntlgy.htm


North/South America

0.80%

5.89%1.14%

2.42%

5.81%

4 June 2012

Infrastructure

- DNS or

- Web or

- E-mail or

- NTP


Low Sample

Low accuracy

1.09%

4.35%

5.41%

0.49%

4.44%

PR: 6.67%

0.30%

3.57%

December 2011

3.30%

6.17%3.57%

PR: 7.14%

4.05%

0.00%

0.93%

3.70%

0.72%

2.32%

5.36%

0.49%

0.53%

0.57%0.56%

3.42%2.63%


North/South America

0.86%

2.66%0.58%

0.61%

0.20%


Low Sample

Low accuracy

1.45%

1.85%

2.68%

0.35%

6.38%

PR: 6.67%

Web only

0.54%

0.19%

PR: 7.14%

1.83%

1.36%

1.03%

0.29%

8.75%

0.24%2.73%2.44%

2.71%

0.31%0.95%

December 2011

4 June 2012

0.56%0.56%

0.00%


For (*) the small number of hosts tested make the results

in many countries appear higher than they really are


Infrastructure

- DNS or

- Web or

- E-mail or

- NTP

(*) Low Sample

Low accuracy



2 Puerto Rico (*) 7.24% 6.67% -0.57%

4 United States 5.81% 6.17% 0.36%

9 Brasil 2.32% 5.89% 3.57%

3 Uruguay (*) 5.41% 5.36% -0.05%

7 Ecuador (*) 3.70% 4.44% 0.74%

5 Venezuela (*) 4.05% 4.35% 0.30%

6 Cuba (*) 3.57% 3.57% 0.00%

15 Peru (*) 2.63% 3.42% 0.79%

8 Canada 2.42% 3.30% 0.88%

10 Panama (*) 0.93% 1.14% 0.21%

16 Costa Rica 0.00% 1.09% 1.09%

11 Mexico 0.53% 0.80% 0.27%

14 Colombia (*) 0.30% 0.72% 0.42%

12 Chile 0.57% 0.56% -0.01%

13 Argentina 0.49% 0.49% 0.00%

1 Guatemala (*) 100.00% 0.00% -100.00%


For (*) the small number of hosts tested make the results

in many countries appear higher than they really are


Web only

(*) Low Sample

Low accuracy



3 Ecuador (*) 6.38% 8.75% 2.37%

1 Puerto Rico (*) 7.14% 6.67% -0.47%

2 Uruguay (*) 2.68% 2.73% 0.05%

15 Peru (*) 2.44% 2.71% 0.27%

5 Brasil 1.36% 2.66% 1.30%

4 Venezuela (*) 1.85% 1.83% -0.02%

16 Costa Rica 0.00% 1.45% 1.45%

6 Mexico 0.86% 1.03% 0.17%

9 Colombia (*) 0.31% 0.95% 0.64%

8 Canada 0.54% 0.61% 0.07%

12 Panama (*) 0.29% 0.58% 0.29%

7 Chile 0.56% 0.56% 0.00%

10 Argentina 0.24% 0.35% 0.11%

11 United States 0.19% 0.20% 0.01%

13 Guatemala (*) 0.00% 0.00% 0.00%

14 Cuba (*) 0.00% 0.00% 0.00%


America Trends

� USA leads in infrastructure but low on dual Stack Web site (although the figure is 1699 hosts).

� Brazil leading in Latin America with 204 Dual Stack Web Site hosts

� Elsewhere, data based on low number of Web sites, needs to be taken in moderation (the restricted number of hosting providers can make figures jump several percentage points)


Worldwide Trends

� We are seeing a slow growth in dual stack IPv4-IPv6 implementation

� A decrease in percentage in some countries, points to unstable peering agreements (the IPv6 network is less closely meshed than the IPv4 network)

� Germany leads the world in the number of Dual Stack Web sites among world’s most popular Web sites: 14636 hosts out of a sample size of 218 178 hosts tested

� Bearing in mind the Asia Pacific Regional Internet Registry has run out of IPv4 addresses, it is alarming to see so few Web sites up and running IPv6 in that region, especially in countries where Internet growth is high, such as in India.


Problems / Possible Errors

� Lots of errors in the DNS – commas, no A, no AAAA record, looping MX, etc.

� Firewalls and security software:

� Blocking of network segments

� detecting denial of service attack (DoS) by error:

• Unusual UDP traffic. Trace-path / ping, SMTP, HTTP, Secure HTTP, NTP port testing.

� Internet snapshot from one location only

� Less accurate results with small input data size (small number of domains tested)

� Disputed accuracy of Geographical IP database


Example: fake IPv6 AAAA record

� Country specific results? /P2

� (examples from the report / finding

errors etc.)

Perform a search for ipv6 field starting with ::ffff

These “ipv6” addresses are AAAA records

which pretend to denote an IPv6 address,

but are actually IPv4 addresses.

There are plenty of examples of such mis-

configuration in the DNS.

Worse problems are caused by commas in domain

names, ie. www.domain,com as well as IP

addresses returning localhost 127.0.0.1 or ::1 etc.

Comma!


Machine readable output

Command directly to SQL database

http://www.ipv6matrix.org:4444/getTable?crawl=2010-07-18_12-24-48&tld=com&table=WWW_com

It is therefore possible to use an entirely new user interface with the back end database


Future work / funding required

� Add more domains to be tested

� Add more features to be tested

� Current front end Web Pages are only an example of possible analysis

� Develop new data visualisation

� Perform further analysis

� Perform historical/time analysis from archives

� Develop an engine to write automated reports

� Duplicate Crawler to other regions


Thank you

CTMInternational

Contact: ISOC England – [email protected]

Technology

IPv6 Matrix presentation for World IPv6 Launch, June 2012