IEEE TRANSACTIONS ON PARALLEL AND · PDF fileA Proximity-Aware Interest-Clustered P2P File Sharing System ... (PAIS) based ... ciency is through a proximity-aware structure [9],

A Proximity-Aware Interest-Clustered P2P FileSharing System

Haiying Shen, Senior Member, IEEE, Guoxin Liu, Student Member, IEEE and Lee Ward

Abstract—Efficient file query is important to the overall performance of peer-to-peer (P2P) file sharing systems. Clustering peers by

their common interests can significantly enhance the efficiency of file query. Clustering peers by their physical proximity can also

improve file query performance. However, few current works are able to cluster peers based on both peer interest and physical

proximity. Although structured P2Ps provide higher file query efficiency than unstructured P2Ps, it is difficult to realize it due to their

strictly defined topologies. In this work, we introduce a Proximity-Aware and Interest-clustered P2P file sharing System (PAIS) based

on a structured P2P, which forms physically-close nodes into a cluster and further groups physically-close and common-interest

nodes into a sub-cluster based on a hierarchical topology. PAIS uses an intelligent file replication algorithm to further enhance file

query efficiency. It creates replicas of files that are frequently requested by a group of physically close nodes in their location.

Moreover, PAIS enhances the intra-sub-cluster file searching through several approaches. First, it further classifies the interest of a

sub-cluster to a number of sub-interests, and clusters common-sub-interest nodes into a group for file sharing. Second, PAIS builds

an overlay for each group that connects lower capacity nodes to higher capacity nodes for distributed file querying while avoiding node

overload. Third, to reduce file searching delay, PAIS uses proactive file information collection so that a file requester can know if its

requested file is in its nearby nodes. Fourth, to reduce the overhead of the file information collection, PAIS uses bloom filter based file

information collection and corresponding distributed file searching. Fifth, to improve the file sharing efficiency, PAIS ranks the bloom

filter results in order. Sixth, considering that a recently visited file tends to be visited again, the bloom filter based approach is

enhanced by only checking the newly added bloom filter information to reduce file searching delay. Trace-driven experimental results

from the real-world PlanetLab testbed demonstrate that PAIS dramatically reduces overhead and enhances the efficiency of file

sharing with and without churn. Further, the experimental results show the high effectiveness of the intra-sub-cluster file searching

approaches in improving file searching efficiency.

Index Terms—P2P networks, file sharing system, proximity awareness, file replication, Bloom filter

Ç

1 INTRODUCTION

OVER the past few years, the immense popularity of theInternet has produced a significant stimulus to P2P

file sharing systems. For example, BitTorrent [1] consti-tutes roughly 35 percent of all traffic on the Internet. Thereare two classes of P2P systems: unstructured and struc-tured. Unstructured P2P networks such as Gnutella [2] andFreenet [3] do not assign responsibility for data to specificnodes. Nodes join and leave the network according tosome loose rules. Currently, unstructured P2P networks’file query method is based on either flooding [2] where thequery is propagated to all the node’s neighbors, or ran-dom-walkers where the query is forwarded to randomlychosen neighbors until the file is found. However, floodingand random walkers cannot guarantee data location. Struc-tured P2P networks [4], [5], [6], [7], i.e., Distributed HashTables (DHTs), can overcome the drawbacks with their fea-tures of higher efficiency, scalability, and deterministicdata location. They have strictly controlled topologies, and

their data placement and lookup algorithms are preciselydefined based on a DHT data structure and consistenthashing function. The node responsible for a key canalways be found even if the system is in a continuous stateof change. Most of the DHTs require Oðlog nÞ hops perlookup request with Oðlog nÞ neighbors per node, where nis the number of nodes in the system.

A key criterion to judge a P2P file sharing system is itsfile location efficiency. To improve this efficiency, numerousmethods have been proposed. One method uses a super-peer topology [8], [9], [10], which consists of supernodeswith fast connections and regular nodes with slower con-nections. A supernode connects with other supernodes andsome regular nodes, and a regular node connects with asupernode. In this super-peer topology, the nodes at thecenter of the network are faster and therefore produce amore reliable and stable backbone. This allows more mes-sages to be routed than a slower backbone and, therefore,allows greater scalability. Super-peer networks occupy themiddle-ground between centralized and entirely symmetricP2P networks, and have the potential to combine the bene-fits of both centralized and distributed searches.

Another class of methods to improve file location effi-ciency is through a proximity-aware structure [9], [11], [12].A logical proximity abstraction derived from a P2P systemdoes not necessarily match the physical proximity informa-tion in reality. The shortest path according to the routingprotocol (i.e., the least hop count routing) is not necessarily

� H. Shen and G. Liu are with the Department of Electrical and ComputerEngineering, Clemson University, Clemson, SC 29634.E-mail: {shenh, guoxinl}@clemson.edu.

� L. Ward is with the Sandia National Laboratories. E-mail: [email protected]

Manuscript received 19 Mar. 2014; revised 11 May 2014; accepted 22 May2014. Date of publication 29 May 2014; date of current version 8 May 2015.Recommended for acceptance by H. Jin.For information on obtaining reprints of this article, please send e-mail to:[email protected], and reference the Digital Object Identifier below.Digital Object Identifier no. 10.1109/TPDS.2014.2327033

IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, VOL. 26, NO. 6, JUNE 2015 1509

1045-9219� 2014 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission.See http://www.ieee.org/publications_standards/publications/rights/index.html for more information.

the shortest physical path. This mismatch becomes a bigobstacle for the deployment and performance optimizationof P2P file sharing systems. A P2P system should utilizeproximity information to reduce file query overhead andimprove its efficiency. In other words, allocating or replicat-ing a file to a node that is physically closer to a requestercan significantly help the requester to retrieve the file effi-ciently. Proximity-aware clustering can be used to groupphysically close peers to effectively improve efficiency. Thethird class of methods to improve file location efficiency isto cluster nodes with similar interests [13], [14], [15], [16],[17], [18], [19], which reduce the file location latency.

Although numerous proximity-based and interest-basedsuper-peer topologies have been proposed with differentfeatures, few methods are able to cluster peers according toboth proximity and interest. In addition, most of thesemethods are on unstructured P2P systems that have nostrict policy for topology construction. They cannot bedirectly applied to general DHTs in spite of their higher filelocation efficiency.

This paper presents a proximity-aware and interest-clus-tered P2P file sharing System (PAIS) on a structured P2Psystem. It forms physically-close nodes into a cluster andfurther groups physically-close and common-interest nodesinto a sub-cluster. It also places files with the same intereststogether and make them accessible through the DHTLookup() routing function. More importantly, it keeps alladvantages of DHTs over unstructured P2Ps. Relying onDHT lookup policy rather than broadcasting, the PAIS con-struction consumes much less cost in mapping nodes toclusters and mapping clusters to interest sub-clusters. PAISuses an intelligent file replication algorithm to furtherenhance file lookup efficiency. It creates replicas of files thatare frequently requested by a group of physically closenodes in their location. Moreover, PAIS enhances the intra-sub-cluster file searching through several approaches. First,it further classifies the interest of a sub-cluster to a numberof sub-interests, and clusters common-sub-interest nodesinto a group for file sharing. Second, PAIS builds an overlayfor each group that connects lower capacity nodes to highercapacity nodes for distributed file querying while avoidingnode overload. Third, to reduce file searching delay, PAISuses proactive file information collection so that a filerequester can know if its requested file is in its nearbynodes. Fourth, to reduce the overhead of the file informationcollection, PAIS uses bloom filter based file information col-lection and corresponding distributed file searching. Fifth,to improve the file sharing efficiency, PAIS ranks the bloomfilter results in order. Sixth, considering that a recently vis-ited file tends to be visited again, the bloom filter basedapproach is enhanced by only checking the newly addedbloom filter information to reduce file searching delay.

Note that although this work is for P2P file sharing sys-tems, the techniques proposed in this paper can benefitmany current applications such as content delivery net-works, P2P video-on-demand systems, and data sharingin online social networks. Since the architecture of PAIS isbased on a structured P2P system, its architecture cannotbe used for unstructured P2P systems. However, PAIS’stechniques for enhance efficiency of the intra-sub-clusterfile searching can be used for unstructured P2P systems

since nodes in a intra-sub-cluster are connected in anunstructured manner. The remainder of this paper isstructured as follows. Section 2 presents a concise reviewof representative approaches for file location efficiencyimprovement in P2P systems. Section 3 describes PAIS,focusing on its structure construction and file searchingalgorithms. Section 4 describes the approaches thatimprove PAIS’s intra-sub-cluster file searching. Section 5presents trace-driven experimental results to showthe effectiveness and efficiency of PAIS compared withother systems in both static and dynamic environments.Section 6 provides the conclusion for this paper.

2 RELATED WORK

We discuss the related works most relevant to PAIS in threegroups: super-peer topology, proximity-awareness, andinterest-based file sharing.

Super-peer topology. FastTrack [10] and Morpheus [20] usesuper-peer topology. The super-peer network in [8] is forefficient and scalable file consistency maintenance in struc-tured P2P systems. Our previous work built a super-peernetwork for load balancing [9]. Garbacki et al. [21] proposeda self-organizing super-peer network architecture that sol-ves four issues in a fully decentralized manner: how clientpeers are related to super-peers, how super-peers locatefiles, how the load is balanced among the super-peers, andhow the system deals with node failures. Mitra et al. [22]developed an analytical framework, which explains theemergence of super-peer networks on execution of the com-mercial P2P bootstrapping protocols by incoming nodes.Chordella [23] is a P2P system that is particularly designedfor heterogeneous environments such as wireless networks.Sachez-Artigaz et al. [24] investigated the feasibility ofsuper-peer ratio maintenance, in which each peer candecide to be a super-peer independently of each other. Liuet al. [25] proposed a hierarchical secure load balancingscheme in a P2P cloud system. It first balances the loadamong supernodes, and then depends on each supernodeto balance the load among nodes under its management.Garbacki et al. [26] proposed a self-organizing supernodearchitecture to facilitate file querying. Each supernodecaches the files recently requested by its children, and otherpeers send requests to the supernodes that can solve mostof their requests.

Proximity-awareness. Techniques to exploit topologyinformation in P2P overlay routing include geographic lay-out, proximity routing, and proximity-neighbor selection.Geographic layout method maps the overlay’s logical ID spaceto the physical network so that neighboring nodes in the IDspace are also close in the physical network. It is employedin topologically-aware CAN [11]. In the proximity routingmethod, the logical overlay is constructed without consider-ing the underlying physical topology. In a routing, the nodewith the closest physical distance to the object key is chosenamong the next hop candidates in the routing table. Theentries of a routing table are selected based on a proximitymetric among all the nodes that satisfy the constraint of thelogical overlay (e.g., in Pastry [5], the constraint is the nodeID prefix). This method has been adopted to Chord [4] andCAN [27]. Proximity neighbor selection selects the routing

1510 IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, VOL. 26, NO. 6, JUNE 2015

table entries pointing to the topologically nearest among allnodes with node ID in the desired portion of the ID space.

Genaud and Rattanapoka [28] proposed a P2P-basedmiddleware for locality-aware resource discovery. Theworks in [29] and [30] measured the inter-ISP traffic inBitTorrent and indicated the importance of locality-aware-ness traffic in reducing the traffic over long-distance connec-tions. Liu et al. [31] examined traffic locality in PPLive andrevealed that PPLive achieves high ISP level traffic locality.Shen and Hwang [32] proposed a locality-aware architec-ture with resource clustering and discovery algorithms forefficient and robust resource location in wide-area distrib-uted grid systems. Lehrieder et al. [33] studied locality-awareness in scenarios with real-life, skewed peer distribu-tions and heterogeneous access bandwidths of peers. Yangand Yang [34] combined the structured and unstructuredoverlays with proximity-awareness for P2P networks toensure the availability of searching results. Gross et al. [35]proposed a BitTorrent-like downloading scheme with local-ity-aware file searching and replication in order to supply arobust and fast downloading. Manzillo et al. [36] proposedthe collaborative locality-aware overlay service, whichreduces the transmit cost of ISPs by switching to the sourceinside the same ISP with the requester.

Interest-base file sharing. One category of interest-base filesharing networks is called schema based networks [16],[17], [18]. They use explicit schemas to describe peers’ con-tents based on semantic description and allow the aggrega-tion and integration of data from distributed data sources.Hang and Sia [14] proposed a method for clustering peersthat share similar properties together and a new intelligentquery routing strategy. Crespo and Garcia-Molina [15] pro-posed a semantic overlay network (SON) based on thesemantic relations among peers. Ruffo and Schifanella [37]studied the spontaneous communities of users in P2P filesharing applications and found that a family of structuresshow self-organized interest-based clusters. The works in[13], [38] consider node interest for publish and subscribe.Iamnitchi et al. [39] found the small world pattern in theinterest-sharing community graphs, and suggested cluster-ing common-interest nodes to improve file searching effi-ciency. Some works leverage the social network common-interest property for efficient file searching. Cheng and Liu[40] proposed NetTube for P2P short video sharing. It clus-ters users with the same interests together for efficient peerassisted video delivering. Li and Shen [41] proposed a P2Pfile sharing system based on social networks, in which com-mon-multi-interest nodes are grouped into a cluster and areconnected based on social relationship. Lin et al. [42] pro-posed a social based P2P assisted video sharing systemthrough friends and acquaintances. Li et al. [43] groupedusers by interests for efficient file querying and used the rel-evant judgment of a file to a query to facilitate subsequentsame queries.

Liu et al. [44], [45] proposed online storage systems withpeer assistance. The works in [46], [47] employ the Bloomfilter technique for file searching. Despite the effortsdevoted to efficient file location in P2P systems, there arefew works that combine the super-peer topology with bothinterest and proximity based clustering methods. In addi-tion, it is difficult to realize in DHTs due to their strictly

defined topology and data allocation policy. This paperdescribes how PAIS tackles the challenge by taking advan-tage of the hierarchical structure of a DHT.

3 PAIS: A PROXIMITY-AWARE

INTEREST-CLUSTERED P2P FILE SHARING

SYSTEM

In our previous work [48], we studied a BitTorrent useractivity trace [49] to analyze the user file sharing behaviors.We found that long distance file retrieval does exist. Thus,we can cluster physically close nodes into a cluster toenhance file sharing efficiency. Also, peers tend to visit filesin a few interests. Thus, we can further cluster nodes thatshare an interest into a sub-cluster. Finally, popular files ineach interest are shared among peers that are globally dis-tributed. Thus, we can use file replication between locationsfor popular files, and use system-wide file searching forunpopular files. We introduce the detailed design of PAISbelow. It is suitable for a file sharing system where files canbe classified to a number of interests and each interest canbe classified to a number of sub-interests.

3.1 PAIS Structure

PAIS is developed based on the Cycloid structured P2P net-work [7]. Cycloid is a lookup efficient, constant-degree over-lay with n ¼ d � 2d nodes, where d is its dimension. Itachieves a time complexity of OðdÞ per lookup request byusing Oð1Þ neighbors per node. Each Cycloid node is repre-sented by a pair of indices ðk; ad�1ad�2 . . . a0Þ where k is acyclic index and ad�1ad�2......a0 is a cubical index. The cyclicindex is an integer ranging from 0 to d� 1, and the cubicalindex is a binary number between 0 and 2d � 1. The nodeswith the same cubical index are ordered by their cyclicindex mod d on a small cycle, which we call a cluster. Allclusters are ordered by their cubical index mod 2d on a largecycle. The Cycloid DHT assigns keys onto its ID space by aconsistent hashing function. For a given key, the cyclicindex of its mapped node is set to its hash value modulatedby d and the cubical index is set to the hash value dividedby d. A key will be assigned to a node whose ID is closest tothe key’s ID. Cycloid also has self-organization mechanismsto deal with node joins, departures, and failures. It hasAPIs, including Insert(key,object), Lookup(key),Join() and Leave(). Cycloid’s routing algorithminvolves three phases. A file request is routed along thecluster of the requester, between clusters, and along thecluster in the destination’s cluster.

A node’s interests are described by a set of attributeswith a globally known string description such as “image”and “music”. The strategies that allow the description of thecontent in a peer with metadata [16], [17], [18] can be usedto derive the interests of each peer.

Taking advantage of the hierarchical structure ofCycloid, PAIS gathers physically close nodes in one clusterand further groups nodes in each cluster into sub-clustersbased on their interests. We define a sub-cluster (SC) as alink structure within a network N given a set of links fromclient (c) to a particular supernode server (s). That is:

ðSCl ¼ ci; sj 2 N j 9 a linkðci; sj; lÞÞ:

ET AL.: A PROXIMITY-AWARE INTEREST-CLUSTERED P2P FILE SHARING SYSTEM 1511

Each SCl supports functions: join(ci; l) that links (ci; sj; l)are created between a server and a client and leave(ci; l)where they are dropped.

The sub-cluster functions as a super-peer network thathas one server and a number of clients connected to it. Theservers are connected into a cluster in Cycloid. All nodes ina sub-cluster have the same Cycloid ID. Fig. 1 illustrates thePAIS structure that shows clusters of nodes with commoninterests. Physically close nodes are in the same cluster, andcommon-interest nodes are grouped into one sub-cluster.The physically close nodes 1-6 are mapped to cluster 200.The nodes interested in “book” are further grouped intosub-cluster a. All nodes in sub-cluster a have ID ð3; 200Þ.

3.2 PAIS Construction and Maintenance

Node proximity representation. A landmarking method can beused to represent node closeness on the network by indicesused in [9]. Landmark clustering has been widely adoptedto generate proximity information [11], [50]. It is based onthe intuition that nodes close to each other are likely to havesimilar distances to a few selected landmark nodes. Weassume there arem landmark nodes that are randomly scat-tered in the Internet. Each node measures its physical dis-tances to the m landmarks and uses the vector of distances<d1; d2; . . . ; dm> as its coordinate in Cartesian space. Twophysically close nodes will have similar vectors. We usespace-filling curves [51], such as the Hilbert curve [50], tomap the m-dimensional landmark vectors to real numbers,so the closeness relationship among the nodes is preserved.We call this number the Hilbert number of the node denotedby H. The closeness of two nodes’ Hs indicates their physi-cal closeness on the Internet.

Node interest representation. Consistent hash functionssuch as SHA-1 is widely used in DHT networks for node orfile ID due to its collision-resistant nature. When using sucha hash function, it is computationally infeasible to find twodifferent messages that produce the same message digest.The consistent hash function is effective to cluster messagesbased on message difference.

Clustering physically close and common-interest nodes. Basedon the Cycloid topology and ID determination, PAIS intelli-gently uses cubical indices to distinguish nodes in differentphysical locations and uses cyclic indices to further classifyphysically close nodes based on their interests. Specifically,PAIS uses node i’s Hilbert number, Hi, as its cubical index,and the consistent hash value of node i’s interest mod d(Si%d) as its cyclic index to generate node i’s ID denoted byðSi%d;HiÞ. If a node has a number of interests, it generatesa set of IDs with different cyclic indices. Using this ID

determination method, the physically close nodes with thesame H will be in a cluster, and nodes with similar H willbe in close clusters in PAIS. Physically close nodes with thesame interest have the same ID, and they further constitutea sub-cluster in a cluster.

PAIS construction and maintenance. When node i joins thesystem, if there already exist nodes with IDs equal toðSi%d;HiÞ, and node i is a regular node, it becomes a clientin the sub-cluster. If node i is a supernode, it becomes abackup for the server in the sub-cluster. Before the serverleaves, one of the backups replaces the leaving server. Ifthere is no node with IDs equal to ðSi%d;HiÞ and node i is asupernode, it becomes the server of the sub-cluster, andother newly-joined nodes with IDs ðSi%d;HiÞ will connectto it. If node i is not a supernode, it temporarily functions asthe server until there is a joining supernode to replace it.

The clusters in PAIS function as a super-peer network.The server in a sub-cluster acts as a centralized server to asubset of clients by maintaining an index of files in the cli-ents. Clients submit queries to their server and receive filelocation results from it like a hybrid system. Servers are alsoconnected to each other as peers in a Cycloid. Servers routemessages over this overlay and submit and answer querieson behalf of their clients and themselves.

To build each peer’s routing table in the Cycloid, PAISuses proximity-neighbor selection method. That is, it selectsthe routing table entries pointing to the nearest physicalnodes among all nodes with IDs in the desired portion ofthe ID space. As a result, in PAIS, the logical proximitybetween neighbor abstractions derived from the overlayapproximately matches the physical proximity information.Due to the uneven distribution of nodes in physical space,nodes may not be distributed with balance in the ID spaceof PAIS. The imbalance of node distribution will not gener-ate adverse effects on file location efficiency in Cycloid [7].Hence, it will not adversely affect the file location efficiencyin PAIS. Algorithms 1 and 2 show the pseudocode for nodejoin and departure in PAIS, respectively.

Algorithm 1. Pseudo-Code for Node n Joining in PAISContaining Node _n.

n.join ( _n){

1: generate IDs: ID1¼ðS1;HnÞ, ... , IDm¼ðSm;HnÞ2: for i ¼ 0 tom do

3: //find the server closest to the IDi

4: si ¼ _n.lookup server(IDi);

5: if n is a regular node then

6: //take si as its server7: serverIDi

¼ si;8: serverIDi

.join(n, l);

9: else

10: //n is a supernode11: if si is a supernode then

12: si.addto backuplist(n);

13: else

14: //replace si because it is a temporary supdernode15: n.clientlistIDi

=si.clientlistIDi;

16: n.backpulistIDi=si.backuplistIDi

;

17: si.remove clientlist(IDi);

Fig. 1. The structure of PAIS.


18: n.join(si, l);

19: initialize routing table;

20: end if

21: end if

22: end for

23: g

Algorithm 2. Pseudo-Code for Node n Leaving PAIS.

n.leave {

1: //assume node n hasm interests2: for i ¼ 0 tom do

3: if it is the server in the sub-cluster of interest i then

4: if it has a supernode(s) in its backup list then

5: find supernode from its backuplist to replace itself6: notify its clients about the server change

7: else

8: notify its clients to rejoin in the system

9: end if

10: execute leaving function in the Cycloid DHT

11: else

12: notify its server about its departure

13: end if

14: end for

15: g

As normal structured P2P systems, PAIS uses stabiliza-tion to deal with node dynamism. Specifically, each serverprobes its routing table entries and predecessor periodicallyto make sure they are correct. If one of its neighbors fails torespond during a certain time period T , the server finds andconnects to a new neighbor. In a sub-cluster, a server selectsa secondary server from its backups that will replace itupon its departure or failure. It also notifies all clients aboutthe secondary server. Before a server leaves, it requests thesecondary server to be the new server and notifies all cli-ents. The clients then connect to the new server. To handlethe influence of a server failure on its clients, PAIS useslazy-update. Specifically, each client probes its server peri-odically. If a client c does not receive a reply from its servers during T , c assumes that s fails, and connects to the sec-ondary server. To further improve the reliability, multiplesecondary servers can be used.

Performance analysis. Unlike other methods that usebroadcasting to cluster nodes, PAIS leverages the DHT IDdetermination to cluster nodes based on their proximityand interest, thus reducing the overhead for structure con-struction. With the assumption that there are ns servers inPAIS, we analyze the overhead of node dynamism in PAISand achieve the following results.

Proposition 3.1. In PAIS, with high probability,1 a node join willincur overhead of Oðlog2 nsÞ messages.

Proof. When a node joins in PAIS, to find its closest serverfor one of its interests, Oðlog nsÞmessages are required. Ifthe new node joins as a server, another Oðlog2 nsÞ

messages are required for neighbor update. Thus, if thenode has m interests, the number of messages needed ismðOðlog nsÞ þ aOðlog2 nsÞÞ � Oðlog2 nsÞ in which a is theprobability that the new node joins as a server. tu

Proposition 3.2. In PAIS, w.h.p., a node departure will incur anoverhead of Oðlog2 nsÞ messages, and a node failure will incuran overhead of Oðlog NsÞ messages.

Proof. According to the PAIS node leaving algorithm, aleaving client only needs Oð1Þ message (i.e., notifying itsserver). If a leaving server has a backup supernode, itneeds Oðlog2 nsÞ messages; otherwise, its clients need torejoin the system again. Each client joining requiresOðlog nsÞ messages. Therefore, the average number ofmessages caused by a node leaving is Oð1Þ � b þ ð1�bÞðð1� gÞOðlog2 nsÞ þ g �Oðlog NsÞÞ � Oðlog2 nsÞ whereb is the percent of clients among all nodes, and g is theprobability that a sever has no backup supernode. It iseasy to derive that a node failure incurs an overhead ofOðlog nsÞmessages. tu

3.3 File Distribution

As physically close and common-interest nodes form a sub-cluster, they can share files between each other so that anode can retrieve its requested file in its interest from aphysically close node. For this purpose, the sub-clusterserver maintains the index of all files in its sub-cluster forfile sharing among nodes in its sub-cluster. A node’srequested file may not exist in its sub-cluster. To help nodesfind files not existing in their sub-clusters, as in traditionalDHT networks, PAIS re-distributes all files among nodes inthe network for efficient global search.

In PAIS, file ID is determined using the same way inCycloid. That is, a file’s cyclic index is its key’s hash valuemodulated by d and its cubical index is set to the hashvalue divided by d, represented as ðH%d;H=dÞ, where His consistent hash value of its key. A file’s key can be itsname or a string describing its contents. The file key mustbe consistent with the node interest. A node stores its filesto the system via Cycloid interface Insert(fileID,

file). According to Cycloid key assignment policy, eachsub-cluster is responsible for the files whose cyclic indicesfall into the key space sector it supervises. Thus, files withsimilar keys will be in the same sub-cluster in a cluster.The supernode in a sub-cluster further distributes filesamong its clients in balance. For example, in Fig. 1, a filewith key “book” has ID ð3; 200Þ, then it will be stored in anode in sub-cluster a. In node joins and departures, thefiles are transferred between nodes based on the keyassignment policy.

When a node joins in the system, it needs to distributeits files according to the file distribution protocol. Thesefiles can be accessed by the Cycloid routing algorithmthrough Lookup(fileID). A newly joined node alsoneeds to report its files corresponding to each of its inter-ests to the server of each interest sub-cluster in order toenable other common-interest nodes to easily retrievetheir requested files from physically close nodes. If anode leaves gracefully, it notifies other nodes to delete itsfiles by Lookup(fileID), and notifies its servers to delete

1. An event happens with high probability (w.h.p.) when it occurswith probability 1�Oðn�1s Þ.


the index of its files. If a server notices that a client failed,it removes the file index of the failed client.

In PAIS, if node i becomes very interested in file f in itscluster, it joins the sub-cluster ðHf%d;HiÞ. If node i is notinterested in a file category any longer, it departs the sub-cluster of the interest. By this way, PAIS tunes to time-vary-ing node interest and file popularity dynamically.

File replication. PAIS relies on file replication to furtherimprove its file location efficiency. Basically, when therequest frequency of a file from a cluster of nodes with Hexceeds a predefined threshold t, the file owner replicates afile in a node closest to ðH%d;HÞ in that cluster. Creating areplica for a group of nodes with high accumulated visitrate on the file, so the file querying of the nodes can be sig-nificantly expedited; meanwhile, the nodes can take advan-tage of the file replicas.

3.4 File Querying Algorithm

The file querying algorithm has several stages: intra-clustersearching (consisting of intra-sub-cluster searching andinter-sub-cluster searching) and inter-cluster searching (i.e.,DHT routing). If the intra-sub-cluster searching fails, PAISrelies on inter-sub-cluster searching. If the inter-sub-clustersearching fails, it will depend on DHT routing for filesearching.

When node iwants to retrieve a file, if the file’s key is oneof the requester’s interest attributes, it uses the intra-sub-cluster searching. Node i sends the request to its server inthe sub-cluster of the interest. Recall that the server main-tains the index of all files in its sub-cluster. Every time aserver receives a request, it checks if its sub-cluster has therequested file. If yes, the server sends the file location to therequester directly. If the file’s key is not one of the reques-ter’s interest attributes, node i checks the existence of thefile or a replica of the file in its cluster (i.e., inter-sub-clustersearching). If there is a replica of the file, It should be storedin a sub-cluster closest to ID ðH%d;HiÞ. Therefore, therequester sends a request with ðH%d;HiÞ as a target. Therequest is forwarded along the servers in each sub-cluster inthe requester’s cluster. If there is no requested file or replicaof the requested file, the file request routing is performedbased on Cycloid routing algorithm (i.e., inter-clustersearching). Then, node i calculates the ID of the fileðH%d;H=dÞ and sends out a message of Lookup(fileID).This routing algorithm does not lead to more overhead.Routing among physically close nodes greatly improves filelocation efficiency.

For example, in Fig. 1, different files are classified intodifferent sub-clusters based on their keys. When a nodequeries for a file in “book”, it sends request Lookup

(3,200) to its server. The requester receives the location ofthe file from the server if there is a requested file in its sub-cluster. Otherwise, the request is routed along its own clus-ter. Each server in the sub-cluster of the cluster checks ifthere is a requested file. If there is no requested file in thecluster, the request will be routed based on Cycloid routingalgorithm which will forward the request to sub-cluster a.Then, the server of the sub-cluster a replies to the requesterof the location of the file. Algorithm 3 shows the pseudo-code of file lookup in PAIS. Proposition 3.3 demonstratesthe efficiency of the file location in PAIS.

Algorithm 3. Pseudo-Code for Looking Up File f inPAIS.

n.lookup (key){

1: get file f’s key;

2: get file f’s ID ðH%d;H=dÞ;3: if key 2 interests then

4: send request to its server of sub-clusterH%d;

5: if receive positive response from the server then

6: exit;7: end if

8: LookupðH%d;HnÞ;9: if receive negative response then

10: //use Cycloid routing algorithm11: LookupðH%d;H=dÞ;12: end if

13: end if

14: g

Proposition 3.3.W.h.p., the lookup path length for a file query inPAIS is bounded by OðdÞ hops.

Proof. In PAIS, it takes a requester one hop to inquire itsserver for a requested file, and takes OðdÞ to check a pos-sible replicated file. Using the Cycloid routing algorithm,the path length is OðdÞ; therefore, w.h.p., the lookup pathlength for a query is bounded by OðdÞ hops. tu

4 INTRA-SUB-CLUSTER QUERYING ENHANCEMENT

4.1 Sub-Interest Based File Querying

The cyclic index k indicates the interest of the nodesinside a sub-cluster. Since k is bounded by d, d must beno smaller than the number of interests in the system.With fine-grained interest classification, d must be a verylarge number. For example, d must be no smaller than 366for the BitTorrent application with 366 fine-grained fileinterests [49]. However, a large d leads to increasedlookup path length and hence lower efficiency in file que-rying based on Proposition 3.3. If PAIS has a small d, itthen has coarse-grained interest classification, which leadsto fewer sub-clusters in a cluster and much more peersinside a sub-cluster. This will introduce a long queuingdelay and even single point of failure due to supernodecongestions, since nodes depend on the supernode forintra-cluster searching. Thus, a small d decreases theintra-cluster searching efficiency. As a result, d representsa trade-off between the inter-cluster and intra-clustersearching efficiency.

To achieve high efficiency in both inter-cluster and intra-cluster searching, PAIS chooses a relative small d withcoarse-grained interest classification and uses an additionalmethod to improve the intra-cluster searching. A small dimproves the inter-cluster file searching efficiency. Becausea coarse-grained interest can be further be classified to anumber of fine-grained interests, PAIS further clustersnodes inside a sub-cluster into sub-interest groups. Forexample, interest “‘Music” can be further classified intosub-interests “Classic”, “Jazz”, “Pop” and so on. Using thesupernode selection methods, a supernode is selected to be


responsible for responding file queries inside each sub-interest group. The sub-interest supernode maintains anindex of files residing in the nodes in the sub-interest groupfor file querying. The sub-cluster supernode records eachsub-interest and its responsible supernode. As shown inFig. 2, inside a sub-cluster, nodes form a two layer tree.Nodes in a sub-interest group connect to the sub-interestsupernode, and sub-interest supdernodes connect to thesub-cluster supernode. When a node in a sub-interest groupA queries for a file in another sub-interest group B, groupA’s supernode will forward the request to the sub-clustersupernode (i.e., tree root), which then will forward therequest to group B’s sub-interest supernode. Then, groupB’s sub-interest supernode forwards the request to the nodein its group that has the requested file if it exists. By splittingthe workload on a single supernode among several supern-odes of sub-interests, the queuing delay and the congestionon the sub-cluster supernode can be reduced. As a result,PAIS improves the intra-cluster searching efficiency as wellas inter-cluster searching efficiency.

4.2 Distributed Intra-Sub-Cluster File Querying

There may be still tens of thousands of nodes inside a sub-interest group that have the same sub-interest and are in thesame location [48]. Then, the file querying may become inef-ficient due to the sub-interest supernode overload or failure.Thus, though the sub-interest based file querying improvesquerying efficiency, it is still not sufficiently scalable whenthere are a very large number of nodes in a sub-interestgroup. We then propose a distributed intra-sub-cluster filequerying method in order to further improve the file query-ing efficiency. In this method, nodes inside a large sub-inter-est group first search files among their neighbors in adistributed manner; if the search fails, the file requester thenforwards its request to the sub-interest supernode as a com-plementary method. Below, we present how to connect thenodes in a sub-interest group for distributed file querying.

Nodes in a P2P system have heterogeneous bandwidthcapacities. If a node receives many file requests but it hasvery limited bandwidth capacity, there will be a delay inthe request responses. Requesting a file from a node withhigh bandwidth capacity can reduce file querying delay.Thus, PAIS classifies nodes in a sub-interest group to differ-ent classes based on the bandwidth capacity; nodes in thesame class have similar bandwidth capacity. Let us use fC1,C2 . . . g to represent the classes in descending order of band-width capacity; nodes in class Cm have higher capacity thanthose in class Cmþ1. Then, a node in class Cmþ1 connects tonodes in class Cm, that is, lower capacity nodes connect tohigher capacity nodes.

PAIS needs to handle the node dynamism in buildingan overlay for a sub-interest group. When a node belong-ing to class Cmþ1 joins in a sub-interest group, the sub-interest supernode randomly selects M nodes in class Cm.The random selection is to balance the searching loadfrom children among parent nodes. When a node in C1

joins in the system, the supernode randomly selects Mother nodes in C1 to be its neighbors. When a non-leafnode leaves, it needs to notify its neighbors and the sub-interest supernode. The sub-interest supernode willassign the children new neighbors.

In the file searching, nodes send their requests to theirparents with TTL (or neighbors in C1), which further for-ward the request to their parents (or neighbors in C1).Nodes asking their parents for files means higher capacitynodes providing files to lower capacity nodes. If a node hasa higher capacity, it has more directly and indirectly con-nected children in the overlay; that is, it is likely to receivemore requests. As a result, the file responding load is dis-tributed among nodes based on their capacity; higher capac-ity nodes received more requests. If a node cannot find itsrequested file, it then broadcasts its requests to its children,which further forward the requests to their children. Thisprocess repeats until the file is located or the search fails.This step helps find a file, which is not in a higher capacitynode but in a lower capacity node. If the search fails, thenode resorts to the sub-interest supernode for the file.

4.3 Proactive File Information Collection Based FileQuerying

In the distributed file searching in a sub-interest overlay, if anode proactively collects the information of files in itsneighborhood, it can find file holders quickly from the col-lected information if they exist in the neighborhood. Then,the file search delay can be reduced and file search successrate can be enhanced. A simple method for a node to repre-sent its file information is to use the names of all files heldby it. In the file information collection process, each nodesends its file information to its neighbors. To limit the fileinformation collection overhead, each node’s file informa-tion is forwarded for only TTL hops. It means that a nodecan know the file information of nodes within TTL hops.Thus, after a node collects all file information from its neigh-bors within TTL hops, it can check whether its requestedfiles exists within its TTL hops and which nodes have thisfile. Then, in the file querying, after a node initiates arequest, it checks its file information to find file holders; if itdoes not have the information of the queried file, it resortsto the supernode. As the file information directly containsfile names and file holders, we refer to this file queryingmethod as FileName.

4.4 Bloom Filter Based File Querying

In the FileName method, the information exchange betweenneighbors may introduce a high network overhead. Also,the total size of the exchanged messages increases exponen-tially as TTL increases. To constrain the overhead in the fileinformation collection, we further propose a method calledBloomFilter that uses the counting bloom filter technique[52] to compress the exchanged messages. As shown in

Fig. 2. Sub-interest based node clustering in a sub-cluster.


Fig. 3, a counting bloom filter is represented by an arraywith each array position denoting an index. The bloom filtermethod has a number of hash functions. To feed a file to abloom filter, the file’s key is hashed by these hash functions.Then, the courter in the array position corresponding toeach hash value is increased by one. The value in the ktharray position of the bloom filter represents the number offiles that have HjðFiÞ ¼ kðj ¼ 1; 2; . . .Þ, where HjðÞ repre-sents the jth hash function and Fi represents a file fed intothe bloom filter. For example, the counting bloom filter inFig. 3 has four hash functions. After hashing by the fourhash functions, file i gains hash values 1, 3, 6 and 8, and filej gains hash values 5, 6, 11 and 12. Thus, the counters in thecorresponding array positions are incremented by one. Anewly added or deleted file needs to be added into ordeleted from the bloom filter with its key information. Weuse v to represent the bloom filter array (e.g., Fig. 3). We usecHjðFiÞ to denote the counter value for hash value HjðFiÞ inv. To decide whether a file Fi is in a bloom filter, the hashvalues HjðFiÞðj ¼ 1; 2; . . . ; KÞ are calculated. If fcHjðFiÞ > 0;81 � j � Kg, the file is considered to be in the bloom filterwith probability �. The expected false positive rate is� ¼ 2�

mn �ln2, where m is the size of the bloom filter array, and

n is the number of files that have fed into the bloom filter.We call this bloom filter is a matched bloom filter of file Fi.

The file information of bloom filters, denoted by six-tuplerepresentation f ¼<v;mf ; p; u;N; ni> , needs to be periodi-cally exchanged among neighbors. mf denotes the numberof files that have been fed into the bloom filter, p denotesthe number of forwarding hops of the bloom filter, udenotes the average upload bandwidth of all nodes holdingthese fed files, N denotes the number of these nodes and ni

denotes the neighbor that forwards f . When node ni ini-tiates the bloom filter information of its own files, it needs tocalculate the bloom filter of all files held by itself as v, mf

which equals the number of files held by itself, and u whichequals its own upload bandwidth. Then, it sends informa-tion f ¼<v;mf; 1; u; 1; ni> to all its neighbors. In order tofurther reduce the network load of collecting file informa-tion, after a node receives the bloom filters from all itsneighbors, it combines those with the same p and sends thecombined bloom filter with p pþ 1 to its neighbors. Thenode excludes the bloom filter from ni from the combinedbloom filter before sending it to ni. Each node’s initiatedbloom filter has a TTL forwarding hop limit; that is, a nodedoes not further forward bloom filters with p ¼ TTL. WhennA receives the bloom filters from its neighbors nB and nC :fB ¼<vB;mðf;BÞ; pB; uB;NB; nB> and fC ¼ <vC;mðf;CÞ;pC; uC;NC; nC> (pB ¼ pC), it combines them and the combi-nation result is fBþC ¼ <vB þ vC;mðf;BÞ þmðf;CÞ; pB þ1; ðuB�NBþuC�NC Þ

NBþNC;NB þNC; nA > . The operation of vB þ vC

adds the two counters of each array position to create a newbloom filter. For example, vB ¼ <7; 4; . . . ; 5> , andvC ¼<2; 4; . . . ; 1> , then vB þ vC ¼<9; 8; . . . ; 6> .

Fig. 4 shows an example of the bloom filter based proac-tive file information collection. Let us assume that the TTLequals to 2. We use a node’s fh

s to represent the bloom filterof files owned by node(s) s with h hops to the node. In thefigure, nA first receives the bloom filter from nB, nC and nD,denoted as f1

B, f1C and f1

D. Also, nB receives f1A, f

1E and f1F .

nB then combines these bloom filters except f1A and sends itto nA, which is denoted by f2EþF . nA also receives bloom fil-ters from other nodes two hops away, i.e., f2

GþH and f2IþJ .

Therefore, after the information collection, each node has aset of bloom filters such as S ¼ ff1

B; f1E; f

1C; f

2IþJ ; f

2EþF ; f

2GþHg

in nA.

A matched bloom filer of a file indicates that this file is

likely to have been fed into the bloom filter. The false posi-

tive rate � can be constrained to a small value if the number

of files fed into the bloom filter is limited. To achieve a given

�, the expected maximum number of files fed into the bloom

filter is �m�ln2log � . In file searching, since a file requester can

only know the bloom filter file information of a group of

nodes within TTL hops (e.g., f2EþF in Fig. 4), the request

needs to be forwarded to the neighbors of the matched

bloom filter, then the neighbors of neighbors and so on until

the requested file is located or the querying TTL is expired.

Specifically, when a node initiates a file request, it searches

its bloom filters to find a matched bloom filter of the

requested file f 2 S, and then sends the request to the node

that forwarded the matched bloom filter (e.g., ni in f). If the

request receiver holds the requested file, it returns the file to

the requester. Otherwise, it repeats the same process. That

is, it tries to find a matched bloom filter f 0 2 S0 and then

sends the request to n0i in f 0. Node n0i continues the same

process until the requested file is found or the querying TTL

expires. If a node cannot find a matched bloom filter, it for-

wards the request to the supernode. We use BloomFilter-

noRank to represent this searching method. For example, as

shown in Fig. 4, when nA queries file Fi, nA first checks all f

in its S sequentially, and finds a matched bloom filter vEþFin f2

EþF . Then, nA forwards the request to the forwarder of

f2EþF , nB. After nB receives the query of Fi, it first checks

whether it has the file. If not, it checks all f inside its S. nB

finds a matched bloom filter of Fi, vE in f1E . It then forwards

the request to nE . If TTL ¼ 0 and nE does not have Fi, nE

forwards the query to the supernode.

4.5 Enhanced Bloom Filter Based File Querying

We further improve BloomFilter-noRank by ordering thebloom filters in S in a certain order to find a matched bloom

Fig. 4. Bloom filter based file information collection.

Fig. 3. The counting bloom filter.


filter so that it is more accurate and faster to find file hold-ers, and the located file holders have higher upload band-width to provide files. We denote this enhanced method byBloomFilter. In a bloom filter result f , a smaller mf leads to asmaller false positive rate in file searching, hence higher filesearching success rate. p indicates the searching path length.u indicates the node capability of serving the file requests. Inorder to enhance the file searching success rate and search-ing efficiency, after periodically receiving all bloom filterresults from its neighbors, nj ranks all bloom filter resultsby mf , p and u. Specifically, node nj sorts all its bloom filterresults firstly by mf in an ascending order, and then sortsthose with the same mf in an ascending order of p, andfinally sorts the bloom filter results in a descending order ofu. In file searching, a node checks the sorted f in S to findmatched bloom filter. For example, in Fig. 4, nA has sorted Sas below:

S ¼<f1B ¼<vB; 10; 1; 10Mb=s; 1; nB> ;

f1C ¼<vC; 10; 1; 5Mb=s; 1; nC > ; . . . ;

f2IþJ ¼<vIþJ ; 20; 2; 10Mb=s; 2; nD> ; . . .> :

(1)

nA searches a matched bloom filter in the top-down order,and finds f1

B. Then, it sends the request to nB in f1B. Though

f2IþJ is also a matched bloom filter, it has lower rank thanf1B, so it is not identified.We assume that a node shares its previously visited

files with other nodes. Thus, highly popular files havemany replicas throughout the network, and the distrib-uted intra-sub-interest-group file searching is efficient insearching highly popular files. However, it may not beeasy to search unpopular files within TTL hops in a sub-interest overlay, since the replicas of such files are sparselydistributed over the network. The number of requests onfiles follows an exponential distribution over time [48].Thus, the requests on unpopular files are limited, whichcan be handled by supernodes. Also, most of the requestson popular files are generated within a short period,which produces many file replicas during this time period.After a node receives a file, it enters this file into its ownbloom filter and sends it to its neighbors in the next timeperiod. Since a recently queried file is very likely to bequeried again in a short time period, when a node initiatesor receives a request, the requested file is very likely to bea newly added entry from the bloom filter from its neigh-bors. Therefore, to improve the searching accuracy, ratherthan checking an entire bloom filter, the node can firstcheck the different part between the bloom filter in theprevious time period and that in the current time period.We use BloomFilter-PriorityCheck to denote this method.

We use vT and vT0 to denote the bloom filters having

the same forwarder ni and forwarding hops p receivedfrom the previous time period and current time period,respectively, by node nj. vT and vT

0 represent the samegroup of nodes that p hops away from nj. We usev�T ¼ v0T � vT to represent the difference between vT

0 andvT. For example, vT

0 ¼ ½7; 4; . . . ; 5, and vT ¼ ½2; 4; . . . ; 1,then v�T ¼ v0T � vT ¼ ½5; 0; . . . ; 4. The difference v�T is thebloom filter for newly added (i.e., requested) files amongnodes p hops from node nj. As recently queried files tend

to be queried again and a smaller mf value increases thesearching accuracy, when nj queries a file, it checks v�Tfirst to improve the accuracy of searching. Specifically, thebloom filters of v�T are ranked based on mf , p and u in thesame way as previously introduced. The node checks theexistence of the file in the sorted v�T first. If a matchedbloom filter is found, the file searching is conducted in thesame manner as in BloomFilter. Otherwise, the node usesthe BloomFilter method, i.e., checking v0T.

5 PERFORMANCE EVALUATION

We implemented a prototype of PAIS on PlanetLab [53], areal-world distributed testbed, to measure the performanceof PAIS in comparison with other P2P file sharing sys-tems. We set the experiment environment according tothe study results [48] of a BitTorrent trace [49]. We ran-domly selected 350 PlanetLab nodes all over the world.Among these nodes, we randomly selected 30 nodes aslandmark nodes to calculate the Hilbert numbers ofnodes. We clustered all nodes into 169 different locationsaccording to the closeness of their Hilbert numbers. Weused the 56,076 files in the BitTorrent trace [49]. The num-ber of interests in the system was set to 20, so we also setthe dimension of the Cycloid DHT to 20. We simulated100,000 peers by default in the experiments. Each peerwas randomly assigned to a location cluster among all169 clusters, and further randomly assigned to a Planet-Lab node within this location. According to [48], a peer’srequests mainly focus on around 20 percent of all of itsinterests. Thus, we randomly selected four interests(20 percent of total 20 interests) for each peer as its inter-ests. The files are randomly assigned to a sub-cluster withthe files’ interest over the total 160 locations, and thenrandomly assigned to nodes in the sub-cluster. Eightypercent of all queries of a requester target on files withowners within the same location, among which 70 percentof its queries are in the interests of the requester [39].According to [48], 80 percent of all requests from a peerfocus on its interests, and each of other requests is in arandomly selected interest outside of its interests. Arequest in an interest means a request for a randomlyselected file in this interest. We also let each file have acopy in another peer in a different location in order to testthe proximity-aware file searching performance.

Unless otherwise specified, there is only one groupinside each sub-cluster. Inside each sub-interest group, thenumber of parents of a peer was set to M ¼ 3. There weretwo node classes (i.e., Class1 and Class2) based on nodebandwidth measured by the number of requests that canbe handled per second. We used a bounded Pareto distribu-tion [54] with shape 2 to generate node bandwidth capacity.The lower bound was set to 10 and 100, and the upperbound was set to 1 and 10 for Class1 and Class2, respec-tively. Each node is assigned to Class1 with a probability15 percent, and to Class2 with a probability 85 percent. TheTTL of intra-group searching was set to 2, considering thata file can be discovered within two hops on average in acommon-interest node cluster [39]. Unless otherwise speci-fied, PAIS uses BloomFilter for the intra-cluster searching.For the counting bloom filter [52], we set the false positive


rate to 1 percent and the expected maximum number ofinserted elements to 10,000.

Each experiment lasted six rounds. In each round, peersgenerated queries in turn at the rate of six queries persecond in the system until each peer finished one query.In order to show the effectiveness of PAIS’s proximity/interest clustering and searching method, we comparedPAIS with SWorld [39], TS_Net [34] and Cycloid [7].SWorld is an interest-aware clustering P2P system, whichgroups common-interest peers into a cluster. Inside a clus-ter, each peer randomly selects 20 peers as neighbors inorder to reach all peers in the cluster within four hops. Foran intra-cluster query, each peer chooses 10 randomlyselected neighbors to forward messages with TTL ¼ 4.TS_Net is a proximity-aware clustering P2P system, whichgroups proximity-close peers into a cluster. Peers inside acluster form a three-ary proximity-aware tree. In intra-cluster searching, a peer forwards a message through thetree structure within seven hops in order to reach mostother peers inside a cluster. In order to make these systemscomparable to PAIS and guarantee a successful responseto each query, we modified SWorld and TS_Net by usingPAIS’s DHT overlay for file searching whenever the intra-cluster searching fails. The DHT consists of supernodesand files are re-distributed among the supernodes and canbe located by the Lookup() function. In SWorld andTS_Net, each cluster randomly selects 169 and 20 peers,respectively, to form the Cycloid overlay. We use Cycloidto denote the system without clustering, which alwaysuses the DHT searching function Lookup() to find files.

5.1 The Efficiency of File Searching

Fig. 5a shows the CDF of file queries versus query pathlength in hops of all systems. It shows that PAIS has morequeries resolved within a small number of hops than othersystems. It has 31, 46 and 85 percent more queries resolvedwithin four hops than SWorld, TS_Net and Cycloid, respec-tively. This is because PAIS’s simultaneous proximity/inter-est-aware clustering enables nodes to find their interestedfiles in proximity-close nodes in intra-cluster searching,which reduces the inter-cluster queries. Our experimentalresults show that the percent of requests resolved in intra-cluster searching are 81, 73, 57 and 0 percent in PAIS, TS_Net,SWorld and Cycloid, respectively. More inter-cluster querieslead to long query path lengths. PAIS also produces shorterquery path lengths than other systems in intra-cluster search-ing. By clustering common-interest nodes, SWorld enablesnodes to find their interested file in their cluster. However,the file providersmay be unreachable from requesters withinTTL. Therefore, queries in PAIS have shorter query paths

than SWorld. Because PAIS further considers interest-basedclustering compared to TS_Net, nodes can more quickly findinterested files. Thus, PAIS leads to shorter path lengths thanTS_Net. Cycloid only depends on DHT routing to find fileswithout considering proximity and interests. DHT lookuppath length is much longer than the path length of intra-clus-ter searching in the other systems. Therefore, Cycloid produ-ces longer path lengths than other systems. TS_Net has morequeries resolved within 8 and fewer queries resolved within4 than SWorld. The intra-cluster forwarding TTL is 7 and 4 inTS_Net and SWorld, respectively. Therefore, TS_Netresolves more queries within 8 hops. The smaller percentageof queries within four hops in TS_Net than in SWorld iscaused by TS_Net’s smaller number of neighbors per node ina cluster for query forwarding than SWorld, which generatesfewer queries resolved within short path lengths. This figureshows that PAIS generates shorter path lengths than othersystems, which indicates its high searching efficiency.

Fig. 5b shows the percentage of queries resolved ineach stage of searching including inter-cluster, intra-clusterand intra-sub-cluster searching in different systems. Theinter-cluster stage means the Lookup() searching in theCycloid DHT overlay. Cycloid only has inter-cluster search-ing, and TS_Net and SWorld do not have intra-sub-clustersearching. From the figure, we find that the percentage ofrequests resolved inside a cluster follows PAIS>TS_Net>SWorld>Cycloid¼0 due to the same reasons as in Fig. 5a.We also find that most of the queries resolved inside a clus-ter are resolved within sub-cluster in PAIS. That is becausemost of the queries of a peer focus on its interests. Thisfigure indicates the effectiveness of our intra-sub-clusterand intra-cluster searching, and it also verifies the effective-ness of proximity/interest-aware clustering in PAIS.

Figs. 5c and 5d show the median, the fifth percentile and95th percentile of the routing cost measured by routing dis-tance in km, and the latency of a request, respectively, ineach round. We see that the median of both cost and latencyof all systems follow PAIS<TS_Net<SWorld<Cycloid. Dueto the same reasons as in Fig. 5a, PAIS has the smallest costand latency among all systems, and Cycloid has the largestcost and latency. Because of the proximity-aware clusteringin TS_Net, its intra-cluster searching is between physicallyclose peers, which introduces smaller path distance andlatency than those in SWorld. We can also see that the fifthpercentiles of routing cost and latency of Cycloid are muchlarger than those in other systems. This is because Cycloidonly uses DHT routing without proximity or interest con-sideration, which generates long routing cost and latency,while in other systems, intra-cluster searching can effi-ciently resolve a large percentage of queries in small pathlengths. These experimental results indicate the

Fig. 5. The efficiency of file searching.


effectiveness of the proximity/interest clustering method inPAIS, which enables it to resolve queries with smaller costand latency than other systems.

Fig. 6 shows the CDF of server-client pairs over distance,which indicates the file transmission load from the server tothe client hence the file sharing efficiency. The figure indi-cates that the expected distance of server-client pairs followsCycloid>SWorld>TS_Net>PAIS. Both PAIS and TS_Netcluster peers with proximity-awareness and resolve most ofqueries within clusters. Thus, they can resolve more querieswithin shorter distances than other two systems withoutproximity-awareness. Compared to TS_Net, PAIS resolvesmore queries in intra-cluster searching. PAIS’s proximity/interest clustering helps nodes quickly find their interestedfile in short distances. With only proximity-aware cluster-ing, TS_Net allows nodes to search files within short distan-ces but cannot guarantee fast file location. Therefore, PAISgenerates a shorter server-client distance than TS_Net. InSWorld, a requester forwards its query to its neighbors, thusthe file holders nearby respond the requester more quicklythan the file holders far away. As a result, SWorld can findthe files nearby with a higher probability than Cycloid, lead-ing to shorter client-server distances than Cycloid. Thisfigure indicates PAIS’s higher file searching efficiency as ithas shorter server-client distances than other systems.

5.2 Performance of File Replication

In this experiment, when peers in one location request a filenot existing in the location for at least t times, the file is rep-licated in their location. In the figures, PAIS/x denotes PAISwith the replication algorithm when t ¼ x. In this experi-ment, there was a single replica for each file initially. Fig. 7ashows the number of created replicas of PAIS with andwithout the replication algorithm with varying t valuesover the continuous six rounds. It shows that the number ofcreated replicas follows PAIS<PAIS/5<PAIS/3<PAIS/2.This is because with the same file requests, a smaller t leadsto more generated replicas. PAIS/2 has created nearly twiceof the number of replicas of PAIS/3. Fig. 7b demonstratesthe replication cost measured by the sum of the distancesbetween each pair of the original file owner and replicanode. The replication cost also follows PAIS/5>PAIS/3>PAIS/2>PAIS, and the cost of PAIS/2 is about twice ofPAIS/3 due to the same reason as in Fig. 7a. Both figures

show that more replicas are created and hence more replica-tion cost is generated as the experiment round increasesbecause more file requests are generated.

Fig. 7c shows the average path length in each round ofPAIS without and with the replication algorithm withvarying t values over the continuous six rounds. First, wesee that PAIS/x (x ¼ 2, 3, 5) generates shorter pathlengths than PAIS, which shows the benefit of replicatingfrequently-visited files for nodes in a location. Second, wenotice that the result follows PAIS/5>PAIS/3>PAIS/2, i.e., the path length decreases as the threshold t decreases.This is because a lower threshold leads to more replicasas shown in Fig. 7a, enabling nodes to find their requestedfiles in their own locations. Third, we see that the pathlength decreases as time goes on. As more and morerequests are sent out from nodes in a location, more repli-cas of different files are generated in their location,enabling nodes to retrieve files within one hop. We alsofind that the path length of PAIS/3 is slightly larger thanPAIS/2. Considering the much larger replication cost andconsistency maintenance cost of PAIS/2 over PAIS/3,t ¼ 3 is a better choice to break the tie between replica-tion/maintenance cost and query efficiency.

5.3 The Overhead of File Searching

Fig. 8a shows the average number of query messages travel-ing through supernodes per supernode in all six rounds,which reflects the load of supernodes in file querying.Cycloid does not use supernodes and it forms all nodes intoa DHT, so we measured metrics on all nodes as its results.In PAIS, the supernodes handle the intra-interest group,intra-sub-cluster, inter-sub-cluster and DHT searching,while in other systems, the supernodes only handle theDHT searching. We measured the number of query mes-sages forwarded to supernodes, and the response messagesfrom supernodes. We see that the number of query mes-sages per supernode follows Cycloid>SWorld>TS_-Net>PAIS. Part of the reason for this result is that thepercentage of queries resolved by DHT routing followsCycloid>SWorld>TS_Net>PAIS as shown in Fig. 5b, andthe Lookup() routing function introduces many routing

Fig. 7. The effectiveness of the file replication algorithm on file searching efficiency.

Fig. 8. The overhead of file searching.

Fig. 6. CDF of server-client pair distance.


messages. In PAIS, many queries are resolved by intra-clus-ter searching, which also introduces some query messages.However, such a query only produces one query message,which is much smaller than one DHT routing query. There-fore, PAIS still generates the smallest number of queryingmessages per supernode. The number of response messagesper supernode follows Cycloid>PAIS>SWorld>TS_Net.PAIS has a larger number of response messages than TS_Netand SWorld, because it depends on supernodes to respondthe requests after intra-interest group searching failures.Most queries are resolved in intra-cluster searching, sosupernodes respond most queries. All queries areresponded by supernodes by Cycloid, which leads to largeraverage response messages than PAIS. The number ofresponse messages of SWorld and TS_Net follows the sameorder as the number of querying messages due to the samereason. Since a file query produces many searching mes-sages but one response message if it is successfully resolved,the total number of messages per supernode still followsCycloid>SWorld>TS_Net>PAIS. These experimentalresults indicate that PAIS has better performance than othersystems in avoiding overloaded supernodes.

Fig. 8b shows the number of communication messagesfor structure maintenance, inter-cluster querying and intra-cluster querying, respectively, and the total number ofthese messages in each system in all six rounds. The experi-mental results show that the number of maintenance mes-sages follows SWorld>Cycloid>PAIS>TS_Net though it isnot obvious in the figure. SWorld generates the largestnumber of maintenance messages, since each peer needs tomaintain the connections to a large number of peers (i.e.,20) in a cluster. Cycloid generates a larger number of main-tenance messages, because its larger Cycloid overlay withall peers participating in the DHT introduces much moremessages to maintain the routing tables. PAIS has a smallernumber of maintenance messages than Cycloid, because itneeds to maintain a smaller Cycloid overlay, where eachnode is the supernode in charging of each sub-cluster. Also,due to its fine-grained interest and proximity clustering,each node maintains fewer neighbors in a sub-cluster thanin a cluster in SWorld. TS_Net has the smallest number ofmaintenance messages, because each node only needs tomaintain the connections to its three children and oneparent inside its cluster. The order of the number of inter-cluster query messages of all systems is the same as that inFig. 8a due to the same reasons. The number of intra-clustermessages follows TS_Net>SWorld>PAIS. PAIS has muchfewer intra-cluster query messages because of its limitedhops in intra-cluster searching. TS_Net produces a largernumber of intra-cluster messages due to its much longer

path length (i.e., 7) in intra-cluster searching. Also, due tothe much larger number of intra-cluster messages ofSWorld and TS_Net, the total number of messages followsTS_Net>SWorld>Cycloid>PAIS. The figure indicates thatPAIS introduces lighter overhead than other systems whileachieves high file searching and sharing efficiency.

5.4 Performance of Dynamism Resilience

This experiment tests the performance of the dynamism-resil-ience of all systems. In this experiment, the peer failure ratefollowed a Poisson distribution [55], with the meanrate varying from 1 to 3.5 percent node failures per second.We measured the average performance of all six rounds. Weused the average path length of all successful resolved queriesas its path length, and used themaximumpath length of DHTrouting as the path length for a failed query. Fig. 9a shows theaverage path length in hops of different systems with differ-ent mean node failure rates. It shows that the average pathlength follows Cycloid>SWorld�TS_Net>PAIS due to thesame reason as in Fig. 5a. TS_Net generates shorter pathlengths than SWorld when the failure rate is low, becauseTS_Net resolves more queries inside a cluster than SWorld asshown in Fig. 5b, and the intra-cluster searching introducesmuch smaller expected path length than inter-cluster search-ing. The figure also shows that the average path lengthincreases as the node failure rate increases for all methods.More peer failures lead to more querying failures, hence lon-ger path lengths. From the figure, we can also see that thepath length increase rate of all methods follows Cycloid>TS_-Net>SWorld>PAIS. In the intra-cluster searching in PAISand SWorld, when a node forwards a request to anothernode, if the receiver fails, the forwarder can choose anothernode to forward the request. TS_Net’s single path leads tohigh failure rate, and then it resorts to DHT routing, whichleads to longer path lengths. In Cycloid, a DHT routing failureleads tomore routing hops. Therefore, PAIS and SWorld gen-erate smaller increase of path length than TS_Net andCycloid. PAIS has a larger percentage of queries resolvedinside a cluster than SWorld, and the intra-cluster searchingis much more dynamism-resilient than the inter-clustersearching. Thus, PAIS has a smaller increase rate thanSWorld. TS_Net’s intra-cluster searching leads to shorter pathlengths than the DHT routing path lengths. Thus, TS_Net hasa smaller path length increase rate than Cycloid. The figureindicates that PAIS can still generate the shortest query pathlength in node dynamism and the node dynamism has thesmallest effect on PAIS’s querying efficiency, which confirmsits higher dynamism-resilience than other systems.

Figs. 9b and 9c show the average routing distance andlatency of all systems, respectively. The figures show that

Fig. 9. File searching performance in node dynamism.


the average routing distance and latency of all systems fol-low the same order as those in Figs. 5c and 5d, respec-tively, due to the same reasons. The figures also show thatall systems’ routing distance and latency increase as thenode failure rate increases, and the increase rate followsCycloid>TS_Net>SWorld>PAIS due to the same reasonas in Fig. 9a.

5.5 The Efficiency of Intra-Sub-Cluster Querying

In this experiment, we randomly selected one location outof all 169 locations, and used all PlanetLab nodes in thislocation to simulate a sub-interest group inside PAIS, wherethe number of peers was increased from 1,000 to 5,000 by1,000 at each step. We randomly selected files to producereplicas and the number of replicas was 40 times of thenumber of peers inside this group. The TTL for file queryingand information forwarding was set to 3. All peers insidethe group only query files within three hops in order to testthe file searching success rate solely determined by the falsepositive rate of the bloom filter method. We use Supernodeto denote the method, in which all group peers forward theinformation of their owned files periodically to the super-node, and peers send file requests to the supernode. Wemeasured the size of the transmitted information for proac-tive file information collection as network load.

Fig. 10a shows the average network load per node in oneround. In Supernode, we measured the size of all file informa-tion transmitted to the supernodes as the result. The figureshows that the average network load follows BloomFil-ter<Supernode<FileName. By forwarding the file informationto all nodeswithin three hops, FileName generates higher net-work load than Supernode. BloomFilter generates much lowernetwork load than others. BloomFilter only needs to transmitthe bloom filters by compressing the file information frommany nodes into a single array of integers, which has a muchsmaller size than the combination of all file information. Thefigure indicates that the bloom filter based information col-lection is effective in reducing the network load.

Fig. 10b shows the query success rate of intra-groupsearching without relying on the supernode in all meth-ods. The figure shows that the success rate followsFileName¼Supernode>BloomFilter>BloomFilter-noRank.Supernode has the file information of all peers in a group,so it generates 100 percent query success rate. In File-Name, each node has each file’s information associatedwith the file holders within TTL hops. Thus, it can defi-nitely find the requested files within TTL hops. However,they introduce larger network load than BloomFilter asshown in Fig. 10a. BloomFilter has a higher success ratethan BloomFilter-noRank, because its identified matchedbloom filter has a smaller false positive rate. The figure

indicates that BloomFilter is effective in searching fileswith a high query success rate while reduces networkload. We also see that the success rates of both BloomFilterand BloomFilter-noRank decrease as the sub-interest groupsize increases. This is because more nodes inside a groupmean more different files within TTL hops of a node,which leads to a larger false positive rate of the bloom fil-ters in file searching.

Fig. 10c shows the average query path length of BloomFil-ter and BloomFilter-noRank inside the sub-interest group.Since Supernode does not have distributed intra-group filesearching and FileName can always find the file holder, wedid not measure their performance. From the figure, we cansee that the average query path length of BloomFilter isshorter than that of BloomFilter-noRank. That is becauseBloomFilter gives the bloom filters with shorter path lengtha higher rank in choosing a matched bloom filter, whileBloomFilter does not. This figure confirms the effectivenessof the enhanced bloom filter based file querying.

We use N to denote the maximum number of filesinserted into the bloom filter in order to achieve �. In thisexperiment, the percent of popular files was set to 1=10 ofall files. All peers requested a randomly selected popularfile in each round. As shown in Fig. 10d, we can see for bothN ¼ 1;000 and N ¼ 10;000, BloomFilter-PriorityCheck produ-ces a large query success rate than BloomFilter. The differ-ence of two consecutive bloom filters only involves thepopular files which are newly created. By checking this dif-ference, BloomFilter-PriorityCheck produces a smaller falsepositive rate due to the smaller number of files involving inthe bloom filter. The figure indicates that the effectivenessof BloomFilter-PriorityCheck in enhancing the success rate ofBloomFilter in searching popular files.

5.6 Performance of Intra-Sub-Cluster Overlay

In this experiment, we used the same experimental envi-ronment as in Section 5.5, with the number of peers inside asub-cluster set to 5,000. To measure the performance ofeffectiveness of the sub-interest clustering in Section 4.1,we increased the number of groups from 1 to 5. Each peerrandomly joined a group, and randomly requested filesowned by the users inside the same group. Fig. 11a showsthe intra-group search success rate of BloomFilter andBloomFilter-noRank versus the number of groups. From thefigure, we can see that the search success rate of BloomFilteris much larger than BloomFilter-noRank as shown inFig. 10b, due to the same reason. We can also see that thesearch success rate of both methods increase as the numberof groups increases. With more groups (i.e., more fine-grained interest classification), there are fewer nodes aswell as fewer files inside a group, which leads to a higher

Fig. 10. Intra-sub-cluster file searching performance.


percentage of requests resolved in intra-group searching.This figure indicates that the sub-interest clusteringimproves the effectiveness of the intra-sub-cluster search-ing by increasing the search success rate.

To measure the performance of effectiveness of overlayconstruction inside a group based on node capacity inSection 4.2, we measured the node utilization by ut ¼W=C,where W is the total number of requests handled in asecond and C is the node capacity. We used (w/)Overlay todenote our node capacity-aware overlay, and (w/o)Overlayto denote the same method to build the overlay except thatClass1 and Class2 randomly selected nodes. Fig. 11b showsthe fifth percentile, median and the 95th percentile of allnodes’ 99th utilization during the experiment. From thefigure, we can see that (w/o)Overlay has a much larger 95thpercentile, and a lower fifth percentile results. This isbecause the nodes in Class1 handle most queries, and theworkload may be too heavy for a low-capacity node. Highcapacity nodes in Class2 may have few requests, which failto fully utilize their capacity. (w/)Overlay considers nodecapacity in overlay construction, so that higher capacitynodes receive more requests and lower capacity nodesreceive fewer requests. Therefore, (w/o)Overlay has a muchlarger deviation of the 99th percentile node utilization. Thisfigure indicates that (w/)Overlay is effective to balance loadamong all peers according to their capacities.

6 CONCLUSIONS

In recent years, to enhance file location efficiency in P2Psystems, interest-clustered super-peer networks and prox-imity-clustered super-peer networks have been proposed.Although both strategies improve the performance of P2Psystems, few works cluster peers based on both peer inter-est and physical proximity simultaneously. Moreover, it isharder to realize it in structured P2P systems due to theirstrictly defined topologies, although they have high effi-ciency of file location than unstructured P2Ps. In thispaper, we introduce a proximity-aware and interest-clus-tered P2P file sharing system based on a structured P2P. Itgroups peers based on both interest and proximity by tak-ing advantage of a hierarchical structure of a structuredP2P. PAIS uses an intelligent file replication algorithmthat replicates a file frequently requested by physicallyclose nodes near their physical location to enhance the filelookup efficiency. Finally, PAIS enhances the file search-ing efficiency among the proximity-close and common-interest nodes through a number of approaches. Thetrace-driven experimental results on PlanetLab demon-strate the efficiency of PAIS in comparison with other P2Pfile sharing systems. It dramatically reduces the overheadand yields significant improvements in file location

efficiency even in node dynamism. Also, the experimentalresults show the effectiveness of the approaches forimproving file searching efficiency among the proximity-close and common-interest nodes.

ACKNOWLEDGMENTS

This research was supported in part by US National ScienceFoundation (NSF) grants IIS-1354123, CNS-1254006, CNS-1249603, CNS-1049947, CNS-0917056 and CNS-1025652,Microsoft Research Faculty Fellowship 8300751, and theUnited States Department of Defense 238866. An early ver-sion of this work was presented in the Proceedings ofCCGRID 2009 [56].

REFERENCES

[1] BitTorrent. (2013) [Online]. Available: http://www.bittorrent.com/

[2] Gnutella home page. (2003) [Online]. Available: http://www.gnutella.com

[3] I. Clarke, O. Sandberg, B. Wiley, and T. W. Hong, “Freenet: A dis-tributed anonymous information storage and retrieval system,” inProc. Int. Workshop Des. Issues Anonymity Unobservability, 2001,pp. 46–66.

[4] I. Stoica, R. Morris, D. Liben-Nowell, D. R. Karger, M. F. Kaa-shoek, F. Dabek, and H. Balakrishnan, “Chord: A scalable peer-to-peer lookup protocol for internet applications,” IEEE/ACM Trans.Netw., vol. 11, no. 1, pp. 17–32, Feb. 2003.

[5] A. Rowstron and P. Druschel, “Pastry: Scalable, decentralizedobject location and routing for large-scale peer-to-peer systems,”in Proc. IFIP/ACM Int. Conf. Distrib. Syst. Platforms Heidelberg,2001, pp. 329–350.

[6] B. Y. Zhao, L. Huang, J. Stribling, S. C. Rhea, A. D. Joseph, and J.Kubiatowicz, “Tapestry: A resilient global-scale overlay for ser-vice deployment,” IEEE J. Sel. Areas Commun., vol. 22, no. 1,pp. 41–53, 2004.

[7] H. Shen, C. Xu, and G. Chen, “Cycloid: A scalable constant-degreeP2P overlay network,” Perform. Eval., vol. 63, pp. 195–216, 2006.

[8] Z. Li, G. Xie, and Z. Li, “Efficient and scalable consistency mainte-nance for heterogeneous peer-to-peer systems,” IEEE Trans. Paral-lel Distrib. Syst., vol. 19, no. 12, pp. 1695–1708, Dec. 2008.

[9] H. Shen and C.-Z. Xu, “Hash-based proximity clustering for effi-cient load balancing in heterogeneous DHT networks,” J. ParallelDistrib. Comput., vol. 68, pp. 686–702, 2008.

[10] FastTrack. (2003) [Online]. Available: http://www.fasttrack.nu/index_int.html

[11] S. Ratnasamy, M. Handley, R. Karp, and S. Shenker,“Topologically-aware overlay construction and server selection,”in Proc. IEEE INFOCOM, 2002, pp. 1190–1199.

[12] M. Waldvogel and R. Rinaldi, “Efficient topology-aware overlaynetwork,” in Proc. ACM Workshop Hot Topics Netw., 2002,pp. 101–106.

[13] Y. Zhu and H. Shen, “An efficient and scalable framework for con-tent-based publish/subscribe systems,” Peer-to-Per Netw. Appl.,vol. 1, pp. 3–17, 2008.

[14] C. Hang and K. C. Sia, “Peer clustering and firework query mod-el,” in Proc. Int. World Wide Web Conf., 2002.

[15] A. Crespo and H. Garcia-Molina, “Routing indices for peer-to-peer systems,” in Proc. 22nd Int. Conf. Distrib. Comput. Syst., 2002,pp. 23–32.

[16] W. Nejdl, M. Wolpers, W. Siberski, C. Schmitz, M. Schlosser, I.Brunkhorst, and A. Loeser, “Super-peer-based routing and clus-tering strategies for RDF-based peer-to-peer networks,” J. WebSemantics, vol. 1, no. 2, pp. 137–240, 2004.

[17] P. A. Bernstein, F. Giunchiglia, A. Kementsietsidis, J. Mylopoulos,L. Serafini, and I. Zaihrayeu, “Data management for peer-to-peercomputing: A vision,” in Proc. 5th Int. Workshop World Wide WebDatabases, 2002, pp. 89–94.

[18] A. Y. Halevy, Z. G. Ives, P. Mork, and I. Tatarinov, “Piazza: Datamanagement infrastructure for semantic web applications,” inProc. 12th Int. Conf. World Wide Web, 2003, pp. 556–567.

[19] K. Aberer, P. Cudr�e-Mauroux, and M. Hauswirth, “The chattyweb: Emergent semantics through gossiping,” in Proc. 12th Int.Conf. World Wide Web, 2003, pp. 197–206.

Fig. 11. Performance of intra-sub-cluster overlay.


[20] Morpheus. (2008) [Online]. Available: http://www.musiccity.com

[21] P. Garbacki, D. H. J. Epema, and M. van Steen, “Optimizing peerrelationships in a super-peer network,” in Proc. Int. Conf. Distrib.Comput. Syst., 2007, p. 31.

[22] B. Mitra, A. K. Dubey, S. Ghose, and N. Ganguly, “How do super-peer networks emerge?” in Proc. INFOCOM, 2010, pp. 1–9.

[23] Q. Hofstatter, S. Zols, M. Michel, Z. Despotovic, and W. Kellerer,“Chordella—A hierarchical peer-to-peer overlay implementationfor heterogeneous, mobile environments,” in Proc. 8th Int. Conf.Peer-to-Peer Comput., 2008, pp 75–76.

[24] M. Sachez-Artigaz, P. Garcia-Lopez, and A. F. G. Skarmeta, “Onthe feasibility of dynamic superpeer ratio maintenance,” in Proc.8th Int. Conf. Peer-to-Peer Comput., 2008, pp. 333–342.

[25] H. Liu, J. Thomas, and P. Khethavath, “Moving target with loadbalancing in P2P cloud,” in Proc. IEEE 6th Int. Conf. Cloud Comput.,2013, pp. 359–366.

[26] P. Garbacki, D. H. J. Epema, and M. V. Steen, “The design andevaluation of a self-organizing superpeer network,” IEEE Trans.Comput., vol. 59, no. 3, pp. 317–331, Mar. 2010.

[27] S. Ratnasamy, P. Francis, M. Handley, R. Karp, and S. Shenker, “Ascalable content-addressable network,” in Proc. ACM SIGCOMM,2001, pp. 329–350.

[28] S. Genaud and C. Rattanapoka, “Large-scale experiment of co-allocation strategies for peer-to-peer supercomputing in P2P-MPI,” in Proc. IEEE Int. Symp. Parallel Distrib. Symp., 2008,pp. 1–8.

[29] R. Cuevas, N. Laoutais, X. Yang, G. Siganos, and P. Rodriguez,“BitTorrent locality and transit traffic reduction: When, why andat what cost?” IEEE Trans. Parallel Distrib. Syst., vol. 25, no. 5,pp. 1177–1189, May 2014.

[30] C. Decker, R. Eidenbenz, and R. Wattenhofer, “Exploring andimproving BitTorrent topologies,” in Proc. Int. Conf. Peer-to-PeerComput., 2013, pp. 1–10.

[31] Y. Liu, L. Guo, F. Li, and S. Chen, “A case study of traffic localityin Internet P2P live streaming systems,” in Proc. IEEE 29th Int.Conf. Distrib. Comput. Syst., 2009, pp. 423–432.

[32] H. Shen and K. Hwang, “Locality-preserving clustering and dis-cover of wide-area grid resources,” in Proc. IEEE Int. Conf. Distrib.Comput. Syst., 2009, pp. 518–525.

[33] F. Lehrieder, S. Oechsner, T. Hossfeld, Z. Despotovic, W. Kellerer,and M. Michel, “Can P2P-users benefit from locality-awareness?”in Proc. IEEE 10th Int. Conf. Peer-to-Peer Comput., 2010, pp. 1–9.

[34] M. Yang and Y. Yang, “An efficient hybrid peer-to-peer system fordistributed data sharing,” IEEE Trans. Comput., vol. 59, no. 9,pp. 1158–1171, Sep. 2010.

[35] C. Gross, B. Richerzhagen, D. Stingl, J. Weber, D. Hausheer, and R.Steinmetz, “GeoSwarm: A multi-aource sownload acheme forpeer-to-peer location-based aervices,” in Proc. 13th IEEE Conf.Peer-to-Peer Comput., 2013, pp. 1–10.

[36] M.P. Manzillo, L. Ciminiera, G. Marchetto, and F. Risso,“CLOSER: A collaborative locality-aware overlay SERvice,” IEEETrans. Parallel Distrib. Syst., vol. 23, no. 6, pp. 1030–1037, Jun. 2012.

[37] G. Ruffo and R. Schifanella, “A peer-to-peer recommender systembased on spontaneous affinities,” ACM Trans. Internet Technol.,vol. 9, pp. 1–34, 2009.

[38] K. Elkhiyaoui, D. Kato, K. Kunieda, K. Yamada, and P. Michiardi,“A scalable interest-oriented peer-to-peer pub/sub network,” inProc. 9th Int. Conf. Peer-to-Peer Comput., 2009, pp. 204–211.

[39] A. Iamnitchi, M. Ripeanu, E. Santos-Neto, and I. Foster, “Thesmall world of file sharing,” IEEE Trans. Parallel Distrib. Syst.,vol. 22, no. 7, pp. 1120–1134, Jul. 2011.

[40] X. Cheng and J. Liu, “NetTube: Exploring social networks forpeer-to-peer short video sharing,” in Proc. IEEE INFOCOM, 2009,pp. 1152–1160.

[41] Z. Li and H. Shen, “Social-P2P: Social network-based P2P file shar-ing system,” in Proc. IEEE Int. Conf. Netw. Protocols, 2012, pp. 1–10.

[42] K. C. J. Lin, C. P. Wang, C. F. Chou, and L. Golubchik, “Socionet:Asocial-based multimedia access system for unstructured p2pnetworks,” IEEE Trans. Parallel Distrib. Syst., vol. 21, no. 7,pp. 1027–1041, Jul. 2010.

[43] Y. Li, L. Shou, and K. L. Tan, “CYBER: A community-based searchengine,” in Proc. 8th Int. Conf. Peer-to-Peer Comput., 2008, pp. 215–224.

[44] F. Liu, Y. Sun, B. Li, B. Li, and X. Zhang, “FS2You: Peer-assistedsemi-persistent online hosting at a large scale,” IEEE Trans. Paral-lel Distrib. Syst., vol. 21, no. 10, pp. 1442–1457, Oct. 2010.

[45] F. Liu, Y. Sun, B. Li, and B. Li, “Quota: Rationing server resourcesin peer-assisted online hosting systems,” in Proc. IEEE Int. Conf.Netw. Protocols, 2009, pp.103–112.

[46] Y. Hua, H. Jiang, Y. Zhu, D. Feng, and L. Tian, “Semantic-awaremetadata organization paradigm in next-generation file systems,”IEEE Trans. Parallel Distrib. Syst., vol. 23, no. 2, pp. 337–344, Feb.2012.

[47] H. Chen, H. Jin, X. Luo, Y. Liu, T. Gu, K. Chen, and L. M. Ni,“BloomCast: Efficient and effective full-text retrieval in unstruc-tured P2P networks,” IEEE Trans. Parallel Distrib. Syst., vol. 23,no. 2, pp. 232–241, Feb. 2012.

[48] G. Liu, H. Shen, and L. Ward, “An efficient and trustworthy P2Pand social network integrated file sharing system,” Proc. P2P,2012, pp. 203–213.

[49] BitTorrent user activity traces. (2008) [Online]. Avaialable: http://www.cs.brown.edu/ pavlo/torrent/

[50] Z. Xu, M. Mahalingam, and M. Karlson,“Turning heterogeneityinto an advantage in overlay routing,” in Proc. INFOCOM, 2003,pp. 1499–1509.

[51] T. Asano, D. Ranjan, T. Roos, E. Welzl, and P. Widmaier,“Spacefilling curves and their use in geometric data structure,” Theoreti-cal Comput. Sci., vol. 181, no. 1, pp. 3–15, 1997.

[52] H. Song, S. Dharmapurikar, J. Turner, and J. Lockwood, “Fasthash table lookup using extended bloom filter: An aid to networkprocessing,” in Proc. Conf. Appl., Technol., Archit., Protocols Comput.Commun., 2005, pp.181–192.

[53] PlanetLab. (2012) [Online]. Available: http://www.planet-lab.org/

[54] K. Psounisa, P. M. Fernandezb, B. Prabhakarc, and F.Papadopoulosd, “Systems with multiple servers under heavy-tailed workloads,” Perform. Eval., vol. 62, pp. 456–474, 2005.

[55] F. A. Haight, Handbook of the Poisson Distribution. New York, NY,USA: Wiley, 1967.

[56] H. Shen, “PAIS: A proximity-aware interest-clustered P2P filesharing system,” in Proc. IEEE/ACM Int. Symp. Cluster Comput.Grid, 2009, pp. 164–171.

Haiying Shen received the BS degree in com-puter science and engineering from Tongji Univer-sity, China, in 2000, and the MS and PhD degreesin computer engineering from Wayne State Uni-versity in 2004 and 2006, respectively. She is cur-rently an associate professor in the Department ofElectrical and Computer Engineering at ClemsonUniversity. Her research interests include distrib-uted computer systems and computer networks,with an emphasis on P2P and content delivery net-works, mobile computing, wireless sensor net-

works, and cloud computing. She is a Microsoft Faculty fellow of 2010, asenior member of the IEEE, and a member of the ACM.

Guoxin Liu received the BS degree from BeiHangUniversity 2006, and the MS degree from Instituteof Software, Chinese Academy of Sciences in2009. He is currently working toward the PhDdegree at the Department of Electrical and Com-puter Engineering of Clemson University. Hisresearch interests include peer-to-peer, CDN, andonline social networks. He is a student member ofthe IEEE.

Lee Ward is a principal member of technical staffin the Scalable Systems Computing Departmentat Sandia National Laboratories. As an inveteratestudent of operating systems and file systems, hisinterests have provided the opportunity to makecontributions in high performance, parallel filesystems, IO libraries, hierarchical storage man-agement and compute cluster integration/man-agement systems.

" For more information on this or any other computing topic,please visit our Digital Library at www.computer.org/publications/dlib.


Documents

IEEE TRANSACTIONS ON PARALLEL AND · PDF fileA Proximity-Aware Interest-Clustered P2P File Sharing System ... (PAIS) based ... ciency is through a proximity-aware structure [9],