54
Low-Cost, No-Tech Ways to Fight Digital Ad Fraud February 2017 Augustine Fou, PhD. [email protected] 212. 203 .7239

Low-Cost, No-Tech Ways to Fight Fraud vMiMA

Embed Size (px)

Citation preview

Page 1: Low-Cost, No-Tech Ways to Fight Fraud vMiMA

Low-Cost, No-Tech Ways to Fight Digital Ad Fraud

February 2017

Augustine Fou, PhD.

[email protected]

212. 203 .7239

Page 2: Low-Cost, No-Tech Ways to Fight Fraud vMiMA

Ad Fraud is VERY Lucrative, VERY Scalable

Page 3: Low-Cost, No-Tech Ways to Fight Fraud vMiMA

February 2017 / Page 2marketing.scienceconsulting group, inc.

linkedin.com/in/augustinefou

How profitable is ad fraud? EXTREMELY

Source: https://hbr.org/2015/10/why-fraudulent-ad-networks-continue-to-thrive

“the profit margin is 99% … [especially with pay-for-use cloud services ]…”

Source: Digital Citizens Alliance Study, Feb 2014

“highly lucrative, and profitable… with

margins from 80% to as high as 94%…”

Page 4: Low-Cost, No-Tech Ways to Fight Fraud vMiMA

February 2017 / Page 3marketing.scienceconsulting group, inc.

linkedin.com/in/augustinefou

How scalable are fraud operations? MASSIVELYCash out sites are massively scalable

131 ads on pageX

100 iframes=

13,100 ads /page

One visit redirected dozens of times

Known blackhat technique to hide real referrer and replace with faked referrer.

Example how-to:http://www.blackhatworld.com/blackhat-seo/cloaking-content-generators/36830-cloaking-redirect-referer.html

Thousands of requests per pageSingle mobile app calling 10k impressions

Source: Forensiq

Page 5: Low-Cost, No-Tech Ways to Fight Fraud vMiMA

February 2017 / Page 4marketing.scienceconsulting group, inc.

linkedin.com/in/augustinefou

AppNexus cleaned up 92% of impressions

Increased CPM prices by 800%

Decreased impression volume by 92%

Source: http://adexchanger.com/ad-exchange-news/6-months-after-fraud-cleanup-appnexus-shares-effect-on-its-exchange/

260 billion

20 billion

> $1.60

< 20 cents

“pity those advertisers who bought before the cleanup”

Page 6: Low-Cost, No-Tech Ways to Fight Fraud vMiMA

February 2017 / Page 5marketing.scienceconsulting group, inc.

linkedin.com/in/augustinefou

Methbot eats $1 in $6 of $10B video ad spend

Source: Dec 2016 Whiteops Discloses Methbot Research

“the largest ad fraud discovered to date, a singlebotnet, Methbot, steals $2 billion annualized.”

1. Targets video ads$13 average CPM, 10X higher than display ads

2. Disguised as good publishersPretending to be good publishers to cover tracks

3. Simulated human actionsActively faked clicks, page scrolling, mouse movements

4. Obfuscated data center originsData center bots pretended to be from residential IP addresses

Page 7: Low-Cost, No-Tech Ways to Fight Fraud vMiMA

February 2017 / Page 6marketing.scienceconsulting group, inc.

linkedin.com/in/augustinefou

Ad fraud is now the largest form of crime

$20 billion

CounterfeitGoods U.S.

$18 billion

Somalipirates

44% of digital ad

spend

$70B 2016ESource: IAB H1

2016

Bank robberies

$38 million

$31 billionU.S. alone

$1 billion

ATM Malware

Payment Card Fraud 2015

$22 billion

Source: NilsonReport Dec 2016

Source: ICC, U.S. DHS, et. al

Source: World Bank Study 2013

Source: Kaspersky 2015

$7 in $100$3 in $100

“this is a PER YEAR number”

Page 8: Low-Cost, No-Tech Ways to Fight Fraud vMiMA

Where is Ad Fraud Concentrated?

Page 9: Low-Cost, No-Tech Ways to Fight Fraud vMiMA

February 2017 / Page 8marketing.scienceconsulting group, inc.

linkedin.com/in/augustinefou

CPM/CPC buckets (91% of spend) is most targeted

Impressions(CPM/CPV)

Clicks(CPC)

Search27%

91% digital spend

Display10%

Video7%

Mobile47%

Leads(CPL)

Sales(CPA)

Lead Gen$2.0B

Other$5.0B

• classifieds• sponsorship• rich media

(89% in 2015)

Source: IAB 1H 2016 Report

(86% in 2014)

Page 10: Low-Cost, No-Tech Ways to Fight Fraud vMiMA

February 2017 / Page 9marketing.scienceconsulting group, inc.

linkedin.com/in/augustinefou

Two key ingredients of CPM and CPC Fraud

Impression(CPM) Fraud

(includes mobile display, video ads)

1. Put up fake websites and load tons of display ads on the pages

Search Click (CPC) Fraud

(includes mobile search ads)

2. Use fake users (bots) to repeatedly load pages to generate fake ad impressions

1. Put up fake websites and participate in search networks

2. Use fake users (bots) to type keywords and click on them to generate the CPC revenue

screen shots of fake sites

Page 11: Low-Cost, No-Tech Ways to Fight Fraud vMiMA

Fake Websites(cash-out sites)

Page 12: Low-Cost, No-Tech Ways to Fight Fraud vMiMA

February 2017 / Page 11marketing.scienceconsulting group, inc.

linkedin.com/in/augustinefou

Websites – spectrum from bad to good

Ad Fraud Sites

Click Fraud Sites

100% bot

mostly human

Piracy Sites

Premium Publishers

Sites w/ Sourced Traffic

“fraud sites” “sites w/ questionable practices” “good guys”

“real content that real humans want to read”

Page 13: Low-Cost, No-Tech Ways to Fight Fraud vMiMA

February 2017 / Page 12marketing.scienceconsulting group, inc.

linkedin.com/in/augustinefou

Identical sites – fraud sites made by template

100% bot

Page 14: Low-Cost, No-Tech Ways to Fight Fraud vMiMA

February 2017 / Page 13marketing.scienceconsulting group, inc.

linkedin.com/in/augustinefou

Countless fraud domains used to commit ad fraudhttp://analyzecanceradvice.comhttp://analyzecancerhelp.comhttp://bestcanceropinion.comhttp://bestcancerproducts.comhttp://bestcancerresults.comhttp://besthealthopinion.comhttp://bettercanceradvice.comhttp://bettercancerhelp.comhttp://betterhealthopinion.comhttp://findcanceropinion.comhttp://findcancerresource.comhttp://findcancertopics.comhttp://findhealthopinion.comhttp://finestcanceradvice.comhttp://finestcancerhelp.comhttp://finestcancerresults.comhttp://getcancerproducts.com

100M+ more

sites like these, designed to profit from high value display, video, and mobile ads

Page 15: Low-Cost, No-Tech Ways to Fight Fraud vMiMA

Fake Visitors(bots)

Page 16: Low-Cost, No-Tech Ways to Fight Fraud vMiMA

February 2017 / Page 15marketing.scienceconsulting group, inc.

linkedin.com/in/augustinefou

Bots are automated browsers used for ad fraud

Headless BrowsersSeleniumPhantomJSZombie.jsSlimerJS

Mobile Simulators35 listed

Bots are made from malware compromised PCs or headless browsers (no screen) in datacenters.

Bots

Page 17: Low-Cost, No-Tech Ways to Fight Fraud vMiMA

February 2017 / Page 16marketing.scienceconsulting group, inc.

linkedin.com/in/augustinefou

Bots range in sophistication, and therefore cost

Javascript installed on webpage

Malware on PCsData Center BotsOn-Page Bots

Headless browsers in data centers

Malware installed on humans’ devices

Less sophisticated Most sophisticated

Source: AdAge/Augustine Fou, Mar 2014 Source: Forensiq Source: Augustine Fou, Oct 2015

“the official industry lists of bots catch NONE of these bots, not one.”

1 cent CPMsLoad pages, click

10 cent CPMsFake scroll, mouse movement, click

1 dollar CPMsReplay human-like mouse movements, clone cookies

Page 18: Low-Cost, No-Tech Ways to Fight Fraud vMiMA

February 2017 / Page 17marketing.scienceconsulting group, inc.

linkedin.com/in/augustinefou

Any device with chip/connectivity can be used as a bot

Traffic cameras used as botnet (Engadget, Oct 2015)

mobile devices

connected traffic lights

connected cars

thermostat connected fridge

Security cams used as DDoS botnet (Engadget, Jun 2016)

(TechTimes, Sep 2016)

Page 19: Low-Cost, No-Tech Ways to Fight Fraud vMiMA

“The equation of ad fraud is simple: buy traffic for $1 CPMs, sell ads for $10 CPMs; pocket $9 of pure profit.”

Page 20: Low-Cost, No-Tech Ways to Fight Fraud vMiMA

February 2017 / Page 19marketing.scienceconsulting group, inc.

linkedin.com/in/augustinefou

How Ad Fraud Harms

Advertisers

Page 21: Low-Cost, No-Tech Ways to Fight Fraud vMiMA

February 2017 / Page 20marketing.scienceconsulting group, inc.

linkedin.com/in/augustinefou

How many clicks/sessions/views do you want?

click on links

load webpages tune bounce rate

tune pages/visit

“bad guys’ bots are advanced enough to fake most metrics”

Page 22: Low-Cost, No-Tech Ways to Fight Fraud vMiMA

February 2017 / Page 21marketing.scienceconsulting group, inc.

linkedin.com/in/augustinefou

What click through rates are you shooting for?Programmatic display

(18-45% clicks from advanced bots)Premium publishers(0% clicks from bots)

0.13% CTR(18% of clicks by bots)

1.32% CTR(23% of clicks by bots)

5.93% CTR(45% of clicks by bots)

Campaign KPI: CTRs

Page 23: Low-Cost, No-Tech Ways to Fight Fraud vMiMA

February 2017 / Page 22marketing.scienceconsulting group, inc.

linkedin.com/in/augustinefou

Want 100% viewability? 0% NHT (bots)?

Bad guys cheat and stack ALL ads above the fold to make 100% viewability.

“100% viewability? Sure, no problem.”

AD

• IAS filtered traffic, • DV filtered traffic• Pixalate filtered traffic, • MOAT filtered traffic, • Forensiq filtered traffic

“0% NHT? Sure, no problem.”

Source: Shailin Dhar

Page 24: Low-Cost, No-Tech Ways to Fight Fraud vMiMA

Current State of NHT Detection

Page 25: Low-Cost, No-Tech Ways to Fight Fraud vMiMA

February 2017 / Page 24marketing.scienceconsulting group, inc.

linkedin.com/in/augustinefou

Fraud bots are NOT on any list

10,000bots observed

in the wild

user-agents.org

bad guys’ bots3%

Dstillery“findings from two independent third parties,

Integral Ad Science and White Ops”

3.7%Rocket Fuel

“Forensiq results confirmed that ... only 3.72% of impressions categorized as high risk.”

2 - 3%comScore

“most campaigns have far less; more in the 2% to 3% range.”

bot list-matching

“not on any list”disguised as popular browsers – Internet Explorer; constantly

adapting to avoid detection

Page 26: Low-Cost, No-Tech Ways to Fight Fraud vMiMA

February 2017 / Page 25marketing.scienceconsulting group, inc.

linkedin.com/in/augustinefou

Three main places for NHT detection

In-Ad(ad iframes)

On-Site(publishers’ sites)

• Used by advertisersto measure ad impressions

• Limitations – tag is in foreign iframe, severe limits on detection

ad tag / pixel(in-ad measurement)

javascript embed(on-site measurement)

In-Network(ad exchange)

• Used by publishers to

measure visitors to pages

• Limitations – most detailed and complete analysis of visitors

• Used by exchanges to

screen bid requests

• Limitations – relies on blacklists or probabilistic algorithms, least info

ad served

bot

human

fraud site

good site

Page 27: Low-Cost, No-Tech Ways to Fight Fraud vMiMA

February 2017 / Page 26marketing.scienceconsulting group, inc.

linkedin.com/in/augustinefou

5% bots doesn’t mean 95% humans

good publishers

ad exchanges/networks

volume bars (green)

Stacked percentBlue (human)Red (bots)

red v blue trendlines

Page 28: Low-Cost, No-Tech Ways to Fight Fraud vMiMA

“Having fraud DETECTION is not the same as having fraud PROTECTION.”

Page 29: Low-Cost, No-Tech Ways to Fight Fraud vMiMA

Case Examples

Page 30: Low-Cost, No-Tech Ways to Fight Fraud vMiMA

February 2017 / Page 29marketing.scienceconsulting group, inc.

linkedin.com/in/augustinefou

Differences in quality, arrivals, conversionsMeasure Ads Measure

ArrivalsMeasure Conversions

good publishers

ad exchanges/networks

346

1743

5

156

Page 31: Low-Cost, No-Tech Ways to Fight Fraud vMiMA

February 2017 / Page 30marketing.scienceconsulting group, inc.

linkedin.com/in/augustinefou

Stepwise improvement using our data

Period 1 Period 3Period 2

Initial baseline measurement

Measurement after first optimization

Eliminating several “problematic” networks

Page 32: Low-Cost, No-Tech Ways to Fight Fraud vMiMA

February 2017 / Page 31marketing.scienceconsulting group, inc.

linkedin.com/in/augustinefou

More accurate analytics when data is clean

7% conversion rate 13% conversion rateartificially low actually correct

Page 33: Low-Cost, No-Tech Ways to Fight Fraud vMiMA

February 2017 / Page 32marketing.scienceconsulting group, inc.

linkedin.com/in/augustinefou

Best Practices of Savvy Advertisers/Agencies

• Challenge all assumptions – don’t assume someone else “took care of it.” Verify, by demanding line-item detailed reports, because fraud hides easily in averages

• Check your Google Analytics - question anything that looks suspicious; more details that can reveal fraud and waste

• Corroborate measurements – measure different parameters together and see if they still make sense together; reduce false positives or negatives

• Use conversion metrics – CPG client uses click-and-print digital coupons; pharma client uses doctor finder zip code searches, plus clicks to doctor pages; retailers use sales

Page 34: Low-Cost, No-Tech Ways to Fight Fraud vMiMA

Bot Fraud Game Show

Page 35: Low-Cost, No-Tech Ways to Fight Fraud vMiMA

February 2017 / Page 34marketing.scienceconsulting group, inc.

linkedin.com/in/augustinefou

Where would you prefer to place your ads?

A

B

Page 36: Low-Cost, No-Tech Ways to Fight Fraud vMiMA

February 2017 / Page 35marketing.scienceconsulting group, inc.

linkedin.com/in/augustinefou

Which chart shows real human traffic surges?

A

B

Page 37: Low-Cost, No-Tech Ways to Fight Fraud vMiMA

February 2017 / Page 36marketing.scienceconsulting group, inc.

linkedin.com/in/augustinefou

Traffic surges caused by bots vs real humans

Caused by bots

Caused by humans

A

B

Page 38: Low-Cost, No-Tech Ways to Fight Fraud vMiMA

February 2017 / Page 37marketing.scienceconsulting group, inc.

linkedin.com/in/augustinefou

Which chart shows fake/sourced traffic?

A

B

Page 39: Low-Cost, No-Tech Ways to Fight Fraud vMiMA

February 2017 / Page 38marketing.scienceconsulting group, inc.

linkedin.com/in/augustinefou

Which chart shows fake/sourced traffic?

A

B

Page 40: Low-Cost, No-Tech Ways to Fight Fraud vMiMA

February 2017 / Page 39marketing.scienceconsulting group, inc.

linkedin.com/in/augustinefou

Which chart shows human segment?

A B

ON-SITE measurement• Scroll: 57%• Mouse: 67%• Click: 56%

ON-SITE measurement• Scroll: 2%• Mouse: 2%• Click: 2%

Page 41: Low-Cost, No-Tech Ways to Fight Fraud vMiMA

February 2017 / Page 40marketing.scienceconsulting group, inc.

linkedin.com/in/augustinefou

Which chart shows human segment?

A B

ON-SITE measurement• Scroll: 57%• Mouse: 67%• Click: 56%

ON-SITE measurement• Scroll: 2%• Mouse: 2%• Click: 2%

Page 42: Low-Cost, No-Tech Ways to Fight Fraud vMiMA

February 2017 / Page 41marketing.scienceconsulting group, inc.

linkedin.com/in/augustinefou

Which chart shows fraudulent mobile apps?

A B

Page 43: Low-Cost, No-Tech Ways to Fight Fraud vMiMA

February 2017 / Page 42marketing.scienceconsulting group, inc.

linkedin.com/in/augustinefou

Which chart shows fraudulent mobile apps?

A B

Page 44: Low-Cost, No-Tech Ways to Fight Fraud vMiMA

February 2017 / Page 43marketing.scienceconsulting group, inc.

linkedin.com/in/augustinefou

What’s wrong with this picture (chart)?

Page 45: Low-Cost, No-Tech Ways to Fight Fraud vMiMA

February 2017 / Page 44marketing.scienceconsulting group, inc.

linkedin.com/in/augustinefou

What’s wrong with this picture (chart)?

Page 46: Low-Cost, No-Tech Ways to Fight Fraud vMiMA

February 2017 / Page 45marketing.scienceconsulting group, inc.

linkedin.com/in/augustinefou

Would you buy more media from this site?

102,231 sessions

0 sessions

goal events

YES NO

Page 47: Low-Cost, No-Tech Ways to Fight Fraud vMiMA

February 2017 / Page 46marketing.scienceconsulting group, inc.

linkedin.com/in/augustinefou

Would you buy more media on this site? NO!

102,231 sessions

0 sessions

goal event – no change

Page 48: Low-Cost, No-Tech Ways to Fight Fraud vMiMA

February 2017 / Page 47marketing.scienceconsulting group, inc.

linkedin.com/in/augustinefou

Would you continue search ad placements?

Line item details

Overall average 9.4% CTR

“fraud hides easily in averages”

Page 49: Low-Cost, No-Tech Ways to Fight Fraud vMiMA

February 2017 / Page 48marketing.scienceconsulting group, inc.

linkedin.com/in/augustinefou

Your ads on .xyz domains, these mobile apps?

.xyz domains suspicious mobile apps

Page 50: Low-Cost, No-Tech Ways to Fight Fraud vMiMA

February 2017 / Page 49marketing.scienceconsulting group, inc.

linkedin.com/in/augustinefou

Mix and Match – which goes with which?

A

B

C

video entertainment

sports info site

investment info site

Page 51: Low-Cost, No-Tech Ways to Fight Fraud vMiMA

“Let’s go fight some bad guys

together!”

Page 52: Low-Cost, No-Tech Ways to Fight Fraud vMiMA

February 2017 / Page 51marketing.scienceconsulting group, inc.

linkedin.com/in/augustinefou

About the Author

February 2017

Augustine Fou, PhD.

[email protected]

212. 203 .7239

Page 53: Low-Cost, No-Tech Ways to Fight Fraud vMiMA

February 2017 / Page 52marketing.scienceconsulting group, inc.

linkedin.com/in/augustinefou

Dr. Augustine Fou – Independent Ad Fraud Researcher

2013

2014

Follow me on LinkedIn (click) and on Twitter @acfou (click)

Further reading:http://www.slideshare.net/augustinefou/presentationshttps://www.linkedin.com/today/author/augustinefou

2016

2015

Page 54: Low-Cost, No-Tech Ways to Fight Fraud vMiMA

February 2017 / Page 53marketing.scienceconsulting group, inc.

linkedin.com/in/augustinefou

Harvard Business Review – October 2015

Excerpt:

Hunting the Bots

Fou, a prodigy who earned a Ph.D. from MIT at 23, belongs to the generation that witnessed the rise of digital marketers, having crafted his trade at American Express, one of the most successful American consumer brands, and at Omnicom, one of the largest global advertising agencies. Eventually stepping away from corporate life, Fou started his own practice, focusing on digital marketing fraud investigation.

Fou’s experiment proved that fake traffic is unproductive traffic. The fake visitors inflated the traffic statistics but contributed nothing to conversions, which stayed steady even after the traffic plummeted (bottom chart). Fake traffic is generated by “bad-guy bots.” A bot is computer code that runs automated tasks.