Geo-social media as a proxy for meteorological data for flood monitoring · 2017-06-21 ·...

Geo-socialmediaasaproxyformeteorologicaldataforflood

monitoringCamiloRestrepo-Estradacamilo.restrepo@udea.edu.coPhd CandidateUniversity of SãoPaulo

thewadilabwater-adaptive design & innovation

São Carlos, SP (November 23th 2015)

Floods

Whatisthat?

Alternativesources

SocialMediaInformation

Waze - Similarconcept

BIGDATA

“Big data usually includes data sets with sizes beyond the ability ofcommonly used software tools to capture, curate, manage, and processdata within a tolerable elapsed time. Big Data philosophy encompassesunstructured, semi-structured and structured data, however the mainfocus is on unstructured data.” source wikipedia

According to IBM: “Big Data is being generated at all times. Every digitalprocess and social media exchange produces it. Systems, sensors andmobile devices transmit it. Much of this data is coming to us in anunstructured form, making it difficult to put into structured tables withrows and columns. To extract insights from this complex data, Big Dataprojects often rely on cutting edge analytics involving data science andmachine learning. Computers running sophisticated algorithms can helpenhance the veracity of information by sifting through the noise createdby Big Data's massive volume, variety, and velocity.”

BIGDATA

BIGDATA

BIGDATA

BIGDATA

BIGDATA

BIGDATA

BIGDATA

BIGDATA

SocialMedia

Personality

- Neuroticism- Extroversion- Kindness- Politicsfiliation

SocialMedia

10

70

150

300

Colleagues

Friends

Family

Partner

Personality

SocialMedia

SocialMedia

SocialMedia

SocialMediaandhydrology

Context

Pluviômetros Satélites

Rede de sensores

Problemstatement

Aricanduva catchment SAISP floods

Relatedgeolocatedtweets

City of São Paulo with related tweets as black points, rainfall gauges as blue triangles and the Aricanduva catchment shaded gray.

KeywordsandwrongkeywordsVariable WordsinPortuguese WordsinEnglish

Keywords %chuv%(chuva,chuvinha,chuvisco)%chov%(chove,chovendo,chover,choveu)

rain,rainy,drizzleItrains,torain,rained

Wrongkeywords

%bolinhodechuva%,%chuveiro%,%chuvanegra%,%chuvadefoto%,%chuvadebenção%,%chuvadegraça%,%chuvadeconfete%,%chuvadearroz%,%chuvadeglitter%,%chuvadeespuma%,%chuvadeamor%,%chuvademec%,%chuvadeabacate%,%chuvadesol%

sweetsnack,shower,rapgroupcallschuva negra,photorain,rainofblessing,rainofgrace,confettirain,ricerain,glitterrain,foamrain,loverain,mec rain,avocadorain,sunrain.

Reinforcement %choveforte%,%chovemuito%,%muitachuva%,%chovendomuito%,%chovemuitoforte%

itrainshard,Itrainsalot,lotsofrain,It'srainingalot,It'srainingverystrong

Weakening %arco íris% rainbow

Preliminaryresults

Transformationfunction

𝑝"#$%&' = 𝛼(1 + 𝜂"./#01 + 𝜂"#2.)𝑓67

𝐴%0.9/9".+: 𝛽%

𝐹67(%)𝐴%0.9/9".

0

%=>

PROBABILITY DISTRIBUTED MODEL (PDM)

Results

Results

References

• Andrade, Sidgley Camargo de, Camilo Restrepo-Estrada, Alexandre C BDelbem, Eduardo Mario Mendiondo, and João Porto De Albuquerque.2017. “Societal Geo-Innovation,” 19–37. doi:10.1007/978-3-319-56759-4.

• Restrepo-Estrada, Camilo; Andrade, Sidgley Camargo de; Albuquerque;João Porto de; Abe, Narumi; Fava, Maria Clara; and Mendiondo, EduardoMario. "Geo-social media as a proxy for meteorological data for floodmonitoring". Computers & Geosciences. (Submitted 2017 - Ref:CAGEO_2017_513).

• BIG DATA | Nerdologia 40.https://www.youtube.com/watch?v=hEFFCKxYbKM

• Dilúvio de dados | Nerdologia 131. https://youtu.be/pNZq8BCS-Bc

• Privacidade na Internet | Nerdologia Tech 07https://youtu.be/wZvDZfO13mA

Thanksforyourattention

CamiloRestrepoEmail:camilo.restrepo@udea.edu.co

Acknowledgements:Authors thank research funding grants from: CAPES-ProEx, CAPES-ProAlertas # 88887.091743/2014-01(CEPED-"USP ALERTA").