event processing system

Preview:

Citation preview

이벤트 처리 시스템

박재홍

jaehong@mycq.co.kr

A Tutorial on Onset Detection in Music Signals

Object Counter

MyTrader

0

3500

7000

10500

14000

2005 2006 2007 2008 2009 2010 2011 2012 2013 2014

Web API Count

12,566

Pharmacy Automation

Data Analysis

Mobile Research

Mondrian OLAP (Open Source )

WoT Platform

Log Platform

3G Packet Analysis

Glory FS Management Tool

OpenStack

Web Load Testing Tool

Patient Monitoring

Copyright 2011 Kelley-McCreary & Associates, LLC

Copyright 2011 Kelley-McCreary & Associates, LLC

http://nosql-database.org

May 18, 2002

CEP

stream (stanford) aurora (brown, mit)

telegraphcq niagra cq open cq cougar

gigascope tribeca

ubicore@ETRI

mycqserver@mycq

Event Processing Architecture Event Generator

Application

Active Business Process

Performance Dashboard

Human

Data Warehouse

Agent

Subscribers

Event-Driven Activity Event

Channel (in) Event Processing

Event Actions

Event Processor

Publish

Notify

Invoke Service

Start Business Process

Capture

Simple Events

Complex Events

Source X

Source Y

Source Z

Source W

Channel A

Channel B

Channel C

Channel N

Generate Event

Local Filter

Formatter

Application Data store Service Business process Transmitter Sensor (RFID..) Collaboration tool (IM, email) …

Event Source

Event Router

Messaging backbone Transmit Standard Formatted Events

Event Channel (out)

Channel A’

Channel B’

Channel C’

Channel M

©2006 Elemental Links Inc.

Transaction

•  SQL Query Compilation •  SQL Query Planning •  SQL Query Evaluation

SQL (INSERT)

SQL (INSERT)

SQL (INSERT)

SQL (INSERT)

SQL (SELECT3) SQL (SELECT N) SQL (SELECT2) SQL (SELECT1)

User

DBMS

Disk/Memory

•  CQ Evaluation

User

Continuous Query Processor

Input Queues

Memory/Disk

Data Streams

•  CQ Compilation •  CQ Planning

CQs User Output Queues

Continuous Query

Asynchronous Style Implementation

Synchronous Style Implementation

SQL

DBMS

Register Query

Request Query

Map / Reduce

T(n) T(n-1) T(n-2) … … T(0)

New Data

Area 1 Area 2

Hot Cold

Continuous (Map / Reduce)

spout (5)

split (8)

count (12)

the cow jumped over the moon

word-count topology

the cow jumped over the moon

the:2 cow:1 jumped:1 over:1 moon:1

Architecture

Data Source Real-Time Data Stream Processor

Database Database

Application

Real-Time Application

Batch Analysis

pattern

Event Archiving

save events

history data join

events (tx)

update rule

T(n) T(n-1) T(n-2) … … T(0)

New Data

Area 1 Area 2

Hot Cold

Recommended