25
Chains and processes to facilitate transparency between government agencies and the public. The Single Window; Dutch customs use case Asish Dash, CTO Marnix Vermaas, Business Architect

Chains and processes to facilitate transparency between ... · data center • Framework for automatic startup of environments INBOUND DC1 DC2 HTTP SRV1 HTTP SRV2 HTTP SRV3 HTTP SRV4

  • Upload
    others

  • View
    6

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Chains and processes to facilitate transparency between ... · data center • Framework for automatic startup of environments INBOUND DC1 DC2 HTTP SRV1 HTTP SRV2 HTTP SRV3 HTTP SRV4

Chains and processes to facilitate transparency between government agencies and the public.

The Single Window; Dutch customs use case

Asish Dash, CTOMarnix Vermaas, Business Architect

Page 2: Chains and processes to facilitate transparency between ... · data center • Framework for automatic startup of environments INBOUND DC1 DC2 HTTP SRV1 HTTP SRV2 HTTP SRV3 HTTP SRV4

About us• Qualified information exchange,

established in 2006

• Responsible for services provided to governments world wide

• Service the complete delivery from idea to operations using open standards and secured protocols

• We embrace laws and regulations.

Page 3: Chains and processes to facilitate transparency between ... · data center • Framework for automatic startup of environments INBOUND DC1 DC2 HTTP SRV1 HTTP SRV2 HTTP SRV3 HTTP SRV4

What is the concept of Single Window?Drivers:

• In line with EU regulations• EU Directive (2010/65/EU)

• Streamline the Dutch economy• Import value (2017):

400,000 million euros• Export value (2017):

450,000 million euros• Automate complex border

processing• Share required information

between agencies • Standardise and harmonise

Page 4: Chains and processes to facilitate transparency between ... · data center • Framework for automatic startup of environments INBOUND DC1 DC2 HTTP SRV1 HTTP SRV2 HTTP SRV3 HTTP SRV4

What is the concept of Single Window?Stakeholders:

• Four Dutch Ministries• Several Dutch Sea Ports

including Rotterdam (largest port in Europe)

• Schiphol Airport (3rd largest in Europe)

• Various companies, Consortiums, Community hubs, networks, etc. (over 1500 parties)

Page 5: Chains and processes to facilitate transparency between ... · data center • Framework for automatic startup of environments INBOUND DC1 DC2 HTTP SRV1 HTTP SRV2 HTTP SRV3 HTTP SRV4

What is the concept of Single Window?Scope of Interaction:

• All border formalities:• Port entry• Cargo• Health and Safety• Border Security

• Maritime and Air transport

Standards:

• WCO semantic model• XML/EDIFACT• SMTP

Page 6: Chains and processes to facilitate transparency between ... · data center • Framework for automatic startup of environments INBOUND DC1 DC2 HTTP SRV1 HTTP SRV2 HTTP SRV3 HTTP SRV4

Where do the messages go?

Single Window

Customs

Immigrations

Page 7: Chains and processes to facilitate transparency between ... · data center • Framework for automatic startup of environments INBOUND DC1 DC2 HTTP SRV1 HTTP SRV2 HTTP SRV3 HTTP SRV4

Where do the messages go?

Single Window

Customs

Immigrations

Page 8: Chains and processes to facilitate transparency between ... · data center • Framework for automatic startup of environments INBOUND DC1 DC2 HTTP SRV1 HTTP SRV2 HTTP SRV3 HTTP SRV4

Where do the messages go?

Single Window

Customs

Immigrations

Page 9: Chains and processes to facilitate transparency between ... · data center • Framework for automatic startup of environments INBOUND DC1 DC2 HTTP SRV1 HTTP SRV2 HTTP SRV3 HTTP SRV4

Why is it important globally?

EU Single Window

Page 10: Chains and processes to facilitate transparency between ... · data center • Framework for automatic startup of environments INBOUND DC1 DC2 HTTP SRV1 HTTP SRV2 HTTP SRV3 HTTP SRV4

What’s our situation?March 2016

Customs Declaration Platform

• Legacy, as-is migration to our platform

• 1-to-1 messages (to Customs)

September 2016

Maritime Single Window MSW

• 1-to-many messages

• Compliant by Design

• WCO Semantic model

• Dutch sea ports connected, incRotterdam

June 2017

Generic Single Window SW

• Dutch airports connected, incSchiphol

• EDIFACT/XML conversion

• Single point of contact for all Dutch border formalities

Aug 2018

Increased volumes, More standards

• More businesses connected

• Business 2 Government (B2G) – 80,000 messages per day (MPD)

• Government 2 Business (G2B) –40,000 messages per day (MPD)

Page 11: Chains and processes to facilitate transparency between ... · data center • Framework for automatic startup of environments INBOUND DC1 DC2 HTTP SRV1 HTTP SRV2 HTTP SRV3 HTTP SRV4

Why did we select TIBCO?

• Onboarding experience• Our team actually enjoys working with and

supporting connecting parties

• Support of Active-Active maintenance• This infrastructure and setup is being used as a

blueprint for other government deployments

• Built-in monitoring of connection points• At a technical and functional level, made our life

easier.

Page 12: Chains and processes to facilitate transparency between ... · data center • Framework for automatic startup of environments INBOUND DC1 DC2 HTTP SRV1 HTTP SRV2 HTTP SRV3 HTTP SRV4

What TIBCO products do we use?

TIBCO BW & BC

• Government transaction gateway for chain processing

TIBCO BW, RV, EMS

• Integration and scalability

Page 13: Chains and processes to facilitate transparency between ... · data center • Framework for automatic startup of environments INBOUND DC1 DC2 HTTP SRV1 HTTP SRV2 HTTP SRV3 HTTP SRV4

How do we use our TIBCO products?

SOAPSOAP

TESTING STUB

ESB ROUTERPOSTFIX

MTAPOSTFIX

Adapter

SMTP-MTA

SMTP Service

Generic Service

(e.g. WUS)

SMTP

• 10K bus messages per minute• 10 TIBCO nodes (BW, RV, EMS)• 30% burst

• No issues at burst• No issue with sustaining burst

POSTFIX

MSA

SMTPPOP3

TERMINOLOGY• MSA – Mail Submission

Agent for mailclient to SMTP server

• MTA – Mail Transmission Agent for machine to machine SMTP traffic

• POSTFIX – Mail Server• WUS – WSDL, UDDI,

SOAP

TECHNICAL CHALLENGES:• Timelines• Burst traffic• 0 down time, 0 loss of

messages, 15s guaranteed delivery

Page 14: Chains and processes to facilitate transparency between ... · data center • Framework for automatic startup of environments INBOUND DC1 DC2 HTTP SRV1 HTTP SRV2 HTTP SRV3 HTTP SRV4

What success looks like Mar 2016 Business

• Platform migration as-is

• Virtually no impact on businesses

• Customs Declarations

INBOUND

DC1 DC2

HTTPSRV1

HTTPSRV2

HTTPSRV3

HTTPSRV4

DB 1 DB 2 DB 3 DB 4

APP SRV2

APP SRV1

APP SRV3

APP SRV5

APP SRV4

APP SRV6

Technical

• Seamless transition from previous system

• Support for blue-green maintenance

• INBOUND fully load balanced and fault tolerant (combination of BC interior, BC exterior, MFT)

• NFS tuned and developed in datacenter to support I/O requirements

Page 15: Chains and processes to facilitate transparency between ... · data center • Framework for automatic startup of environments INBOUND DC1 DC2 HTTP SRV1 HTTP SRV2 HTTP SRV3 HTTP SRV4

What success looks like Sep 2016 Business

• 3 Port Hubs

• Customs, Border Control, SafeSeaNet

• OTP starts transition to Single Window

• B2G – 200 MPD

• G2B – 100 MPD

Technical

• Enhanced monitoring

• Technical

• Functional

• E2E

• Performance tuning based on this monitored data

Go to cool animation …

Page 16: Chains and processes to facilitate transparency between ... · data center • Framework for automatic startup of environments INBOUND DC1 DC2 HTTP SRV1 HTTP SRV2 HTTP SRV3 HTTP SRV4

Enhanced monitoring

Single Window

Customs

Immigrations

1A

1B

2A

2B

3A

3B

E2E

Page 17: Chains and processes to facilitate transparency between ... · data center • Framework for automatic startup of environments INBOUND DC1 DC2 HTTP SRV1 HTTP SRV2 HTTP SRV3 HTTP SRV4

Enhanced monitoring

Single Window

Customs

Immigrations

1A

1B

2A

2B

3A

3B

FunctionalTimingsRepliesTracking

DiskCPURAM

Network

Technical

Page 18: Chains and processes to facilitate transparency between ... · data center • Framework for automatic startup of environments INBOUND DC1 DC2 HTTP SRV1 HTTP SRV2 HTTP SRV3 HTTP SRV4

What success looks like Jun 2017 Business

• Air traffic and cargo messages

• Send and receive in EDIFACT

• B2G – 7,000 MPD

• G2B – 5,000 MPD

Technical

• Automatic databases failover in one data center

• Double management LAN from second data center

• Framework for automatic startup of environments

INBOUND

DC1 DC2

HTTPSRV1

HTTPSRV2

HTTPSRV3

HTTPSRV4

DB 1 DB 2 DB 3 DB 4

APP SRV2

APP SRV1

APP SRV3

APP SRV5

APP SRV4

APP SRV6

DB 2

Page 19: Chains and processes to facilitate transparency between ... · data center • Framework for automatic startup of environments INBOUND DC1 DC2 HTTP SRV1 HTTP SRV2 HTTP SRV3 HTTP SRV4

What success looks like Jun 2017 Business

• Air traffic and cargo messages

• Send and receive in EDIFACT

• B2G – 7,000 MPD

• G2B – 5,000 MPD

Technical

• Automatic databases failover in one data center

• Double management LAN from second data center

• Framework for automatic startup of environments

INBOUND

DC1 DC2

HTTPSRV1

HTTPSRV2

HTTPSRV3

HTTPSRV4

DB 1 DB 2 DB 3 DB 4

APP SRV2

APP SRV1

APP SRV3

APP SRV5

APP SRV4

APP SRV6MG

T SR

V1

DB 2 DB 3 DB 4

Page 20: Chains and processes to facilitate transparency between ... · data center • Framework for automatic startup of environments INBOUND DC1 DC2 HTTP SRV1 HTTP SRV2 HTTP SRV3 HTTP SRV4

What success looks like Jun 2017 Business

• Air traffic and cargo messages

• Send and receive in EDIFACT

• B2G – 7,000 MPD

• G2B – 5,000 MPD

Technical

• Automatic databases failover in one data center

• Double management LAN from second data center

• Framework for automatic startup of environments

INBOUND

DC1 DC2

HTTPSRV1

HTTPSRV2

HTTPSRV3

HTTPSRV4

DB 1 DB 2 DB 3 DB 4

APP SRV2

APP SRV1

APP SRV3

APP SRV5

APP SRV4

APP SRV6MG

T SR

V1

MG

T SR

V2

Page 21: Chains and processes to facilitate transparency between ... · data center • Framework for automatic startup of environments INBOUND DC1 DC2 HTTP SRV1 HTTP SRV2 HTTP SRV3 HTTP SRV4

Lessons LearnedData synchronization is a problem

• DB data synchronization and latency (amount of data, pipe saturation, errors, etc)

Infrastructure fails

• Hardware fails, networks go down, KPIs not met, Hacks and attacks

Actively put in monitoring on day 1

• Don’t assume out of the box monitoring will meet your needs. Functional (individual component/service), Technical (middleware down) and E2E chain (message flow) need to be viewed in a consolidated place.

Equal partners, conflicting interests

• How to build trust and confidence

Page 22: Chains and processes to facilitate transparency between ... · data center • Framework for automatic startup of environments INBOUND DC1 DC2 HTTP SRV1 HTTP SRV2 HTTP SRV3 HTTP SRV4

What success looks like next year?Tackling BREXIT

• 35,000 companies affected:

• More connected parties

• Message volume growth:

• B2G – 120, 000 MPD

• G2B – 60, 000 MPD

One Single Window to rule them all

• Interconnecting national Single Windows

• Additional: Tracking Cargo, Modes of transport and sharing Documentation

EU Single Window

Page 23: Chains and processes to facilitate transparency between ... · data center • Framework for automatic startup of environments INBOUND DC1 DC2 HTTP SRV1 HTTP SRV2 HTTP SRV3 HTTP SRV4

What else do we do with TIBCO?Dutch Tax Declarations

• For Companies and Citizens

• Standard Business Reporting (SBR), Extensible Business Reporting Language (XBRL)

E-Government/GLOBE

• National platform for all communications from Government to Citizen (replacing all paper)

FinTech

• Certified SWIFT Service Bureau, PSD2

• Government transaction gateway for national financial transactions

Page 24: Chains and processes to facilitate transparency between ... · data center • Framework for automatic startup of environments INBOUND DC1 DC2 HTTP SRV1 HTTP SRV2 HTTP SRV3 HTTP SRV4

What’s next?Improve our architecture

• APACHE kafka (as part of SMACK stack)

• Autoscaling

• Hyperledger

Hackathons

• Identities on Blockchain

• Fraud detection/universal track-and-trace

More industries, more …:

• Health and Safety

• Statistics Office

• Housing Authority

• Financial SWIFT transactions

• Personal Data Management (GDPR)

Page 25: Chains and processes to facilitate transparency between ... · data center • Framework for automatic startup of environments INBOUND DC1 DC2 HTTP SRV1 HTTP SRV2 HTTP SRV3 HTTP SRV4

Questions…• EBPI - https://www.ebpi.nl/

• Hyper42 - https://www.hyper42.eu/

• Blockchaingers Hack-a-thon - https://blockchaingers.org/teams-2018/hyper42

• Dutch Customs Single Window -https://www.belastingdienst.nl/wps/wcm/connect/bldcontenten/belastingdienst/customs/reference_books_and_other_information/single-window/

• EBPI’s news on the launch of Single Window - https://www.ebpi.nl/over-ons/single-window/