32
1 | WWW.BENTLEY.COM | © 2016 Bentley Systems, Incorporated © 2016 Bentley Systems, Incorporated Scaling Out your ProjectWise System Marty Nickel, Senior Systems Architect Project Delivery, Americas

DWDEDVH 1HWZRUNV /RDG %DODQFLQJ &DFKLQJ 6HUYHUV …files.midamericacadd.org/2017/Presentations/MACCC... · _ ::: %(17/(< &20 _ %hqwoh\ 6\vwhpv ,qfrusrudwhg,qglfdwlrqv ri d 6orz 'dwdedvh

  • Upload
    others

  • View
    2

  • Download
    0

Embed Size (px)

Citation preview

Page 1: DWDEDVH 1HWZRUNV /RDG %DODQFLQJ &DFKLQJ 6HUYHUV …files.midamericacadd.org/2017/Presentations/MACCC... · _ ::: %(17/(< &20 _ %hqwoh\ 6\vwhpv ,qfrusrudwhg,qglfdwlrqv ri d 6orz 'dwdedvh

1 | WWW.BENTLEY.COM | © 2016 Bentley Systems, Incorporated © 2016 Bentley Systems, Incorporated

Scaling Out your ProjectWise System

Marty Nickel, Senior Systems ArchitectProject Delivery, Americas

Page 2: DWDEDVH 1HWZRUNV /RDG %DODQFLQJ &DFKLQJ 6HUYHUV …files.midamericacadd.org/2017/Presentations/MACCC... · _ ::: %(17/(< &20 _ %hqwoh\ 6\vwhpv ,qfrusrudwhg,qglfdwlrqv ri d 6orz 'dwdedvh

2 | WWW.BENTLEY.COM | © 2016 Bentley Systems, Incorporated

Marty Nickel, Senior Systems ArchitectProject Delivery, Americas

Page 3: DWDEDVH 1HWZRUNV /RDG %DODQFLQJ &DFKLQJ 6HUYHUV …files.midamericacadd.org/2017/Presentations/MACCC... · _ ::: %(17/(< &20 _ %hqwoh\ 6\vwhpv ,qfrusrudwhg,qglfdwlrqv ri d 6orz 'dwdedvh

3 | WWW.BENTLEY.COM | © 2016 Bentley Systems, Incorporated

Agenda

Database

Networks

Load Balancing

Caching Servers

Archiving

Automation of Tasks

Backup/Archive

Page 4: DWDEDVH 1HWZRUNV /RDG %DODQFLQJ &DFKLQJ 6HUYHUV …files.midamericacadd.org/2017/Presentations/MACCC... · _ ::: %(17/(< &20 _ %hqwoh\ 6\vwhpv ,qfrusrudwhg,qglfdwlrqv ri d 6orz 'dwdedvh

4 | WWW.BENTLEY.COM | © 2016 Bentley Systems, Incorporated © 2016 Bentley Systems, Incorporated

Database Database Database

Page 5: DWDEDVH 1HWZRUNV /RDG %DODQFLQJ &DFKLQJ 6HUYHUV …files.midamericacadd.org/2017/Presentations/MACCC... · _ ::: %(17/(< &20 _ %hqwoh\ 6\vwhpv ,qfrusrudwhg,qglfdwlrqv ri d 6orz 'dwdedvh

5 | WWW.BENTLEY.COM | © 2016 Bentley Systems, Incorporated

Scale your database with your ProjectWise System!!!

Page 6: DWDEDVH 1HWZRUNV /RDG %DODQFLQJ &DFKLQJ 6HUYHUV …files.midamericacadd.org/2017/Presentations/MACCC... · _ ::: %(17/(< &20 _ %hqwoh\ 6\vwhpv ,qfrusrudwhg,qglfdwlrqv ri d 6orz 'dwdedvh

6 | WWW.BENTLEY.COM | © 2016 Bentley Systems, Incorporated

Indications of a Slow Database

Slow folder navigation is the first signErrors in dmskrnl logs:

2014-07-31 10:34:56,089 WARN [0x00000cb4] pwise.database - Statement execution took 8.0496 seconds, exceeds performance threshold of 1.0000 seconds. 'SELECT COUNT (*) FROM dms_nlst where o_sentto = 7122 and o_status = 1'2014-07-31 10:34:56,266 WARN [0x000010d0] pwise.database - Statement execution took 8.0365 seconds, exceeds performance threshold of 1.0000 seconds. 'SELECT COUNT (*) FROM dms_nlst where o_sentto = 5338 and o_status = 1'

2014-07-31 10:35:32,270 WARN [0x00002ce0] pwise.database - Statement execution took 1.6132 seconds, exceeds performance threshold of 1.0000 seconds. 'SELECT COUNT (*) FROM dms_nlst where o_sentto = 521 and o_status = 1'

2014-07-31 10:35:32,399 WARN [0x00002934] pwise.database - Statement execution took 3.8467 seconds, exceeds performance threshold of 1.0000 seconds. 'select o_value from dms_rtv where o_rtvno = ?'

2014-07-31 10:35:33,220 WARN [0x00002a70] pwise.database - Statement execution took 6.3001 seconds, exceeds performance threshold of 1.0000 seconds. 'select o_intval from dms_ucfg where o_userno = ? and o_paramno = ?'

Page 7: DWDEDVH 1HWZRUNV /RDG %DODQFLQJ &DFKLQJ 6HUYHUV …files.midamericacadd.org/2017/Presentations/MACCC... · _ ::: %(17/(< &20 _ %hqwoh\ 6\vwhpv ,qfrusrudwhg,qglfdwlrqv ri d 6orz 'dwdedvh

7 | WWW.BENTLEY.COM | © 2016 Bentley Systems, Incorporated

How can I check to see if my dba is doing his job?

Page 8: DWDEDVH 1HWZRUNV /RDG %DODQFLQJ &DFKLQJ 6HUYHUV …files.midamericacadd.org/2017/Presentations/MACCC... · _ ::: %(17/(< &20 _ %hqwoh\ 6\vwhpv ,qfrusrudwhg,qglfdwlrqv ri d 6orz 'dwdedvh

8 | WWW.BENTLEY.COM | © 2016 Bentley Systems, Incorporated

How do I prove my dba wrong?

Page 9: DWDEDVH 1HWZRUNV /RDG %DODQFLQJ &DFKLQJ 6HUYHUV …files.midamericacadd.org/2017/Presentations/MACCC... · _ ::: %(17/(< &20 _ %hqwoh\ 6\vwhpv ,qfrusrudwhg,qglfdwlrqv ri d 6orz 'dwdedvh

9 | WWW.BENTLEY.COM | © 2016 Bentley Systems, Incorporated

Page 10: DWDEDVH 1HWZRUNV /RDG %DODQFLQJ &DFKLQJ 6HUYHUV …files.midamericacadd.org/2017/Presentations/MACCC... · _ ::: %(17/(< &20 _ %hqwoh\ 6\vwhpv ,qfrusrudwhg,qglfdwlrqv ri d 6orz 'dwdedvh

10 | WWW.BENTLEY.COM | © 2016 Bentley Systems, Incorporated

Page 11: DWDEDVH 1HWZRUNV /RDG %DODQFLQJ &DFKLQJ 6HUYHUV …files.midamericacadd.org/2017/Presentations/MACCC... · _ ::: %(17/(< &20 _ %hqwoh\ 6\vwhpv ,qfrusrudwhg,qglfdwlrqv ri d 6orz 'dwdedvh

11 | WWW.BENTLEY.COM | © 2016 Bentley Systems, Incorporated

Key Points on Databases

Dedicated Database Server if possible

If the database is slow the users will be the first to complain

A powerful database is needed Lots of CPU and RAM Fast Disks

Follow Microsoft/Oracle Best Practices

Updating Statistics and Rebuilding Indexes regularly 1x a week for small firms 3xs a week for medium firms Every day for large firms

Page 12: DWDEDVH 1HWZRUNV /RDG %DODQFLQJ &DFKLQJ 6HUYHUV …files.midamericacadd.org/2017/Presentations/MACCC... · _ ::: %(17/(< &20 _ %hqwoh\ 6\vwhpv ,qfrusrudwhg,qglfdwlrqv ri d 6orz 'dwdedvh

12 | WWW.BENTLEY.COM | © 2016 Bentley Systems, Incorporated © 2016 Bentley Systems, Incorporated

Network

Page 13: DWDEDVH 1HWZRUNV /RDG %DODQFLQJ &DFKLQJ 6HUYHUV …files.midamericacadd.org/2017/Presentations/MACCC... · _ ::: %(17/(< &20 _ %hqwoh\ 6\vwhpv ,qfrusrudwhg,qglfdwlrqv ri d 6orz 'dwdedvh

13 | WWW.BENTLEY.COM | © 2016 Bentley Systems, Incorporated

Latency….

Page 14: DWDEDVH 1HWZRUNV /RDG %DODQFLQJ &DFKLQJ 6HUYHUV …files.midamericacadd.org/2017/Presentations/MACCC... · _ ::: %(17/(< &20 _ %hqwoh\ 6\vwhpv ,qfrusrudwhg,qglfdwlrqv ri d 6orz 'dwdedvh

14 | WWW.BENTLEY.COM | © 2016 Bentley Systems, Incorporated

Bandwidth is like the lanes on a highway

Page 15: DWDEDVH 1HWZRUNV /RDG %DODQFLQJ &DFKLQJ 6HUYHUV …files.midamericacadd.org/2017/Presentations/MACCC... · _ ::: %(17/(< &20 _ %hqwoh\ 6\vwhpv ,qfrusrudwhg,qglfdwlrqv ri d 6orz 'dwdedvh

15 | WWW.BENTLEY.COM | © 2016 Bentley Systems, Incorporated

Page 16: DWDEDVH 1HWZRUNV /RDG %DODQFLQJ &DFKLQJ 6HUYHUV …files.midamericacadd.org/2017/Presentations/MACCC... · _ ::: %(17/(< &20 _ %hqwoh\ 6\vwhpv ,qfrusrudwhg,qglfdwlrqv ri d 6orz 'dwdedvh

16 | WWW.BENTLEY.COM | © 2016 Bentley Systems, Incorporated16 | WWW.BENTLEY.COM | © 2016 Bentley Systems, Incorporated

Key Points on Networks

• ProjectWise will be effected by high latency

– >300ms latency and ProjectWise will suffer greatly

• High Bandwidth + Low Latency = Better ProjectWise Performance

• QOS (Quality of Service) is important for the network traffic

– Determines the priority of the ProjectWise traffic

• The better the connection the better ProjectWise will run.

• Directly connecting to a hosted solution may be better due to internet connectivity

Page 17: DWDEDVH 1HWZRUNV /RDG %DODQFLQJ &DFKLQJ 6HUYHUV …files.midamericacadd.org/2017/Presentations/MACCC... · _ ::: %(17/(< &20 _ %hqwoh\ 6\vwhpv ,qfrusrudwhg,qglfdwlrqv ri d 6orz 'dwdedvh

17 | WWW.BENTLEY.COM | © 2016 Bentley Systems, Incorporated © 2016 Bentley Systems, Incorporated

Load Balancing

Page 18: DWDEDVH 1HWZRUNV /RDG %DODQFLQJ &DFKLQJ 6HUYHUV …files.midamericacadd.org/2017/Presentations/MACCC... · _ ::: %(17/(< &20 _ %hqwoh\ 6\vwhpv ,qfrusrudwhg,qglfdwlrqv ri d 6orz 'dwdedvh

18 | WWW.BENTLEY.COM | © 2016 Bentley Systems, Incorporated

Load Balancing your Integration Servers

Storage on a SAN

Indexing/Thumbnails/File Props

Load Balancer

Indexing/Thumbnails/File Props

Page 19: DWDEDVH 1HWZRUNV /RDG %DODQFLQJ &DFKLQJ 6HUYHUV …files.midamericacadd.org/2017/Presentations/MACCC... · _ ::: %(17/(< &20 _ %hqwoh\ 6\vwhpv ,qfrusrudwhg,qglfdwlrqv ri d 6orz 'dwdedvh

19 | WWW.BENTLEY.COM | © 2016 Bentley Systems, Incorporated

Automated File Processing Load Balancing

Page 20: DWDEDVH 1HWZRUNV /RDG %DODQFLQJ &DFKLQJ 6HUYHUV …files.midamericacadd.org/2017/Presentations/MACCC... · _ ::: %(17/(< &20 _ %hqwoh\ 6\vwhpv ,qfrusrudwhg,qglfdwlrqv ri d 6orz 'dwdedvh

20 | WWW.BENTLEY.COM | © 2016 Bentley Systems, Incorporated

Key Points on Clustering

~500 concurrently connected users per Integration ServerIf over 50% of memory utilization add

another Integration Server Slower access will indicate this

Makes upgrades much easierKeeps your ProjectWise system up all

the timeIf your Indexing/Thumbnails/File

Properties are not keeping up Remember every time a document gets

checked out/in it gets marked for reprocessing

Fastest known processing time is ~251,000 in a 24 hour period!

Page 21: DWDEDVH 1HWZRUNV /RDG %DODQFLQJ &DFKLQJ 6HUYHUV …files.midamericacadd.org/2017/Presentations/MACCC... · _ ::: %(17/(< &20 _ %hqwoh\ 6\vwhpv ,qfrusrudwhg,qglfdwlrqv ri d 6orz 'dwdedvh

21 | WWW.BENTLEY.COM | © 2016 Bentley Systems, Incorporated © 2016 Bentley Systems, Incorporated

Caching Servers

Page 22: DWDEDVH 1HWZRUNV /RDG %DODQFLQJ &DFKLQJ 6HUYHUV …files.midamericacadd.org/2017/Presentations/MACCC... · _ ::: %(17/(< &20 _ %hqwoh\ 6\vwhpv ,qfrusrudwhg,qglfdwlrqv ri d 6orz 'dwdedvh

22 | WWW.BENTLEY.COM | © 2016 Bentley Systems, Incorporated

Caching Server

Servers

London, England

Server

Check In/Out & Update Files

Inactive ProjectWise Connection

DatasourceTransactions

Virginia USACentral Data

Center

Page 23: DWDEDVH 1HWZRUNV /RDG %DODQFLQJ &DFKLQJ 6HUYHUV …files.midamericacadd.org/2017/Presentations/MACCC... · _ ::: %(17/(< &20 _ %hqwoh\ 6\vwhpv ,qfrusrudwhg,qglfdwlrqv ri d 6orz 'dwdedvh

23 | WWW.BENTLEY.COM | © 2016 Bentley Systems, Incorporated

Storage Server at Project Site

Servers

Pune, India

Server

Check In/Out & Update Files

Inactive ProjectWise Connection

DatasourceTransactions

* ProjectWise Design Integration application servers, SQL/Oracle DB’s, publishing servers, distribution servers and web servers can be on-premises, cloud provisioned by Bentley or a hybrid combination of the two deployment options.

Virginia USACentral Data

Center

Page 24: DWDEDVH 1HWZRUNV /RDG %DODQFLQJ &DFKLQJ 6HUYHUV …files.midamericacadd.org/2017/Presentations/MACCC... · _ ::: %(17/(< &20 _ %hqwoh\ 6\vwhpv ,qfrusrudwhg,qglfdwlrqv ri d 6orz 'dwdedvh

24 | WWW.BENTLEY.COM | © 2016 Bentley Systems, Incorporated24 | WWW.BENTLEY.COM | © 2016 Bentley Systems, Incorporated

Key Points on Caching to take to your Users

• If there are more then 5-10 users in an office, add a caching server– The first piece for increased

performance

– Use fetchfiles.exe to prepopulate the cache

• If the connection is slow in a remote office, think about putting a storage area there

Page 25: DWDEDVH 1HWZRUNV /RDG %DODQFLQJ &DFKLQJ 6HUYHUV …files.midamericacadd.org/2017/Presentations/MACCC... · _ ::: %(17/(< &20 _ %hqwoh\ 6\vwhpv ,qfrusrudwhg,qglfdwlrqv ri d 6orz 'dwdedvh

25 | WWW.BENTLEY.COM | © 2016 Bentley Systems, Incorporated © 2016 Bentley Systems, Incorporated

Archiving

Page 26: DWDEDVH 1HWZRUNV /RDG %DODQFLQJ &DFKLQJ 6HUYHUV …files.midamericacadd.org/2017/Presentations/MACCC... · _ ::: %(17/(< &20 _ %hqwoh\ 6\vwhpv ,qfrusrudwhg,qglfdwlrqv ri d 6orz 'dwdedvh

26 | WWW.BENTLEY.COM | © 2016 Bentley Systems, Incorporated

POW POW POWERSHELL!!!

Page 27: DWDEDVH 1HWZRUNV /RDG %DODQFLQJ &DFKLQJ 6HUYHUV …files.midamericacadd.org/2017/Presentations/MACCC... · _ ::: %(17/(< &20 _ %hqwoh\ 6\vwhpv ,qfrusrudwhg,qglfdwlrqv ri d 6orz 'dwdedvh

27 | WWW.BENTLEY.COM | © 2016 Bentley Systems, Incorporated27 | WWW.BENTLEY.COM | © 2016 Bentley Systems, Incorporated

Key Points on Archiving

• Only active work should be in your datasource

– Lean and mean

• Use PowerShell to archive old data– Can go to another datasource or disk

– Can modify the data when archived like no versions, read only, etc

– Able to run through a variety of ways

• Remove old projects that have been over for years

Page 28: DWDEDVH 1HWZRUNV /RDG %DODQFLQJ &DFKLQJ 6HUYHUV …files.midamericacadd.org/2017/Presentations/MACCC... · _ ::: %(17/(< &20 _ %hqwoh\ 6\vwhpv ,qfrusrudwhg,qglfdwlrqv ri d 6orz 'dwdedvh

28 | WWW.BENTLEY.COM | © 2016 Bentley Systems, Incorporated © 2016 Bentley Systems, Incorporated

Backup/Recovery

Page 29: DWDEDVH 1HWZRUNV /RDG %DODQFLQJ &DFKLQJ 6HUYHUV …files.midamericacadd.org/2017/Presentations/MACCC... · _ ::: %(17/(< &20 _ %hqwoh\ 6\vwhpv ,qfrusrudwhg,qglfdwlrqv ri d 6orz 'dwdedvh

29 | WWW.BENTLEY.COM | © 2016 Bentley Systems, Incorporated

Secondary

Mirroring your Environment

Primary

Page 30: DWDEDVH 1HWZRUNV /RDG %DODQFLQJ &DFKLQJ 6HUYHUV …files.midamericacadd.org/2017/Presentations/MACCC... · _ ::: %(17/(< &20 _ %hqwoh\ 6\vwhpv ,qfrusrudwhg,qglfdwlrqv ri d 6orz 'dwdedvh

30 | WWW.BENTLEY.COM | © 2016 Bentley Systems, Incorporated © 2016 Bentley Systems, Incorporated

Automation of Tasks

Page 31: DWDEDVH 1HWZRUNV /RDG %DODQFLQJ &DFKLQJ 6HUYHUV …files.midamericacadd.org/2017/Presentations/MACCC... · _ ::: %(17/(< &20 _ %hqwoh\ 6\vwhpv ,qfrusrudwhg,qglfdwlrqv ri d 6orz 'dwdedvh

31 | WWW.BENTLEY.COM | © 2016 Bentley Systems, Incorporated31 | WWW.BENTLEY.COM | © 2016 Bentley Systems, Incorporated

Key Points on PowerShell

• Primarily meant for ProjectWise Administrators

– Most operations require an admin account

• Automate many administrative tasks– Reports

• Lots of cmdlets– 188

• New-PWInputOutputPerformanceReport

• Attend the SIG and workshops– SIG is 2nd Thursday of every month

• Go to Bentley Communities for help!

Page 32: DWDEDVH 1HWZRUNV /RDG %DODQFLQJ &DFKLQJ 6HUYHUV …files.midamericacadd.org/2017/Presentations/MACCC... · _ ::: %(17/(< &20 _ %hqwoh\ 6\vwhpv ,qfrusrudwhg,qglfdwlrqv ri d 6orz 'dwdedvh

32 | WWW.BENTLEY.COM | © 2016 Bentley Systems, Incorporated