8
ADVANTAGES OF RUNNING AI WORKLOADS ON IBM POWER SYSTEM SERVERS A Whitepaper by GBM

ADVANTAGES OF RUNNING AI WORKLOADS ON IBM POWER … · Achieving ROI means deploying the right-sized solution that meets business needs and is adaptable to changing requirements

  • Upload
    others

  • View
    4

  • Download
    0

Embed Size (px)

Citation preview

Page 1: ADVANTAGES OF RUNNING AI WORKLOADS ON IBM POWER … · Achieving ROI means deploying the right-sized solution that meets business needs and is adaptable to changing requirements

ADVANTAGES OF RUNNING AI WORKLOADS ON IBM POWER SYSTEM SERVERSA Whitepaper by GBM

GBM whitepaper

2

AN EVALUATION OF THE BUSINESS BENEFITS OFFERED BY THE AI-FOCUSED IBM POWER SYSTEM AC922 AND RELATED SERVER PRODUCTSIn the relatively new field of artificial intelligence (AI) enterprises are being inspired to invest by the availability of market-ready AI solutions There is also growing evidence that AI is delivering both ROI and competitive edge for businesses that have adopted it1 But what is the right path to AI success

Choosing the right infrastructure is an essential step Generally speaking AI workloads are GPU-intensive While basic AI models can be tested on standard servers specialized servers with GPU accelerators are required to run enterprise projects at scale2 However there is no need to replace the entire IT infrastructure With the right hardware and solution partner businesses can start with one small AI server and scale as needed

GBM whitepaper

3

PAKISTANrsquoS EVOLVING LANDSCAPEFor enterprises in Pakistan that want to demonstrate technology leadership and innovate valuable new business models and services now is a good moment to invest Pakistanrsquos AI landscape has immense potential AI opportunities are already being seized upon as illustrated by the establishment of Pakistanrsquos National Center of Artificial Intelligence in 20183 and the success of events such as AI Summit 2019 in Karachi4 Interestingly a 2018 Gartner survey of global CIOs found only 4 had deployed AI while around 20 had started or were planning a pilot project5 this reflects the pace of AI innovation in Pakistan to a great extent

IBM LEADS THE GLOBAL AI MARKETMany of the businesses making successful forays into AI are doing so with IBM Power Systems and IBM AI technologies IBM has been the global market share leader for the past three consecutive years according to IDC research6 Its cognitive assistant services the kind that enable customer service innovation such as AI chatbots were ranked as the best available in 20187 IBM has also prioritized AI as the focus of its enterprise hardware architecture including the POWER9 processor which is designed specifically to accelerate AI workloads8 Those technologies include ultra-fast connectivity between the POWER9 processor and attached GPUs enabling AI applications to move massive amounts of data around at unsurpassed speeds

This paper is for enterprises evaluating routes into AI including AI-focused servers such as the IBM Power AC922 System It looks at the unique features of these POWER9 processor-based servers and the performance and business advantages they offer It also stresses the importance of sizing and planning AI infrastructure correctly to achieve maximum ROI

GBM whitepaper

4

READY TO RIDE THE AI WAVEThe advantages of running AI workloads on IBM Power AC922 Systems are visible in the architecture of the servers themselves These are servers made specifically for AI powered by a new-generation processor

POWER9 SUPERHIGHWAYThat processor is IBM POWER9 and it represents an evolutionary shift away from the once-dominant on-chip microprocessor towards what IBM has called an internal lsquoinformation superhighwayrsquo which decouples processing and gives advanced accelerators the bandwidth they need to handle massive data sets8 This lsquosuperhighwayrsquo includes a dedicated IO and processor chip for increased data bandwidth plus ultra-high bandwidth interconnects with accelerators that do much of the heavy lifting in AI workloads

POWER9 provides up to 15x the performance of its predecessor POWER8

FASTEST ACCELERATION BY NVIDIAAI workloads run fastest when accelerated by GPUs This requires the CPU and GPU to work in parallel and they must be able to exchange data with extreme speed and bandwidth to avoid performance bottlenecks In this area POWER9-based servers truly excel thanks to the NVIDIA NVLink interconnect NVLink enables POWER9-based systems to

bull Integrate multiple advanced GPUs (up to 6 NVIDIA Tesla V100 GPUs in Power AC922 servers)

bull Achieve total GPU-GPU bandwidth of 300 GBs 10x more than PCIe Gen3

bull Achieve CPU-GPU bandwidth of 50 - 150 GBs

Workload performance is up to 70 faster than with PCIe Gen3 interconnects in standard servers9 POWER9 also supports the newer PCIe Gen4

GBM whitepaper

5

UP TO 10X PERFORMANCE WITH OPENCAPIGPUs are not the only accelerators useful in AI Field programmable gate arrays (FPGAs) and network interface cards (NICs) are other important components for off-loading processing from the CPU FPGAs are low-power reprogrammable devices that can be customized for multiple AI projects10 NICs are responsible for handling network data packets High-bandwidth connectivity to these components can eliminate bottlenecks

POWER9 is the first processor with on-chip support for OpenCAPI a new and open connectivity standard that delivers up to 150GBs bandwidth between CPU and devices such as FPGAs and NICs OpenCAPI can increase datacenter performance by up to 10 times11

UP TO 10X PERFORMANCE

GBM whitepaper

6

POWER SYSTEM AC922 lsquoTHE MOST POWERFUL TRAINING PLATFORMrsquoIBM has stated that Power System AC922 is engineered to be the most powerful training platform for AI12 While it shares common POWER9 features with other Power System servers it also provides capability to

bull Scale from one server to a supercomputer ndashfor efficiency and ease of AI deployment Power AC922 is the backbone of the Summit and Sierra supercomputers

bull Share RAM across CPUs and GPUs ndash simplifying AI application development

bull Benefit from 56x more bandwidth and 2x more threads ndash compared to x86 alternatives

AI SUCCESS STORIESMany businesses have already put POWER9 systems and specifically Power AC922 servers to work in AI deployments that have delivered business value Achieving ROI means deploying the right-sized solution that meets business needs and is adaptable to changing requirements

FAWRY CHANGING THE WAY PEOPLE BANKLeading Egyptian bank Fawry used AI to understand its customers more deeply and sustain rapid growth It deployed IBM Watson Machine Learning Accelerator on Power AC922 servers featuring POWER9 processors and NVIDIA Tesla V100 NVLink GPUs plus leading open source AI frameworks The solution halved processing times

ldquoIBM Watson Machine Learning Accelerator will give us incredibly high performance required to extract new insights from our datardquo said Haytham Abbas of Fawry13

CEDAT 85 SOPHISTICATED NEURAL NETWORKSTurning nuanced speech into analyzable text is a huge technical challenge IBM AI infrastructure helped Cedat 85 do it more than 2x faster with no loss of accuracy The company also gained greater project scope which led to revenue growth and new innovationldquoUsing IBM Power Systems AC922 servers we can train neural network models 24 times fasterrdquo said Enrico Giannotti of Cedat 8514

OCB LEADING-EDGE CANCER DIAGNOSTICSOxford Cancer Biomarkers used IBM PowerAI Vision to identify diagnostic lsquobiomarkersrsquo in tumor to better predict outcomes for cancer patients Deployed on Power AC922 servers the solution reduced AI modeling time from months to hours and helped take the technique globalldquoAs soon as we saw IBM PowerAI in action we knew that it was going to have a seismic effectrdquo said David Browning of OCB15

GBM whitepaper

7

CONCLUSIONArtificial intelligence is a different kind of computing which requires a different kind of server Because AI applications depend on the CPU working in parallel with accelerators such as GPUs and FPGAs servers must have the ability to transfer data internally with extreme bandwidth to avoid bottlenecks IBM has architected the POWER9 processor to excel in these areas and has configured the Power System AC922 server for AI deployments The advantages are clear industry-leading bandwidth and performance plus AI business value proven by a range of success stories Power AC922 can also start small and scale as AI needs grow

Every enterprisersquos needs are different GBM Pakistan has the expertise to support businesses planning their first AI projects with tailored solution design and consultation To learn more please contact the GBM Pakistan team at pakistangbmmecom

GBM whitepaper

7

1 Gartner (2018)Gartner Says Global Artificial Intelligence Business Value to Reach $12 Trillion in 2018 Available from httpswwwgartnercomennewsroompress-releases2018-04-25-gartner-says-global-artificial-intelligence-business-value-to-reach-1-point-2-trillion-in-2018 [Accessed 8 Nov 2019]

2 IDG (2017) AI-defined infrastructure be prepared for a new generation of business models and applications Available from httpswwwciocomarticle3234656ai-defined-infrastructure-be-prepared-for-a-new-generation-of-business-models-and-applicationshtml [Accessed 8 Nov 2019]

3 NUST (2018)National Center of Artificial Intelligence (NCAI) Inaugurated at NUST Available from httpwwwnustedupkNewsPagesNational-Center-of-Artificial-Intelligence-(NCAl)-inaugurated-at-NUSTaspx [Accessed 8 Nov 2019]

4 AI Summit 2019 (2019) AI Summit Pakistan 2019 Conference and Expo Available at httpswwwaisummitio [Accessed 11 Nov 2019]

5 Gartner (2018) Build the AI Business Case Available at httpsemtempgcomcloudngwglobalassetseninformation-technologydocumentstrendsai-business-case-ebookpdf [Accessed 11 Nov 2019]

6 IBM (2019) IBM Ranked the Worldwide Market Share Leader in Artificial Intelligence for Third Consecutive Year Available from httpsnewsroomibmcom2019-10-09-IBM-Ranked-the-Worldwide-Market-Share-Leader-in-Artificial-Intelligence-for-Third-Consecutive-Year [Accessed 11 Nov 2019]

7 HFS Research (2018) HFS Top 10 Cognitive Assistant Service Providers Available from httpswwwibmcomdownloadscas4EXZGZ7Y [Accessed 11 Nov 2019]

8 IBM (2017) With IBM POWER9 wersquore all riding the AI wave Available from httpswwwibmcomblogssystemswith-ibm-power9-were-ahead-of-the-ai-wave [Accessed 11 Nov 2019]

9 NVIDIA (2019) NVLINK AND NVSWITCH Available from httpswwwnvidiacomen-usdata-centernvlink[Accessed 12 Nov 2019]

10 Forbes (2018) Management AI GPU and FPGA Why They Are Important for Artificial Intelligence Available from httpswwwforbescomsitesdavidteich20180615management-ai-gpu-and-fpga-why-they-are-important-for-artificial-intelligence137c1c407159 [Accessed 12 Nov 2019]

11 OpenCAPI (2016) Tech Leaders Unite to Enable New Cloud Datacenter Server Designs Available from httpsopencapiorg201610tech-leaders-unite-to-enable-new-cloud-datacenter-server-designs-for-big-data-machine-learning-analytics-and-other-emerging-workloads [Accessed 12 Nov 2019]

12 IBM (2019) IBM Power System AC922 Available from httpswwwibmcomuk-enmarketplacepower-systems-ac922 [Accessed 12 Nov 2019]

13 IBM (2019) Fawry (case study) Available from httpswwwibmcomcase-studiesfawry-systems-hardware-flashsystem-power-systems [Accessed 11 Nov 2019]

14 IBM (2019) Cedat 85 (case study) Available from httpswwwibmcomcase-studiescedat-85-systems-hardware-neural-networks [Accessed 9 Dec 2019]

15 IBM (2019) Oxford Cancer Biomarkers (case study) Available from httpswwwibmcomcase-studiesoxford-cancer-biomarkers-systems-hardware-ai-diagnostics [Accessed 11 Nov 2019]

Page 2: ADVANTAGES OF RUNNING AI WORKLOADS ON IBM POWER … · Achieving ROI means deploying the right-sized solution that meets business needs and is adaptable to changing requirements

GBM whitepaper

2

AN EVALUATION OF THE BUSINESS BENEFITS OFFERED BY THE AI-FOCUSED IBM POWER SYSTEM AC922 AND RELATED SERVER PRODUCTSIn the relatively new field of artificial intelligence (AI) enterprises are being inspired to invest by the availability of market-ready AI solutions There is also growing evidence that AI is delivering both ROI and competitive edge for businesses that have adopted it1 But what is the right path to AI success

Choosing the right infrastructure is an essential step Generally speaking AI workloads are GPU-intensive While basic AI models can be tested on standard servers specialized servers with GPU accelerators are required to run enterprise projects at scale2 However there is no need to replace the entire IT infrastructure With the right hardware and solution partner businesses can start with one small AI server and scale as needed

GBM whitepaper

3

PAKISTANrsquoS EVOLVING LANDSCAPEFor enterprises in Pakistan that want to demonstrate technology leadership and innovate valuable new business models and services now is a good moment to invest Pakistanrsquos AI landscape has immense potential AI opportunities are already being seized upon as illustrated by the establishment of Pakistanrsquos National Center of Artificial Intelligence in 20183 and the success of events such as AI Summit 2019 in Karachi4 Interestingly a 2018 Gartner survey of global CIOs found only 4 had deployed AI while around 20 had started or were planning a pilot project5 this reflects the pace of AI innovation in Pakistan to a great extent

IBM LEADS THE GLOBAL AI MARKETMany of the businesses making successful forays into AI are doing so with IBM Power Systems and IBM AI technologies IBM has been the global market share leader for the past three consecutive years according to IDC research6 Its cognitive assistant services the kind that enable customer service innovation such as AI chatbots were ranked as the best available in 20187 IBM has also prioritized AI as the focus of its enterprise hardware architecture including the POWER9 processor which is designed specifically to accelerate AI workloads8 Those technologies include ultra-fast connectivity between the POWER9 processor and attached GPUs enabling AI applications to move massive amounts of data around at unsurpassed speeds

This paper is for enterprises evaluating routes into AI including AI-focused servers such as the IBM Power AC922 System It looks at the unique features of these POWER9 processor-based servers and the performance and business advantages they offer It also stresses the importance of sizing and planning AI infrastructure correctly to achieve maximum ROI

GBM whitepaper

4

READY TO RIDE THE AI WAVEThe advantages of running AI workloads on IBM Power AC922 Systems are visible in the architecture of the servers themselves These are servers made specifically for AI powered by a new-generation processor

POWER9 SUPERHIGHWAYThat processor is IBM POWER9 and it represents an evolutionary shift away from the once-dominant on-chip microprocessor towards what IBM has called an internal lsquoinformation superhighwayrsquo which decouples processing and gives advanced accelerators the bandwidth they need to handle massive data sets8 This lsquosuperhighwayrsquo includes a dedicated IO and processor chip for increased data bandwidth plus ultra-high bandwidth interconnects with accelerators that do much of the heavy lifting in AI workloads

POWER9 provides up to 15x the performance of its predecessor POWER8

FASTEST ACCELERATION BY NVIDIAAI workloads run fastest when accelerated by GPUs This requires the CPU and GPU to work in parallel and they must be able to exchange data with extreme speed and bandwidth to avoid performance bottlenecks In this area POWER9-based servers truly excel thanks to the NVIDIA NVLink interconnect NVLink enables POWER9-based systems to

bull Integrate multiple advanced GPUs (up to 6 NVIDIA Tesla V100 GPUs in Power AC922 servers)

bull Achieve total GPU-GPU bandwidth of 300 GBs 10x more than PCIe Gen3

bull Achieve CPU-GPU bandwidth of 50 - 150 GBs

Workload performance is up to 70 faster than with PCIe Gen3 interconnects in standard servers9 POWER9 also supports the newer PCIe Gen4

GBM whitepaper

5

UP TO 10X PERFORMANCE WITH OPENCAPIGPUs are not the only accelerators useful in AI Field programmable gate arrays (FPGAs) and network interface cards (NICs) are other important components for off-loading processing from the CPU FPGAs are low-power reprogrammable devices that can be customized for multiple AI projects10 NICs are responsible for handling network data packets High-bandwidth connectivity to these components can eliminate bottlenecks

POWER9 is the first processor with on-chip support for OpenCAPI a new and open connectivity standard that delivers up to 150GBs bandwidth between CPU and devices such as FPGAs and NICs OpenCAPI can increase datacenter performance by up to 10 times11

UP TO 10X PERFORMANCE

GBM whitepaper

6

POWER SYSTEM AC922 lsquoTHE MOST POWERFUL TRAINING PLATFORMrsquoIBM has stated that Power System AC922 is engineered to be the most powerful training platform for AI12 While it shares common POWER9 features with other Power System servers it also provides capability to

bull Scale from one server to a supercomputer ndashfor efficiency and ease of AI deployment Power AC922 is the backbone of the Summit and Sierra supercomputers

bull Share RAM across CPUs and GPUs ndash simplifying AI application development

bull Benefit from 56x more bandwidth and 2x more threads ndash compared to x86 alternatives

AI SUCCESS STORIESMany businesses have already put POWER9 systems and specifically Power AC922 servers to work in AI deployments that have delivered business value Achieving ROI means deploying the right-sized solution that meets business needs and is adaptable to changing requirements

FAWRY CHANGING THE WAY PEOPLE BANKLeading Egyptian bank Fawry used AI to understand its customers more deeply and sustain rapid growth It deployed IBM Watson Machine Learning Accelerator on Power AC922 servers featuring POWER9 processors and NVIDIA Tesla V100 NVLink GPUs plus leading open source AI frameworks The solution halved processing times

ldquoIBM Watson Machine Learning Accelerator will give us incredibly high performance required to extract new insights from our datardquo said Haytham Abbas of Fawry13

CEDAT 85 SOPHISTICATED NEURAL NETWORKSTurning nuanced speech into analyzable text is a huge technical challenge IBM AI infrastructure helped Cedat 85 do it more than 2x faster with no loss of accuracy The company also gained greater project scope which led to revenue growth and new innovationldquoUsing IBM Power Systems AC922 servers we can train neural network models 24 times fasterrdquo said Enrico Giannotti of Cedat 8514

OCB LEADING-EDGE CANCER DIAGNOSTICSOxford Cancer Biomarkers used IBM PowerAI Vision to identify diagnostic lsquobiomarkersrsquo in tumor to better predict outcomes for cancer patients Deployed on Power AC922 servers the solution reduced AI modeling time from months to hours and helped take the technique globalldquoAs soon as we saw IBM PowerAI in action we knew that it was going to have a seismic effectrdquo said David Browning of OCB15

GBM whitepaper

7

CONCLUSIONArtificial intelligence is a different kind of computing which requires a different kind of server Because AI applications depend on the CPU working in parallel with accelerators such as GPUs and FPGAs servers must have the ability to transfer data internally with extreme bandwidth to avoid bottlenecks IBM has architected the POWER9 processor to excel in these areas and has configured the Power System AC922 server for AI deployments The advantages are clear industry-leading bandwidth and performance plus AI business value proven by a range of success stories Power AC922 can also start small and scale as AI needs grow

Every enterprisersquos needs are different GBM Pakistan has the expertise to support businesses planning their first AI projects with tailored solution design and consultation To learn more please contact the GBM Pakistan team at pakistangbmmecom

GBM whitepaper

7

1 Gartner (2018)Gartner Says Global Artificial Intelligence Business Value to Reach $12 Trillion in 2018 Available from httpswwwgartnercomennewsroompress-releases2018-04-25-gartner-says-global-artificial-intelligence-business-value-to-reach-1-point-2-trillion-in-2018 [Accessed 8 Nov 2019]

2 IDG (2017) AI-defined infrastructure be prepared for a new generation of business models and applications Available from httpswwwciocomarticle3234656ai-defined-infrastructure-be-prepared-for-a-new-generation-of-business-models-and-applicationshtml [Accessed 8 Nov 2019]

3 NUST (2018)National Center of Artificial Intelligence (NCAI) Inaugurated at NUST Available from httpwwwnustedupkNewsPagesNational-Center-of-Artificial-Intelligence-(NCAl)-inaugurated-at-NUSTaspx [Accessed 8 Nov 2019]

4 AI Summit 2019 (2019) AI Summit Pakistan 2019 Conference and Expo Available at httpswwwaisummitio [Accessed 11 Nov 2019]

5 Gartner (2018) Build the AI Business Case Available at httpsemtempgcomcloudngwglobalassetseninformation-technologydocumentstrendsai-business-case-ebookpdf [Accessed 11 Nov 2019]

6 IBM (2019) IBM Ranked the Worldwide Market Share Leader in Artificial Intelligence for Third Consecutive Year Available from httpsnewsroomibmcom2019-10-09-IBM-Ranked-the-Worldwide-Market-Share-Leader-in-Artificial-Intelligence-for-Third-Consecutive-Year [Accessed 11 Nov 2019]

7 HFS Research (2018) HFS Top 10 Cognitive Assistant Service Providers Available from httpswwwibmcomdownloadscas4EXZGZ7Y [Accessed 11 Nov 2019]

8 IBM (2017) With IBM POWER9 wersquore all riding the AI wave Available from httpswwwibmcomblogssystemswith-ibm-power9-were-ahead-of-the-ai-wave [Accessed 11 Nov 2019]

9 NVIDIA (2019) NVLINK AND NVSWITCH Available from httpswwwnvidiacomen-usdata-centernvlink[Accessed 12 Nov 2019]

10 Forbes (2018) Management AI GPU and FPGA Why They Are Important for Artificial Intelligence Available from httpswwwforbescomsitesdavidteich20180615management-ai-gpu-and-fpga-why-they-are-important-for-artificial-intelligence137c1c407159 [Accessed 12 Nov 2019]

11 OpenCAPI (2016) Tech Leaders Unite to Enable New Cloud Datacenter Server Designs Available from httpsopencapiorg201610tech-leaders-unite-to-enable-new-cloud-datacenter-server-designs-for-big-data-machine-learning-analytics-and-other-emerging-workloads [Accessed 12 Nov 2019]

12 IBM (2019) IBM Power System AC922 Available from httpswwwibmcomuk-enmarketplacepower-systems-ac922 [Accessed 12 Nov 2019]

13 IBM (2019) Fawry (case study) Available from httpswwwibmcomcase-studiesfawry-systems-hardware-flashsystem-power-systems [Accessed 11 Nov 2019]

14 IBM (2019) Cedat 85 (case study) Available from httpswwwibmcomcase-studiescedat-85-systems-hardware-neural-networks [Accessed 9 Dec 2019]

15 IBM (2019) Oxford Cancer Biomarkers (case study) Available from httpswwwibmcomcase-studiesoxford-cancer-biomarkers-systems-hardware-ai-diagnostics [Accessed 11 Nov 2019]

Page 3: ADVANTAGES OF RUNNING AI WORKLOADS ON IBM POWER … · Achieving ROI means deploying the right-sized solution that meets business needs and is adaptable to changing requirements

GBM whitepaper

3

PAKISTANrsquoS EVOLVING LANDSCAPEFor enterprises in Pakistan that want to demonstrate technology leadership and innovate valuable new business models and services now is a good moment to invest Pakistanrsquos AI landscape has immense potential AI opportunities are already being seized upon as illustrated by the establishment of Pakistanrsquos National Center of Artificial Intelligence in 20183 and the success of events such as AI Summit 2019 in Karachi4 Interestingly a 2018 Gartner survey of global CIOs found only 4 had deployed AI while around 20 had started or were planning a pilot project5 this reflects the pace of AI innovation in Pakistan to a great extent

IBM LEADS THE GLOBAL AI MARKETMany of the businesses making successful forays into AI are doing so with IBM Power Systems and IBM AI technologies IBM has been the global market share leader for the past three consecutive years according to IDC research6 Its cognitive assistant services the kind that enable customer service innovation such as AI chatbots were ranked as the best available in 20187 IBM has also prioritized AI as the focus of its enterprise hardware architecture including the POWER9 processor which is designed specifically to accelerate AI workloads8 Those technologies include ultra-fast connectivity between the POWER9 processor and attached GPUs enabling AI applications to move massive amounts of data around at unsurpassed speeds

This paper is for enterprises evaluating routes into AI including AI-focused servers such as the IBM Power AC922 System It looks at the unique features of these POWER9 processor-based servers and the performance and business advantages they offer It also stresses the importance of sizing and planning AI infrastructure correctly to achieve maximum ROI

GBM whitepaper

4

READY TO RIDE THE AI WAVEThe advantages of running AI workloads on IBM Power AC922 Systems are visible in the architecture of the servers themselves These are servers made specifically for AI powered by a new-generation processor

POWER9 SUPERHIGHWAYThat processor is IBM POWER9 and it represents an evolutionary shift away from the once-dominant on-chip microprocessor towards what IBM has called an internal lsquoinformation superhighwayrsquo which decouples processing and gives advanced accelerators the bandwidth they need to handle massive data sets8 This lsquosuperhighwayrsquo includes a dedicated IO and processor chip for increased data bandwidth plus ultra-high bandwidth interconnects with accelerators that do much of the heavy lifting in AI workloads

POWER9 provides up to 15x the performance of its predecessor POWER8

FASTEST ACCELERATION BY NVIDIAAI workloads run fastest when accelerated by GPUs This requires the CPU and GPU to work in parallel and they must be able to exchange data with extreme speed and bandwidth to avoid performance bottlenecks In this area POWER9-based servers truly excel thanks to the NVIDIA NVLink interconnect NVLink enables POWER9-based systems to

bull Integrate multiple advanced GPUs (up to 6 NVIDIA Tesla V100 GPUs in Power AC922 servers)

bull Achieve total GPU-GPU bandwidth of 300 GBs 10x more than PCIe Gen3

bull Achieve CPU-GPU bandwidth of 50 - 150 GBs

Workload performance is up to 70 faster than with PCIe Gen3 interconnects in standard servers9 POWER9 also supports the newer PCIe Gen4

GBM whitepaper

5

UP TO 10X PERFORMANCE WITH OPENCAPIGPUs are not the only accelerators useful in AI Field programmable gate arrays (FPGAs) and network interface cards (NICs) are other important components for off-loading processing from the CPU FPGAs are low-power reprogrammable devices that can be customized for multiple AI projects10 NICs are responsible for handling network data packets High-bandwidth connectivity to these components can eliminate bottlenecks

POWER9 is the first processor with on-chip support for OpenCAPI a new and open connectivity standard that delivers up to 150GBs bandwidth between CPU and devices such as FPGAs and NICs OpenCAPI can increase datacenter performance by up to 10 times11

UP TO 10X PERFORMANCE

GBM whitepaper

6

POWER SYSTEM AC922 lsquoTHE MOST POWERFUL TRAINING PLATFORMrsquoIBM has stated that Power System AC922 is engineered to be the most powerful training platform for AI12 While it shares common POWER9 features with other Power System servers it also provides capability to

bull Scale from one server to a supercomputer ndashfor efficiency and ease of AI deployment Power AC922 is the backbone of the Summit and Sierra supercomputers

bull Share RAM across CPUs and GPUs ndash simplifying AI application development

bull Benefit from 56x more bandwidth and 2x more threads ndash compared to x86 alternatives

AI SUCCESS STORIESMany businesses have already put POWER9 systems and specifically Power AC922 servers to work in AI deployments that have delivered business value Achieving ROI means deploying the right-sized solution that meets business needs and is adaptable to changing requirements

FAWRY CHANGING THE WAY PEOPLE BANKLeading Egyptian bank Fawry used AI to understand its customers more deeply and sustain rapid growth It deployed IBM Watson Machine Learning Accelerator on Power AC922 servers featuring POWER9 processors and NVIDIA Tesla V100 NVLink GPUs plus leading open source AI frameworks The solution halved processing times

ldquoIBM Watson Machine Learning Accelerator will give us incredibly high performance required to extract new insights from our datardquo said Haytham Abbas of Fawry13

CEDAT 85 SOPHISTICATED NEURAL NETWORKSTurning nuanced speech into analyzable text is a huge technical challenge IBM AI infrastructure helped Cedat 85 do it more than 2x faster with no loss of accuracy The company also gained greater project scope which led to revenue growth and new innovationldquoUsing IBM Power Systems AC922 servers we can train neural network models 24 times fasterrdquo said Enrico Giannotti of Cedat 8514

OCB LEADING-EDGE CANCER DIAGNOSTICSOxford Cancer Biomarkers used IBM PowerAI Vision to identify diagnostic lsquobiomarkersrsquo in tumor to better predict outcomes for cancer patients Deployed on Power AC922 servers the solution reduced AI modeling time from months to hours and helped take the technique globalldquoAs soon as we saw IBM PowerAI in action we knew that it was going to have a seismic effectrdquo said David Browning of OCB15

GBM whitepaper

7

CONCLUSIONArtificial intelligence is a different kind of computing which requires a different kind of server Because AI applications depend on the CPU working in parallel with accelerators such as GPUs and FPGAs servers must have the ability to transfer data internally with extreme bandwidth to avoid bottlenecks IBM has architected the POWER9 processor to excel in these areas and has configured the Power System AC922 server for AI deployments The advantages are clear industry-leading bandwidth and performance plus AI business value proven by a range of success stories Power AC922 can also start small and scale as AI needs grow

Every enterprisersquos needs are different GBM Pakistan has the expertise to support businesses planning their first AI projects with tailored solution design and consultation To learn more please contact the GBM Pakistan team at pakistangbmmecom

GBM whitepaper

7

1 Gartner (2018)Gartner Says Global Artificial Intelligence Business Value to Reach $12 Trillion in 2018 Available from httpswwwgartnercomennewsroompress-releases2018-04-25-gartner-says-global-artificial-intelligence-business-value-to-reach-1-point-2-trillion-in-2018 [Accessed 8 Nov 2019]

2 IDG (2017) AI-defined infrastructure be prepared for a new generation of business models and applications Available from httpswwwciocomarticle3234656ai-defined-infrastructure-be-prepared-for-a-new-generation-of-business-models-and-applicationshtml [Accessed 8 Nov 2019]

3 NUST (2018)National Center of Artificial Intelligence (NCAI) Inaugurated at NUST Available from httpwwwnustedupkNewsPagesNational-Center-of-Artificial-Intelligence-(NCAl)-inaugurated-at-NUSTaspx [Accessed 8 Nov 2019]

4 AI Summit 2019 (2019) AI Summit Pakistan 2019 Conference and Expo Available at httpswwwaisummitio [Accessed 11 Nov 2019]

5 Gartner (2018) Build the AI Business Case Available at httpsemtempgcomcloudngwglobalassetseninformation-technologydocumentstrendsai-business-case-ebookpdf [Accessed 11 Nov 2019]

6 IBM (2019) IBM Ranked the Worldwide Market Share Leader in Artificial Intelligence for Third Consecutive Year Available from httpsnewsroomibmcom2019-10-09-IBM-Ranked-the-Worldwide-Market-Share-Leader-in-Artificial-Intelligence-for-Third-Consecutive-Year [Accessed 11 Nov 2019]

7 HFS Research (2018) HFS Top 10 Cognitive Assistant Service Providers Available from httpswwwibmcomdownloadscas4EXZGZ7Y [Accessed 11 Nov 2019]

8 IBM (2017) With IBM POWER9 wersquore all riding the AI wave Available from httpswwwibmcomblogssystemswith-ibm-power9-were-ahead-of-the-ai-wave [Accessed 11 Nov 2019]

9 NVIDIA (2019) NVLINK AND NVSWITCH Available from httpswwwnvidiacomen-usdata-centernvlink[Accessed 12 Nov 2019]

10 Forbes (2018) Management AI GPU and FPGA Why They Are Important for Artificial Intelligence Available from httpswwwforbescomsitesdavidteich20180615management-ai-gpu-and-fpga-why-they-are-important-for-artificial-intelligence137c1c407159 [Accessed 12 Nov 2019]

11 OpenCAPI (2016) Tech Leaders Unite to Enable New Cloud Datacenter Server Designs Available from httpsopencapiorg201610tech-leaders-unite-to-enable-new-cloud-datacenter-server-designs-for-big-data-machine-learning-analytics-and-other-emerging-workloads [Accessed 12 Nov 2019]

12 IBM (2019) IBM Power System AC922 Available from httpswwwibmcomuk-enmarketplacepower-systems-ac922 [Accessed 12 Nov 2019]

13 IBM (2019) Fawry (case study) Available from httpswwwibmcomcase-studiesfawry-systems-hardware-flashsystem-power-systems [Accessed 11 Nov 2019]

14 IBM (2019) Cedat 85 (case study) Available from httpswwwibmcomcase-studiescedat-85-systems-hardware-neural-networks [Accessed 9 Dec 2019]

15 IBM (2019) Oxford Cancer Biomarkers (case study) Available from httpswwwibmcomcase-studiesoxford-cancer-biomarkers-systems-hardware-ai-diagnostics [Accessed 11 Nov 2019]

Page 4: ADVANTAGES OF RUNNING AI WORKLOADS ON IBM POWER … · Achieving ROI means deploying the right-sized solution that meets business needs and is adaptable to changing requirements

GBM whitepaper

4

READY TO RIDE THE AI WAVEThe advantages of running AI workloads on IBM Power AC922 Systems are visible in the architecture of the servers themselves These are servers made specifically for AI powered by a new-generation processor

POWER9 SUPERHIGHWAYThat processor is IBM POWER9 and it represents an evolutionary shift away from the once-dominant on-chip microprocessor towards what IBM has called an internal lsquoinformation superhighwayrsquo which decouples processing and gives advanced accelerators the bandwidth they need to handle massive data sets8 This lsquosuperhighwayrsquo includes a dedicated IO and processor chip for increased data bandwidth plus ultra-high bandwidth interconnects with accelerators that do much of the heavy lifting in AI workloads

POWER9 provides up to 15x the performance of its predecessor POWER8

FASTEST ACCELERATION BY NVIDIAAI workloads run fastest when accelerated by GPUs This requires the CPU and GPU to work in parallel and they must be able to exchange data with extreme speed and bandwidth to avoid performance bottlenecks In this area POWER9-based servers truly excel thanks to the NVIDIA NVLink interconnect NVLink enables POWER9-based systems to

bull Integrate multiple advanced GPUs (up to 6 NVIDIA Tesla V100 GPUs in Power AC922 servers)

bull Achieve total GPU-GPU bandwidth of 300 GBs 10x more than PCIe Gen3

bull Achieve CPU-GPU bandwidth of 50 - 150 GBs

Workload performance is up to 70 faster than with PCIe Gen3 interconnects in standard servers9 POWER9 also supports the newer PCIe Gen4

GBM whitepaper

5

UP TO 10X PERFORMANCE WITH OPENCAPIGPUs are not the only accelerators useful in AI Field programmable gate arrays (FPGAs) and network interface cards (NICs) are other important components for off-loading processing from the CPU FPGAs are low-power reprogrammable devices that can be customized for multiple AI projects10 NICs are responsible for handling network data packets High-bandwidth connectivity to these components can eliminate bottlenecks

POWER9 is the first processor with on-chip support for OpenCAPI a new and open connectivity standard that delivers up to 150GBs bandwidth between CPU and devices such as FPGAs and NICs OpenCAPI can increase datacenter performance by up to 10 times11

UP TO 10X PERFORMANCE

GBM whitepaper

6

POWER SYSTEM AC922 lsquoTHE MOST POWERFUL TRAINING PLATFORMrsquoIBM has stated that Power System AC922 is engineered to be the most powerful training platform for AI12 While it shares common POWER9 features with other Power System servers it also provides capability to

bull Scale from one server to a supercomputer ndashfor efficiency and ease of AI deployment Power AC922 is the backbone of the Summit and Sierra supercomputers

bull Share RAM across CPUs and GPUs ndash simplifying AI application development

bull Benefit from 56x more bandwidth and 2x more threads ndash compared to x86 alternatives

AI SUCCESS STORIESMany businesses have already put POWER9 systems and specifically Power AC922 servers to work in AI deployments that have delivered business value Achieving ROI means deploying the right-sized solution that meets business needs and is adaptable to changing requirements

FAWRY CHANGING THE WAY PEOPLE BANKLeading Egyptian bank Fawry used AI to understand its customers more deeply and sustain rapid growth It deployed IBM Watson Machine Learning Accelerator on Power AC922 servers featuring POWER9 processors and NVIDIA Tesla V100 NVLink GPUs plus leading open source AI frameworks The solution halved processing times

ldquoIBM Watson Machine Learning Accelerator will give us incredibly high performance required to extract new insights from our datardquo said Haytham Abbas of Fawry13

CEDAT 85 SOPHISTICATED NEURAL NETWORKSTurning nuanced speech into analyzable text is a huge technical challenge IBM AI infrastructure helped Cedat 85 do it more than 2x faster with no loss of accuracy The company also gained greater project scope which led to revenue growth and new innovationldquoUsing IBM Power Systems AC922 servers we can train neural network models 24 times fasterrdquo said Enrico Giannotti of Cedat 8514

OCB LEADING-EDGE CANCER DIAGNOSTICSOxford Cancer Biomarkers used IBM PowerAI Vision to identify diagnostic lsquobiomarkersrsquo in tumor to better predict outcomes for cancer patients Deployed on Power AC922 servers the solution reduced AI modeling time from months to hours and helped take the technique globalldquoAs soon as we saw IBM PowerAI in action we knew that it was going to have a seismic effectrdquo said David Browning of OCB15

GBM whitepaper

7

CONCLUSIONArtificial intelligence is a different kind of computing which requires a different kind of server Because AI applications depend on the CPU working in parallel with accelerators such as GPUs and FPGAs servers must have the ability to transfer data internally with extreme bandwidth to avoid bottlenecks IBM has architected the POWER9 processor to excel in these areas and has configured the Power System AC922 server for AI deployments The advantages are clear industry-leading bandwidth and performance plus AI business value proven by a range of success stories Power AC922 can also start small and scale as AI needs grow

Every enterprisersquos needs are different GBM Pakistan has the expertise to support businesses planning their first AI projects with tailored solution design and consultation To learn more please contact the GBM Pakistan team at pakistangbmmecom

GBM whitepaper

7

1 Gartner (2018)Gartner Says Global Artificial Intelligence Business Value to Reach $12 Trillion in 2018 Available from httpswwwgartnercomennewsroompress-releases2018-04-25-gartner-says-global-artificial-intelligence-business-value-to-reach-1-point-2-trillion-in-2018 [Accessed 8 Nov 2019]

2 IDG (2017) AI-defined infrastructure be prepared for a new generation of business models and applications Available from httpswwwciocomarticle3234656ai-defined-infrastructure-be-prepared-for-a-new-generation-of-business-models-and-applicationshtml [Accessed 8 Nov 2019]

3 NUST (2018)National Center of Artificial Intelligence (NCAI) Inaugurated at NUST Available from httpwwwnustedupkNewsPagesNational-Center-of-Artificial-Intelligence-(NCAl)-inaugurated-at-NUSTaspx [Accessed 8 Nov 2019]

4 AI Summit 2019 (2019) AI Summit Pakistan 2019 Conference and Expo Available at httpswwwaisummitio [Accessed 11 Nov 2019]

5 Gartner (2018) Build the AI Business Case Available at httpsemtempgcomcloudngwglobalassetseninformation-technologydocumentstrendsai-business-case-ebookpdf [Accessed 11 Nov 2019]

6 IBM (2019) IBM Ranked the Worldwide Market Share Leader in Artificial Intelligence for Third Consecutive Year Available from httpsnewsroomibmcom2019-10-09-IBM-Ranked-the-Worldwide-Market-Share-Leader-in-Artificial-Intelligence-for-Third-Consecutive-Year [Accessed 11 Nov 2019]

7 HFS Research (2018) HFS Top 10 Cognitive Assistant Service Providers Available from httpswwwibmcomdownloadscas4EXZGZ7Y [Accessed 11 Nov 2019]

8 IBM (2017) With IBM POWER9 wersquore all riding the AI wave Available from httpswwwibmcomblogssystemswith-ibm-power9-were-ahead-of-the-ai-wave [Accessed 11 Nov 2019]

9 NVIDIA (2019) NVLINK AND NVSWITCH Available from httpswwwnvidiacomen-usdata-centernvlink[Accessed 12 Nov 2019]

10 Forbes (2018) Management AI GPU and FPGA Why They Are Important for Artificial Intelligence Available from httpswwwforbescomsitesdavidteich20180615management-ai-gpu-and-fpga-why-they-are-important-for-artificial-intelligence137c1c407159 [Accessed 12 Nov 2019]

11 OpenCAPI (2016) Tech Leaders Unite to Enable New Cloud Datacenter Server Designs Available from httpsopencapiorg201610tech-leaders-unite-to-enable-new-cloud-datacenter-server-designs-for-big-data-machine-learning-analytics-and-other-emerging-workloads [Accessed 12 Nov 2019]

12 IBM (2019) IBM Power System AC922 Available from httpswwwibmcomuk-enmarketplacepower-systems-ac922 [Accessed 12 Nov 2019]

13 IBM (2019) Fawry (case study) Available from httpswwwibmcomcase-studiesfawry-systems-hardware-flashsystem-power-systems [Accessed 11 Nov 2019]

14 IBM (2019) Cedat 85 (case study) Available from httpswwwibmcomcase-studiescedat-85-systems-hardware-neural-networks [Accessed 9 Dec 2019]

15 IBM (2019) Oxford Cancer Biomarkers (case study) Available from httpswwwibmcomcase-studiesoxford-cancer-biomarkers-systems-hardware-ai-diagnostics [Accessed 11 Nov 2019]

Page 5: ADVANTAGES OF RUNNING AI WORKLOADS ON IBM POWER … · Achieving ROI means deploying the right-sized solution that meets business needs and is adaptable to changing requirements

GBM whitepaper

5

UP TO 10X PERFORMANCE WITH OPENCAPIGPUs are not the only accelerators useful in AI Field programmable gate arrays (FPGAs) and network interface cards (NICs) are other important components for off-loading processing from the CPU FPGAs are low-power reprogrammable devices that can be customized for multiple AI projects10 NICs are responsible for handling network data packets High-bandwidth connectivity to these components can eliminate bottlenecks

POWER9 is the first processor with on-chip support for OpenCAPI a new and open connectivity standard that delivers up to 150GBs bandwidth between CPU and devices such as FPGAs and NICs OpenCAPI can increase datacenter performance by up to 10 times11

UP TO 10X PERFORMANCE

GBM whitepaper

6

POWER SYSTEM AC922 lsquoTHE MOST POWERFUL TRAINING PLATFORMrsquoIBM has stated that Power System AC922 is engineered to be the most powerful training platform for AI12 While it shares common POWER9 features with other Power System servers it also provides capability to

bull Scale from one server to a supercomputer ndashfor efficiency and ease of AI deployment Power AC922 is the backbone of the Summit and Sierra supercomputers

bull Share RAM across CPUs and GPUs ndash simplifying AI application development

bull Benefit from 56x more bandwidth and 2x more threads ndash compared to x86 alternatives

AI SUCCESS STORIESMany businesses have already put POWER9 systems and specifically Power AC922 servers to work in AI deployments that have delivered business value Achieving ROI means deploying the right-sized solution that meets business needs and is adaptable to changing requirements

FAWRY CHANGING THE WAY PEOPLE BANKLeading Egyptian bank Fawry used AI to understand its customers more deeply and sustain rapid growth It deployed IBM Watson Machine Learning Accelerator on Power AC922 servers featuring POWER9 processors and NVIDIA Tesla V100 NVLink GPUs plus leading open source AI frameworks The solution halved processing times

ldquoIBM Watson Machine Learning Accelerator will give us incredibly high performance required to extract new insights from our datardquo said Haytham Abbas of Fawry13

CEDAT 85 SOPHISTICATED NEURAL NETWORKSTurning nuanced speech into analyzable text is a huge technical challenge IBM AI infrastructure helped Cedat 85 do it more than 2x faster with no loss of accuracy The company also gained greater project scope which led to revenue growth and new innovationldquoUsing IBM Power Systems AC922 servers we can train neural network models 24 times fasterrdquo said Enrico Giannotti of Cedat 8514

OCB LEADING-EDGE CANCER DIAGNOSTICSOxford Cancer Biomarkers used IBM PowerAI Vision to identify diagnostic lsquobiomarkersrsquo in tumor to better predict outcomes for cancer patients Deployed on Power AC922 servers the solution reduced AI modeling time from months to hours and helped take the technique globalldquoAs soon as we saw IBM PowerAI in action we knew that it was going to have a seismic effectrdquo said David Browning of OCB15

GBM whitepaper

7

CONCLUSIONArtificial intelligence is a different kind of computing which requires a different kind of server Because AI applications depend on the CPU working in parallel with accelerators such as GPUs and FPGAs servers must have the ability to transfer data internally with extreme bandwidth to avoid bottlenecks IBM has architected the POWER9 processor to excel in these areas and has configured the Power System AC922 server for AI deployments The advantages are clear industry-leading bandwidth and performance plus AI business value proven by a range of success stories Power AC922 can also start small and scale as AI needs grow

Every enterprisersquos needs are different GBM Pakistan has the expertise to support businesses planning their first AI projects with tailored solution design and consultation To learn more please contact the GBM Pakistan team at pakistangbmmecom

GBM whitepaper

7

1 Gartner (2018)Gartner Says Global Artificial Intelligence Business Value to Reach $12 Trillion in 2018 Available from httpswwwgartnercomennewsroompress-releases2018-04-25-gartner-says-global-artificial-intelligence-business-value-to-reach-1-point-2-trillion-in-2018 [Accessed 8 Nov 2019]

2 IDG (2017) AI-defined infrastructure be prepared for a new generation of business models and applications Available from httpswwwciocomarticle3234656ai-defined-infrastructure-be-prepared-for-a-new-generation-of-business-models-and-applicationshtml [Accessed 8 Nov 2019]

3 NUST (2018)National Center of Artificial Intelligence (NCAI) Inaugurated at NUST Available from httpwwwnustedupkNewsPagesNational-Center-of-Artificial-Intelligence-(NCAl)-inaugurated-at-NUSTaspx [Accessed 8 Nov 2019]

4 AI Summit 2019 (2019) AI Summit Pakistan 2019 Conference and Expo Available at httpswwwaisummitio [Accessed 11 Nov 2019]

5 Gartner (2018) Build the AI Business Case Available at httpsemtempgcomcloudngwglobalassetseninformation-technologydocumentstrendsai-business-case-ebookpdf [Accessed 11 Nov 2019]

6 IBM (2019) IBM Ranked the Worldwide Market Share Leader in Artificial Intelligence for Third Consecutive Year Available from httpsnewsroomibmcom2019-10-09-IBM-Ranked-the-Worldwide-Market-Share-Leader-in-Artificial-Intelligence-for-Third-Consecutive-Year [Accessed 11 Nov 2019]

7 HFS Research (2018) HFS Top 10 Cognitive Assistant Service Providers Available from httpswwwibmcomdownloadscas4EXZGZ7Y [Accessed 11 Nov 2019]

8 IBM (2017) With IBM POWER9 wersquore all riding the AI wave Available from httpswwwibmcomblogssystemswith-ibm-power9-were-ahead-of-the-ai-wave [Accessed 11 Nov 2019]

9 NVIDIA (2019) NVLINK AND NVSWITCH Available from httpswwwnvidiacomen-usdata-centernvlink[Accessed 12 Nov 2019]

10 Forbes (2018) Management AI GPU and FPGA Why They Are Important for Artificial Intelligence Available from httpswwwforbescomsitesdavidteich20180615management-ai-gpu-and-fpga-why-they-are-important-for-artificial-intelligence137c1c407159 [Accessed 12 Nov 2019]

11 OpenCAPI (2016) Tech Leaders Unite to Enable New Cloud Datacenter Server Designs Available from httpsopencapiorg201610tech-leaders-unite-to-enable-new-cloud-datacenter-server-designs-for-big-data-machine-learning-analytics-and-other-emerging-workloads [Accessed 12 Nov 2019]

12 IBM (2019) IBM Power System AC922 Available from httpswwwibmcomuk-enmarketplacepower-systems-ac922 [Accessed 12 Nov 2019]

13 IBM (2019) Fawry (case study) Available from httpswwwibmcomcase-studiesfawry-systems-hardware-flashsystem-power-systems [Accessed 11 Nov 2019]

14 IBM (2019) Cedat 85 (case study) Available from httpswwwibmcomcase-studiescedat-85-systems-hardware-neural-networks [Accessed 9 Dec 2019]

15 IBM (2019) Oxford Cancer Biomarkers (case study) Available from httpswwwibmcomcase-studiesoxford-cancer-biomarkers-systems-hardware-ai-diagnostics [Accessed 11 Nov 2019]

Page 6: ADVANTAGES OF RUNNING AI WORKLOADS ON IBM POWER … · Achieving ROI means deploying the right-sized solution that meets business needs and is adaptable to changing requirements

GBM whitepaper

6

POWER SYSTEM AC922 lsquoTHE MOST POWERFUL TRAINING PLATFORMrsquoIBM has stated that Power System AC922 is engineered to be the most powerful training platform for AI12 While it shares common POWER9 features with other Power System servers it also provides capability to

bull Scale from one server to a supercomputer ndashfor efficiency and ease of AI deployment Power AC922 is the backbone of the Summit and Sierra supercomputers

bull Share RAM across CPUs and GPUs ndash simplifying AI application development

bull Benefit from 56x more bandwidth and 2x more threads ndash compared to x86 alternatives

AI SUCCESS STORIESMany businesses have already put POWER9 systems and specifically Power AC922 servers to work in AI deployments that have delivered business value Achieving ROI means deploying the right-sized solution that meets business needs and is adaptable to changing requirements

FAWRY CHANGING THE WAY PEOPLE BANKLeading Egyptian bank Fawry used AI to understand its customers more deeply and sustain rapid growth It deployed IBM Watson Machine Learning Accelerator on Power AC922 servers featuring POWER9 processors and NVIDIA Tesla V100 NVLink GPUs plus leading open source AI frameworks The solution halved processing times

ldquoIBM Watson Machine Learning Accelerator will give us incredibly high performance required to extract new insights from our datardquo said Haytham Abbas of Fawry13

CEDAT 85 SOPHISTICATED NEURAL NETWORKSTurning nuanced speech into analyzable text is a huge technical challenge IBM AI infrastructure helped Cedat 85 do it more than 2x faster with no loss of accuracy The company also gained greater project scope which led to revenue growth and new innovationldquoUsing IBM Power Systems AC922 servers we can train neural network models 24 times fasterrdquo said Enrico Giannotti of Cedat 8514

OCB LEADING-EDGE CANCER DIAGNOSTICSOxford Cancer Biomarkers used IBM PowerAI Vision to identify diagnostic lsquobiomarkersrsquo in tumor to better predict outcomes for cancer patients Deployed on Power AC922 servers the solution reduced AI modeling time from months to hours and helped take the technique globalldquoAs soon as we saw IBM PowerAI in action we knew that it was going to have a seismic effectrdquo said David Browning of OCB15

GBM whitepaper

7

CONCLUSIONArtificial intelligence is a different kind of computing which requires a different kind of server Because AI applications depend on the CPU working in parallel with accelerators such as GPUs and FPGAs servers must have the ability to transfer data internally with extreme bandwidth to avoid bottlenecks IBM has architected the POWER9 processor to excel in these areas and has configured the Power System AC922 server for AI deployments The advantages are clear industry-leading bandwidth and performance plus AI business value proven by a range of success stories Power AC922 can also start small and scale as AI needs grow

Every enterprisersquos needs are different GBM Pakistan has the expertise to support businesses planning their first AI projects with tailored solution design and consultation To learn more please contact the GBM Pakistan team at pakistangbmmecom

GBM whitepaper

7

1 Gartner (2018)Gartner Says Global Artificial Intelligence Business Value to Reach $12 Trillion in 2018 Available from httpswwwgartnercomennewsroompress-releases2018-04-25-gartner-says-global-artificial-intelligence-business-value-to-reach-1-point-2-trillion-in-2018 [Accessed 8 Nov 2019]

2 IDG (2017) AI-defined infrastructure be prepared for a new generation of business models and applications Available from httpswwwciocomarticle3234656ai-defined-infrastructure-be-prepared-for-a-new-generation-of-business-models-and-applicationshtml [Accessed 8 Nov 2019]

3 NUST (2018)National Center of Artificial Intelligence (NCAI) Inaugurated at NUST Available from httpwwwnustedupkNewsPagesNational-Center-of-Artificial-Intelligence-(NCAl)-inaugurated-at-NUSTaspx [Accessed 8 Nov 2019]

4 AI Summit 2019 (2019) AI Summit Pakistan 2019 Conference and Expo Available at httpswwwaisummitio [Accessed 11 Nov 2019]

5 Gartner (2018) Build the AI Business Case Available at httpsemtempgcomcloudngwglobalassetseninformation-technologydocumentstrendsai-business-case-ebookpdf [Accessed 11 Nov 2019]

6 IBM (2019) IBM Ranked the Worldwide Market Share Leader in Artificial Intelligence for Third Consecutive Year Available from httpsnewsroomibmcom2019-10-09-IBM-Ranked-the-Worldwide-Market-Share-Leader-in-Artificial-Intelligence-for-Third-Consecutive-Year [Accessed 11 Nov 2019]

7 HFS Research (2018) HFS Top 10 Cognitive Assistant Service Providers Available from httpswwwibmcomdownloadscas4EXZGZ7Y [Accessed 11 Nov 2019]

8 IBM (2017) With IBM POWER9 wersquore all riding the AI wave Available from httpswwwibmcomblogssystemswith-ibm-power9-were-ahead-of-the-ai-wave [Accessed 11 Nov 2019]

9 NVIDIA (2019) NVLINK AND NVSWITCH Available from httpswwwnvidiacomen-usdata-centernvlink[Accessed 12 Nov 2019]

10 Forbes (2018) Management AI GPU and FPGA Why They Are Important for Artificial Intelligence Available from httpswwwforbescomsitesdavidteich20180615management-ai-gpu-and-fpga-why-they-are-important-for-artificial-intelligence137c1c407159 [Accessed 12 Nov 2019]

11 OpenCAPI (2016) Tech Leaders Unite to Enable New Cloud Datacenter Server Designs Available from httpsopencapiorg201610tech-leaders-unite-to-enable-new-cloud-datacenter-server-designs-for-big-data-machine-learning-analytics-and-other-emerging-workloads [Accessed 12 Nov 2019]

12 IBM (2019) IBM Power System AC922 Available from httpswwwibmcomuk-enmarketplacepower-systems-ac922 [Accessed 12 Nov 2019]

13 IBM (2019) Fawry (case study) Available from httpswwwibmcomcase-studiesfawry-systems-hardware-flashsystem-power-systems [Accessed 11 Nov 2019]

14 IBM (2019) Cedat 85 (case study) Available from httpswwwibmcomcase-studiescedat-85-systems-hardware-neural-networks [Accessed 9 Dec 2019]

15 IBM (2019) Oxford Cancer Biomarkers (case study) Available from httpswwwibmcomcase-studiesoxford-cancer-biomarkers-systems-hardware-ai-diagnostics [Accessed 11 Nov 2019]

Page 7: ADVANTAGES OF RUNNING AI WORKLOADS ON IBM POWER … · Achieving ROI means deploying the right-sized solution that meets business needs and is adaptable to changing requirements

GBM whitepaper

7

CONCLUSIONArtificial intelligence is a different kind of computing which requires a different kind of server Because AI applications depend on the CPU working in parallel with accelerators such as GPUs and FPGAs servers must have the ability to transfer data internally with extreme bandwidth to avoid bottlenecks IBM has architected the POWER9 processor to excel in these areas and has configured the Power System AC922 server for AI deployments The advantages are clear industry-leading bandwidth and performance plus AI business value proven by a range of success stories Power AC922 can also start small and scale as AI needs grow

Every enterprisersquos needs are different GBM Pakistan has the expertise to support businesses planning their first AI projects with tailored solution design and consultation To learn more please contact the GBM Pakistan team at pakistangbmmecom

GBM whitepaper

7

1 Gartner (2018)Gartner Says Global Artificial Intelligence Business Value to Reach $12 Trillion in 2018 Available from httpswwwgartnercomennewsroompress-releases2018-04-25-gartner-says-global-artificial-intelligence-business-value-to-reach-1-point-2-trillion-in-2018 [Accessed 8 Nov 2019]

2 IDG (2017) AI-defined infrastructure be prepared for a new generation of business models and applications Available from httpswwwciocomarticle3234656ai-defined-infrastructure-be-prepared-for-a-new-generation-of-business-models-and-applicationshtml [Accessed 8 Nov 2019]

3 NUST (2018)National Center of Artificial Intelligence (NCAI) Inaugurated at NUST Available from httpwwwnustedupkNewsPagesNational-Center-of-Artificial-Intelligence-(NCAl)-inaugurated-at-NUSTaspx [Accessed 8 Nov 2019]

4 AI Summit 2019 (2019) AI Summit Pakistan 2019 Conference and Expo Available at httpswwwaisummitio [Accessed 11 Nov 2019]

5 Gartner (2018) Build the AI Business Case Available at httpsemtempgcomcloudngwglobalassetseninformation-technologydocumentstrendsai-business-case-ebookpdf [Accessed 11 Nov 2019]

6 IBM (2019) IBM Ranked the Worldwide Market Share Leader in Artificial Intelligence for Third Consecutive Year Available from httpsnewsroomibmcom2019-10-09-IBM-Ranked-the-Worldwide-Market-Share-Leader-in-Artificial-Intelligence-for-Third-Consecutive-Year [Accessed 11 Nov 2019]

7 HFS Research (2018) HFS Top 10 Cognitive Assistant Service Providers Available from httpswwwibmcomdownloadscas4EXZGZ7Y [Accessed 11 Nov 2019]

8 IBM (2017) With IBM POWER9 wersquore all riding the AI wave Available from httpswwwibmcomblogssystemswith-ibm-power9-were-ahead-of-the-ai-wave [Accessed 11 Nov 2019]

9 NVIDIA (2019) NVLINK AND NVSWITCH Available from httpswwwnvidiacomen-usdata-centernvlink[Accessed 12 Nov 2019]

10 Forbes (2018) Management AI GPU and FPGA Why They Are Important for Artificial Intelligence Available from httpswwwforbescomsitesdavidteich20180615management-ai-gpu-and-fpga-why-they-are-important-for-artificial-intelligence137c1c407159 [Accessed 12 Nov 2019]

11 OpenCAPI (2016) Tech Leaders Unite to Enable New Cloud Datacenter Server Designs Available from httpsopencapiorg201610tech-leaders-unite-to-enable-new-cloud-datacenter-server-designs-for-big-data-machine-learning-analytics-and-other-emerging-workloads [Accessed 12 Nov 2019]

12 IBM (2019) IBM Power System AC922 Available from httpswwwibmcomuk-enmarketplacepower-systems-ac922 [Accessed 12 Nov 2019]

13 IBM (2019) Fawry (case study) Available from httpswwwibmcomcase-studiesfawry-systems-hardware-flashsystem-power-systems [Accessed 11 Nov 2019]

14 IBM (2019) Cedat 85 (case study) Available from httpswwwibmcomcase-studiescedat-85-systems-hardware-neural-networks [Accessed 9 Dec 2019]

15 IBM (2019) Oxford Cancer Biomarkers (case study) Available from httpswwwibmcomcase-studiesoxford-cancer-biomarkers-systems-hardware-ai-diagnostics [Accessed 11 Nov 2019]

Page 8: ADVANTAGES OF RUNNING AI WORKLOADS ON IBM POWER … · Achieving ROI means deploying the right-sized solution that meets business needs and is adaptable to changing requirements

1 Gartner (2018)Gartner Says Global Artificial Intelligence Business Value to Reach $12 Trillion in 2018 Available from httpswwwgartnercomennewsroompress-releases2018-04-25-gartner-says-global-artificial-intelligence-business-value-to-reach-1-point-2-trillion-in-2018 [Accessed 8 Nov 2019]

2 IDG (2017) AI-defined infrastructure be prepared for a new generation of business models and applications Available from httpswwwciocomarticle3234656ai-defined-infrastructure-be-prepared-for-a-new-generation-of-business-models-and-applicationshtml [Accessed 8 Nov 2019]

3 NUST (2018)National Center of Artificial Intelligence (NCAI) Inaugurated at NUST Available from httpwwwnustedupkNewsPagesNational-Center-of-Artificial-Intelligence-(NCAl)-inaugurated-at-NUSTaspx [Accessed 8 Nov 2019]

4 AI Summit 2019 (2019) AI Summit Pakistan 2019 Conference and Expo Available at httpswwwaisummitio [Accessed 11 Nov 2019]

5 Gartner (2018) Build the AI Business Case Available at httpsemtempgcomcloudngwglobalassetseninformation-technologydocumentstrendsai-business-case-ebookpdf [Accessed 11 Nov 2019]

6 IBM (2019) IBM Ranked the Worldwide Market Share Leader in Artificial Intelligence for Third Consecutive Year Available from httpsnewsroomibmcom2019-10-09-IBM-Ranked-the-Worldwide-Market-Share-Leader-in-Artificial-Intelligence-for-Third-Consecutive-Year [Accessed 11 Nov 2019]

7 HFS Research (2018) HFS Top 10 Cognitive Assistant Service Providers Available from httpswwwibmcomdownloadscas4EXZGZ7Y [Accessed 11 Nov 2019]

8 IBM (2017) With IBM POWER9 wersquore all riding the AI wave Available from httpswwwibmcomblogssystemswith-ibm-power9-were-ahead-of-the-ai-wave [Accessed 11 Nov 2019]

9 NVIDIA (2019) NVLINK AND NVSWITCH Available from httpswwwnvidiacomen-usdata-centernvlink[Accessed 12 Nov 2019]

10 Forbes (2018) Management AI GPU and FPGA Why They Are Important for Artificial Intelligence Available from httpswwwforbescomsitesdavidteich20180615management-ai-gpu-and-fpga-why-they-are-important-for-artificial-intelligence137c1c407159 [Accessed 12 Nov 2019]

11 OpenCAPI (2016) Tech Leaders Unite to Enable New Cloud Datacenter Server Designs Available from httpsopencapiorg201610tech-leaders-unite-to-enable-new-cloud-datacenter-server-designs-for-big-data-machine-learning-analytics-and-other-emerging-workloads [Accessed 12 Nov 2019]

12 IBM (2019) IBM Power System AC922 Available from httpswwwibmcomuk-enmarketplacepower-systems-ac922 [Accessed 12 Nov 2019]

13 IBM (2019) Fawry (case study) Available from httpswwwibmcomcase-studiesfawry-systems-hardware-flashsystem-power-systems [Accessed 11 Nov 2019]

14 IBM (2019) Cedat 85 (case study) Available from httpswwwibmcomcase-studiescedat-85-systems-hardware-neural-networks [Accessed 9 Dec 2019]

15 IBM (2019) Oxford Cancer Biomarkers (case study) Available from httpswwwibmcomcase-studiesoxford-cancer-biomarkers-systems-hardware-ai-diagnostics [Accessed 11 Nov 2019]