{"id":1624,"date":"2024-11-12T09:14:33","date_gmt":"2024-11-12T09:14:33","guid":{"rendered":"https:\/\/nas01.tallpaul.net\/wordpress\/?p=1624"},"modified":"2024-11-12T10:37:26","modified_gmt":"2024-11-12T10:37:26","slug":"csi-ai-demos","status":"publish","type":"post","link":"https:\/\/nas01.tallpaul.net\/wordpress\/2024\/11\/csi-ai-demos\/","title":{"rendered":"AI Innovation on IBM Power: CSI Showcases Enterprise-Ready Use Cases"},"content":{"rendered":"\n<figure class=\"wp-block-embed is-type-video is-provider-youtube wp-block-embed-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<iframe loading=\"lazy\" title=\"CSI Talks AI on Power\" width=\"500\" height=\"281\" src=\"https:\/\/www.youtube.com\/embed\/ZJBEkaDfPI8?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe>\n<\/div><\/figure>\n\n\n\n<p>It&#8217;s been my pleasure to collaborate with <a rel=\"noreferrer noopener\" href=\"https:\/\/www.linkedin.com\/in\/ishwar-fernandes-4b704410\/\" target=\"_blank\">Ishwar Fernandes<\/a> and the talented <a rel=\"noreferrer noopener\" href=\"https:\/\/www.csiltd.co.uk\/\" target=\"_blank\">CSI <\/a>and IBM teams on this exciting project that demonstrates the practical applications of AI on IBM Power systems. In their recent technical demonstration, CSI showcases how they&#8217;re leveraging IBM Power10 technology to run sophisticated AI workloads efficiently and securely on-premises.<\/p>\n\n\n\n<p class=\"has-large-font-size\"><strong>Great job, Ishwar!<\/strong><\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Infrastructure Setup<\/h2>\n\n\n\n<p>The demonstration runs on a robust infrastructure consisting of:<\/p>\n\n\n\n<p>&#8211; IBM Power, with Power10, MMA inferences technology<\/p>\n\n\n\n<p>&#8211; NO GPU&#8217;s<\/p>\n\n\n\n<p>&#8211; OpenShift Container Platform <\/p>\n\n\n\n<p>&#8211; Three master nodes<\/p>\n\n\n\n<p>&#8211; Five worker nodes &#8211; with AI running on just two of the Power Worker Nodes<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Highlighted Use Cases<\/h2>\n\n\n\n<h3 class=\"wp-block-heading\">1. Custom Question &amp; Answer System<\/h3>\n\n\n\n<p>&#8211; Processes uploaded PDF documents<\/p>\n\n\n\n<p>&#8211; Demonstrates real-time analysis of technical documentation<\/p>\n\n\n\n<p>&#8211; Showcased using IBM Power S1012 documentation<\/p>\n\n\n\n<p>&#8211; Provides accurate, context-aware responses<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">2. PII Data Processing<\/h3>\n\n\n\n<p>&#8211; Identifies and manages sensitive information<\/p>\n\n\n\n<p>&#8211; Handles numerical data extraction and masking<\/p>\n\n\n\n<p>&#8211; Essential for compliance and data security<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">3. Marketing Content Generation<\/h3>\n\n\n\n<p>&#8211; Creates comprehensive marketing briefs<\/p>\n\n\n\n<p>&#8211; Generates structured content with clear objectives <\/p>\n\n\n\n<p>&#8211; Streamlines content creation workflows<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">4. Email Summarization<\/h3>\n\n\n\n<p>&#8211; Quickly distills key information from email communications<\/p>\n\n\n\n<p>&#8211; Improves productivity through automated comprehension <\/p>\n\n\n\n<p>&#8211; Provides concise, actionable summaries<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">5. Sales Insight Analysis<\/h3>\n\n\n\n<p>&#8211; Analyzes sales conversations<\/p>\n\n\n\n<p>&#8211; Extracts main topics and key points<\/p>\n\n\n\n<p>&#8211; Helps identify customer needs and priorities<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Technical Highlights<\/h2>\n\n\n\n<p>&#8211; Flexible LLM Integration: Currently utilizing Google FLAN with capability to integrate other models from HuggingFace or NVIDIA<\/p>\n\n\n\n<p>&#8211; On-Premises Processing: All AI inferencing runs locally on Power10 hardware<\/p>\n\n\n\n<p>&#8211; Multi-Architecture Support: Leverages OpenShift&#8217;s Multi-Architecture Compute clustering, which provides support for both x86 and IBM Power Worker Nodes within the same OpenShift cluster (v4.14 and later).<\/p>\n\n\n\n<p>&#8211; Seamless Data Movement: Enables efficient data transfer between x86 and Power architectures<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Looking Forward<\/h2>\n\n\n\n<p>This demonstration showcases the practical reality of enterprise AI deployment on IBM Power systems. CSI&#8217;s implementation proves that organizations can run sophisticated AI workloads efficiently while maintaining data sovereignty and security through on-premises processing.<\/p>\n\n\n\n<p>The combination of IBM Power10&#8217;s processing capabilities with OpenShift&#8217;s container orchestration creates a robust foundation for Enterprise AI applications. This solution opens new possibilities for organizations looking to implement AI while maintaining control over their data and processing infrastructure.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Next Steps<\/h3>\n\n\n\n<ol class=\"wp-block-list\">\n<li>Customers, get in touch with CSI and or IBM to identify and or progress AI on Power projects.<\/li>\n\n\n\n<li>Business Partners, get in touch with IBM to assist with your own AI on Power development.<\/li>\n\n\n\n<li>ISV&#8217;s get in touch for assistance integrating AI on Power with your own solutions.<\/li>\n<\/ol>\n\n\n\n<ul class=\"wp-block-social-links aligncenter has-huge-icon-size has-icon-color is-style-default is-layout-flex wp-block-social-links-is-layout-flex\"><li style=\"color: #ffffff; \" class=\"wp-social-link wp-social-link-wordpress  wp-block-social-link\"><a rel=\"noopener nofollow\" target=\"_blank\" href=\"https:\/\/nas01.tallpaul.net\/wordpress\/\" class=\"wp-block-social-link-anchor\"><svg width=\"24\" height=\"24\" viewBox=\"0 0 24 24\" version=\"1.1\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" aria-hidden=\"true\" focusable=\"false\"><path d=\"M12.158,12.786L9.46,20.625c0.806,0.237,1.657,0.366,2.54,0.366c1.047,0,2.051-0.181,2.986-0.51 c-0.024-0.038-0.046-0.079-0.065-0.124L12.158,12.786z M3.009,12c0,3.559,2.068,6.634,5.067,8.092L3.788,8.341 C3.289,9.459,3.009,10.696,3.009,12z M18.069,11.546c0-1.112-0.399-1.881-0.741-2.48c-0.456-0.741-0.883-1.368-0.883-2.109 c0-0.826,0.627-1.596,1.51-1.596c0.04,0,0.078,0.005,0.116,0.007C16.472,3.904,14.34,3.009,12,3.009 c-3.141,0-5.904,1.612-7.512,4.052c0.211,0.007,0.41,0.011,0.579,0.011c0.94,0,2.396-0.114,2.396-0.114 C7.947,6.93,8.004,7.642,7.52,7.699c0,0-0.487,0.057-1.029,0.085l3.274,9.739l1.968-5.901l-1.401-3.838 C9.848,7.756,9.389,7.699,9.389,7.699C8.904,7.67,8.961,6.93,9.446,6.958c0,0,1.484,0.114,2.368,0.114 c0.94,0,2.397-0.114,2.397-0.114c0.485-0.028,0.542,0.684,0.057,0.741c0,0-0.488,0.057-1.029,0.085l3.249,9.665l0.897-2.996 C17.841,13.284,18.069,12.316,18.069,11.546z M19.889,7.686c0.039,0.286,0.06,0.593,0.06,0.924c0,0.912-0.171,1.938-0.684,3.22 l-2.746,7.94c2.673-1.558,4.47-4.454,4.47-7.771C20.991,10.436,20.591,8.967,19.889,7.686z M12,22C6.486,22,2,17.514,2,12 C2,6.486,6.486,2,12,2c5.514,0,10,4.486,10,10C22,17.514,17.514,22,12,22z\"><\/path><\/svg><span class=\"wp-block-social-link-label screen-reader-text\">WordPress<\/span><\/a><\/li>\n\n<li style=\"color: #ffffff; \" class=\"wp-social-link wp-social-link-mail  wp-block-social-link\"><a rel=\"noopener nofollow\" target=\"_blank\" href=\"mailto:paulchapman@uk.ibm.com\" class=\"wp-block-social-link-anchor\"><svg width=\"24\" height=\"24\" viewBox=\"0 0 24 24\" version=\"1.1\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" aria-hidden=\"true\" focusable=\"false\"><path d=\"M19,5H5c-1.1,0-2,.9-2,2v10c0,1.1.9,2,2,2h14c1.1,0,2-.9,2-2V7c0-1.1-.9-2-2-2zm.5,12c0,.3-.2.5-.5.5H5c-.3,0-.5-.2-.5-.5V9.8l7.5,5.6,7.5-5.6V17zm0-9.1L12,13.6,4.5,7.9V7c0-.3.2-.5.5-.5h14c.3,0,.5.2.5.5v.9z\"><\/path><\/svg><span class=\"wp-block-social-link-label screen-reader-text\">Mail<\/span><\/a><\/li>\n\n<li style=\"color: #ffffff; \" class=\"wp-social-link wp-social-link-youtube  wp-block-social-link\"><a rel=\"noopener nofollow\" target=\"_blank\" href=\"https:\/\/www.youtube.com\/@paulchapman1280\/videos\" class=\"wp-block-social-link-anchor\"><svg width=\"24\" height=\"24\" viewBox=\"0 0 24 24\" version=\"1.1\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" aria-hidden=\"true\" focusable=\"false\"><path d=\"M21.8,8.001c0,0-0.195-1.378-0.795-1.985c-0.76-0.797-1.613-0.801-2.004-0.847c-2.799-0.202-6.997-0.202-6.997-0.202 h-0.009c0,0-4.198,0-6.997,0.202C4.608,5.216,3.756,5.22,2.995,6.016C2.395,6.623,2.2,8.001,2.2,8.001S2,9.62,2,11.238v1.517 c0,1.618,0.2,3.237,0.2,3.237s0.195,1.378,0.795,1.985c0.761,0.797,1.76,0.771,2.205,0.855c1.6,0.153,6.8,0.201,6.8,0.201 s4.203-0.006,7.001-0.209c0.391-0.047,1.243-0.051,2.004-0.847c0.6-0.607,0.795-1.985,0.795-1.985s0.2-1.618,0.2-3.237v-1.517 C22,9.62,21.8,8.001,21.8,8.001z M9.935,14.594l-0.001-5.62l5.404,2.82L9.935,14.594z\"><\/path><\/svg><span class=\"wp-block-social-link-label screen-reader-text\">YouTube<\/span><\/a><\/li>\n\n<li style=\"color: #ffffff; \" class=\"wp-social-link wp-social-link-linkedin  wp-block-social-link\"><a rel=\"noopener nofollow\" target=\"_blank\" href=\"https:\/\/www.linkedin.com\/in\/chapmanp\/\" class=\"wp-block-social-link-anchor\"><svg width=\"24\" height=\"24\" viewBox=\"0 0 24 24\" version=\"1.1\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" aria-hidden=\"true\" focusable=\"false\"><path d=\"M19.7,3H4.3C3.582,3,3,3.582,3,4.3v15.4C3,20.418,3.582,21,4.3,21h15.4c0.718,0,1.3-0.582,1.3-1.3V4.3 C21,3.582,20.418,3,19.7,3z M8.339,18.338H5.667v-8.59h2.672V18.338z M7.004,8.574c-0.857,0-1.549-0.694-1.549-1.548 c0-0.855,0.691-1.548,1.549-1.548c0.854,0,1.547,0.694,1.547,1.548C8.551,7.881,7.858,8.574,7.004,8.574z M18.339,18.338h-2.669 v-4.177c0-0.996-0.017-2.278-1.387-2.278c-1.389,0-1.601,1.086-1.601,2.206v4.249h-2.667v-8.59h2.559v1.174h0.037 c0.356-0.675,1.227-1.387,2.526-1.387c2.703,0,3.203,1.779,3.203,4.092V18.338z\"><\/path><\/svg><span class=\"wp-block-social-link-label screen-reader-text\">LinkedIn<\/span><\/a><\/li><\/ul>\n\n\n\n<h2 class=\"wp-block-heading\">Credit<\/h2>\n\n\n\n<figure class=\"wp-block-gallery has-nested-images columns-4 is-cropped wp-block-gallery-1 is-layout-flex wp-block-gallery-is-layout-flex\">\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"364\" height=\"364\" data-id=\"1626\" src=\"https:\/\/nas01.tallpaul.net\/wordpress\/wp-content\/uploads\/2024\/11\/Ishwar-Fernandes.jpeg\" alt=\"\" class=\"wp-image-1626\" srcset=\"https:\/\/nas01.tallpaul.net\/wordpress\/wp-content\/uploads\/2024\/11\/Ishwar-Fernandes.jpeg 364w, https:\/\/nas01.tallpaul.net\/wordpress\/wp-content\/uploads\/2024\/11\/Ishwar-Fernandes-300x300.jpeg 300w, https:\/\/nas01.tallpaul.net\/wordpress\/wp-content\/uploads\/2024\/11\/Ishwar-Fernandes-150x150.jpeg 150w\" sizes=\"auto, (max-width: 364px) 100vw, 364px\" \/><figcaption class=\"wp-element-caption\">Ishwar Frenades <br>(CSI)<\/figcaption><\/figure>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"200\" height=\"200\" data-id=\"1349\" src=\"https:\/\/nas01.tallpaul.net\/wordpress\/wp-content\/uploads\/2024\/10\/SebastianLehrigportrait2small2.png\" alt=\"\" class=\"wp-image-1349\" srcset=\"https:\/\/nas01.tallpaul.net\/wordpress\/wp-content\/uploads\/2024\/10\/SebastianLehrigportrait2small2.png 200w, https:\/\/nas01.tallpaul.net\/wordpress\/wp-content\/uploads\/2024\/10\/SebastianLehrigportrait2small2-150x150.png 150w\" sizes=\"auto, (max-width: 200px) 100vw, 200px\" \/><figcaption class=\"wp-element-caption\"><a href=\"https:\/\/www.linkedin.com\/in\/lehrig\/overlay\/about-this-profile\/\">Dr. Sebastian Lehrig<\/a> (IBM)<\/figcaption><\/figure>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"500\" height=\"500\" data-id=\"1627\" src=\"https:\/\/nas01.tallpaul.net\/wordpress\/wp-content\/uploads\/2024\/11\/Sylvain-Delabarre.jpeg\" alt=\"\" class=\"wp-image-1627\" srcset=\"https:\/\/nas01.tallpaul.net\/wordpress\/wp-content\/uploads\/2024\/11\/Sylvain-Delabarre.jpeg 500w, https:\/\/nas01.tallpaul.net\/wordpress\/wp-content\/uploads\/2024\/11\/Sylvain-Delabarre-300x300.jpeg 300w, https:\/\/nas01.tallpaul.net\/wordpress\/wp-content\/uploads\/2024\/11\/Sylvain-Delabarre-150x150.jpeg 150w\" sizes=\"auto, (max-width: 500px) 100vw, 500px\" \/><figcaption class=\"wp-element-caption\"><a href=\"https:\/\/www.linkedin.com\/in\/sylvaindelabarre\/overlay\/about-this-profile\/\">Sylvain Delabarre<\/a> (IBM)<\/figcaption><\/figure>\n\n\n\n<figure class=\"wp-block-image size-thumbnail\"><img loading=\"lazy\" decoding=\"async\" width=\"150\" height=\"150\" data-id=\"955\" src=\"https:\/\/nas01.tallpaul.net\/wordpress\/wp-content\/uploads\/2024\/09\/Andrew-Laidlaw-150x150.jpg\" alt=\"\" class=\"wp-image-955\" srcset=\"https:\/\/nas01.tallpaul.net\/wordpress\/wp-content\/uploads\/2024\/09\/Andrew-Laidlaw-150x150.jpg 150w, https:\/\/nas01.tallpaul.net\/wordpress\/wp-content\/uploads\/2024\/09\/Andrew-Laidlaw-300x300.jpg 300w, https:\/\/nas01.tallpaul.net\/wordpress\/wp-content\/uploads\/2024\/09\/Andrew-Laidlaw-768x768.jpg 768w, https:\/\/nas01.tallpaul.net\/wordpress\/wp-content\/uploads\/2024\/09\/Andrew-Laidlaw.jpg 800w\" sizes=\"auto, (max-width: 150px) 100vw, 150px\" \/><figcaption class=\"wp-element-caption\">Andrew Laidlaw<br>(IBM)<\/figcaption><\/figure>\n<\/figure>\n\n\n\n<p><a rel=\"noreferrer noopener\" href=\"https:\/\/www.linkedin.com\/in\/ishwar-fernandes-4b704410\/\" target=\"_blank\">Ishwar Fernandes<\/a>, Head of Technical Architects, CSI<\/p>\n\n\n\n<p><a rel=\"noreferrer noopener\" href=\"https:\/\/www.linkedin.com\/in\/lehrig\/\" target=\"_blank\">Dr Sebastian Lehrig<\/a>, WW AI on IBM Power Leader<\/p>\n\n\n\n<p><a rel=\"noreferrer noopener\" href=\"https:\/\/www.linkedin.com\/in\/andrewlaidlaw\/\" target=\"_blank\">Andrew Laidlaw<\/a>, Supporting IBM Power Business Partners, IBM UK<\/p>\n\n\n\n<p><a rel=\"noreferrer noopener\" href=\"https:\/\/www.linkedin.com\/in\/sylvaindelabarre\/\" target=\"_blank\">Sylvain Delabarre<\/a>, IBM Client Engineering EMEA<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Many thanks to: <\/h3>\n\n\n\n<p><strong>Ishwar Fernandes<\/strong> for taking the time and effort to learn and share the art of the possible with AI on IBM Power.<\/p>\n\n\n\n<p><strong>Sebastian Lehrig<\/strong> for sharing lessons learned from Global AI on Power projects.<\/p>\n\n\n\n<p><strong>Andrew Laidlaw<\/strong> for supporting CSI through this project.<\/p>\n\n\n\n<p>IBM Client Engineering from Montpellier for their support in hosting and supporting the project, while CSI provision local resources for longer term use. <\/p>\n\n\n\n<p><strong>Sylvain Delabarre<\/strong> from IBM Client Engineering, who is always very helpful running and supporting customer proof of concepts, proof of technology and delivering minimal viable products. <\/p>\n","protected":false},"excerpt":{"rendered":"<p>Explore how CSI leverages IBM Power10 technology to run cutting-edge AI use cases, from document analysis to sales insights, all on-premises.<\/p>\n","protected":false},"author":1,"featured_media":1629,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[82,127,3,5,13,6,7],"tags":[],"class_list":["post-1624","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-ai","category-ai-open-source","category-ibm","category-open-source","category-openshift","category-power-systems","category-red-hat"],"_links":{"self":[{"href":"https:\/\/nas01.tallpaul.net\/wordpress\/wp-json\/wp\/v2\/posts\/1624","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/nas01.tallpaul.net\/wordpress\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/nas01.tallpaul.net\/wordpress\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/nas01.tallpaul.net\/wordpress\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/nas01.tallpaul.net\/wordpress\/wp-json\/wp\/v2\/comments?post=1624"}],"version-history":[{"count":0,"href":"https:\/\/nas01.tallpaul.net\/wordpress\/wp-json\/wp\/v2\/posts\/1624\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/nas01.tallpaul.net\/wordpress\/wp-json\/wp\/v2\/media\/1629"}],"wp:attachment":[{"href":"https:\/\/nas01.tallpaul.net\/wordpress\/wp-json\/wp\/v2\/media?parent=1624"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/nas01.tallpaul.net\/wordpress\/wp-json\/wp\/v2\/categories?post=1624"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/nas01.tallpaul.net\/wordpress\/wp-json\/wp\/v2\/tags?post=1624"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}