Presentation
BYOD Lab: Leverage Generative AI on z/OS using zCX, IBM Spyre and Red Hat AI Inference Server
Contributors
Event Type
Technical Session
Machine Learning/AI
z/OS Systems Programming
All Audiences
Modernize Data Management and Analytics
TimeTuesday, August 183:45pm - 4:45pm EDT
LocationSTE Lab
DescriptionIn this Lab we will learn how to leverage a simple AI chatbot running in a container on zCX to demonstrate generative AI inferencing requests using Red Hat Inferencing Server and IBM Spyre accelerators on z/OS using zCX. We will leverage Granite 3.3 8B Instruct model using the vLLM runtime on IBM Spyre accelerators, and validate the deployment through prompt-driven user interactions using simple AI Chatbot.
Contributors
zCX Development Lead
IBM STSM
Senior AI Client Engagement Leader