Cost-Effective and Scalable Infrastructure for GenAI Workloads

Read/Download White Paper (PDF)

Intel IT is expanding and evolving our “Citizen AI” framework—named iGPT, which enables Intel employees to use Generative AI (GenAI) to streamline processes and enhance efficiency. This democratized AI platform empowers users to build chatbots and AI agents using intuitive, no-code tools. This enables them to create solutions tailored to their specific needs and quickly adapt to a rapidly changing business landscape. To improve scalability and potentially reduce cost per token, we are deploying our Citizen AI platform, both on-premises and in the cloud, using a mix of newer Intel Xeon processors and Intel Gaudi accelerators.

Tags: AI models, Citizen AI, cost efficiency, cost per token, genAI, Generative AI, iGPT, Intel AI for Enterprise Inference, Intel Gaudi, Intel Gaudi Accelerators, Intel IT, Intel Xeon, Intel Xeon processor, IT Best Practices, IT Business Value, IT@Intel, On-Prem, Open Source, scalability, Scalable Infrastructure, scalable infrastructure for GenAI workloads
 
Posted in: Artificial Intelligence, Cloud Computing, Intel, Intel IT, IT White Papers, IT@Intel