Sandra Ahlgrimm is a Senior Cloud Advocate at Microsoft, specializing in supporting Java Developers. With over a decade of experience as a Java developer, she brings a wealth of knowledge to her role. Sandra is passionate about containers and has recently learned to love AI.
AI technologies, and particularly large language models (LLMs), have been popping up like mushrooms lately. But how can you use them in your applications?
In this workshop, we will use a chatbot to interact with GPT-4 and implement the Retrieval Augmented Generation (RAG) pattern. Using a vector database, the model will be able to answer questions in natural language and generate complete, sourced responses from your own documents. To do this, we will create a Quarkus service based on the Open Source LangChain4J and ChatBootAI frameworks to test our chatbot. Finally, we will deploy everything to the Cloud.
After a short introduction to language models (operations and limitations), and prompt engineering, you will:
- Create a knowledge base: local HuggingFace LLMs, embeddings, a vector database, and semantic search
- Use LangChain4J to implement the RAG (Retrieval Augmented Generation) pattern
- Create a Quarkus API to interact with the LLM: OpenAI / AzureOpenAI
- Use ChatBootAI to interact with the Quarkus API
- Improve performance thanks to prompt engineering
- Containerize the application
- Deploy the containerized application to the Cloud
- Tweak your RAG integration
- Optimize for quality, cost or size
At the end of the workshop, you will have a clearer understanding of large language models and how they work, as well as ideas for using them in your applications. You will also know how to create a functional knowledge base and chatbot, and how to deploy them in the cloud.
Join us to explore how Microsoft is advancing Java development with AI.
Pierre, Cedric and Sandra will showcase a real-world example using various innovative frameworks such as LangChain4J and Spring AI.
During the session they will demonstrate and code a ready app, and no, it’s not another chatbot. Let’s face it, a free text form is not always the best idea for user input. What is more useful? An image is more worth than a thousand words. We’ll leverage Java on steroids with Azure OpenAI, Azure Container apps and a clean micro service architecture, to extract all the necessary information from an image, to fill out forms automatically without any user interaction.
Experience the flexibility and power of combining Java and AI on Azure and discover how these technologies can transform your applications. Join us to learn practical tips from experts and improve your development skills to shape the future of your applications.
Searching for speaker images...