Mgmt Summary: AI has revolutionized how we access public knowledge, from Google Search to ChatGPT. However, these tools can't be safely used with confidential data, as demonstrated by recent incidents. This presentation introduces a solution: AI-powered private knowledge management systems. Using open-source tools, organizations can create secure, local AI chatbots that interact with their proprietary data. This approach offers enhanced information retrieval and analysis while maintaining data privacy. The presentation concludes with a live demo and discusses potential challenges and future implications for corporate knowledge management.

In ancient times, it required people to travel and to tell, to share knowledge. I took this picture of the alps, but in ancient times it was a huge barrier for knowledge...

Then the letterpresschanged changed how we saved and shared knowledge. Now it was possible to persist information.

What a revoluation when Google published its search engine: The simplest way to search for public information, the world's knowledge at our fingertips

ChatGPT (Launched in November 2022) represents a paradigm shift in how we access and interact with information. While Google Search provides a list of relevant links, ChatGPT offers a conversational interface that allows users to engage directly with knowledge. This AI-powered tool not only retrieves information but also synthesizes it, providing detailed summaries, drawing correlations, and maintaining context across multiple queries.

While advanced technologies like Google Search and ChatGPT have revolutionized access to public knowledge, they cannot provide insights into confidential institutional data. This limitation often results in a disparity between the effectiveness of public information retrieval and internal knowledge work within organizations.

So, some clever guys tried to use AI with their secret data, but it didn't quite work out as planned. Samsung employees ended up leaking their secret trade data to ChatGPT. It was a bad idea, and it highlights the risks of using AI tools with sensitive information.

The most important question is: why can't we limit the answers of an AI to private data without leaking it?

I will show you how easy it is. I will create our own ai powered chat bot that we can interact with our private data.

Imagine the use cases ...

sounds complicated, requires a lot of ressources and don't we need an llm?

speaker notes Ladies and Gentlemen, we've seen how AI-powered knowledge management can transform the way we interact with our data. It's not just for tech giants - it's accessible, powerful, and ready for you to use." I encourage you to explore this technology. The Self-Hosted AI Starter Kit is available on GitHub. Start small, experiment, and see how it can enhance your work. Thank you, and I'm happy to take any questions."