Search, Observability, Security: a new era
A presentation at Azure Day with Kubernetes in in Paris, France by David Pilato
Search, Observability, Security: a new era David Pilato | @dadoonet
Elasticsearch You Know, for Vector Search
Embeddings represent your data Example: 1-dimensional vector Character Vector [ -1 ] Realistic Cartoon [1]
Multiple dimensions represent different data aspects Human Character Vector [ -1, 1 ] Realistic Cartoon Machine [ 1, 0 ]
Similar data is grouped together Human Character Vector [ -1.0, 1.0 ] Realistic Cartoon [ 1.0, 0.0 ] [ -1.0, 0.8 ] Machine
Vector search ranks objects by similarity (~relevance) to the query Human Rank Query 1 Realistic Cartoon 2 3 4 5 Machine Result
Similarity: cosine (cosine) Human q d1 d2 Realistic θ 1 + 𝑐𝑜𝑠(𝜃) _𝑠𝑐𝑜𝑟𝑒 = 2
Data Ingestion and Embedding Generation { “_id”:”product-1234”, “product_name”:”Summer Dress”, “description”:”Our best-selling…”, “Price”: 118, “color”:”blue”, “fabric”:”cotton”, “desc_embedding”:[0.452,0.3242,…], “img_embedding”:[0.012,0.0,…] } Source data POST /_doc
Vector Query GET product-catalog/_search { “knn”: { “field”: “desc_embbeding”, “k”: 5, “num_candidates”: 50, “query_vector”: [0.123, 0.244,…], “filter”: { “term”: { “department”: “women” } } }, “size”: 10 }
ChatGPT Elastic and LLM
Gen AI Search engines
LLM: opportunities and limits your question one answer your question GAI / LLM public internet data
Retrieval Augmented Generation your question the right answer your question + context window GAI / LLM public internet data your business data documents images audio
Demo: Elastic + Azure OpenAI
AI Assistant for security and observability
Search, Observability, Security: a new era David Pilato | @dadoonet
In this session, we will use the principles of vector search to find pieces similar to others. To do this, we will review the principles of generating embeddings to represent any type of data, whether textual or binary. Then we will use that to do RAG and generate meaningful results for our users. Finally we will showcase how all that has been applied to the Elastic Security and Observability AI Assistants.
Resources
The following resources were mentioned during the presentation or are useful additional information.
Buzz and feedback
Here’s what was said about this presentation on social media.
