Search, Observability, Security: a new era David Pilato | @dadoonet

Elasticsearch You Know, for Vector Search

Embeddings represent your data Example: 1-dimensional vector Character Vector [ -1 ] Realistic Cartoon [1]

Multiple dimensions represent different data aspects Human Character Vector [ -1, 1 ] Realistic Cartoon Machine [ 1, 0 ]

Similar data is grouped together Human Character Vector [ -1.0, 1.0 ] Realistic Cartoon [ 1.0, 0.0 ] [ -1.0, 0.8 ] Machine

Vector search ranks objects by similarity (~relevance) to the query Human Rank Query 1 Realistic Cartoon 2 3 4 5 Machine Result

Similarity: cosine (cosine) Human q d1 d2 Realistic θ 1 + 𝑐𝑜𝑠(𝜃) _𝑠𝑐𝑜𝑟𝑒 = 2

Data Ingestion and Embedding Generation { “_id”:”product-1234”, “product_name”:”Summer Dress”, “description”:”Our best-selling…”, “Price”: 118, “color”:”blue”, “fabric”:”cotton”, “desc_embedding”:[0.452,0.3242,…], “img_embedding”:[0.012,0.0,…] } Source data POST /_doc

Vector Query GET product-catalog/_search { “knn”: { “field”: “desc_embbeding”, “k”: 5, “num_candidates”: 50, “query_vector”: [0.123, 0.244,…], “filter”: { “term”: { “department”: “women” } } }, “size”: 10 }

ChatGPT Elastic and LLM

Gen AI Search engines

LLM: opportunities and limits your question one answer your question GAI / LLM public internet data

Retrieval Augmented Generation your question the right answer your question + context window GAI / LLM public internet data your business data documents images audio

Demo: Elastic + Azure OpenAI

AI Assistant for security and observability

Search, Observability, Security: a new era David Pilato | @dadoonet