Elasticsearch
A presentation at BBL AXA (Private Event) in in Wasquehal, France by David Pilato
Elastic Stack Overview Search. Observe. Protect. The world’s most popular enterprise products for real-time search, logging, analytics, and more
Who? $ curl http://localhost:9200/speaker/_doc/dpilato { “nom” : “David Pilato”, “jobs” : [ { “boite” : “SRA Europe (SSII)”, “mission” : “bon à tout faire”, “date” : “1995” }, { “boite” : “SFR”, “mission” : “touche à tout”, “date” : “1997” }, { “boite” : “e-Brands / Vivendi”, “mission” : “chef de projets”, “date”: “2000” }, { “boite” : “DGDDI (douane)”, “mission” : “mouton à 5 pattes”, “date” : “2005” }, { “boite” : “IDEO Technologies”, “mission” : “CTO”, “date” : “2012” }, { “boite” : “elastic”, “mission” : “développeur”, “date” : “2013” } ], “passions” : [ “famille”, “job”, “deejay” ], “blog” : “http://david.pilato.fr/”, “twitter” : [ “@dadoonet”, “@elasticfr” ], “email” : “david@pilato.fr” } 2
Employees in 40+ countries Public company on NYSE
The Elastic Stack Reliably and securely take data from any source, in any format, then search, analyze, and visualize it in real time.
Deploy anywhere. Elastic Cloud SaaS Elastic Cloud Enterprise Elastic Cloud on Kubernetes Orchestration
FILEBEAT MASTER (3) METRICBEA T PACKETBEAT WINGLOBEAT AUDITBEAT HEARTBEAT CUSTOM UI INGEST (X) Coordinating (X) DATA - HOT (X) FUNCTION BEAT KAFKA ELASTICSEARCH CLIENTS DATA - WARM (X) REDIS DATA STORE SOCIAL 6 WEB APIS SENSORS MESSAGING QUEUE WORKERS (2+) ALERTING (X) MACHINE LEARNING (2+) INSTANCES (X)
7 https://www.elastic.co/fr/subscriptions
Services at a Glance Elastic Training Certification • Immersive learning experience • Performance-based exam • Solution-based curriculum • Solve real-world tasks, in realtime • Flexible ways-to-train • Remote, secure testing People Strategy 8 Elastic Consulting • Expert services focused on your business goals • Phased-based packages • Product expertise Project Strategy
En Elastic Training Paris / France fra nç ais Course offerings Elasticsearch Engineer I: Apr 20-21 IMMERSIVE LEARNING SOLUTION-BASED Elasticsearch Engineer II: Apr 22-23 ENVIRONMENT CURRICULUM Lab-based exercises to help master Real-world examples and common new skills use cases EXPERIENCED PERFORMANCE-BASED INSTRUCTORS CERTIFICATION Expertly trained and deeply rooted in Apply skills to real-world use cases, in everything Elastic real-time Who should attend? Software Developers, Engineers, Data Architects, System Administrators, DevOps What will I learn? ● How to manage deployments and develop solutions. ● Advanced cluster management techniques, best practices for capacity planning and scaling, and more. 50% discount on the 2nd seat - discount until Feb 24th
A typical search implementation… CREATE TABLE user ( name VARCHAR(100), comments VARCHAR(1000) ); INSERT INTO user VALUES (‘David Pilato’, ‘Developer at elastic’); INSERT INTO user VALUES (‘Malloum Laya’, ‘Worked with David at french customs service’); INSERT INTO user VALUES (‘David Gageot’, ‘Engineer at Google’); INSERT INTO user VALUES (‘David David’, ‘Who is that guy?’); David 11
Search on term INSERT INSERT french INSERT INSERT INTO user VALUES (‘David Pilato’, ‘Developer at elastic’); INTO user VALUES (‘Malloum Laya’, ‘Worked with David at customs service’); INTO user VALUES (‘David Gageot’, ‘Engineer at Google’); INTO user VALUES (‘David David’, ‘Who is that guy?’); SELECT * FROM user WHERE name=”David”; Empty set (0,00 sec) David 12
Search like INSERT INSERT french INSERT INSERT INTO user VALUES (‘David Pilato’, ‘Developer at elastic’); INTO user VALUES (‘Malloum Laya’, ‘Worked with David at customs service’); INTO user VALUES (‘David Gageot’, ‘Engineer at Google’); INTO user VALUES (‘David David’, ‘Who is that guy?’); SELECT * FROM user WHERE name LIKE “%David%”; +———————+———————————+ | name | comments | +———————+———————————+ | David Pilato | Developer at elastic | | David Gageot | Engineer at Google | | David David | Who is that guy? | +———————+———————————+ David 13
Search for terms INSERT INSERT french INSERT INSERT INTO user VALUES (‘David Pilato’, ‘Developer at elastic’); INTO user VALUES (‘Malloum Laya’, ‘Worked with David at customs service’); INTO user VALUES (‘David Gageot’, ‘Engineer at Google’); INTO user VALUES (‘David David’, ‘Who is that guy?’); SELECT * FROM user WHERE name LIKE “%David Pilato%”; +———————+———————————+ | name | comments | +———————+———————————+ | David Pilato | Developer at elastic | +———————+———————————+ David Pilato 14
Search with inverted terms INSERT INSERT french INSERT INSERT INTO user VALUES (‘David Pilato’, ‘Developer at elastic’); INTO user VALUES (‘Malloum Laya’, ‘Worked with David at customs service’); INTO user VALUES (‘David Gageot’, ‘Engineer at Google’); INTO user VALUES (‘David David’, ‘Who is that guy?’); SELECT * FROM user WHERE name LIKE “%Pilato David%”; Empty set (0,00 sec) SELECT * FROM user WHERE name LIKE “%Pilato%David%”; Empty set (0,00 sec) Pilato David 15
Search for terms INSERT INSERT french INSERT INSERT INTO user VALUES (‘David Pilato’, ‘Developer at elastic’); INTO user VALUES (‘Malloum Laya’, ‘Worked with David at customs service’); INTO user VALUES (‘David Gageot’, ‘Engineer at Google’); INTO user VALUES (‘David David’, ‘Who is that guy?’); SELECT * FROM user WHERE name LIKE “%David%” AND name LIKE “%Pilato%”; +———————+———————————+ | name | comments | +———————+———————————+ | David Pilato | Developer at elastic | +———————+———————————+ Pilato David 16
Search in two fields INSERT INSERT french INSERT INSERT INTO user VALUES (‘David Pilato’, ‘Developer at elastic’); INTO user VALUES (‘Malloum Laya’, ‘Worked with David at customs service’); INTO user VALUES (‘David Gageot’, ‘Engineer at Google’); INTO user VALUES (‘David David’, ‘Who is that guy?’); SELECT * FROM user WHERE name LIKE “%David%” OR comments LIKE “%David%”; +———————+——————————————————————-+ | name | comments | +———————+——————————————————————-+ | David Pilato | Developer at elastic | | Malloum Laya | Worked with David at french customs service | | David Gageot | Engineer at Google | | David David | Who is that guy? | +———————+——————————————————————-+ David 17
Search with typos INSERT INSERT french INSERT INSERT INTO user VALUES (‘David Pilato’, ‘Developer at elastic’); INTO user VALUES (‘Malloum Laya’, ‘Worked with David at customs service’); INTO user VALUES (‘David Gageot’, ‘Engineer at Google’); INTO user VALUES (‘David David’, ‘Who is that guy?’); SELECT * FROM user WHERE name LIKE “%Dadid%”; Empty set (0,00 sec) Dadid 19
Search with typos INSERT INSERT french INSERT INSERT INTO user VALUES (‘David Pilato’, ‘Developer at elastic’); INTO user VALUES (‘Malloum Laya’, ‘Worked with David at customs service’); INTO user VALUES (‘David Gageot’, ‘Engineer at Google’); INTO user VALUES (‘David David’, ‘Who is that guy?’); SELECT * FROM user WHERE name LIKE “%adid%” OR name LIKE “%D_did%” OR name LIKE “%Da_id%” OR name LIKE “%Dad_d%” OR name LIKE “%Dadi%”; +———————+———————————+ | name | comments | +———————+———————————+ | David Pilato | Developer at elastic | | David Gageot | Engineer at Google | | David David | Who is that guy? | +———————+———————————+ 20
User Interface 22
Search engine? Moteur d’indexation de documents Moteur de recherche dans les index 23
Demo time! 24
Elastic Cloud on Kubernetes The official Operator (and more) for Elasticsearch and Kibana
Ne w Elasticsearch SIEM solution available for free in 7. 2
3 solutions Elastic Enterprise Search Elastic Observability Elastic Security
Elastic Enterprise Search Workplace Search App Search Site Search
ELASTIC ENTERPRISE SEARCH Search everything, anywhere Easily implement powerful, modern search experiences across your website, app, or digital workplace. Search it all, simply.
Elastic Observability Logs Metrics APM Uptime
ELASTIC OBSERVABILITY Unified visibility across your entire ecosystem Bring your logs, metrics, and traces together into a single stack so you can monitor, detect, and react to events with speed.
Elastic Security Endpoint SIEM
ELASTIC SECURITY Security how it should be: open Elastic Security integrates endpoint security and SIEM to give you prevention, collection, detection, and response capabilities for unified protection across your infrastructure.
Searching for Rides
Searching for Restaurants
38
#ElasticStories
En Elastic Training Paris / France fra nç ais Course offerings Elasticsearch Engineer I: Apr 20-21 IMMERSIVE LEARNING SOLUTION-BASED Elasticsearch Engineer II: Apr 22-23 ENVIRONMENT CURRICULUM Lab-based exercises to help master Real-world examples and common new skills use cases EXPERIENCED PERFORMANCE-BASED INSTRUCTORS CERTIFICATION Expertly trained and deeply rooted in Apply skills to real-world use cases, in everything Elastic real-time Who should attend? Software Developers, Engineers, Data Architects, System Administrators, DevOps What will I learn? ● How to manage deployments and develop solutions. ● Advanced cluster management techniques, best practices for capacity planning and scaling, and more. 50% discount on the 2nd seat - discount until Feb 24th
elasticfr @elasticfr discuss.elastic.co
Vous utilisez encore des requêtes SQL pour faire des recherches ? Vos utilisateurs vous reprochent de ne pas pouvoir chercher sur toutes les rubriques ? Votre temps de réponse moyen est supérieur à la demi-seconde avec seulement quelques millions de documents ? Il vous faut 3 jours pour produire des statistiques sur vos données ? Vous rêvez d’offrir une recherche “à la google” sur les données de votre SI ?
Ne cherchez plus ! Cette conférence est faite pour vous.
David présentera au cours du déjeuner pourquoi et comment il est passé de la recherche SQL à Elasticsearch en détaillant les apports de ce moteur par rapport à une solution pure Lucene :
- Pourquoi Elasticsearch ?
- L’indexation
- La recherche
- Les agrégations et le principe de navigation par facettes
- La scalabilité horizontale
- La communauté
Video
Resources
The following resources were mentioned during the presentation or are useful additional information.
-
Kibana Demo Script
This is the Kibana script I’m starting from when doing the talk
Code
The following code examples from the presentation can be tried out live.
Buzz and feedback
Here’s what was said about this presentation on social media.
